Added intermediate_memmap='zarr' option which dumps to temporary zarr arrays by astrofrog · Pull Request #612 · astropy/reproject · GitHub
Skip to content

Added intermediate_memmap='zarr' option which dumps to temporary zarr arrays#612

Draft
astrofrog wants to merge 10 commits into
astropy:mainfrom
astrofrog:intermediate-memmap-zarr
Draft

Added intermediate_memmap='zarr' option which dumps to temporary zarr arrays#612
astrofrog wants to merge 10 commits into
astropy:mainfrom
astrofrog:intermediate-memmap-zarr

Conversation

@astrofrog

@astrofrog astrofrog commented Jun 30, 2026

Copy link
Copy Markdown
Member

Fixes #533

@codecov

codecov Bot commented Jun 30, 2026

Copy link
Copy Markdown

@astrofrog astrofrog force-pushed the intermediate-memmap-zarr branch from 4ace406 to f9f11e0 Compare June 30, 2026 13:27
astrofrog added 10 commits June 30, 2026 21:57
…ed arrays so that intermediate_memmap='zarr' does not silently leave NaNs in the output
…each on-disk chunk is read once instead of being re-read across smaller chunk boundaries
…bined so they do not accumulate on disk for the duration of the coaddition
…jection and coaddition functions including that it always reprojects in blocks and defaults block_size to auto
…han the output along the reprojected dimensions, reprojecting each plane in sub-tiles so the coordinate transform memory stays bounded for large planes
…ns of the input WCS to the output so coaddition works when the output WCS has fewer dimensions than the input such as a celestial only output with non_reprojected_dims
…g a tile footprint into a lower-dimensional output WCS so that non-linear variation of the reprojected WCS along those axes is captured rather than only the end points
@astrofrog astrofrog force-pushed the intermediate-memmap-zarr branch from f9f11e0 to 8ad3ee2 Compare June 30, 2026 22:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Have option to use zarr temporary arrays instead of temporary memmaps for mosaicking

1 participant