-
Notifications
You must be signed in to change notification settings - Fork 4
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
WCS sampling & FITS to TOAST FITS #86
WCS sampling & FITS to TOAST FITS #86
Commits on Aug 18, 2022
-
Configuration menu - View commit details
-
Copy full SHA for 69bd1ff - Browse repository at this point
Copy the full SHA 69bd1ffView commit details -
Configuration menu - View commit details
-
Copy full SHA for 013e873 - Browse repository at this point
Copy the full SHA 013e873View commit details -
Configuration menu - View commit details
-
Copy full SHA for 303ed3f - Browse repository at this point
Copy the full SHA 303ed3fView commit details -
Added utility functions to (1) guess appropriate base layer level & (…
…2) get all ancestors of a set of tiles
Configuration menu - View commit details
-
Copy full SHA for 3a2f7d7 - Browse repository at this point
Copy the full SHA 3a2f7d7View commit details -
Configuration menu - View commit details
-
Copy full SHA for 5cef0cb - Browse repository at this point
Copy the full SHA 5cef0cbView commit details -
Configuration menu - View commit details
-
Copy full SHA for 13aa67b - Browse repository at this point
Copy the full SHA 13aa67bView commit details -
Added tile_toast functionality from input array/wcs. This is now the …
…default way to tile images with a large FoV
Configuration menu - View commit details
-
Copy full SHA for df2262b - Browse repository at this point
Copy the full SHA df2262bView commit details -
Configuration menu - View commit details
-
Copy full SHA for be98692 - Browse repository at this point
Copy the full SHA be98692View commit details
Commits on Aug 19, 2022
-
Configuration menu - View commit details
-
Copy full SHA for ce17f64 - Browse repository at this point
Copy the full SHA ce17f64View commit details -
Updated view docs now that TOAST is the default tiling method for ima…
…ges with large angular size
Configuration menu - View commit details
-
Copy full SHA for 019be3a - Browse repository at this point
Copy the full SHA 019be3aView commit details -
Configuration menu - View commit details
-
Copy full SHA for 9534fbd - Browse repository at this point
Copy the full SHA 9534fbdView commit details -
Configuration menu - View commit details
-
Copy full SHA for 7f98528 - Browse repository at this point
Copy the full SHA 7f98528View commit details -
Configuration menu - View commit details
-
Copy full SHA for 973d0f2 - Browse repository at this point
Copy the full SHA 973d0f2View commit details
Commits on Aug 23, 2022
-
Now using the same import of the TilingMethod enum, to ensure that en…
…um things like TilingMethod.TOAST actually equals TilingMethod.TOAST. Also added assertion for the resulting imageset's projection type after creation by tests.
Configuration menu - View commit details
-
Copy full SHA for 5c81023 - Browse repository at this point
Copy the full SHA 5c81023View commit details -
Configuration menu - View commit details
-
Copy full SHA for a924ffc - Browse repository at this point
Copy the full SHA a924ffcView commit details -
Configuration menu - View commit details
-
Copy full SHA for f092aae - Browse repository at this point
Copy the full SHA f092aaeView commit details
Commits on Aug 24, 2022
-
Configuration menu - View commit details
-
Copy full SHA for 543ea7a - Browse repository at this point
Copy the full SHA 543ea7aView commit details -
toasty/samplers.py: fix the latlon tile sampler for images covering >…
…180 degrees of longitude
Configuration menu - View commit details
-
Copy full SHA for 0fb2d5f - Browse repository at this point
Copy the full SHA 0fb2d5fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 3373e26 - Browse repository at this point
Copy the full SHA 3373e26View commit details -
Configuration menu - View commit details
-
Copy full SHA for 4b95075 - Browse repository at this point
Copy the full SHA 4b95075View commit details -
Configuration menu - View commit details
-
Copy full SHA for 8c45b1c - Browse repository at this point
Copy the full SHA 8c45b1cView commit details -
toasty/fits_tiler.py: check if hips_{pixel_cut,data_range} are present
In one test image I have, hipsgen produces a "BAD PIXEL CUT" warning and doesn't emit this information. (I think it's because the file has an integer data type.) Avoid the crash if this is the case.
Configuration menu - View commit details
-
Copy full SHA for 07832f7 - Browse repository at this point
Copy the full SHA 07832f7View commit details -
Configuration menu - View commit details
-
Copy full SHA for 9fe7184 - Browse repository at this point
Copy the full SHA 9fe7184View commit details
Commits on Aug 25, 2022
-
Setting distinct out dir for TOAST and TAN tiled FITS - to not overri…
…de the other if it exists
Configuration menu - View commit details
-
Copy full SHA for d3f950e - Browse repository at this point
Copy the full SHA d3f950eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 56d828b - Browse repository at this point
Copy the full SHA 56d828bView commit details
Commits on Aug 29, 2022
-
Configuration menu - View commit details
-
Copy full SHA for d0d18f4 - Browse repository at this point
Copy the full SHA d0d18f4View commit details -
toasty/collection.py: improve DASCH hack/fix
As noted in the comments, my DASCH sample file that crosses the pole has WCS headers that seem to have another problem beyond their specification of the TPV polynomial distortions. I need to set LONPOLE explicitly to get the correct orientation on the sky.
Configuration menu - View commit details
-
Copy full SHA for 19ef824 - Browse repository at this point
Copy the full SHA 19ef824View commit details -
Configuration menu - View commit details
-
Copy full SHA for 0e6ceac - Browse repository at this point
Copy the full SHA 0e6ceacView commit details
Commits on Aug 31, 2022
-
toasty/merge.py: make tiles_to_process a set, not a list
The "initiate readiness state" algorithm repeatedly tests whether positions are in the tiles_to_process set. If large numbers of tiles (tens of millions) are being processed, the algorithm basically fails because such tests have O(n) scaling with lists. With a set, things become tractable. There may well be further room for improvement here, but this one change makes an enormous difference for big problems.
Configuration menu - View commit details
-
Copy full SHA for 3a77819 - Browse repository at this point
Copy the full SHA 3a77819View commit details -
Configuration menu - View commit details
-
Copy full SHA for 8c07b23 - Browse repository at this point
Copy the full SHA 8c07b23View commit details -
Configuration menu - View commit details
-
Copy full SHA for f5b85ad - Browse repository at this point
Copy the full SHA f5b85adView commit details -
Cythonize the
latlon_tile_filter
functionIn processing a FITS-to-TOAST dataset going down to level 14, with about 24 million tiles to process, I discovered that the tile filter function was a non-trivial bottleneck -- it took about 10 minutes just to count the tiles that needed to be processed! Some profiling showed that most of the time was actually in the Numpy min/max functions. Here we Cythonize the function and avoid the Numpy functions. My measurements indicate a speedup of a factor of around 20.
Configuration menu - View commit details
-
Copy full SHA for e9a8774 - Browse repository at this point
Copy the full SHA e9a8774View commit details