All notable changes to this project will be documented in this file.
The format is based on Keep a Changelog, and this project adheres to Semantic Versioning.
When updating this file, please add an entry for your change under Not Yet Released and one of the following headings:
- Added - for new features.
- Changed - for changes in existing functionality.
- Deprecated - for soon-to-be removed features.
- Removed - for now removed features.
- Fixed - for any bug fixes.
- Security - in case of vulnerabilities.
If the heading does not yet exist under Not Yet Released, then add it as a 3rd level heading, underlined with pluses (see examples below).
When preparing for a public release add a new 2nd level heading, underlined with dashes under Not Yet Released with the version number and the release date, in year-month-day format (see examples below).
- fft_clean was added to the console programs list. Still very experimental.
- Updated EDR_Stats to be consistent with upstream EDR_Stats Pipeline version 3.0.0 (2021/09/08). This handles the new LUT settings.
- Updated HiCal to be consistent with upstream HiCal Pipeline version 4.2.3 (2021/11/17).
- Updated HiStitch to be consistent with upstream HiStitch Pipeline version 2.21.2 (2021/09/09). This change defaults to balance processing for all CCDs and corrects an indexing bug.
- HiCal now deals with missing fields in the output of histats.
- lisfix now does not try to fit a slope to a column with masked values.
- bitflips now raises more descriptive exceptions when given poor data.
- fft_clean functionality added for more testing, but not integrated with HiCal or hiproc.
- EDR_Stats was failing when some histats return values were None. Now properly just saves a "None" for SNR.
- HiCal multiprocessing approach was failing when a Channel was bypassed, essentially breaking the whole run.
- When the HiStitch function was called externally, a missing channel wasn't handled properly. When called from the HiStitch console script, it was fine.
- hiproc adjusted to take advantage of the above two fixes to HiCal and HiStitch.
- HiccdStitch now tolerant against the new ISIS stats return of the "N/A" string for missing values.
- HiJACK now retains pre- and post-HiJACK flat files by default.
- HiJACK now has a --plotflats argument that can be used to plot the new flat files after a run of HiJACK.
- Added new rjplot program to plot the contents of the jitter and smear output files created by resolve_jitter.
- In certain conditions an array can have zero length, and when it does, one shouldn't try and index it in a logging statement.
- Additional logging of the HiPrecisionInit output during a hiproc run, which was previously obscured.
- In some legitimate cases, some elements returned from ISIS histat would be missing (e.g. in the case of no valid pixels in the CAL_BUFFER area, there is no returned value of "Average"), but were not handled properly (Issue #3). More robust handling was added.
- bitflips.py: Removed the span check when considering end values, which may affect how the algorithm deals with "mostly good" DN histograms, such that it should now correctly handle mesa-shaped DN histograms and not chop them in the middle.
- The new-in-0.7.0 multiprocessing requires that the multidict package be installed (for pvl to use), and it wasn't included in the requirements. If you have 0.7.0, a simple "conda install multidict" should get you working.
- Improved documentation
- environment.yml for conda development
- Added Python-based multiprocessing capabilities to EDR_Stats, HiCal, and hiproc.
- Incorporated changes from upstream to HiCal to make bitflip and lisfix settings on by default.
- resolve_jitter output header lines properly commented, now doesn't bomb HiJACK's run of hijitter.
- now, additionally supporting ISIS 4.1.1 through 5.0.0
- Upstream addressed a bug in analyze_cubenorm_stats() that we had noticed, so now fixed here, too.
- MANIFEST.in did not properly include the "data" directory, so that was a problem.
- lisfix will return a non-zero exit code if it chooses not to fix the input cube.
- Updated documentation in various places.
- More complete documentation for the programs and their parameters.
- Implemented better handling for configuration files so that they will get distributed with the package.
- lisfix: Added the lisfix module.
- bitflips: Sometimes the very end of the histogram (although not a formal minima) is the appropriate choice, and is now considered.
- bitflips: Added capability to ignore minor maxima at the ends of the histogram to "roll down" to a better solution.
- name change of project from pyrise to hiproc.
- bitflips: Changed the default medstd_limit from 300 to 400 DN.
- bitflips: There were a variety of edge cases that resulted in errors. The appropriate guardrails, handlers, and recovery logic has now been added.
- HiStitch: The equalize and balance parameters cannot both be true.
- Tremendous amount of re-working in bitflips to improve performance.
- Format cleanup
- Confirmed that EDR_Stats and HiCal produce identical output cubes.
- Updated with bit-flip correction.
- First shared on GitHub