v0.23.1 – 2024-12-05

Summary

This is a bugfix release, mainly to address issues that arose from trying to process prod6 files on the grid.

See changelog here: https://ctapipe.readthedocs.io/en/latest/changelog.html#change-log and list of merged pull requests below.

Contributors

@Hckjs, @LukasBeiske, @kosack and @maxnoe

What has changed since v0.23.0

Pull-requests containing changes of multiple nature are repeated.

• Prepare 0.23.1 (#2667) @maxnoe
• Fix dtype of tel_id in subarray hdf table (#2622) @maxnoe
• Fixed unknown configs being silently ignored (#2666) @kosack
• Switch to use Minio hosted by DESY for testdata (#2664) @maxnoe
• Fix tool exit order (#2662) @maxnoe
• Fix error in ctapipe-process in case telescope event is missing true image (#2659) @maxnoe
• Fix uncertainty calculation in StereoMeanCombiner (#2658) @LukasBeiske
• Use sphinx-changelog (#2657) @maxnoe
• Support astropy 7.0 (#2639) @maxnoe

Maintenance

• Update image.cleaning docs (#2669) @Hckjs

v0.23.0 – 2024-11-20

Summary

For the changelog, please see https://ctapipe.readthedocs.io/en/latest/changelog.html#ctapipe-v0-23-0-2024-11-18

For contributors and list of merged PRs, see below.

Contributors

@TjarkMiener, @ctoennis, @dependabot, @dependabot[bot], @kosack, @maxnoe, @mexanick and Christoph Toennis

What has changed since v0.22.0

Pull-requests containing changes of multiple nature are repeated.

• Prepare 0.23.0 (#2654) @maxnoe
• Improve reference metadata handling for EventSource (#2648) @maxnoe
• Fix CTAO link in docs (#2653) @maxnoe
• Variance calibration (#2636) @ctoennis
• Update / add reprs for reference metadata objects (#2650) @maxnoe
• Bump SonarSource/sonarqube-scan-action from 3 to 4 (#2652) @dependabot
• Make some dependencies optional (#2641) @maxnoe
• Refactor how shower distributions are written, write them for all EventSources, implement for HDF5EventSource (#2633) @maxnoe
• Add calibration calculators (#2609) @TjarkMiener
• Set null island as fallback reference location in Subarray.from_hdf (#2627) @maxnoe
• Bump mamba-org/setup-micromamba from 1 to 2 (#2624) @dependabot
• Add 0.22 to version switcher (#2618) @maxnoe

New features

• Improve changelog checks (#2637) @mexanick
• Add Hipparcos as second star catalog, apply space motion (#2625) @ctoennis

Bug Fixes

• Restore reading of pointing for files written with ctapipe<0.21 (#2655) @maxnoe
• Fix changelog checks (#2642) @mexanick
• Improve changelog checks (#2637) @mexanick

v0.22.0 – 2024-09-13

Summary

See the full changelog in the docs for the release notes.

Below, you can find the contributors and merged PRs.

Contributors

@Hckjs, @TjarkMiener, @aaguasca, @ctoennis, @dependabot, @dependabot[bot], @kosack, @maxnoe, @mexanick

What has changed since v0.21.2

Pull-requests containing changes of multiple nature are repeated.

• Convert metadata Instrument.site to free string instead of enum (#2616) @maxnoe
• Fix error messages for non-existing path (#2591) @maxnoe
• Move interpolator from io to monitoring (#2615) @maxnoe
• Check uniqueness of input paths and obs_ids in merge tool (#2611) @maxnoe
• Fix typo CameraGeometry docs (#2613) @aaguasca
• Add support for numpy 2.0 (#2580) @maxnoe
• Fix warning in sonarqube (#2588) @maxnoe
• Fix typo waveform in docs (#2608) @aaguasca
• Bump SonarSource/sonarqube-scan-action from 2 to 3 (#2605) @dependabot
• Input reference meta (#2598) @maxnoe
• OutlierDetector components (#2604) @TjarkMiener
• Update AUTHORS, add to release procedure (#2590) @maxnoe
• Variance extractor (#2543) @ctoennis
• Delete tel attribute from MonitoringCameraContainer in NSBImageCleaner (#2602) @Hckjs
• Fix deprecation warning in provenance, fixes #2592 (#2599) @maxnoe
• Fix provenance in case broken packages are in the environment (#2595) @maxnoe
• Fix traitlets test by ignoring test modules and _dev_version (#2593) @maxnoe
• Fix docs build (#2589) @maxnoe
• Treat deprecation warnings as errors (#2581) @maxnoe
• Fix sonar (#2586) @maxnoe
• Fix sonarqube for forks (#2585) @maxnoe
• Fix missing SONAR_HOST_URL (#2584) @maxnoe
• use correct sonar action (#2583) @maxnoe
• Fix filename in sonar action (#2582) @maxnoe
• Run sonar in separate step to enable PRs from forks again (#2578) @maxnoe
• Bugfix: don't intercept normal SystemExit(0) in Tool (#2575) @mexanick

New features

• Interpolator (#2600) @ctoennis
• Add StatisticsAggregator API (#2554) @TjarkMiener
• Update exception handling in tools (#2594) @mexanick
• Implement lstchains image cleaning (#2541) @Hckjs

Maintenance

• Update intersphinx mapping and sphinx-gallery-conf (#2572) @Hckjs

v0.21.2 – 2024-06-27

Summary

Small bugfix release to fix ctapipe with scipy 1.14.

Find the changelog in the docs: https://ctapipe.readthedocs.io/en/latest/changelog.html#ctapipe-v0-21-2-2024-06-27
and the list of merged pull requests below.

Contributors

@kosack, @maxnoe, @mexanick and @morcuended

What has changed since v0.21.1

Pull-requests containing changes of multiple nature are repeated.

• Support scipy 1.14, fixes #2568 (#2569) @maxnoe
• Use debug logging for plugin loading details (#2560) @kosack
• Add new version to docs switcher (#2558) @maxnoe

New features

• Feature/custom exit codes in tools (#2566) @mexanick

Maintenance

• Remove unsed config files for old test and quality control systems (#2562) @morcuended

v0.21.1 – 2024-05-15

Summary

This is a small bugfix and maintenance release for 0.21.0.

Find the changelog in the docs: https://ctapipe.readthedocs.io/en/latest/changelog.html#ctapipe-v0-21-1-2024-05-15
and the list of merged pull requests below.

Contributors

@gschwefer and @maxnoe

What has changed since v0.21.0

Pull-requests containing changes of multiple nature are repeated.

• Render changelog for 0.21.1 (#2557) @maxnoe
• Fix StereoTrigger non-deterministically discarding LST-1 in prod6 files (#2552) @maxnoe
• Impact code cleanup (#2551) @gschwefer

Maintenance

• Remove upload to pages ci, replaced by using readthedocs (#2553) @maxnoe

v0.21.0 – 2024-04-26

Summary

This is a pretty large release with lots of changes, new features and a couple of API breaking changes, see below.

The headline feature is that through a lot of work, the ImPACT reconstructor works again.

For the full changelog, see https://ctapipe.readthedocs.io/en/stable/changelog.html#ctapipe-v0-21-0-2024-04-26, for contributors and list of merged PRs, see below.

Contributors

@Hckjs, @LukasBeiske, @LukasNickel, @StFroese, @Tobychev, @aknierim, @ccossou, @dependabot, @dependabot[bot], @gschwefer, @kosack, @maxnoe, @morcuended and @nbiederbeck

What has changed since v0.20.0

Pull-requests containing changes of multiple nature are repeated.

• Prepare changelog for 0.21.0 (#2550) @maxnoe
• Update to bokeh 3 (#2549) @maxnoe
• Compute deconvolution parameters in FlashCamExtractor only as needed (#2545) @maxnoe
• Fix possible out of bounds error in FlashCamExtractor (#2544) @maxnoe
• Fix CI (#2547) @maxnoe
• Add function to get point on shower axis in altaz (#2537) @maxnoe
• Update ImPACT code to work again (#2305) @Tobychev
• Bump JamesIves/github-pages-deploy-action from 4.5.0 to 4.6.0 (#2538) @dependabot
• Interpolate pointing in TableLoader and HDF5EventSource (#2409) @maxnoe
• add SonarQube badges & remove codecov (#2531) @kosack
• Overburden-to-height conversion functions (#2422) @gschwefer
• Add a trait for astropy quantities (#2524) @LukasBeiske
• Add configuration for using CTAO sonarqube to check code (#2463) @maxnoe
• Add a note to CameraGeometry docs about from_name() (#2485) @kosack
• Fix entry point specification (#2516) @maxnoe
• Use signal_fraction for training particle classifier (#2465) @LukasBeiske
• fix some documentation bugs (#2514) @kosack
• Test on python 3.12 (#2486) @maxnoe
• Bump pre-commit/action from 3.0.0 to 3.0.1 (#2510) @dependabot
• Bump codecov/codecov-action from 3 to 4 (#2509) @dependabot
• Bump release-drafter/release-drafter from 5 to 6 (#2508) @dependabot
• Bump andstor/file-existence-action from 2 to 3 (#2506) @dependabot
• Improve logging colorization, fixes #2504 (#2505) @maxnoe
• Fix wrong branch name in README (#2502) @maxnoe
• Fix pydata sphinx theme is not safe for parallel writing warning (#2500) @maxnoe
• Bump actions/cache from 3 to 4 (#2498) @dependabot
• Load constant pointing in TableLoader (#2481) @maxnoe
• Accept CEP 002 (#2400) @kosack
• Bump actions/checkout from 3 to 4 (#2492) @dependabot
• Bump JamesIves/github-pages-deploy-action from 3.7.1 to 4.5.0 (#2494) @dependabot
• Bump actions/upload-artifact from 3 to 4 (#2493) @dependabot
• Bump actions/setup-python from 4 to 5 (#2495) @dependabot
• Update citation year and add link (#2487) @maxnoe
• Write out cross-validation results immediately (#2483) @LukasBeiske
• Update and add missing docstrings related to ML functionalities (#2456) @LukasBeiske
• Let the DispReconstructor also compute a score for the sign prediction (#2479) @maxnoe
• Allow passing of ax to Subarray.peek, do not always call tight_layout (#2369) @maxnoe
• Change how DataWriter writes simulation pointing (#2438) @maxnoe
• Add missing cache=True to numba compilation (#2477) @maxnoe
• Docs: Fix Headings in Docs [Closes #2472] (#2474) @aknierim
• Allow setting n_jobs on tool invocation (#2430) @LukasNickel
• Update citation (#2470) @maxnoe
• Make ML config files more readable and add comments. (#2455) @LukasBeiske
• Remove python warnings (#2421) @LukasNickel
• Enable str/Path as input to get_hdf5_datalevels (#2451) @maxnoe
• Add true_impact_distance to cross validation output (#2468) @LukasBeiske
• Chunked loading of training data (#2423) @LukasBeiske
• Rename single changelog file (#2435) @StFroese
• Removed stray : from ctapipe.io page (#2448) @Tobychev
• Bump setuptools and setuptools scm versions (#2447) @morcuended
• Propose CEP 3: remove image parameters in camera frame (#2405) @maxnoe
• run test only if labels don't contain 'documentation' (#2227) @nbiederbeck
• Fix unwanted default columns in disp output (#2440) @maxnoe
• Add docstring for ctapipe-train-disp-reconstructor (#2420) @LukasBeiske
• Check pointing coordinate frame in DispReconstructor (#2431) @LukasBeiske
• Check if tel_id exists when looking up TelescopeParameters (#2429) @maxnoe
• Fix broken urls in README (#2408) @aknierim
• Fix h_max definition (#2403) @kosack
• Do not use hidden attribute reconstructor._models in ctapipe-apply-models (#2418) @LukasBeiske
• Changed some numpy calls following the numpy 2.0 migration guide (#2406) @Tobychev
• Include example config for ctapipe-train-disp-reconstructor in quickstart tool (#2414) @LukasBeiske
• Fix empty reference location (#2402) @kosack

New features

• Change R1- and DL0-waveforms shape to (n_channels, n_pixels, n_samples) (#2529) @Hckjs
• Change ImageCleaner API (#2511) @Hckjs
• Use intmin for invalid pixel positions, allow empty arguments (#2397) @maxnoe
• Add option to override obs_id in SimTelEventSource (#2411) @maxnoe

API Changes

• Change ImageCleaner API (#2511) @Hckjs
• Refactor/rename datawriter options (redux) (#2520) @kosack
• Move TableLoader traits to read_...-methods (#2482) @Hckjs

Data Model Changes

• Change R1- and DL0-waveforms shape to (n_channels, n_pixels, n_samples) (#2529) @Hckjs
• Change definition of leakage_pixel_{1,2} (#2432) @maxnoe
• Improve column names for disp (#2443) @LukasBeiske
• Add option to override obs_id in SimTelEventSource (#2411) @maxnoe

Bug Fixes

• Properly transform between camera and telescope frame in muon fitter (#2464) @maxnoe

Refactoring and Optimization

• Prevent import of ctapipe.image at import time of ctapipe.io (#2488) @maxnoe

Maintenance

• Use macos 14 (apple arm) in CI (#2534) @maxnoe
• Fix docs build, use sphinxcontrib-bibtex for bibliography (#2536) @maxnoe
• Drop python 3.9 (#2526) @maxnoe
• Fix sonar complaining about statements in notebooks (#2527) @maxnoe
• Update sonar key (#2525) @maxnoe
• Update python version in deploy config (#2523) @maxnoe
• Use ruff for linting (#2416) @maxnoe
• Move options from setup.cfg to pyproject.toml (#2512) @maxnoe
• Switch to src based repository structure (#2459) @maxnoe
• pin scikit-learn to < 1.4, breaks with astropy tables (#2496) @maxnoe
• Add config to let dependabot update github actions (#2490) @maxnoe
• Fix some minor issues found by sonarqube (#2466) @maxnoe
• Move TableLoader traits to read_...-methods (#2482) @Hckjs
• Fix docstring of EventSource (#2419) @maxnoe
• Support for astropy 6 (#2475) @maxnoe
• Fix indentation in docs resulting in wrong rendering (#2462) @maxnoe
• Fix CI after pytest-xdist update (#2469) @maxnoe
• Use editable install to fix coverage (#2460) @maxnoe
• Fix coverage report not being found by codecov (#2458) @maxnoe
• Add more nitpick ignores to fix docs build after traitlets update (#2412) @maxnoe
• Fix docs by adding more traitlets nitpick ignores (#2399) @maxnoe

v0.20.0 – 2023-09-11

Summary

This release has a couple of bug fixes, new features and mainly documentation theme updates, see below for the merged pull requests and find the full changelog on readthedocs

Contributors

@StFroese, @TjarkMiener, @Tobychev, @aknierim, @gschwefer, @jstvdk, @kosack, @maxnoe and Vadym Voitsekhovskyi

What has changed since v0.19.3

Pull-requests containing changes of multiple nature are repeated.

New features

• Add fit status fields to output container of MuonIntensityFitter (#2381) @jstvdk
• R0 and R1 waveform merging (#2386) @TjarkMiener
• Make provenance information in log optional (#2328) @Tobychev

API Changes

• Use int minval instead -1 for invalid telescope ids in SubarrayDescription.tel_index_array, improve docstrings (#2376) @maxnoe
• Remove EventSource.from_config, fixes #2258 (#2384) @maxnoe
• Remove dump-triggers, enable ctapipe-process to store only trigger and simulation data (#2375) @maxnoe

Data Model Changes

• Add fields defined in CTAO DL0 and R1 data models (#2338) @maxnoe
• Remove SimulationConfigContainer.injection_height, add SimulatedShowercontainer.starting_grammage (#2343) @maxnoe

Bug Fixes

• Fix HillasIntersection error for badly reconstructed events (#2265) @gschwefer
• Bug fix in full numeric pixel likelihood calculation (#2388) @gschwefer

Maintenance

• Add changelog for 0.20.0 (#2394) @maxnoe
• Convert all notebooks to sphinx gallery format (#2377) @StFroese
• Use int minval instead -1 for invalid telescope ids in SubarrayDescription.tel_index_array, improve docstrings (#2376) @maxnoe
• Update doc structure and dev guide (#2383) @maxnoe
• Remove no-longer needed importlib_resources (#2389) @maxnoe
• Replace deprecated provision-with-micromamba action with setup-micromamba (#2387) @maxnoe
• Drop support for python 3.8, update env file (#2342) @maxnoe
• Update docs (#2373) @aknierim
• Try to fix readthedocsbuild (#2365) @maxnoe

v0.19.3 – 2023-06-21

Summary

This is a bugfix release, find the list of merged pull requests below, the changelog is available on readthedocs.

Contributors

@LukasBeiske, @clara-escanuela, @kosack and @maxnoe

What has changed since v0.19.2

Pull-requests containing changes of multiple nature are repeated.

• Render changelog for 0.19.3 (#2362) @maxnoe
• Improve docstring and validation of parameters in CameraGeometry (#2361) @maxnoe
• Fix removal of telescope events in software trigger, fixes #2356 (#2357) @maxnoe
• Add support for using toymodel in telescope frame (#2349) @maxnoe
• Fix pixel picking for multiple displays in same figure (#2358) @maxnoe
• Fill reference_location into SubarrayDescription.tel_coords (#2354) @maxnoe
• fix help string in disp reconstructor (#2352) @maxnoe
• Add support for hillas parameters in TelescopeFrame to CameraDisplay (#2347) @maxnoe
• Fix typo in merge tool flag definition (#2341) @LukasBeiske
• Fix return value of NullDataVolumeReducer (#2340) @maxnoe
• Peak time units conversion for the FlashCam reconstructor (#2337) @clara-escanuela

Maintenance

• Improve error messages of expression engine (#2350) @maxnoe

v0.19.2 – 2023-05-17

Summary

This is a bugfix release, see the full changelog in the docs and merged Pull Requests below.

Contributors

@clara-escanuela and @maxnoe

What has changed since v0.19.1

Pull-requests containing changes of multiple nature are repeated.

• Fix peak_time estimation in FlashCamExtractor (#2333) @clara-escanuela

Maintenance

• Render changelog for 0.19.2 (#2334) @maxnoe
• Fix links to docs (#2330) @maxnoe

v0.19.1 – 2023-05-11

Summary

This is mainly a bug fix and maintenance release containing one feature addition.

See the full changelog in the documentation
and the list of merged PRs below.

This is also the first release to support python 3.11.

Contributors

@kosack and @maxnoe

What has changed since v0.19.0

Pull-requests containing changes of multiple nature are repeated.

Bug Fixes

• Do not use pathlib for hdf5 datasets, fixes #2318 (#2319) @maxnoe
• Fix SoftwareTrigger for actual simtel files (#2320) @maxnoe
• Allow training without cross validation (#2310) @maxnoe
• Fix --overwrite for ApplyModel tool (#2311) @maxnoe
• Fix neighbor matrix for no pixels, fixes #2316 (#2317) @maxnoe
• Fix activity start order (#2312) @maxnoe

New Features

• Add possibility to compute multiplicities using FeatureGenerator (#2308) @maxnoe

Maintenance

• Support python 3.11 (#2107) @maxnoe
• Render changelog to prepare for v0.19.1 release (#2327) @maxnoe
• Remove unused codecov (got yanked from pypi) (#2306) @maxnoe
• Deduplicate tomas in mailmap (#2314) @maxnoe