New Multi-Task Warm-starting and Dashboard Prototype

🚀 Features

• Add experiment progress bar to dashboard @notoraptor (#1080)
• Add benchmarks endpoints to Orion Web API @notoraptor (#996)
• Knowledge Base + Multi-Task Warm-starting @lebrice (#933)
• Display trial status in trials table on dashboard @notoraptor (#1071)

🏗 Enhancements

• Make ExperimentClient.observe support single value @bouthilx (#1063)
• Bump json5 from 1.0.1 to 1.0.2 in /dashboard/src @dependabot (#1057)
• Improve experiment stats @notoraptor (#1038)
• Remove references to get_storage @Delaunay (#1042)
• Add assert_contains to print a more precise error message @Delaunay (#1013)
• Do not close the executor after workon #863 @Delaunay (#1041)
• Update yarn.lock @notoraptor (#1032)
• Add Python 3.10 @Delaunay (#690)
• reservation_timeout removed @Simnol22 (#1011)
• Enhance table @notoraptor (#982)
• Add poolexecutor to the executor entry point @Delaunay (#1047)
• remove python 3.6 special handling @Delaunay (#1045)
• Only Protect gather from interruptions #789 @Delaunay (#1048)
• Changing experiment.algorithms to experiment.algorithm @Simnol22 (#1014)
• Reduce Warnings @Delaunay (#1072)

🐛 Bug Fixes

• Limit nevergrad version to fix long algo tests in CI @notoraptor (#1086)
• Fix detection of dashboard build files in installed packages. @notoraptor (#1084)
• CI - fix pre-commit and backward compatibility @notoraptor (#1079)
• Xfail HEBO and add warning in docs @bouthilx (#1051)
• Fix algos for nested spaces @bouthilx (#1064)
• Remove pandas version cap @bouthilx (#1006)
• Fix uniform real dimension interval mapping to ConfigSpace @Delaunay (#1034)
• Downgrade pandas in conda build too @bouthilx (#1001)
• Downgrade pandas temporarily @bouthilx (#998)
• Fix a few bugs in the Profet tasks @lebrice (#1030)

📜 Documentation

• Update Storage doc config example #1055 @Delaunay (#1056)
• Add credit to Guillaume Alain for logos @bouthilx (#1043)
• SpeechBrain Tutorial @Simnol22 (#1004)
• Add logos for Oríon @bouthilx (#941)
• Fixing some details for the tutorials to run. @Simnol22 (#997)
• Adding HuggingFace Tutorial @Simnol22 (#1040)

🧰 Maintenance

• [ci] Install Orion from local cloned repository @notoraptor (#1068)
• Dashboard - new testing framework: playwright @notoraptor (#1078)
• Move numpy version cap to HEBO optional deps @bouthilx (#1065)
• Use list instead of array @bouthilx (#1050)
• Add matplotlib dependency to pb2 @Delaunay (#1020)
• Upgrade MongoDB to 6.0 @Delaunay (#1036)
• Reactivate dashboard CI @notoraptor (#952)
• Update pre-commit to use the right flake8 repo @Delaunay (#1028)

Bugfix for user script stdout/stderr

Changes

🐛 Bug Fixes

• Revert Subprocess pipe @Delaunay (#985)

Bugfixes for PBT

🏗 Enhancements

• Add configspace conversion @Delaunay (#832)
• no singleton test @Delaunay (#942)
• Simplify tree.py @lebrice (#966)
• Minor refactor: Make creation of Experiment objects more explicit @lebrice (#968)
• [dashboard/experiments/database] make columns sortable, except non-singleton array columns @notoraptor (#969)
• [dashboard/DB page] Display only 7 first characters of trial ID in ID column. @notoraptor (#960)
• [dashboard] Display trials for selected experiment in Database page @notoraptor (#944)
• Add a dashboard launcher @notoraptor (#943)
• [dashboard/experiments/database page] New table framework @notoraptor (#975)
• [dashboard/experiments/navbar] Remove (x) icon on experiment menu and rely on highlight only @notoraptor (#970)
• Small fixes @abergeron (#964)
• [dashboard/db page] DIsplay parameters in separated flattened columns after ID column @notoraptor (#961)
• Add repr to dbs to help debug with orion db test @bouthilx (#958)
• Remove experiment from Trial hash @bouthilx (#950)

🐛 Bug Fixes

• Fix bug with algo param_names @lebrice (#947)
• Fix PBT issues with working dir and promotion of max fidelity trials @bouthilx (#903)

📜 Documentation

• Fix some documentation formatting @abergeron (#946)
• Add more info on how trial config is passed to scripts @bouthilx (#957)

🧰 Maintenance

• Fix pre-commit issues present in develop @lebrice (#967)
• Replace (part of) pretest of CI with Pre-commit equivalent @lebrice (#918)
• Fix ConfigSpace dependency issue @bouthilx (#955)
• Ignore .post in version for backward comp tests. @bouthilx (#949)
• Add mongodb & test_no_extras to pypi test deps @bouthilx (#940)

Algorithm Integrations and Improvements

🚀 Features

• Add Ax Optimizer @satyaog (#866)
• Migrate Orion dashboard into Orion repository @notoraptor (#920)
• Add MOFA @wagnersj (#864)
• Add DEHB @bouthilx (#849)
• Add Hebo @lebrice (#915)
• Add PB2 @bouthilx (#831)
• Add BOHB @bouthilx (#848)
• Move nevergrad to orion repo @Delaunay (#906)
• new parallel advantage assessment support @donglinjy (#685)
• Add tasks from Profet @lebrice (#632)

🏗 Enhancements

• Fix dependabot issues @notoraptor (#926)
• Dashboard: updates dependencies to try resolve dependabot issues @notoraptor (#923)
• Add number of suggest() attempts in Algo wrapper @lebrice (#883)
• Reduce verbosity of the Runner @bouthilx (#879)
• Detect _param_names from __init__ signature @lebrice (#867)
• Add Registry, rework how Space is passed to algorithms @lebrice (#833)
• Upgrade default python to 3.9 in build.yaml @lebrice (#855)

🐛 Bug Fixes

• Fix IndexError for freshly branched exp @vmichals (#898)
• Handle all tests using Dask @bouthilx (#828)

📜 Documentation

• Add video links to last presentations @bouthilx (#928)
• Add CITATION.bib to make it easier to cite Orion @lebrice (#896)

🧰 Maintenance

• Add Github Actions to automatically compile Orion dashboard @notoraptor (#930)
• [dashboard] Increase Axios timeout @notoraptor (#927)
• Add .pre-commit-config.yaml for local setup @lebrice (#895)
• Hotfix for nevergrad tests @lebrice (#913)
• Simplify tests suite, remove spy_phase and related functions @lebrice (#886)
• Refactor tox to run for any algo @Delaunay (#907)
• Fix Pypi, add CITATION to manifest @Delaunay (#899)
• Remove remaining mongodb configs @bouthilx (#868)
• Simplify setting test phases in Test Classes @lebrice (#874)
• Update black @Delaunay (#861)
• Drop support for python 3.6 @lebrice (#853)
• Test algo can handle broken trials @bouthilx (#813)
• Tests run with no extras and all extras @lebrice (#810)
• Don't build wheels in tox build step by @lebrice (#938)

Full Changelog: v0.2.3...v0.2.4.post1

Bug fix to adress severe I/O load during optimization

🏗 Enhancements

• Add config option frontends_uri to specify allowed frontend addresses for Orion Web API @notoraptor (#811)

🐛 Bug Fixes

• Make sure subprocess/process/thread/dask can create a runner instance @Delaunay (#816)
• Reduce DB I/O during optimization @bouthilx (#823)

Improved parallelization and PBT algorithm

Parallelization is improved leveraging new Runner (#684) and a shared algorithm state (#786).

🚀 Features

• PBT implementation @bouthilx (#705)

🏗 Enhancements

• Shared algorithm status @bouthilx (#786)
• Fix get_prior_string [#774] @Delaunay (#776)
• Replace np.object by object; np.object is deprecated @Delaunay (#773)
• Update backend_plotly.py @Delaunay (#772)
• Rework workon @Delaunay (#684)
• Print version on debug verbosity level @nurbal (#765)
• Remove ParallelStrategies from Producer and make them reusable modules for algorithms instead. @bouthilx (#760)

🐛 Bug Fixes

• (re) Fix parsing of hps with "." in name from commandline @lebrice (#785)
• Fix multiprocess del guard @Delaunay (#784)
• Replace exp's stat dict by a dataclass @bouthilx (#771)
• replace count by count_documents #706 @Delaunay (#707)

📜 Documentation

• Escape the escape @Delaunay (#783)

🧰 Maintenance

• Fix Track requirement URL for github @bouthilx (#761)

Minor release: Bug fix for ASHA when some trials have identical objectives

🐛 Bug Fixes

• Fix ASHA for identical objectives @bouthilx (#699)

New interface for algorithm's `suggest()` and `observe()` methods.

Algorithm interface for suggest() and observe() is changed to use trials instead of list of points. This will provide more flexibility when designing new algorithms. There is no impact for users, except for algorithm plugins that will not be backward compatible with previous versions of Oríon.

The factory abstract class used to create database, storage, algorithm, adapters and parallel strategy has been redesigned to better support external implementations and be easier to debug. This redesign should also have no direct impact for users, except for backward compatibility issues with algorithm plugins for previous versions of Oríon.

🏗 Enhancements

• Improve resiliency of trial reservation @bouthilx (#693)
• Support batched promotions in ASHA @bouthilx (#689)
• Refactor algorithms observe/suggest to work on trial objects directly @bouthilx (#686)
• Rework factory @bouthilx (#681)
• Improve Getting started example command @Delaunay (#666)

🐛 Bug Fixes

• Avoid inf-loop in TPE.suggest @bouthilx (#680)

Revert to default inf max trials and pool-size of 1

🏗 Enhancements

• Revert to default inf max_trials and pool-size of 1 @bouthilx (#659)
• Support to configure executor for benchmark @donglinjy (#634)

🐛 Bug Fixes

• Fix grouping of plots in legend @lebrice (#662)
• Support linearize log integer properly @bouthilx (#658)
• Fix shape argument in categorical dims @bouthilx (#654)
• Use user_script_config from parser in EVC @bouthilx (#655)
• Fix TPE sampling in narrow spaces @bouthilx (#650)
• Handle repo with invalid HEAD state @bouthilx (#645)
• List EVC tree once only when querying with name @bouthilx (#642)
• Handle properly all types in config during branch @bouthilx (#641)

📜 Documentation

• Clear error message for dup branching error @bouthilx (#652)
• Add missing documentation for EVC enable option @bouthilx (#651)

Disabled Experiment Version Control

Experiment Version Control (EVC) will now be disabled by default. When the EVC is disabled, any changes in the experiment will be saved to the DB, overriding the previous version. See configuration doc to enable the EVC: https://orion.readthedocs.io/en/stable/user/config.html#experiment-version-control.

🏗 Enhancements

• Feature/filter duplicate in evc @bouthilx (#630)
• Add enable option for EVC, with default = false @bouthilx (#626)

🐛 Bug Fixes

• Warn only if diffs exists during exp build @bouthilx (#638)
• Fix lost trials of parents @bouthilx (#637)
• Compute cardinality for loguniform with precision @bouthilx (#635)
• Duplicate pending trials from parent/child for exc @bouthilx (#631)
• Remove space upgrade from DB upgrade @bouthilx (#627)
• Allow branching when parent script isn't available @bouthilx (#625)
• fix benchmark ranking and regret visualization @donglinjy (#620)
• fix tpe space cardinality @donglinjy (#619)

📜 Documentation

• Change algo documentation @bouthilx (#623)