Skip to content

New commands `list`, `status` and `info` and support interruption/resumption of trials

Pre-release
Pre-release
Compare
Choose a tag to compare
@bouthilx bouthilx released this 23 Jul 18:16
· 3158 commits to master since this release
acb106a

New commands

New commands list, status and info now enable simple monitoring and inspection of experiments. The command list prints out all the experiments' name so you can easily keep track of what is available in your database. The command status gives a summary of experiments' status, with number of trials in different status (completed, reserved, etc) and best objective found so far. Finally the command info prints out all details of a given experiment, command line used, search space, algorithm configuration and current statistics.

Trial interruption

So far interrupted trials would keep the status reserved and wouldn't be available for selection
again, so they would be lost somehow. They will now be set to interrupted and will be available
for resumption. If user's script does not support checkpointing internally, the process will simply be re-executed from scratch.

New features

  • New command list (#208, #216 )
  • New command status (#222, #229)
  • New command info (#211)
  • New StorageProtocol (#221)
  • Handling of interrupted trials (#197, #202, #203, #235)
  • Limit number of broken trials before experiment stop execution (#204)
  • Add working_dir attribute to Trial (#205)

Breaking Changes

  • Deprecate pack/unpack in orion.algo.space (#236)

Bug Fixes

  • Fix code conflict detection when not using code versioning (#207)
  • Add $ne and handle non-supported operations in EphemeralDB (#214)
  • Fix ScriptConfigConflict for data with non-string values (#215)
  • Fix race conditions during algo updates (#217)
  • Fix experiment views (#218, #223, #234)
  • Make sure higher shape points are not ndarray objects (#224, #236)

Other Improvements

  • Mute (intense) logging of filelock (#201)
  • Functional tests for user script config (#212)
  • Use yaml.safe_load instead of yaml (#219)
  • Remove upsert from write (#220)

Documentation Improvements

  • Add documentation for new commands list, info and status (#226, #228)
  • Add documentation on Search Space (#227)