Skip to content

v0.8.0

Compare
Choose a tag to compare
@yuema137 yuema137 released this 13 Mar 03:50
· 69 commits to master since this release
b096031

In this release, we refactored the batch module, which is used for job submission.

Major changes include:

  1. Integrate the functions in the JobSubmission class
  2. Use pydantic and typing to validate the argument types so that the error message will be easy to read if the arguments are not in the correct format. Also, the error messages will be thrown during the initialization before the submission actually runs.
  3. The overwriting and log-dir checking for dali is also put in the validators.
  4. Use simple_slurm to generate the sbatch script instead of a hard-coded template. Simple_slurm deletes the batch automatically after the submission. The script is also available with the “dry run” option. More information is accessible by setting verbose to be True

Note: The submit_job() function is kept for compatibility so that the users can still use their existing code. But if the users use JobSubmission, there will be more information provided in modern code editor like vscode