Skip to content

Releases: Sage-Bionetworks-Challenges/pegs-evaluation

v1.5.0

03 Jul 00:07
f610c7c
Compare
Choose a tag to compare

What's Changed

  • update expected colnames
  • add some pre-logic and pre-processing before scoring

Full Changelog: v1.4.3...v1.5.0

v1.4.3

08 May 22:37
Compare
Choose a tag to compare

What's Changed

  • add robustness to scoring by handling ValueError exception

Full Changelog: v1.4.2...v1.4.3

v1.4.2

08 May 22:08
Compare
Choose a tag to compare

What's Changed

  • Fix mixup between expected columns for goldstandard and prediction in score.py

Full Changelog: v1.4.1...v1.4.2

v1.4.1

08 May 21:02
Compare
Choose a tag to compare

What's Changed

  • Specify column types when reading in the goldstandard files
  • Remove unneeded package from requirements.txt

Full Changelog: v1.4.0...v1.4.1

v1.4.0

07 May 04:18
7acb610
Compare
Choose a tag to compare

What's Changed

  • Logic to extract the goldstandard file from folder by @jaymedina in #3

Full Changelog: v1.3.1...v1.4.0

v1.3.1

06 May 18:47
2d83ed1
Compare
Choose a tag to compare

What's Changed

New Contributors

Full Changelog: v1.3.0...v1.3.1

v1.3.0

01 May 23:14
Compare
Choose a tag to compare

What's Changed

  • Add logic to not validate if prediction file is not found (indicated by "INVALID" in filename)
  • Update scoring error message

Full Changelog: v1.2.0...v1.2.1

v1.2.0

01 May 17:14
Compare
Choose a tag to compare

What's Changed

  • Print to STDOUT the score status
  • Add logic to not score if prediction file is invalid
  • Use 4 annotations:
    • validation_status
    • validation_errors
    • score_status
    • score_errors

Full Changelog: v1.1.0...v1.2.0

v1.1.0

01 May 07:08
Compare
Choose a tag to compare

What's Changed

  • Integrate with ORCA's model2data workflow by:
    • removing the python ENTRYPOINT from the Dockerfile
    • printing to STDOUT the validation status only
    • using results.json as the default filename for validation results
    • updating an existing results.json with scores (instead of overwriting the file)

Full Changelog: v1.0.0...v1.1.0

v1.0.0

25 Apr 21:19
Compare
Choose a tag to compare

What's Changed

  • Add initial version of scripts and Dockerfile
  • Add CI workflow

Full Changelog: https://github.com/Sage-Bionetworks-Challenges/pegs-evaluation/commits/v1.0.0