Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: hand symptoms to cTAKES in a format it expects #292

Merged
merged 1 commit into from
Jan 8, 2024
Merged

Conversation

mikix
Copy link
Contributor

@mikix mikix commented Jan 4, 2024

Ever since the March 17th, 2023 commit that fed cTAKES a custom bsv file, our COVID NLP performance has taken a hit (unbeknownst to us).

cTAKES actually expects a slightly different format for symptoms bsv files, which we now enforce as we send it files.

This gets our COVID NLP performance on a standard BCH set of 200-odd Cerner html notes from 0.784 to 0.813 F1.

This commit bumps the covid tasks' task_format from 3 to 4.

Checklist

  • Consider if documentation (like in docs/) needs to be updated
  • Consider if tests should be added

"oracledb < 2",
"oracledb < 3",
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Unrelated - just noticed that they released a new major version, dropping support for python 3.6

Ever since the March 17th, 2023 commit that fed cTAKES a custom bsv
file, our COVID NLP performance has taken a hit (unbeknownst to us).

cTAKES actually expects a slightly different format for symptoms bsv
files, which we now enforce as we send it files.

This gets our COVID NLP performance on a standard BCH set of 200-odd
Cerner html notes from 0.784 to 0.813 F1.

This commit bumps the covid tasks' task_format from 3 to 4.
@mikix mikix merged commit 7405ff8 into main Jan 8, 2024
2 checks passed
@mikix mikix deleted the mikix/bsv4cols branch January 8, 2024 13:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants