Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[analysis] provide a report of auc vs data modification #136

Closed
suzannejin opened this issue May 13, 2024 · 1 comment
Closed

[analysis] provide a report of auc vs data modification #136

suzannejin opened this issue May 13, 2024 · 1 comment

Comments

@suzannejin
Copy link
Contributor

suzannejin commented May 13, 2024

  1. we first fix the data. So for example fix the data to not modified bind set.
  2. Then compute the AUC of models trained on different data modifications
  3. Plot test data modification as X, AUC as Y, and color the models based on which data modification is used to train the model.
  4. Or plot a heatmap with X as blind set data modifications and Y as model modifications, and AUC values. But always with fixed to one kind of data modification per heatmap to have a meaningful analysis
@mathysgrapotte
Copy link
Contributor

cf stimulus-py

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants