Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Provide example analysis of evidence data #23

Open
3 of 5 tasks
LiFaytheGoblin opened this issue Aug 8, 2023 · 2 comments
Open
3 of 5 tasks

Provide example analysis of evidence data #23

LiFaytheGoblin opened this issue Aug 8, 2023 · 2 comments
Labels
documentation Improvements or additions to documentation

Comments

@LiFaytheGoblin
Copy link
Owner

LiFaytheGoblin commented Aug 8, 2023

So far, the plugin creates a bunch of evidence - but how to use it for an audit? Provide a sample Jupyter Notebook that demonstrates what can be read from the evidence.

  • imbalanced training/ testing data/ dataset (using related_data)
  • unfairness in predictions dataset
  • optional: re-building the model using the given parameters and training & testing it in Jupyter notebook. Changing parameters to see if that improves any bias.

Provide the example analysis

  • upload the notebooks & used evidence in a repo
  • link to the repo in the wiki
@LiFaytheGoblin LiFaytheGoblin added this to the v3.0 milestone Aug 8, 2023
@LiFaytheGoblin LiFaytheGoblin added the documentation Improvements or additions to documentation label Aug 9, 2023
@LiFaytheGoblin
Copy link
Owner Author

@LiFaytheGoblin LiFaytheGoblin removed this from the v3.0 milestone Jan 22, 2024
@LiFaytheGoblin
Copy link
Owner Author

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation
Projects
None yet
Development

No branches or pull requests

1 participant