We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
inspect eval
Currently you can use the -F flag to filter tasks when running inspect list tasks (see https://inspect.ai-safety-institute.org.uk/eval-sets.html#attributes-and-filters).
inspect list tasks
It would be nice to also support this flag on the inspect eval subcommand, so instead of having to run this:
inspect list tasks security -F light=true | xargs inspect eval-set --log-dir logs-security-42
you can run this:
inspect eval-set --log-dir logs-security-42 -F light=true
The text was updated successfully, but these errors were encountered:
Yes, that would be so much nicer! Will try to take care of this soon.
Sorry, something went wrong.
No branches or pull requests
Currently you can use the -F flag to filter tasks when running
inspect list tasks
(see https://inspect.ai-safety-institute.org.uk/eval-sets.html#attributes-and-filters).It would be nice to also support this flag on the
inspect eval
subcommand, so instead of having to run this:inspect list tasks security -F light=true | xargs inspect eval-set --log-dir logs-security-42
you can run this:
The text was updated successfully, but these errors were encountered: