Evaluator CRUD in UI and API

[qrosseel]

Describe the feature or potential improvement

I'm not sure if I'm missing something, but I cannot seem to do CRUD actions on Evaluator objects, either through the UI or API.
Is there active work in this area?

Problem

• Changing the query & generation parameters requires me to create a new Evaluator from a template all together, which is a frustrating UX. When I need to change a configuration (e.g. on what traces it is triggered), I'm not able to edit all params of the evaluator.
• Deleting an Evaluator just turns them Inactive, leaving a trace of messy development evaluators that didn't work
• AFAIK, there's no documentation on a public API for CRUD on these objects

Additional information

No response

[marliessophie]

Hey @qrosseel, thanks for reporting.

We're adding support for updates over the next weeks. I will ping here once released. We're planning to support update operations, but are currently not planning to support deleting. Appreciate the feedback though, have logged an internal ticket and will keep you posted here

[ggdupont]

@marliessophie will that also cover accessing the evaluator from the API? and python SDK?

[nishantkr18]

Another request for CRUD operations on evaluator. ✋