Aggregate kebechet knowledge into single file

[xtuchyna]

Is your feature request related to a problem? Please describe.
Kebechet knowledge is being stored for every repo individually (#76). We need to merge that into a single file, so that overall statistics can be known (Kebechet is keeping ??? repos and etc.)

Describe the solution you'd like
Make mi-scheduler inspect all the knowledge tree after workflows are finished and merge data into

s3://thoth/data/{deployment-name}/thoth-sli-metrics/kebechet-update-manager/overall-{day_date}.json

Describe alternatives you've considered
Maybe make mi do this merging ?

[pacospace]

Is your feature request related to a problem? Please describe.
Kebechet knowledge is being stored for every repo individually (#76). We need to merge that into a single file, so that overall statistics can be known (Kebechet is keeping ??? repos and etc.)

Describe the solution you'd like
Make mi-scheduler inspect all the knowledge tree after workflows are finished and merge data into

s3://thoth/data/{deployment-name}/thoth-sli-metrics/kebechet-update-manager/overall-{day_date}.json

Describe alternatives you've considered
Maybe make mi do this merging ?

what about another component? another cronjob run every day, that check that knowledge and stores the aggreagated part again, something like thoth-station/slo-reporter#210 as kebechet is related to thoth? but not directly using SLO reporter if we are not interested in sending that aggregated knowledge also by email.

@goern wdyt?

[goern]

sounds reasonable, I'm sure you'll find a good solution!

[sesheta]

Issues go stale after 90d of inactivity.
Mark the issue as fresh with /remove-lifecycle stale.
Stale issues rot after an additional 30d of inactivity and eventually close.

If this issue is safe to close now please do so with /close.

/lifecycle stale

[xtuchyna]

All relevant PRs merged, closin this one