RSR per allocator

[bajtos]

Provide retrieval-based RSR calculated on a per-allocator basis.

• REST API
• Visualisation on the Spark Public Dashboard

Pre-requisites:

• RSR per client #193

Related discussions:

• https://filecoinproject.slack.com/archives/C0807FBUKC3/p1731226294482699
  ^^ The goal is to calculate RSR for deals made by a particular data onramp provider. See https://app.hex.tech/protocol/app/ccbb785c-7fad-42b5-9553-609cde5c6acc/latest
• Break down retrieval success rate by Deals, Clients, Allocators, MetaAllocators #139
• Provide miner RSR per client and per allocator filecoin-station/spark#79

Notes:

• In spark-evaluate, we are (or will be) mapping retrievals to clients, see RSR per client #193.

• The missing piece is aggregating per-client data to per-allocator data. The important insight is that each client is linked to a single allocator only.

• fil-deal-ingester maintains a mapping between clients and allocators in the table allocator_clients.

• We need to access this mapping from spark-evaluate or spark-stats, depending on where we aggregate per-client to per-allocator stats.

  Possible options to consider:

  1. Enhance each retrieval task in the round details with the list of allocators in addition to the list of clients.
     • This may be the easiest path if we map clients to allocators in spark-evaluate.
  2. Implement a new REST API endpoint in spark-stats to allow spark-evaluate or spark-stats to map clients to allocators.
     • We must be careful about performance - we don't want to make one request for each client.
     • This endpoint can be useful for per-client dashboard as it will allow us to show the allocator from which the client has received DataCap.
     • spark-stats can provide a public facade for this endpoint using the same mechanism we have already in place for getting deals eligible for retrieval testing (source code).