Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Extend eligible deals schema to enable adding DDO deals #29

Open
5 tasks
bajtos opened this issue Jan 6, 2025 · 0 comments
Open
5 tasks

Extend eligible deals schema to enable adding DDO deals #29

bajtos opened this issue Jan 6, 2025 · 0 comments
Assignees

Comments

@bajtos
Copy link
Member

bajtos commented Jan 6, 2025

  • Enhance fil-deal-ingester to store PieceCID and PieceSize alongside Label CID in the database of eligible deals.
  • Add a new column to the database of eligible deals to distinguish between f05 and DDO deals.

See Spark & DDO deals and Spark DDO hack.

Tasks:

  • spark-api - create a new table, eligible_deals, adding new columns on top of retrievable_deals schema. This way, we can migrate the schema & data incrementally.
    feat: add table eligible_deals spark-api#485
  • fil-deal-ingester - produce SQL to update eligible_deals table, set new columns for newly ingested deals
    feat: switch to eligible_deals + set piece info #30
  • manually run fil-deal-ingester to populate eligible_deals table, expand the filter to include all deals (not only recent)
  • spark-api - update all code to use eligible_deals instead of retrievable_deals
  • spark-api - drop retrievable_deals table after the change above was deployed
@bajtos bajtos self-assigned this Jan 6, 2025
@bajtos bajtos changed the title Extend eligible deals to support DDO Extend eligible deals schema to enable adding DDO deals Jan 6, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant