Validate Catalog Performance

[richardtreier]

Feature Request

Requirements

Requires EDC 0.1.0

Breakdown

Validate / Test:

• depends on Bump Core EDC Version to 0.1.0 edc-broker-server-extension#82
• Broker MUST be capable to crawl a Connector with 10,000 assets
• Broker MUST be capable to crawl 100 Connectors
• Validation steps. Until all these are tested this issue must remain open:
  • Create a Connector with 10k assets.
  • Crawl that connector and measure the time.
  • Create a Connector with 5 assets.
  • Crawl that connector and measure the time.
  • We should be able to support support at least one such large connector and 99 smaller ones that return only 5 data offers.
  • We need to adjust the update frequency accordingly.