[EPIC] e2e: Celestia network tests

[liamsi]

Celestia network tests roadmap

Before incentivised testnet, we should have a set of test plans that contain such scenarios:

• PoC: testground is a viable option for further test automation to catch regressions on a e2e level
  • e2e/testground: proof of concept #638
• K8s Infra Setup:
  • infra: K8S cluster setup test-infra#25
• appkit: Finish app-validator story
  • testground/celestia-app: create basic validator steps creation test-infra#24
• plan 1: Big blocks
  • [EPIC] #001 Big Blocks Implementation test-infra#77
• plan 2: Benchmarking Bridge/Full nodes serving shares to Light Nodes
  • [EPIC] Benchmark Test-Plan for Bridge/Full nodes serving shares to LNs test-infra#83
• plan 3: Node download data by namespace
  • [EPIC] E2E large block reconstruction test tracking issue #602 (for plan 1/2)
• plan 4: Peer discovery (peers (quickly) find/discover each other)
  • e2e: peer discovery  #649
• plan 5: Block recovery
  • [EPIC] Failure and Recovery cases for block with withheld data test-infra#21,
  • share: test complex recovery scenarious  #600
• plan 6: composition tests for sync scenarios
  • e2e: node sync between different versions  #647
    Nice to have:
• plan 7: working out custom malicious app nodes to test out befp

CI/CD

In order to put out the tests above into a regular run cadence/schedule we need to do the following:

1. Polish/Harden out the set of tests that are used for experiments
2. Split tests by amount of instances and which test-plans are executed in different stages
3. Define the inbound requirements which triggers test runs (e.g. once a release candidate is released in either of the stack app/node/optimint)
4. Implement a new github action for e2e/network runs
5. Store a bucket of output logs
6. Notification mechanism

[Wondertan]

This will be resolved with Swamp.

[adlerjohn]

Ref: #315

[liamsi]

Swamp PR was merged now but at least some of this was rather about e2e tests with more realistic networking instead of integration tests and mocked networks. But feel free to close this in favour of more concrete and actionable issues.

[Bidon15]

@Bidon15 1 bridge (4MB) and 1k light nodes das it

[Bidon15]

@Bidon15 1 bridge (4MB) and 1k light nodes das it

Updated the issue description to reflect this upcoming test-plan

[Bidon15]

Will be closed as celestiaorg/test-infra#21 this is getting to the finishing line implementation wise

This one will be on it's own #647

[Bidon15]

We will close this issue once we get manual work for BR ods 128