Is it possible to make codecov action not "fail" until all other runs are completed?

[jakkdl]

As I'm currently juggling several PRs and since the added xfail's on 3.12 it's not possible to see the ✔️ vs ❌ on a PR to see at a glance if it passes test. But, as soon as the first result is pushed to codecov it will fail and display ❌, until however longer time later when enough results have come in that it passes. I'd personally much prefer if it was possible to mark it as not giving a result until all results are in, so I can rely on the status icon of ✔️ vs ❌ vs 🟡.

One solution would be:

One thought I have on this, though, is that what Hynek advocates for in his article https://hynek.me/articles/ditch-codecov-python/ could be useful here too. Maybe, if we merged all the reports on the GHA side and made just a single upload to Codecov, it could help with the rate limit just enough for this CI to have the best of two worlds: stability + ability to view coverage on Codecov's web UI.

as mentioned in #2672 (review)

[jakkdl]

oh, and somewhat related - I'm getting duplicate codecov checks, e.g. in #2686

[jakkdl]

Gonna bump this after codecov flakiness in #2812 (comment)

[richardsheridan]

I implemented something inspired by Hynek's post in my repo fwiw: richardsheridan/trio-parallel#114