[Release] KFP 2.3.0 & KFP SDK 2.9.0 release tracker

[chensun]

Release owner: @chensun
Release instructions: https://github.com/kubeflow/pipelines/blob/master/RELEASE.md

Tentative release timeline: early to mid September

[chensun]

Current release blockers:

• Post-submit tests failures:
  

[HumairAK]

I would like to propose we also get this merged in: #11058
cc @zijianjoy before we cut a release, it's a very apparent bug that users will immediately hit

[hbelmiro]

@chensun it seems like these tests are not expected to run on pushes. See, for example,

pipelines/.github/workflows/kfp-sdk-runtime-tests.yml

Line 30 in 71a52ab

export PULL_NUMBER="${{ github.event.inputs.pull_number || github.event.pull_request.number }}"

and

pipelines/test/kfp-kubernetes-execution-tests/sdk_execution_tests.py

Line 113 in 2009dfb

if os.environ.get('PULL_NUMBER') is not None:

AssertionError: 1 != 0 :   WARNING: Did not find branch or tag 'refs/pull//merge', assuming revision or ref.

I created a test PR and all tests are passing: #11150

I'll take a closer look to fix them.

[hbelmiro]

@chensun it seems like we also have some flaky tests.

As a workaround, can we ignore the failing tests in the master branch and use my test PR instead? Just while we fix the failing tests.
We can rebase and/or rerun the tests (with rerun-all) as much as needed before releasing.

If the failing tests block some automation, we can disable them from running on pushes. (Also, just while we fix them)

Please let me know if that works for you and if I need to disable them from running on pushes.

I created this issue to track this work.

[HumairAK]

I'm not sure if this is included as part of the instructions, but please also rebuild driver/launcher images, as these have also undergone changes.

[chensun]

@chensun it seems like these tests are not expected to run on pushes. See, for example,

pipelines/.github/workflows/kfp-sdk-runtime-tests.yml

Line 30 in 71a52ab

export PULL_NUMBER="${{ github.event.inputs.pull_number || github.event.pull_request.number }}"

and

pipelines/test/kfp-kubernetes-execution-tests/sdk_execution_tests.py

Line 113 in 2009dfb

if os.environ.get('PULL_NUMBER') is not None:

AssertionError: 1 != 0 :   WARNING: Did not find branch or tag 'refs/pull//merge', assuming revision or ref.

I created a test PR and all tests are passing: #11150

I'll take a closer look to fix them.

Thank you for the investigation. It sounds good to me to ignore the failure and unblock the release. I can probably do the release tomorrow.

[chensun]

Release notes:
https://github.com/kubeflow/pipelines/releases/tag/2.3.0
https://github.com/kubeflow/pipelines/releases/tag/sdk-2.9.0