Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[sdk] Missing Alternative for set_ttl_seconds_after_finished in KFP v2 #10899

Open
nasenthi opened this issue Jun 13, 2024 · 5 comments
Open
Assignees

Comments

@nasenthi
Copy link

Environment

  • KFP version: KFP v2
  • KFP SDK version: 2.5.0

Steps to reproduce

  1. Create and run any pipeline in KFP v2.
  2. Observe that the pods created by the run are not automatically deleted after the pipeline execution is complete.

In KFP v1, there was a function kfp.dsl.PipelineConf().set_ttl_seconds_after_finished(seconds) that allowed us to delete pods after a specified time. However, in KFP v2, this function has been deprecated. When attempting to use this deprecated function, we encounter errors as documented in the following issues:

Issue - #10715
Issue - #9803
Is there any alternative method available in KFP v2 to delete the pods after they have finished executing?

Expected result

There should be a method in KFP v2 SDK to specify the TTLStrategy inside argo workflows to have them cleaned up.

Materials and Reference


Impacted by this bug? Give it a 👍.

@nasenthi nasenthi changed the title [sdk] Missing Alternative for set_ttl_seconds_after_finished in Kubeflow v2 [sdk] Missing Alternative for set_ttl_seconds_after_finished in KFP v2 Jun 13, 2024
@gregsheremeta
Copy link
Contributor

I'm working on this

@hbelmiro
Copy link
Contributor

/assign @gregsheremeta

@papagala
Copy link
Contributor

We are currently migrating all our pipelines to V2.7.0 and experienced the same problem. It was also useful to have a way to add secrets at a pipeline level and image pull secrets. Thanks @gregsheremeta 👍

Copy link

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

@github-actions github-actions bot added the lifecycle/stale The issue / pull request is stale, any activities remove this label. label Aug 20, 2024
@gregsheremeta
Copy link
Contributor

It was also useful to have a way to add secrets at a pipeline level and image pull secrets

Extracted PipelineConfig to #11112 -- please 👍 there :)

@stale stale bot removed the lifecycle/stale The issue / pull request is stale, any activities remove this label. label Aug 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
4 participants