Running Spark Jobs Across Multiple Namespaces with Custom Service Accounts

[ramsinghtmdc]

What question do you want to ask?

• ✋ Hi team,

I would like to know if it's possible to configure the Kubeflow Spark Operator to allow running Spark jobs from all namespaces using custom service accounts.

In our use case, users create their own namespaces in Kubernetes and want to run Spark jobs from those namespaces using their specific service accounts. Is there a way to set this up in the operator? If so, could you provide guidance or documentation on how to achieve this?

Thanks in advance for your help!

Additional context

No response

Have the same question?

Give it a 👍 We prioritize the question with most 👍

[ChenYi015]

@ramsinghtmdc If the service accounts in those namespaces have the same name, then you can configure spark operator helm chart to create RBAC resources for these service accounts. Otherwise, you need to create the RBAC resources manually for these service accounts.

[ramsinghtmdc]

Got it, Thanks @ChenYi015.