Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] update running job, will set job clusterId to null, leading to Streampark cannot get status for the job #4075

Closed
3 tasks done
xieyi888 opened this issue Sep 20, 2024 · 0 comments · Fixed by #4076
Closed
3 tasks done
Labels
bug Something isn't working

Comments

@xieyi888
Copy link
Contributor

Search before asking

  • I had searched in the issues and found no similar issues.

Java Version

1.8

Scala Version

2.11.x

StreamPark Version

dev

Flink Version

1.16.2

deploy mode

yarn-application

What happened

deploy mode:
yarn application
yarn session

below is the error example for yarn application mode

  1. a running job
    image
    job cluster_id is application_1726758048768_39519
    image

  2. update job and submit

image
flink/app/update controller did not pass clusterId during update job
image

after update job, job cluster_id is set to null
image

  1. stop the job

the job stoped failed
image

error stack

java.util.concurrent.CompletionException: java.lang.reflect.InvocationTargetException
	at java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:273)
	at java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:280)
	at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1606)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:750)
Caused by: java.lang.reflect.InvocationTargetException
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.streampark.flink.client.FlinkClient$.$anonfun$proxy$1(FlinkClient.scala:89)
	at org.apache.streampark.flink.proxy.FlinkShimsProxy$.$anonfun$proxy$1(FlinkShimsProxy.scala:72)
	at org.apache.streampark.common.util.ClassLoaderUtils$.runAsClassLoader(ClassLoaderUtils.scala:44)
	at org.apache.streampark.flink.proxy.FlinkShimsProxy$.proxy(FlinkShimsProxy.scala:72)
	at org.apache.streampark.flink.client.FlinkClient$.proxy(FlinkClient.scala:84)
	at org.apache.streampark.flink.client.FlinkClient$.cancel(FlinkClient.scala:62)
	at org.apache.streampark.flink.client.FlinkClient.cancel(FlinkClient.scala)
	at org.apache.streampark.console.core.service.application.impl.ApplicationActionServiceImpl.lambda$cancel$0(ApplicationActionServiceImpl.java:314)
	at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604)
	... 3 more
Caused by: java.lang.IllegalArgumentException: [StreamPark] getClusterClient error. No cluster id was specified. Please specify a cluster to which you would like to connect.
	at org.apache.streampark.common.util.AssertUtils$.required(AssertUtils.scala:59)
	at org.apache.streampark.flink.client.trait.YarnClientTrait.executeClientAction(YarnClientTrait.scala:59)
	at org.apache.streampark.flink.client.trait.YarnClientTrait.doCancel(YarnClientTrait.scala:90)
	at org.apache.streampark.flink.client.trait.YarnClientTrait.doCancel$(YarnClientTrait.scala:86)
	at org.apache.streampark.flink.client.impl.YarnApplicationClient$.doCancel(YarnApplicationClient.scala:47)
	at org.apache.streampark.flink.client.trait.FlinkClientTrait.cancel(FlinkClientTrait.scala:229)
	at org.apache.streampark.flink.client.trait.FlinkClientTrait.cancel$(FlinkClientTrait.scala:212)
	at org.apache.streampark.flink.client.impl.YarnApplicationClient$.cancel(YarnApplicationClient.scala:47)
	at org.apache.streampark.flink.client.FlinkClientEntrypoint$.cancel(FlinkClientEntrypoint.scala:48)
	at org.apache.streampark.flink.client.FlinkClientEntrypoint.cancel(FlinkClientEntrypoint.scala)
	... 16 more

Error Exception

No response

Screenshots

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!(您是否要贡献这个PR?)

Code of Conduct

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
1 participant