streampark ui 点击取消job的时候，选择保存saveponit超时导致失败，怎么解决 #2530

gxl191911 · 2023-03-30T05:25:44Z

gxl191911
Mar 30, 2023

问题复述：
现在遇到的问题是通过ui停止job的时候选择savepoint，然后过一会提示失败，查看异常日志如下:
java.util.concurrent.CompletionException: java.lang.reflect.InvocationTargetException
at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:314)
at java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:319)
at java.base/java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1702)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:834)
Caused by: java.lang.reflect.InvocationTargetException
at jdk.internal.reflect.GeneratedMethodAccessor963.invoke(Unknown Source)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at org.apache.streampark.flink.client.FlinkClient$.$anonfun$cancel$1(FlinkClient.scala:73)
at org.apache.streampark.flink.proxy.FlinkShimsProxy$.$anonfun$proxy$1(FlinkShimsProxy.scala:63)
at org.apache.streampark.common.util.ClassLoaderUtils$.runAsClassLoader(ClassLoaderUtils.scala:40)
at org.apache.streampark.flink.proxy.FlinkShimsProxy$.proxy(FlinkShimsProxy.scala:63)
at org.apache.streampark.flink.client.FlinkClient$.cancel(FlinkClient.scala:68)
at org.apache.streampark.flink.client.FlinkClient.cancel(FlinkClient.scala)
at org.apache.streampark.console.core.service.impl.ApplicationServiceImpl.lambda$cancel$6(ApplicationServiceImpl.java:1235)
at java.base/java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1700)
... 3 more
Caused by: java.util.concurrent.TimeoutException
at java.base/java.util.concurrent.CompletableFuture.timedGet(CompletableFuture.java:1886)
at java.base/java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2021)
at org.apache.streampark.flink.client.trait.FlinkSubmitTrait.cancelJob(FlinkSubmitTrait.scala:482)
at org.apache.streampark.flink.client.trait.FlinkSubmitTrait.cancelJob$(FlinkSubmitTrait.scala:451)
at org.apache.streampark.flink.client.impl.KubernetesNativeSessionSubmit$.org$apache$streampark$flink$client$trait$KubernetesNativeSubmitTrait$$super$cancelJob(KubernetesNativeSessionSubmit.scala:48)
at org.apache.streampark.flink.client.trait.KubernetesNativeSubmitTrait.doCancel(KubernetesNativeSubmitTrait.scala:99)
at org.apache.streampark.flink.client.trait.KubernetesNativeSubmitTrait.doCancel$(KubernetesNativeSubmitTrait.scala:82)
at org.apache.streampark.flink.client.impl.KubernetesNativeSessionSubmit$.doCancel(KubernetesNativeSessionSubmit.scala:121)
at org.apache.streampark.flink.client.trait.FlinkSubmitTrait.cancel(FlinkSubmitTrait.scala:159)
at org.apache.streampark.flink.client.trait.FlinkSubmitTrait.cancel$(FlinkSubmitTrait.scala:143)
at org.apache.streampark.flink.client.impl.KubernetesNativeSessionSubmit$.cancel(KubernetesNativeSessionSubmit.scala:48)
at org.apache.streampark.flink.client.FlinkClientHandler$.cancel(FlinkClientHandler.scala:46)
at org.apache.streampark.flink.client.FlinkClientHandler.cancel(FlinkClientHandler.scala)
... 14 more

java.util.concurrent.CompletionException: java.lang.reflect.InvocationTargetException
at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:314)
at java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:319)
at java.base/java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1702)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:834)
Caused by: java.lang.reflect.InvocationTargetException
at jdk.internal.reflect.GeneratedMethodAccessor963.invoke(Unknown Source)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at org.apache.streampark.flink.client.FlinkClient$.$anonfun$cancel$1(FlinkClient.scala:73)
at org.apache.streampark.flink.proxy.FlinkShimsProxy$.$anonfun$proxy$1(FlinkShimsProxy.scala:63)
at org.apache.streampark.common.util.ClassLoaderUtils$.runAsClassLoader(ClassLoaderUtils.scala:40)
at org.apache.streampark.flink.proxy.FlinkShimsProxy$.proxy(FlinkShimsProxy.scala:63)
at org.apache.streampark.flink.client.FlinkClient$.cancel(FlinkClient.scala:68)
at org.apache.streampark.flink.client.FlinkClient.cancel(FlinkClient.scala)
at org.apache.streampark.console.core.service.impl.ApplicationServiceImpl.lambda$cancel$6(ApplicationServiceImpl.java:1235)
at java.base/java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1700)
... 3 more
Caused by: java.util.concurrent.TimeoutException
at java.base/java.util.concurrent.CompletableFuture.timedGet(CompletableFuture.java:1886)
at java.base/java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2021)
at org.apache.streampark.flink.client.trait.FlinkSubmitTrait.cancelJob(FlinkSubmitTrait.scala:482)
at org.apache.streampark.flink.client.trait.FlinkSubmitTrait.cancelJob$(FlinkSubmitTrait.scala:451)
at org.apache.streampark.flink.client.impl.KubernetesNativeSessionSubmit$.org$apache$streampark$flink$client$trait$KubernetesNativeSubmitTrait$$super$cancelJob(KubernetesNativeSessionSubmit.scala:48)
at org.apache.streampark.flink.client.trait.KubernetesNativeSubmitTrait.doCancel(KubernetesNativeSubmitTrait.scala:99)
at org.apache.streampark.flink.client.trait.KubernetesNativeSubmitTrait.doCancel$(KubernetesNativeSubmitTrait.scala:82)
at org.apache.streampark.flink.client.impl.KubernetesNativeSessionSubmit$.doCancel(KubernetesNativeSessionSubmit.scala:121)
at org.apache.streampark.flink.client.trait.FlinkSubmitTrait.cancel(FlinkSubmitTrait.scala:159)
at org.apache.streampark.flink.client.trait.FlinkSubmitTrait.cancel$(FlinkSubmitTrait.scala:143)
at org.apache.streampark.flink.client.impl.KubernetesNativeSessionSubmit$.cancel(KubernetesNativeSessionSubmit.scala:48)
at org.apache.streampark.flink.client.FlinkClientHandler$.cancel(FlinkClientHandler.scala:46)
at org.apache.streampark.flink.client.FlinkClientHandler.cancel(FlinkClientHandler.scala)
... 14 more

java.util.concurrent.CompletionException: java.lang.reflect.InvocationTargetException
at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:314)
at java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:319)
at java.base/java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1702)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:834)
Caused by: java.lang.reflect.InvocationTargetException
at jdk.internal.reflect.GeneratedMethodAccessor963.invoke(Unknown Source)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at org.apache.streampark.flink.client.FlinkClient$.$anonfun$cancel$1(FlinkClient.scala:73)
at org.apache.streampark.flink.proxy.FlinkShimsProxy$.$anonfun$proxy$1(FlinkShimsProxy.scala:63)
at org.apache.streampark.common.util.ClassLoaderUtils$.runAsClassLoader(ClassLoaderUtils.scala:40)
at org.apache.streampark.flink.proxy.FlinkShimsProxy$.proxy(FlinkShimsProxy.scala:63)
at org.apache.streampark.flink.client.FlinkClient$.cancel(FlinkClient.scala:68)
at org.apache.streampark.flink.client.FlinkClient.cancel(FlinkClient.scala)
at org.apache.streampark.console.core.service.impl.ApplicationServiceImpl.lambda$cancel$6(ApplicationServiceImpl.java:1235)
at java.base/java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1700)
... 3 more
Caused by: java.util.concurrent.TimeoutException
at java.base/java.util.concurrent.CompletableFuture.timedGet(CompletableFuture.java:1886)
at java.base/java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2021)
at org.apache.streampark.flink.client.trait.FlinkSubmitTrait.cancelJob(FlinkSubmitTrait.scala:482)
at org.apache.streampark.flink.client.trait.FlinkSubmitTrait.cancelJob$(FlinkSubmitTrait.scala:451)
at org.apache.streampark.flink.client.impl.KubernetesNativeSessionSubmit$.org$apache$streampark$flink$client$trait$KubernetesNativeSubmitTrait$$super$cancelJob(KubernetesNativeSessionSubmit.scala:48)
at org.apache.streampark.flink.client.trait.KubernetesNativeSubmitTrait.doCancel(KubernetesNativeSubmitTrait.scala:99)
at org.apache.streampark.flink.client.trait.KubernetesNativeSubmitTrait.doCancel$(KubernetesNativeSubmitTrait.scala:82)
at org.apache.streampark.flink.client.impl.KubernetesNativeSessionSubmit$.doCancel(KubernetesNativeSessionSubmit.scala:121)
at org.apache.streampark.flink.client.trait.FlinkSubmitTrait.cancel(FlinkSubmitTrait.scala:159)
at org.apache.streampark.flink.client.trait.FlinkSubmitTrait.cancel$(FlinkSubmitTrait.scala:143)
at org.apache.streampark.flink.client.impl.KubernetesNativeSessionSubmit$.cancel(KubernetesNativeSessionSubmit.scala:48)
at org.apache.streampark.flink.client.FlinkClientHandler$.cancel(FlinkClientHandler.scala:46)
at org.apache.streampark.flink.client.FlinkClientHandler.cancel(FlinkClientHandler.scala)
... 14 more
显示超时, 这个时候这个job其实已经在进行savepoint还未结束，过一会这个job savepoint成功了，ui上面job的状态又变更为取消成功。但是无法通过ui去从刚刚的savepoint启动该job。

这个问题怎么解决，有没有可以将streampark savepoint超时时间调大的配置吗

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

streampark ui 点击取消job的时候，选择保存saveponit超时导致失败，怎么解决 #2530

{{title}}

Replies: 0 comments

Select a reply

streampark ui 点击取消job的时候，选择保存saveponit超时导致失败，怎么解决 #2530

gxl191911 Mar 30, 2023

Replies: 0 comments

gxl191911
Mar 30, 2023