Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]Couldn't deploy Yarn Application Cluster #3163

Closed
3 tasks done
jetliu1711 opened this issue Feb 19, 2024 · 5 comments
Closed
3 tasks done

[Bug]Couldn't deploy Yarn Application Cluster #3163

jetliu1711 opened this issue Feb 19, 2024 · 5 comments
Assignees
Labels
Need Reproduce Need to provide reproduction steps

Comments

@jetliu1711
Copy link

Search before asking

  • I had searched in the issues and found no similar issues.

What happened

Use application mode sumbit flink sql task,it makes some errors,like this:
2024-02-19 13:24:58,616 WARN org.apache.flink.configuration.Configuration [] - Config uses deprecated configuration key 'web.port' instead of proper key 'rest.bind-port'
2024-02-19 13:24:58,632 INFO org.apache.flink.runtime.clusterframework.BootstrapTools [] - Setting directories for temporary files to: /data/vdb/yarn/local/usercache/dinky/appcache/application_1707125270554_0031,/data/vdc/yarn/local/usercache/dinky/appcache/application_1707125270554_0031,/data/vdd/yarn/local/usercache/dinky/appcache/application_1707125270554_0031,/data/vde/yarn/local/usercache/dinky/appcache/application_1707125270554_0031,/data/vdf/yarn/local/usercache/dinky/appcache/application_1707125270554_0031,/data/vdg/yarn/local/usercache/dinky/appcache/application_1707125270554_0031,/data/vdh/yarn/local/usercache/dinky/appcache/application_1707125270554_0031
2024-02-19 13:24:58,668 ERROR org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Could not create application program.
org.apache.flink.util.FlinkException: Could not load the provided entrypoint class.
at org.apache.flink.client.program.DefaultPackagedProgramRetriever.getPackagedProgram(DefaultPackagedProgramRetriever.java:215) ~[flink-dist-1.17.2.jar:1.17.2]
at org.apache.flink.yarn.entrypoint.YarnApplicationClusterEntryPoint.getPackagedProgram(YarnApplicationClusterEntryPoint.java:126) ~[flink-dist-1.17.2.jar:1.17.2]
at org.apache.flink.yarn.entrypoint.YarnApplicationClusterEntryPoint.main(YarnApplicationClusterEntryPoint.java:96) [flink-dist-1.17.2.jar:1.17.2]
Caused by: org.apache.flink.client.program.ProgramInvocationException: JAR file does not exist '/data/vdb/yarn/local/usercache/dinky/appcache/application_1707125270554_0031/container_e08_1707125270554_0031_01_000001/dinky-app-1.17-1.0.0-rc4-jar-with-dependencies.jar'
at org.apache.flink.client.program.PackagedProgram.checkJarFile(PackagedProgram.java:617) ~[flink-dist-1.17.2.jar:1.17.2]
at org.apache.flink.client.program.PackagedProgram.loadJarFile(PackagedProgram.java:465) ~[flink-dist-1.17.2.jar:1.17.2]
at org.apache.flink.client.program.PackagedProgram.(PackagedProgram.java:135) ~[flink-dist-1.17.2.jar:1.17.2]
at org.apache.flink.client.program.PackagedProgram.(PackagedProgram.java:65) ~[flink-dist-1.17.2.jar:1.17.2]
at org.apache.flink.client.program.PackagedProgram$Builder.build(PackagedProgram.java:691) ~[flink-dist-1.17.2.jar:1.17.2]
at org.apache.flink.client.program.DefaultPackagedProgramRetriever.getPackagedProgram(DefaultPackagedProgramRetriever.java:213) ~[flink-dist-1.17.2.jar:1.17.2]
... 2 more
Caused by: java.io.IOException: JAR file does not exist '/data/vdb/yarn/local/usercache/dinky/appcache/application_1707125270554_0031/container_e08_1707125270554_0031_01_000001/dinky-app-1.17-1.0.0-rc4-jar-with-dependencies.jar'
at org.apache.flink.util.JarUtils.checkJarFile(JarUtils.java:46) ~[flink-dist-1.17.2.jar:1.17.2]
at org.apache.flink.client.program.PackagedProgram.checkJarFile(PackagedProgram.java:615) ~[flink-dist-1.17.2.jar:1.17.2]
at org.apache.flink.client.program.PackagedProgram.loadJarFile(PackagedProgram.java:465) ~[flink-dist-1.17.2.jar:1.17.2]
at org.apache.flink.client.program.PackagedProgram.(PackagedProgram.java:135) ~[flink-dist-1.17.2.jar:1.17.2]
at org.apache.flink.client.program.PackagedProgram.(PackagedProgram.java:65) ~[flink-dist-1.17.2.jar:1.17.2]
at org.apache.flink.client.program.PackagedProgram$Builder.build(PackagedProgram.java:691) ~[flink-dist-1.17.2.jar:1.17.2]
at org.apache

What you expected to happen

can work well

How to reproduce

write flink sql task ,then click the "running" button.

Anything else

No response

Version

1.0.0

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

@jetliu1711 jetliu1711 added Bug Something isn't working Waiting for reply Waiting for reply labels Feb 19, 2024
Copy link

Hello @jetliu1711, this issue is about web, so I assign it to @Zzm0809. If you have any questions, you can comment and reply.

你好 @jetliu1711, 这个 issue 是关于 web 的,所以我把它分配给了 @Zzm0809。如有任何问题,可以评论回复。

@Zzm0809
Copy link
Contributor

Zzm0809 commented Feb 19, 2024

@jetliu1711 请规范编写 issue title 否则将视为无效 issue

@jetliu1711 jetliu1711 changed the title Couldn't deploy Yarn Application Cluster [Bug]Couldn't deploy Yarn Application Cluster Feb 19, 2024
@aiwenmo aiwenmo removed the Waiting for reply Waiting for reply label Feb 19, 2024
@Zzm0809 Zzm0809 added Need Reproduce Need to provide reproduction steps and removed Bug Something isn't working labels Feb 21, 2024
Copy link

Hello @jetliu1711, we need you to provide reproduction steps so that we can help you troubleshoot the problem. Issues are marked `Need Reproduce`.

你好 @jetliu1711, 我们需要你提供复现步骤以便于我们帮你排查问题,Issues 标注为 `Need Reproduce` 。

Copy link

github-actions bot commented Mar 3, 2024

Hi @, Because this issue was marked as requiring detailed reproduction steps, no response was received for 10 days. The issue is now closed. If you have any questions, please comment and reply.

Hi @, 由于该 issue 被标记为需要提供详细复现步骤,却 10 天未收到回应。现关闭 issue,若有任何问题,可评论回复。

@github-actions github-actions bot closed this as not planned Won't fix, can't repro, duplicate, stale Mar 3, 2024
@hugh018
Copy link

hugh018 commented Aug 19, 2024

复现 flink-1.17.2 dinky-1.0.2

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Need Reproduce Need to provide reproduction steps
Projects
None yet
Development

No branches or pull requests

4 participants