Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

flink-sql-connector-hive-3.1.3_2.12-1.18.1.jar conflicts with flink-table-planner_2.12-*.jar #4253

Open
2 of 3 tasks
ylhh353 opened this issue Feb 25, 2025 · 2 comments
Open
2 of 3 tasks

flink-sql-connector-hive-3.1.3_2.12-1.18.1.jar conflicts with flink-table-planner_2.12-*.jar #4253

ylhh353 opened this issue Feb 25, 2025 · 2 comments
Assignees
@gaoyan1998 @zackyoungh
Labels
Bug Something isn't working

Comments

@ylhh353
Copy link

ylhh353 commented Feb 25, 2025

Search before asking

  • I had searched in the issues and found no similar issues.

What happened

flink-sql-connector-hive-3.1.3_2.12-1.18.1.jar 与 flink-table-planner_2.12-*.jar 冲突了 ，

报错了 FO org.dinky.app.flinksql.Submitter [] - Start Monitor Job
2025-02-25 16:08:07,162 ERROR org.dinky.app.flinksql.Submitter [] - jobClient is empty, can not monitor job
2025-02-25 16:08:07,163 WARN org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap [] - Application failed unexpectedly:
java.util.concurrent.CompletionException: org.apache.flink.client.deployment.application.ApplicationExecutionException: Could not execute application.
at java.util.concurrent.CompletableFuture.encodeThrowable(Unknown Source) ~[?:?]
at java.util.concurrent.CompletableFuture.completeThrowable(Unknown Source) ~[?:?]
at java.util.concurrent.CompletableFuture$UniCompose.tryFire(Unknown Source) ~[?:?]
at java.util.concurrent.CompletableFuture.postComplete(Unknown Source) ~[?:?]
at java.util.concurrent.CompletableFuture.completeExceptionally(Unknown Source) ~[?:?]
at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:337) ~[flink-dist-1.18.1.jar:1.18.1]
at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.lambda$runApplicationAsync$2(ApplicationDispatcherBootstrap.java:254) ~[flink-dist-1.18.1.jar:1.18.1]
at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[?:?]
at java.util.concurrent.FutureTask.run(Unknown Source) ~[?:?]
at org.apache.flink.runtime.concurrent.pekko.ActorSystemScheduledExecutorAdapter$ScheduledFutureTask.run(ActorSystemScheduledExecutorAdapter.java:172) ~[?:?]
at org.apache.flink.runtime.concurrent.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:68) ~[flink-dist-1.18.1.jar:1.18.1]
at org.apache.flink.runtime.concurrent.ClassLoadingUtils.lambda$withContextClassLoader$0(ClassLoadingUtils.java:41) ~[flink-dist-1.18.1.jar:1.18.1]
at org.apache.pekko.dispatch.TaskInvocation.run(AbstractDispatcher.scala:59) [flink-rpc-akka0c08bd6d-34e4-4874-b05f-0a4330bf4a08.jar:1.18.1]
at org.apache.pekko.dispatch.ForkJoinExecutorConfigurator$PekkoForkJoinTask.exec(ForkJoinExecutorConfigurator.scala:57) [flink-rpc-akka0c08bd6d-34e4-4874-b05f-0a4330bf4a08.jar:1.18.1]
at java.util.concurrent.ForkJoinTask.doExec(Unknown Source) [?:?]
at java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(Unknown Source) [?:?]
at java.util.concurrent.ForkJoinPool.scan(Unknown Source) [?:?]
at java.util.concurrent.ForkJoinPool.runWorker(Unknown Source) [?:?]
at java.util.concurrent.ForkJoinWorkerThread.run(Unknown Source) [?:?]
Caused by: org.apache.flink.client.deployment.application.ApplicationExecutionException: Could not execute application.
... 14 more
Caused by: java.lang.NoSuchFieldError: operands
at org.apache.calcite.plan.RelOptRule.operand(RelOptRule.java:129) ~[flink-sql-connector-hive-3.1.3_2.12-1.18.1.jar:1.18.1]
at org.apache.flink.table.planner.plan.rules.logical.SimplifyFilterConditionRule.(SimplifyFilterConditionRule.scala:36) ~[flink-table-planner_2.12-1.18.1.jar:1.18.1]
at org.apache.flink.table.planner.plan.rules.logical.SimplifyFilterConditionRule$.(SimplifyFilterConditionRule.scala:94) ~[flink-table-planner_2.12-1.18.1.jar:1.18.1]
at org.apache.flink.table.planner.plan.rules.logical.SimplifyFilterConditionRule$.(SimplifyFilterConditionRule.scala) ~[flink-table-planner_2.12-1.18.1.jar:1.18.1]
at org.apache.flink.table.planner.plan.rules.FlinkStreamRuleSets$.(FlinkStreamRuleSets.scala:35) ~[flink-table-planner_2.12-1.18.1.jar:1.18.1]
at org.apache.flink.table.planner.plan.rules.FlinkStreamRuleSets$.(FlinkStreamRuleSets.scala) ~[flink-table-planner_2.12-1.18.1.jar:1.18.1]
at org.apache.flink.table.planner.plan.optimize.program.FlinkStreamProgram$.buildProgram(FlinkStreamProgram.scala:57) ~[flink-table-planner_2.12-1.18.1.jar:1.18.1]
at org.apache.flink.table.planner.plan.optimize.StreamCommonSubGraphBasedOptimizer.$anonfun$optimizeTree$1(StreamCommonSubGraphBasedOptimizer.scala:169) ~[flink-table-planner_2.12-1.18.1.jar:1.18.1]
at scala.Option.getOrElse(Option.scala:121) ~[flink-scala_2.12-1.18.1.jar:1.18.1]
at org.apache.flink.table.planner.plan.optimize.StreamCommonSubGraphBasedOptimizer.optimizeTree(StreamCommonSubGraphBasedOptimizer.scala:169) ~[flink-table-planner_2.12-1.18.1.jar:1.18.1]
at org.apache.flink.table.planner.plan.optimize.StreamCommonSubGraphBasedOptimizer.doOptimize(StreamCommonSubGraphBasedOptimizer.scala:83) ~[flink-table-planner_2.12-1.18.1.jar:1.18.1]
at org.apache.flink.table.planner.plan.optimize.CommonSubGraphBasedOptimizer.optimize(CommonSubGraphBasedOptimizer.scala:87) ~[flink-table-planner_2.12-1.18.1.jar:1.18.1]
at org.apache.flink.table.planner.delegation.PlannerBase.optimize(PlannerBase.scala:324) ~[flink-table-planner_2.12-1.18.1.jar:1.18.1]
at org.apache.flink.table.planner.delegation.PlannerBase.translate(PlannerBase.scala:182) ~[flink-table-planner_2.12-1.18.1.jar:1.18.1]
at org.apache.flink.table.api.internal.TableEnvironmentImpl.translate(TableEnvironmentImpl.java:1277) ~[flink-table-api-java-uber-1.18.1.jar:1.18.1]
at org.apache.flink.table.api.internal.TableEnvironmentImpl.executeInternal(TableEnvironmentImpl.java:862) ~[flink-table-api-java-uber-1.18.1.jar:1.18.1]
at org.dinky.executor.DefaultTableEnvironmentInternal.executeInternal(DefaultTableEnvironmentInternal.java:69) ~[?:?]
at org.dinky.executor.CustomTableEnvironmentImpl.executeStatementSet(CustomTableEnvironmentImpl.java:271) ~[?:?]
at org.dinky.executor.Executor.executeStatements(Executor.java:364) ~[?:?]
at org.dinky.job.runner.JobSqlRunner.execute(JobSqlRunner.java:87) ~[?:?]
at org.dinky.app.flinksql.Submitter.executeJob(Submitter.java:322) ~[?:?]
at org.dinky.app.flinksql.Submitter.submit(Submitter.java:144) ~[?:?]
at org.dinky.app.MainApp.main(MainApp.java:53) ~[?:?]
at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?]
at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) ~[?:?]
at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) ~[?:?]
at java.lang.reflect.Method.invoke(Unknown Source) ~[?:?]
at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355) ~[flink-dist-1.18.1.jar:1.18.1]
at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222) ~[flink-dist-1.18.1.jar:1.18.1]
at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:105) ~[flink-dist-1.18.1.jar:1.18.1]
at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:301) ~[flink-dist-1.18.1.jar:1.18.1]
... 13 more
2025-02-25 16:08:07,168 ERROR org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Fatal error occurred in the cluster entrypoint.
java.util.concurrent.CompletionException: org.apache.flink.client.deployment.application.ApplicationExecutionException: Could not execute application.
at java.util.concurrent.CompletableFuture.encodeThrowable(Unknown Source) ~[?:?]
at java.util.concurrent.CompletableFuture.completeThrowable(Unknown Source) ~[?:?]
at java.util.concurrent.CompletableFuture$UniCompose.tryFire(Unknown Source) ~[?:?]
at java.util.concurrent.CompletableFuture.postComplete(Unknown Source) ~[?:?]
at java.util.concurrent.CompletableFuture.completeExceptionally(Unknown Source) ~[?:?]
at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:337) ~[flink-dist-1.18.1.jar:1.18.1]
at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.lambda$runApplicationAsync$2(ApplicationDispatcherBootstrap.java:254) ~[flink-dist-1.18.1.jar:1.18.1]
at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[?:?]
at java.util.concurrent.FutureTask.run(Unknown Source) ~[?:?]
at org.apache.flink.runtime.concurrent.pekko.ActorSystemScheduledExecutorAdapter$ScheduledFutureTask.run(ActorSystemScheduledExecutorAdapter.java:172) ~[?:?]
at org.apache.flink.runtime.concurrent.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:68) ~[flink-dist-1.18.1.jar:1.18.1]
at org.apache.flink.runtime.concurrent.ClassLoadingUtils.lambda$withContextClassLoader$0(ClassLoadingUtils.java:41) ~[flink-dist-1.18.1.jar:1.18.1]
at org.apache.pekko.dispatch.TaskInvocation.run(AbstractDispatcher.scala:59) [flink-rpc-akka0c08bd6d-34e4-4874-b05f-0a4330bf4a08.jar:1.18.1]
at org.apache.pekko.dispatch.ForkJoinExecutorConfigurator$PekkoForkJoinTask.exec(ForkJoinExecutorConfigurator.scala:57) [flink-rpc-akka0c08bd6d-34e4-4874-b05f-0a4330bf4a08.jar:1.18.1]
at java.util.concurrent.ForkJoinTask.doExec(Unknown Source) [?:?]
at java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(Unknown Source) [?:?]
at java.util.concurrent.ForkJoinPool.scan(Unknown Source) [?:?]
at java.util.concurrent.ForkJoinPool.runWorker(Unknown Source) [?:?]
at java.util.concurrent.ForkJoinWorkerThread.run(Unknown Source) [?:?]
Caused by: org.apache.flink.client.deployment.application.ApplicationExecutionException: Could not execute application.
... 14 more
Caused by: java.lang.NoSuchFieldError: operands
at org.apache.calcite.plan.RelOptRule.operand(RelOptRule.java:129) ~[flink-sql-connector-hive-3.1.3_2.12-1.18.1.jar:1.18.1]
at org.apache.flink.table.planner.plan.rules.logical.SimplifyFilterConditionRule.(SimplifyFilterConditionRule.scala:36) ~[flink-table-planner_2.12-1.18.1.jar:1.18.1]
at org.apache.flink.table.planner.plan.rules.logical.SimplifyFilterConditionRule$.(SimplifyFilterConditionRule.scala:94) ~[flink-table-planner_2.12-1.18.1.jar:1.18.1]
at org.apache.flink.table.planner.plan.rules.logical.SimplifyFilterConditionRule$.(SimplifyFilterConditionRule.scala) ~[flink-table-planner_2.12-1.18.1.jar:1.18.1]
at org.apache.flink.table.planner.plan.rules.FlinkStreamRuleSets$.(FlinkStreamRuleSets.scala:35) ~[flink-table-planner_2.12-1.18.1.jar:1.18.1]
at org.apache.flink.table.planner.plan.rules.FlinkStreamRuleSets$.(FlinkStreamRuleSets.scala) ~[flink-table-planner_2.12-1.18.1.jar:1.18.1]
at org.apache.flink.table.planner.plan.optimize.program.FlinkStreamProgram$.buildProgram(FlinkStreamProgram.scala:57) ~[flink-table-planner_2.12-1.18.1.jar:1.18.1]
at org.apache.flink.table.planner.plan.optimize.StreamCommonSubGraphBasedOptimizer.$anonfun$optimizeTree$1(StreamCommonSubGraphBasedOptimizer.scala:169) ~[flink-table-planner_2.12-1.18.1.jar:1.18.1]
at scala.Option.getOrElse(Option.scala:121) ~[flink-scala_2.12-1.18.1.jar:1.18.1]
at org.apache.flink.table.planner.plan.optimize.StreamCommonSubGraphBasedOptimizer.optimizeTree(StreamCommonSubGraphBasedOptimizer.scala:169) ~[flink-table-planner_2.12-1.18.1.jar:1.18.1]
at org.apache.flink.table.planner.plan.optimize.StreamCommonSubGraphBasedOptimizer.doOptimize(StreamCommonSubGraphBasedOptimizer.scala:83) ~[flink-table-planner_2.12-1.18.1.jar:1.18.1]
at org.apache.flink.table.planner.plan.optimize.CommonSubGraphBasedOptimizer.optimize(CommonSubGraphBasedOptimizer.scala:87) ~[flink-table-planner_2.12-1.18.1.jar:1.18.1]
at org.apache.flink.table.planner.delegation.PlannerBase.optimize(PlannerBase.scala:324) ~[flink-table-planner_2.12-1.18.1.jar:1.18.1]
at org.apache.flink.table.planner.delegation.PlannerBase.translate(PlannerBase.scala:182) ~[flink-table-planner_2.12-1.18.1.jar:1.18.1]
at org.apache.flink.table.api.internal.TableEnvironmentImpl.translate(TableEnvironmentImpl.java:1277) ~[flink-table-api-java-uber-1.18.1.jar:1.18.1]
at org.apache.flink.table.api.internal.TableEnvironmentImpl.executeInternal(TableEnvironmentImpl.java:862) ~[flink-table-api-java-uber-1.18.1.jar:1.18.1]
at org.dinky.executor.DefaultTableEnvironmentInternal.executeInternal(DefaultTableEnvironmentInternal.java:69) ~[?:?]
at org.dinky.executor.CustomTableEnvironmentImpl.executeStatementSet(CustomTableEnvironmentImpl.java:271) ~[?:?]
at org.dinky.executor.Executor.executeStatements(Executor.java:364) ~[?:?]
at org.dinky.job.runner.JobSqlRunner.execute(JobSqlRunner.java:87) ~[?:?]
at org.dinky.app.flinksql.Submitter.executeJob(Submitter.java:322) ~[?:?]
at org.dinky.app.flinksql.Submitter.submit(Submitter.java:144) ~[?:?]
at org.dinky.app.MainApp.main(MainApp.java:53) ~[?:?]
at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?]
at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) ~[?:?]
at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) ~[?:?]
at java.lang.reflect.Method.invoke(Unknown Source) ~[?:?]
at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355) ~[flink-dist-1.18.1.jar:1.18.1]
at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222) ~[flink-dist-1.18.1.jar:1.18.1]
at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:105) ~[flink-dist-1.18.1.jar:1.18.1]
at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:301) ~[flink-dist-1.18.1.jar:1.18.1]
... 13 more
2025-02-25 16:08:07,171 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Shutting KubernetesApplicationClusterEntrypoint down with application status UNKNOWN. Diagnostics Cluster entrypoint has been closed externally..
2025-02-25 16:08:07,348 INFO org.apache.pekko.remote.RemoteActorRefProvider$RemotingTerminator [] - Shutting down remote daemon.
2025-02-25 16:08:07,349 INFO org.apache.pekko.remote.RemoteActorRefProvider$RemotingTerminator [] - Remote daemon shut down; proceeding with flushing remote transports.
2025-02-25 16:08:07,349 INFO org.apache.pekko.actor.CoordinatedShutdown [] - Running CoordinatedShutdown with reason [ActorSystemTerminateReason]
2025-02-25 16:08:07,351 INFO org.apache.pekko.remote.RemoteActorRefProvider$RemotingTerminator [] - Shutting down remote daemon.

What you expected to happen

我这里用的是dinky 1.2.1 flink 1.18.1

How to reproduce

FO org.dinky.app.flinksql.Submitter [] - Start Monitor Job
2025-02-25 16:08:07,162 ERROR org.dinky.app.flinksql.Submitter [] - jobClient is empty, can not monitor job
2025-02-25 16:08:07,163 WARN org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap [] - Application failed unexpectedly:
java.util.concurrent.CompletionException: org.apache.flink.client.deployment.application.ApplicationExecutionException: Could not execute application.
at java.util.concurrent.CompletableFuture.encodeThrowable(Unknown Source) ~[?:?]
at java.util.concurrent.CompletableFuture.completeThrowable(Unknown Source) ~[?:?]
at java.util.concurrent.CompletableFuture$UniCompose.tryFire(Unknown Source) ~[?:?]
at java.util.concurrent.CompletableFuture.postComplete(Unknown Source) ~[?:?]
at java.util.concurrent.CompletableFuture.completeExceptionally(Unknown Source) ~[?:?]
at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:337) ~[flink-dist-1.18.1.jar:1.18.1]
at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.lambda$runApplicationAsync$2(ApplicationDispatcherBootstrap.java:254) ~[flink-dist-1.18.1.jar:1.18.1]
at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[?:?]
at java.util.concurrent.FutureTask.run(Unknown Source) ~[?:?]
at org.apache.flink.runtime.concurrent.pekko.ActorSystemScheduledExecutorAdapter$ScheduledFutureTask.run(ActorSystemScheduledExecutorAdapter.java:172) ~[?:?]
at org.apache.flink.runtime.concurrent.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:68) ~[flink-dist-1.18.1.jar:1.18.1]
at org.apache.flink.runtime.concurrent.ClassLoadingUtils.lambda$withContextClassLoader$0(ClassLoadingUtils.java:41) ~[flink-dist-1.18.1.jar:1.18.1]
at org.apache.pekko.dispatch.TaskInvocation.run(AbstractDispatcher.scala:59) [flink-rpc-akka0c08bd6d-34e4-4874-b05f-0a4330bf4a08.jar:1.18.1]
at org.apache.pekko.dispatch.ForkJoinExecutorConfigurator$PekkoForkJoinTask.exec(ForkJoinExecutorConfigurator.scala:57) [flink-rpc-akka0c08bd6d-34e4-4874-b05f-0a4330bf4a08.jar:1.18.1]
at java.util.concurrent.ForkJoinTask.doExec(Unknown Source) [?:?]
at java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(Unknown Source) [?:?]
at java.util.concurrent.ForkJoinPool.scan(Unknown Source) [?:?]
at java.util.concurrent.ForkJoinPool.runWorker(Unknown Source) [?:?]
at java.util.concurrent.ForkJoinWorkerThread.run(Unknown Source) [?:?]
Caused by: org.apache.flink.client.deployment.application.ApplicationExecutionException: Could not execute application.
... 14 more
Caused by: java.lang.NoSuchFieldError: operands
at org.apache.calcite.plan.RelOptRule.operand(RelOptRule.java:129) ~[flink-sql-connector-hive-3.1.3_2.12-1.18.1.jar:1.18.1]
at org.apache.flink.table.planner.plan.rules.logical.SimplifyFilterConditionRule.(SimplifyFilterConditionRule.scala:36) ~[flink-table-planner_2.12-1.18.1.jar:1.18.1]
at org.apache.flink.table.planner.plan.rules.logical.SimplifyFilterConditionRule$.(SimplifyFilterConditionRule.scala:94) ~[flink-table-planner_2.12-1.18.1.jar:1.18.1]
at org.apache.flink.table.planner.plan.rules.logical.SimplifyFilterConditionRule$.(SimplifyFilterConditionRule.scala) ~[flink-table-planner_2.12-1.18.1.jar:1.18.1]
at org.apache.flink.table.planner.plan.rules.FlinkStreamRuleSets$.(FlinkStreamRuleSets.scala:35) ~[flink-table-planner_2.12-1.18.1.jar:1.18.1]
at org.apache.flink.table.planner.plan.rules.FlinkStreamRuleSets$.(FlinkStreamRuleSets.scala) ~[flink-table-planner_2.12-1.18.1.jar:1.18.1]
at org.apache.flink.table.planner.plan.optimize.program.FlinkStreamProgram$.buildProgram(FlinkStreamProgram.scala:57) ~[flink-table-planner_2.12-1.18.1.jar:1.18.1]
at org.apache.flink.table.planner.plan.optimize.StreamCommonSubGraphBasedOptimizer.$anonfun$optimizeTree$1(StreamCommonSubGraphBasedOptimizer.scala:169) ~[flink-table-planner_2.12-1.18.1.jar:1.18.1]
at scala.Option.getOrElse(Option.scala:121) ~[flink-scala_2.12-1.18.1.jar:1.18.1]
at org.apache.flink.table.planner.plan.optimize.StreamCommonSubGraphBasedOptimizer.optimizeTree(StreamCommonSubGraphBasedOptimizer.scala:169) ~[flink-table-planner_2.12-1.18.1.jar:1.18.1]
at org.apache.flink.table.planner.plan.optimize.StreamCommonSubGraphBasedOptimizer.doOptimize(StreamCommonSubGraphBasedOptimizer.scala:83) ~[flink-table-planner_2.12-1.18.1.jar:1.18.1]
at org.apache.flink.table.planner.plan.optimize.CommonSubGraphBasedOptimizer.optimize(CommonSubGraphBasedOptimizer.scala:87) ~[flink-table-planner_2.12-1.18.1.jar:1.18.1]
at org.apache.flink.table.planner.delegation.PlannerBase.optimize(PlannerBase.scala:324) ~[flink-table-planner_2.12-1.18.1.jar:1.18.1]
at org.apache.flink.table.planner.delegation.PlannerBase.translate(PlannerBase.scala:182) ~[flink-table-planner_2.12-1.18.1.jar:1.18.1]
at org.apache.flink.table.api.internal.TableEnvironmentImpl.translate(TableEnvironmentImpl.java:1277) ~[flink-table-api-java-uber-1.18.1.jar:1.18.1]
at org.apache.flink.table.api.internal.TableEnvironmentImpl.executeInternal(TableEnvironmentImpl.java:862) ~[flink-table-api-java-uber-1.18.1.jar:1.18.1]
at org.dinky.executor.DefaultTableEnvironmentInternal.executeInternal(DefaultTableEnvironmentInternal.java:69) ~[?:?]
at org.dinky.executor.CustomTableEnvironmentImpl.executeStatementSet(CustomTableEnvironmentImpl.java:271) ~[?:?]
at org.dinky.executor.Executor.executeStatements(Executor.java:364) ~[?:?]
at org.dinky.job.runner.JobSqlRunner.execute(JobSqlRunner.java:87) ~[?:?]
at org.dinky.app.flinksql.Submitter.executeJob(Submitter.java:322) ~[?:?]
at org.dinky.app.flinksql.Submitter.submit(Submitter.java:144) ~[?:?]
at org.dinky.app.MainApp.main(MainApp.java:53) ~[?:?]
at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?]
at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) ~[?:?]
at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) ~[?:?]
at java.lang.reflect.Method.invoke(Unknown Source) ~[?:?]
at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355) ~[flink-dist-1.18.1.jar:1.18.1]
at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222) ~[flink-dist-1.18.1.jar:1.18.1]
at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:105) ~[flink-dist-1.18.1.jar:1.18.1]
at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:301) ~[flink-dist-1.18.1.jar:1.18.1]
... 13 more
2025-02-25 16:08:07,168 ERROR org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Fatal error occurred in the cluster entrypoint.
java.util.concurrent.CompletionException: org.apache.flink.client.deployment.application.ApplicationExecutionException: Could not execute application.
at java.util.concurrent.CompletableFuture.encodeThrowable(Unknown Source) ~[?:?]
at java.util.concurrent.CompletableFuture.completeThrowable(Unknown Source) ~[?:?]
at java.util.concurrent.CompletableFuture$UniCompose.tryFire(Unknown Source) ~[?:?]
at java.util.concurrent.CompletableFuture.postComplete(Unknown Source) ~[?:?]
at java.util.concurrent.CompletableFuture.completeExceptionally(Unknown Source) ~[?:?]
at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:337) ~[flink-dist-1.18.1.jar:1.18.1]
at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.lambda$runApplicationAsync$2(ApplicationDispatcherBootstrap.java:254) ~[flink-dist-1.18.1.jar:1.18.1]
at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[?:?]
at java.util.concurrent.FutureTask.run(Unknown Source) ~[?:?]
at org.apache.flink.runtime.concurrent.pekko.ActorSystemScheduledExecutorAdapter$ScheduledFutureTask.run(ActorSystemScheduledExecutorAdapter.java:172) ~[?:?]
at org.apache.flink.runtime.concurrent.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:68) ~[flink-dist-1.18.1.jar:1.18.1]
at org.apache.flink.runtime.concurrent.ClassLoadingUtils.lambda$withContextClassLoader$0(ClassLoadingUtils.java:41) ~[flink-dist-1.18.1.jar:1.18.1]
at org.apache.pekko.dispatch.TaskInvocation.run(AbstractDispatcher.scala:59) [flink-rpc-akka0c08bd6d-34e4-4874-b05f-0a4330bf4a08.jar:1.18.1]
at org.apache.pekko.dispatch.ForkJoinExecutorConfigurator$PekkoForkJoinTask.exec(ForkJoinExecutorConfigurator.scala:57) [flink-rpc-akka0c08bd6d-34e4-4874-b05f-0a4330bf4a08.jar:1.18.1]
at java.util.concurrent.ForkJoinTask.doExec(Unknown Source) [?:?]
at java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(Unknown Source) [?:?]
at java.util.concurrent.ForkJoinPool.scan(Unknown Source) [?:?]
at java.util.concurrent.ForkJoinPool.runWorker(Unknown Source) [?:?]
at java.util.concurrent.ForkJoinWorkerThread.run(Unknown Source) [?:?]
Caused by: org.apache.flink.client.deployment.application.ApplicationExecutionException: Could not execute application.
... 14 more
Caused by: java.lang.NoSuchFieldError: operands
at org.apache.calcite.plan.RelOptRule.operand(RelOptRule.java:129) ~[flink-sql-connector-hive-3.1.3_2.12-1.18.1.jar:1.18.1]
at org.apache.flink.table.planner.plan.rules.logical.SimplifyFilterConditionRule.(SimplifyFilterConditionRule.scala:36) ~[flink-table-planner_2.12-1.18.1.jar:1.18.1]
at org.apache.flink.table.planner.plan.rules.logical.SimplifyFilterConditionRule$.(SimplifyFilterConditionRule.scala:94) ~[flink-table-planner_2.12-1.18.1.jar:1.18.1]
at org.apache.flink.table.planner.plan.rules.logical.SimplifyFilterConditionRule$.(SimplifyFilterConditionRule.scala) ~[flink-table-planner_2.12-1.18.1.jar:1.18.1]
at org.apache.flink.table.planner.plan.rules.FlinkStreamRuleSets$.(FlinkStreamRuleSets.scala:35) ~[flink-table-planner_2.12-1.18.1.jar:1.18.1]
at org.apache.flink.table.planner.plan.rules.FlinkStreamRuleSets$.(FlinkStreamRuleSets.scala) ~[flink-table-planner_2.12-1.18.1.jar:1.18.1]
at org.apache.flink.table.planner.plan.optimize.program.FlinkStreamProgram$.buildProgram(FlinkStreamProgram.scala:57) ~[flink-table-planner_2.12-1.18.1.jar:1.18.1]
at org.apache.flink.table.planner.plan.optimize.StreamCommonSubGraphBasedOptimizer.$anonfun$optimizeTree$1(StreamCommonSubGraphBasedOptimizer.scala:169) ~[flink-table-planner_2.12-1.18.1.jar:1.18.1]
at scala.Option.getOrElse(Option.scala:121) ~[flink-scala_2.12-1.18.1.jar:1.18.1]
at org.apache.flink.table.planner.plan.optimize.StreamCommonSubGraphBasedOptimizer.optimizeTree(StreamCommonSubGraphBasedOptimizer.scala:169) ~[flink-table-planner_2.12-1.18.1.jar:1.18.1]
at org.apache.flink.table.planner.plan.optimize.StreamCommonSubGraphBasedOptimizer.doOptimize(StreamCommonSubGraphBasedOptimizer.scala:83) ~[flink-table-planner_2.12-1.18.1.jar:1.18.1]
at org.apache.flink.table.planner.plan.optimize.CommonSubGraphBasedOptimizer.optimize(CommonSubGraphBasedOptimizer.scala:87) ~[flink-table-planner_2.12-1.18.1.jar:1.18.1]
at org.apache.flink.table.planner.delegation.PlannerBase.optimize(PlannerBase.scala:324) ~[flink-table-planner_2.12-1.18.1.jar:1.18.1]
at org.apache.flink.table.planner.delegation.PlannerBase.translate(PlannerBase.scala:182) ~[flink-table-planner_2.12-1.18.1.jar:1.18.1]
at org.apache.flink.table.api.internal.TableEnvironmentImpl.translate(TableEnvironmentImpl.java:1277) ~[flink-table-api-java-uber-1.18.1.jar:1.18.1]
at org.apache.flink.table.api.internal.TableEnvironmentImpl.executeInternal(TableEnvironmentImpl.java:862) ~[flink-table-api-java-uber-1.18.1.jar:1.18.1]
at org.dinky.executor.DefaultTableEnvironmentInternal.executeInternal(DefaultTableEnvironmentInternal.java:69) ~[?:?]
at org.dinky.executor.CustomTableEnvironmentImpl.executeStatementSet(CustomTableEnvironmentImpl.java:271) ~[?:?]
at org.dinky.executor.Executor.executeStatements(Executor.java:364) ~[?:?]
at org.dinky.job.runner.JobSqlRunner.execute(JobSqlRunner.java:87) ~[?:?]
at org.dinky.app.flinksql.Submitter.executeJob(Submitter.java:322) ~[?:?]
at org.dinky.app.flinksql.Submitter.submit(Submitter.java:144) ~[?:?]
at org.dinky.app.MainApp.main(MainApp.java:53) ~[?:?]
at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?]
at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) ~[?:?]
at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) ~[?:?]
at java.lang.reflect.Method.invoke(Unknown Source) ~[?:?]
at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355) ~[flink-dist-1.18.1.jar:1.18.1]
at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222) ~[flink-dist-1.18.1.jar:1.18.1]
at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:105) ~[flink-dist-1.18.1.jar:1.18.1]
at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:301) ~[flink-dist-1.18.1.jar:1.18.1]
... 13 more
2025-02-25 16:08:07,171 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Shutting KubernetesApplicationClusterEntrypoint down with application status UNKNOWN. Diagnostics Cluster entrypoint has been closed externally..
2025-02-25 16:08:07,348 INFO org.apache.pekko.remote.RemoteActorRefProvider$RemotingTerminator [] - Shutting down remote daemon.
2025-02-25 16:08:07,349 INFO org.apache.pekko.remote.RemoteActorRefProvider$RemotingTerminator [] - Remote daemon shut down; proceeding with flushing remote transports.
2025-02-25 16:08:07,349 INFO org.apache.pekko.actor.CoordinatedShutdown [] - Running CoordinatedShutdown with reason [ActorSystemTerminateReason]
2025-02-25 16:08:07,351 INFO org.apache.pekko.remote.RemoteActorRefProvider$RemotingTerminator [] - Shutting down remote daemon.

Anything else

怎么解决这个问题呀

Version

dev

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct
@ylhh353 ylhh353 added Bug Something isn't working Waiting for reply Waiting for reply labels Feb 25, 2025
@github-actions GitHub Actions
Copy link

Hello @ylhh353, this issue is about K8S, so I assign it to @gaoyan1998 and @zackyoungh. If you have any questions, you can comment and reply.

你好 @ylhh353, 这个 issue 是关于 K8S 的，所以我把它分配给了 @gaoyan1998 和 @zackyoungh。如有任何问题，可以评论回复。

@github-actions github-actions bot changed the title flink-sql-connector-hive-3.1.3_2.12-1.18.1.jar 与flink-table-planner_2.12-*.jar 冲突了 flink-sql-connector-hive-3.1.3_2.12-1.18.1.jar conflicts with flink-table-planner_2.12-*.jar Feb 25, 2025
@ylhh353
Copy link
Author

ylhh353 commented Feb 25, 2025

ARG FLINK_VERSION=1.18.1

FROM flink:${FLINK_VERSION}-scala_2.12
ENV FLINK_HOME=/opt/flink

COPY mysql-connector-java-8.0.28.jar $FLINK_HOME/lib/
COPY dinky-app-1.18-1.2.1-jar-with-dependencies.jar /opt/dinky/jar/
COPY paimon-flink-1.18-1.0.1.jar $FLINK_HOME/lib/
COPY alluxio-2.6.1-client.jar $FLINK_HOME/lib/
COPY hiveConf $FLINK_HOME/hiveConf

RUN rm -rf /opt/flink/lib/flink-table-planner-loader-.jar
RUN mv /opt/flink/opt/flink-table-planner_2.12-.jar /opt/flink/lib
RUN mkdir /opt/flink/plugins/s3-fs-hadoop ;
cp /opt/flink/opt/flink-s3-fs-hadoop-1.18.1.jar /opt/flink/plugins/s3-fs-hadoop/ ;
# 更改 s3-fs-hadoop 目录的所有者和所属组为 flink
chown -R flink:flink $FLINK_HOME/plugins/s3-fs-hadoop

COPY flink-sql-connector-hive-3.1.3_2.12-1.18.1.jar $FLINK_HOME/lib/ 我加了这个jar,就报以上的错误，可以问一下，怎么解决的呀，

@aiwenmo aiwenmo removed the Waiting for reply Waiting for reply label Mar 1, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@gaoyan1998 gaoyan1998

@zackyoungh zackyoungh

Labels
Bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@aiwenmo @gaoyan1998 @ylhh353 @zackyoungh