Re: Re: flink1.14.5 sql-client 运行在yarn-session模式提交任务报错
Hi,
根据上面的异常栈信息，你可以检查一下是否配置了cluster id，在yarn里配置项是`yarn.application.id`
Best,
Shammon FY
On Sat, Jul 15, 2023 at 6:50 PM 杨东树 wrote:
> 您好，
>针对sql-client运行在yarn-session模式报错，现补充相关日志报错信息：
> 2023-07-15 18:43:21,503 INFO org.apache.flink.table.client.cli.CliClient
> [] - Command history file path: /root/.flink-sql-history
> 2023-07-15 18:43:28,225 INFO
> org.apache.flink.table.catalog.CatalogManager[] - Set the
> current default database as [flink] in the current default catalog [myhive].
> 2023-07-15 18:43:38,410 WARN
> org.apache.flink.connector.kafka.source.KafkaSourceBuilder [] - Offset
> commit on checkpoint is disabled because group.id is not specified
> 2023-07-15 18:43:39,986 WARN
> org.apache.flink.connector.kafka.source.KafkaSourceBuilder [] - Offset
> commit on checkpoint is disabled because group.id is not specified
> 2023-07-15 18:43:40,605 WARN
> org.apache.flink.yarn.configuration.YarnLogConfigUtil[] - The
> configuration directory ('/usr/local/flink-1.14.5/conf') already contains a
> LOG4J config file.If you want to use logback, then please delete or rename
> the log configuration file.
> 2023-07-15 18:43:40,676 INFO org.apache.hadoop.yarn.client.RMProxy
> [] - Connecting to ResourceManager at /0.0.0.0:8032
> 2023-07-15 18:43:40,788 INFO org.apache.flink.yarn.YarnClusterDescriptor
> [] - No path for the flink jar passed. Using the location
> of class org.apache.flink.yarn.YarnClusterDescriptor to locate the jar
> 2023-07-15 18:43:40,791 WARN org.apache.flink.table.client.cli.CliClient
> [] - Could not execute SQL statement.
> org.apache.flink.table.client.gateway.SqlExecutionException: Could not
> execute SQL statement.
> at
> org.apache.flink.table.client.gateway.local.LocalExecutor.executeModifyOperations(LocalExecutor.java:224)
> ~[flink-sql-client_2.11-1.14.5.jar:1.14.5]
> at
> org.apache.flink.table.client.cli.CliClient.callInserts(CliClient.java:571)
> ~[flink-sql-client_2.11-1.14.5.jar:1.14.5]
> at
> org.apache.flink.table.client.cli.CliClient.callInsert(CliClient.java:560)
> ~[flink-sql-client_2.11-1.14.5.jar:1.14.5]
> at
> org.apache.flink.table.client.cli.CliClient.callOperation(CliClient.java:420)
> ~[flink-sql-client_2.11-1.14.5.jar:1.14.5]
> at
> org.apache.flink.table.client.cli.CliClient.lambda$executeStatement$1(CliClient.java:332)
> [flink-sql-client_2.11-1.14.5.jar:1.14.5]
> at java.util.Optional.ifPresent(Optional.java:159) ~[?:1.8.0_231]
> at
> org.apache.flink.table.client.cli.CliClient.executeStatement(CliClient.java:325)
> [flink-sql-client_2.11-1.14.5.jar:1.14.5]
> at
> org.apache.flink.table.client.cli.CliClient.executeInteractive(CliClient.java:297)
> [flink-sql-client_2.11-1.14.5.jar:1.14.5]
> at
> org.apache.flink.table.client.cli.CliClient.executeInInteractiveMode(CliClient.java:221)
> [flink-sql-client_2.11-1.14.5.jar:1.14.5]
> at
> org.apache.flink.table.client.SqlClient.openCli(SqlClient.java:151)
> [flink-sql-client_2.11-1.14.5.jar:1.14.5]
> at
> org.apache.flink.table.client.SqlClient.start(SqlClient.java:95)
> [flink-sql-client_2.11-1.14.5.jar:1.14.5]
> at
> org.apache.flink.table.client.SqlClient.startClient(SqlClient.java:187)
> [flink-sql-client_2.11-1.14.5.jar:1.14.5]
> at
> org.apache.flink.table.client.SqlClient.main(SqlClient.java:161)
> [flink-sql-client_2.11-1.14.5.jar:1.14.5]
> Caused by: org.apache.flink.table.api.TableException: Failed to execute sql
> at
> org.apache.flink.table.api.internal.TableEnvironmentImpl.executeInternal(TableEnvironmentImpl.java:791)
> ~[flink-table_2.11-1.14.5.jar:1.14.5]
> at
> org.apache.flink.table.api.internal.TableEnvironmentImpl.executeInternal(TableEnvironmentImpl.java:754)
> ~[flink-table_2.11-1.14.5.jar:1.14.5]
> at
> org.apache.flink.table.client.gateway.local.LocalExecutor.lambda$executeModifyOperations$4(LocalExecutor.java:222)
> ~[flink-sql-client_2.11-1.14.5.jar:1.14.5]
> at
> org.apache.flink.table.client.gateway.context.ExecutionContext.wrapClassLoader(ExecutionContext.java:88)
> ~[flink-sql-client_2.11-1.14.5.jar:1.14.5]
> at
> org.apache.flink.table.client.gateway.local.LocalExecutor.executeModifyOperations(LocalExecutor.java:222)
> ~[flink-sql-client_2.11-1.14.5.jar:1.14.5]
> ... 12 more
> Caused by: java.lang.IllegalStateException
> at
> org.apache.flink.util.Preconditions.checkState(Preconditions.java:177)
> ~[flink-dist_2.11-1.14.5.jar:1.14.5]
> at
> org.apache.flink.client.deployment.executors.AbstractSessionClusterExecutor.execute(AbstractSessionClusterExecutor.java:72)
> ~[flink-clients_2.11-1.14.5.jar:1.14.5]
> at
> org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.executeAsync(StreamExecutionEnvironment.java:2042)
> ~[flink-dist_2.11-1.14.5.jar:1.14.5]
> at
>
Re:Re: flink1.14.5 sql-client 运行在yarn-session模式提交任务报错
您好，
针对sql-client运行在yarn-session模式报错，现补充相关日志报错信息：
2023-07-15 18:43:21,503 INFO org.apache.flink.table.client.cli.CliClient
[] - Command history file path: /root/.flink-sql-history
2023-07-15 18:43:28,225 INFO org.apache.flink.table.catalog.CatalogManager
[] - Set the current default database as [flink] in the current
default catalog [myhive].
2023-07-15 18:43:38,410 WARN
org.apache.flink.connector.kafka.source.KafkaSourceBuilder [] - Offset commit
on checkpoint is disabled because group.id is not specified
2023-07-15 18:43:39,986 WARN
org.apache.flink.connector.kafka.source.KafkaSourceBuilder [] - Offset commit
on checkpoint is disabled because group.id is not specified
2023-07-15 18:43:40,605 WARN
org.apache.flink.yarn.configuration.YarnLogConfigUtil[] - The
configuration directory ('/usr/local/flink-1.14.5/conf') already contains a
LOG4J config file.If you want to use logback, then please delete or rename the
log configuration file.
2023-07-15 18:43:40,676 INFO org.apache.hadoop.yarn.client.RMProxy
[] - Connecting to ResourceManager at /0.0.0.0:8032
2023-07-15 18:43:40,788 INFO org.apache.flink.yarn.YarnClusterDescriptor
[] - No path for the flink jar passed. Using the location of class
org.apache.flink.yarn.YarnClusterDescriptor to locate the jar
2023-07-15 18:43:40,791 WARN org.apache.flink.table.client.cli.CliClient
[] - Could not execute SQL statement.
org.apache.flink.table.client.gateway.SqlExecutionException: Could not execute
SQL statement.
at
org.apache.flink.table.client.gateway.local.LocalExecutor.executeModifyOperations(LocalExecutor.java:224)
~[flink-sql-client_2.11-1.14.5.jar:1.14.5]
at
org.apache.flink.table.client.cli.CliClient.callInserts(CliClient.java:571)
~[flink-sql-client_2.11-1.14.5.jar:1.14.5]
at
org.apache.flink.table.client.cli.CliClient.callInsert(CliClient.java:560)
~[flink-sql-client_2.11-1.14.5.jar:1.14.5]
at
org.apache.flink.table.client.cli.CliClient.callOperation(CliClient.java:420)
~[flink-sql-client_2.11-1.14.5.jar:1.14.5]
at
org.apache.flink.table.client.cli.CliClient.lambda$executeStatement$1(CliClient.java:332)
[flink-sql-client_2.11-1.14.5.jar:1.14.5]
at java.util.Optional.ifPresent(Optional.java:159) ~[?:1.8.0_231]
at
org.apache.flink.table.client.cli.CliClient.executeStatement(CliClient.java:325)
[flink-sql-client_2.11-1.14.5.jar:1.14.5]
at
org.apache.flink.table.client.cli.CliClient.executeInteractive(CliClient.java:297)
[flink-sql-client_2.11-1.14.5.jar:1.14.5]
at
org.apache.flink.table.client.cli.CliClient.executeInInteractiveMode(CliClient.java:221)
[flink-sql-client_2.11-1.14.5.jar:1.14.5]
at org.apache.flink.table.client.SqlClient.openCli(SqlClient.java:151)
[flink-sql-client_2.11-1.14.5.jar:1.14.5]
at org.apache.flink.table.client.SqlClient.start(SqlClient.java:95)
[flink-sql-client_2.11-1.14.5.jar:1.14.5]
at
org.apache.flink.table.client.SqlClient.startClient(SqlClient.java:187)
[flink-sql-client_2.11-1.14.5.jar:1.14.5]
at org.apache.flink.table.client.SqlClient.main(SqlClient.java:161)
[flink-sql-client_2.11-1.14.5.jar:1.14.5]
Caused by: org.apache.flink.table.api.TableException: Failed to execute sql
at
org.apache.flink.table.api.internal.TableEnvironmentImpl.executeInternal(TableEnvironmentImpl.java:791)
~[flink-table_2.11-1.14.5.jar:1.14.5]
at
org.apache.flink.table.api.internal.TableEnvironmentImpl.executeInternal(TableEnvironmentImpl.java:754)
~[flink-table_2.11-1.14.5.jar:1.14.5]
at
org.apache.flink.table.client.gateway.local.LocalExecutor.lambda$executeModifyOperations$4(LocalExecutor.java:222)
~[flink-sql-client_2.11-1.14.5.jar:1.14.5]
at
org.apache.flink.table.client.gateway.context.ExecutionContext.wrapClassLoader(ExecutionContext.java:88)
~[flink-sql-client_2.11-1.14.5.jar:1.14.5]
at
org.apache.flink.table.client.gateway.local.LocalExecutor.executeModifyOperations(LocalExecutor.java:222)
~[flink-sql-client_2.11-1.14.5.jar:1.14.5]
... 12 more
Caused by: java.lang.IllegalStateException
at
org.apache.flink.util.Preconditions.checkState(Preconditions.java:177)
~[flink-dist_2.11-1.14.5.jar:1.14.5]
at
org.apache.flink.client.deployment.executors.AbstractSessionClusterExecutor.execute(AbstractSessionClusterExecutor.java:72)
~[flink-clients_2.11-1.14.5.jar:1.14.5]
at
org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.executeAsync(StreamExecutionEnvironment.java:2042)
~[flink-dist_2.11-1.14.5.jar:1.14.5]
at
org.apache.flink.table.planner.delegation.DefaultExecutor.executeAsync(DefaultExecutor.java:95)
~[flink-table_2.11-1.14.5.jar:1.14.5]
at
org.apache.flink.table.api.internal.TableEnvironmentImpl.executeInternal(TableEnvironmentImpl.java:773)
Re: flink1.14.5 sql-client 运行在yarn-session模式提交任务报错
Hi, 邮件里的图片看不到 Best, Shammon FY On Sun, Jul 9, 2023 at 7:30 PM 杨东树 wrote: > 各位好， >目前我在使用flink1.14.5版本的sql-client on > yarn-session模式时，发现无法正常执行sql任务，日志报如下错误，希望能得到指导，谢谢： >背景信息： >1、当flink配置execution.target: > yarn-per-job时，随后进入sql-client执行sql任务，可正常执行。 >2、当flink配置execution.target: yarn-session，并启动flink > yarn-session集群，随后进入sql-client执行同样的sql任务，报上图中的错误。 >
flink1.14.5 sql-client 运行在yarn-session模式提交任务报错
各位好， 目前我在使用flink1.14.5版本的sql-client on yarn-session模式时，发现无法正常执行sql任务，日志报如下错误，希望能得到指导，谢谢： 背景信息： 1、当flink配置execution.target: yarn-per-job时，随后进入sql-client执行sql任务，可正常执行。 2、当flink配置execution.target: yarn-session，并启动flink yarn-session集群，随后进入sql-client执行同样的sql任务，报上图中的错误。
