Hi 这个看上去是提交到 Yarn 了,具体的原因需要看下 JM log 是啥原因。另外是否是日志没有贴全,这里只看到本地 log,其他的就只有小部分 jobmanager.err 的 log。
Best, Congxian Zhou Zach <[email protected]> 于2020年7月9日周四 下午9:23写道: > hi all, > 原来用1.10使用per job模式,可以提交的作业,现在用1.11使用应用模式提交失败,看日志,也不清楚原因, > yarn log: > Log Type: jobmanager.err > > > Log Upload Time: Thu Jul 09 21:02:48 +0800 2020 > > > Log Length: 785 > > > SLF4J: Class path contains multiple SLF4J bindings. > SLF4J: Found binding in > [jar:file:/yarn/nm/usercache/hdfs/appcache/application_1594271580406_0010/filecache/11/data-flow-1.0.jar!/org/slf4j/impl/StaticLoggerBinder.class] > SLF4J: Found binding in > [jar:file:/opt/cloudera/parcels/CDH-6.3.2-1.cdh6.3.2.p0.1605554/jars/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an > explanation. > SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] > log4j:WARN No appenders could be found for logger > (org.apache.flink.runtime.entrypoint.ClusterEntrypoint). > log4j:WARN Please initialize the log4j system properly. > log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for > more info. > > > Log Type: jobmanager.out > > > Log Upload Time: Thu Jul 09 21:02:48 +0800 2020 > > > Log Length: 0 > > > > > Log Type: prelaunch.err > > > Log Upload Time: Thu Jul 09 21:02:48 +0800 2020 > > > Log Length: 0 > > > > > Log Type: prelaunch.out > > > Log Upload Time: Thu Jul 09 21:02:48 +0800 2020 > > > Log Length: 70 > > > Setting up env variables > Setting up job resources > Launching container > > > > > > > > > 本地log: > 2020-07-09 21:02:41,015 INFO org.apache.flink.client.cli.CliFrontend > [] - > -------------------------------------------------------------------------------- > 2020-07-09 21:02:41,020 INFO > org.apache.flink.configuration.GlobalConfiguration [] - Loading > configuration property: jobmanager.rpc.address, localhost > 2020-07-09 21:02:41,020 INFO > org.apache.flink.configuration.GlobalConfiguration [] - Loading > configuration property: jobmanager.rpc.port, 6123 > 2020-07-09 21:02:41,021 INFO > org.apache.flink.configuration.GlobalConfiguration [] - Loading > configuration property: jobmanager.memory.process.size, 1600m > 2020-07-09 21:02:41,021 INFO > org.apache.flink.configuration.GlobalConfiguration [] - Loading > configuration property: taskmanager.memory.process.size, 1728m > 2020-07-09 21:02:41,021 INFO > org.apache.flink.configuration.GlobalConfiguration [] - Loading > configuration property: taskmanager.numberOfTaskSlots, 1 > 2020-07-09 21:02:41,021 INFO > org.apache.flink.configuration.GlobalConfiguration [] - Loading > configuration property: parallelism.default, 1 > 2020-07-09 21:02:41,021 INFO > org.apache.flink.configuration.GlobalConfiguration [] - Loading > configuration property: jobmanager.execution.failover-strategy, region > 2020-07-09 21:02:41,164 INFO > org.apache.flink.runtime.security.modules.HadoopModule [] - Hadoop > user set to hdfs (auth:SIMPLE) > 2020-07-09 21:02:41,172 INFO > org.apache.flink.runtime.security.modules.JaasModule [] - Jaas file > will be created as /tmp/jaas-2213111423022415421.conf. > 2020-07-09 21:02:41,181 INFO org.apache.flink.client.cli.CliFrontend > [] - Running 'run-application' command. > 2020-07-09 21:02:41,194 INFO > org.apache.flink.client.deployment.application.cli.ApplicationClusterDeployer > [] - Submitting application in 'Application Mode'. > 2020-07-09 21:02:41,201 WARN > org.apache.flink.yarn.configuration.YarnLogConfigUtil [] - The > configuration directory ('/opt/flink-1.11.0/conf') already contains a LOG4J > config file.If you want to use logback, then please delete or rename the > log configuration file. > 2020-07-09 21:02:41,537 INFO org.apache.flink.yarn.YarnClusterDescriptor > [] - No path for the flink jar passed. Using the location > of class org.apache.flink.yarn.YarnClusterDescriptor to locate the jar > 2020-07-09 21:02:41,665 INFO > org.apache.hadoop.yarn.client.ConfiguredRMFailoverProxyProvider [] - > Failing over to rm220 > 2020-07-09 21:02:41,717 INFO org.apache.hadoop.conf.Configuration > [] - resource-types.xml not found > 2020-07-09 21:02:41,718 INFO > org.apache.hadoop.yarn.util.resource.ResourceUtils [] - Unable to > find 'resource-types.xml'. > 2020-07-09 21:02:41,755 INFO org.apache.flink.yarn.YarnClusterDescriptor > [] - Cluster specification: > ClusterSpecification{masterMemoryMB=2048, taskManagerMemoryMB=4096, > slotsPerTaskManager=1} > 2020-07-09 21:02:42,723 INFO org.apache.flink.yarn.YarnClusterDescriptor > [] - Submitting application master > application_1594271580406_0010 > 2020-07-09 21:02:42,969 INFO > org.apache.hadoop.yarn.client.api.impl.YarnClientImpl [] - Submitted > application application_1594271580406_0010 > 2020-07-09 21:02:42,969 INFO org.apache.flink.yarn.YarnClusterDescriptor > [] - Waiting for the cluster to be allocated > 2020-07-09 21:02:42,971 INFO org.apache.flink.yarn.YarnClusterDescriptor > [] - Deploying cluster, current state ACCEPTED > 2020-07-09 21:02:47,619 INFO org.apache.flink.yarn.YarnClusterDescriptor > [] - YARN application has been deployed successfully. > 2020-07-09 21:02:47,620 INFO org.apache.flink.yarn.YarnClusterDescriptor > [] - Found Web Interface cdh003:38716 of application > 'application_1594271580406_0010'
