Thank you, Jesse. Here are more log info:
2020-07-15 18:19:36,456 INFO org.apache.flink.client.cli.CliFrontend - -------------------------------------------------------------------------------- 2020-07-15 18:19:36,460 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.address, localhost 2020-07-15 18:19:36,460 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.port, 6123 2020-07-15 18:19:36,460 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.heap.size, 1024m 2020-07-15 18:19:36,460 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.heap.size, 1024m 2020-07-15 18:19:36,460 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.numberOfTaskSlots, 1 2020-07-15 18:19:36,460 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: parallelism.default, 1 2020-07-15 18:19:36,461 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.execution.failover-strategy, region 2020-07-15 18:19:36,463 WARN org.apache.flink.client.cli.CliFrontend - Could not load CLI class org.apache.flink.yarn.cli.FlinkYarnSessionCli. java.lang.NoClassDefFoundError: org/apache/hadoop/yarn/exceptions/YarnException at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.flink.client.cli.CliFrontend.loadCustomCommandLine(CliFrontend.java:1185) at org.apache.flink.client.cli.CliFrontend.loadCustomCommandLines(CliFrontend.java:1145) at org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:1070) Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.yarn.exceptions.YarnException at java.net.URLClassLoader.findClass(URLClassLoader.java:382) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) ... 5 more 2020-07-15 18:19:36,519 INFO org.apache.flink.core.fs.FileSystem - Hadoop is not in the classpath/dependencies. The extended set of supported File Systems via Hadoop is not availab\ le. 2020-07-15 18:19:36,647 INFO org.apache.flink.runtime.security.modules.HadoopModuleFactory - Cannot create Hadoop Security Module because Hadoop cannot be found in the Classpath. 2020-07-15 18:19:36,658 INFO org.apache.flink.runtime.security.SecurityUtils - Cannot install HadoopSecurityContext because Hadoop cannot be found in the Classpath. Best regards Rainie On Wed, Jul 15, 2020 at 11:49 AM Jesse Lord <jl...@vectra.ai> wrote: > Hi Rainie, > > > > I am relatively new to flink, but I suspect that your error is somewhere > else in the log. I have found most of my problems by doing a search for the > word “error” or “exception”. Since all of these log lines are at the info > level, they are probably not highlighting any real issues. If you send more > of the log or find an error line that might help others debug. > > > > Thanks, > > Jesse > > > > *From: *Rainie Li <raini...@pinterest.com> > *Date: *Wednesday, July 15, 2020 at 10:54 AM > *To: *"user@flink.apache.org" <user@flink.apache.org> > *Subject: *flink app crashed > > > > Hi All, > > > > I am new to Flink, any idea why flink app's Job Manager stuck, here is > bottom part from the Job Manager log. Any suggestion will be appreciated. > > 2020-07-15 16:49:52,749 INFO > org.apache.flink.runtime.rpc.akka.AkkaRpcService - Starting RPC endpoint > for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at > akka://flink/user/dispatcher . > > 2020-07-15 16:49:52,759 INFO > org.apache.flink.runtime.leaderretrieval.ZooKeeperLeaderRetrievalService - > Starting ZooKeeperLeaderRetrievalService /leader/resource_manager_lock. > > 2020-07-15 16:49:52,759 INFO > org.apache.flink.runtime.leaderretrieval.ZooKeeperLeaderRetrievalService - > Starting ZooKeeperLeaderRetrievalService /leader/dispatcher_lock. > > 2020-07-15 16:49:52,762 INFO > org.apache.flink.runtime.leaderelection.ZooKeeperLeaderElectionService - > Starting ZooKeeperLeaderElectionService > ZooKeeperLeaderElectionService{leaderPath='/leader/dispatcher_lock'}. > > 2020-07-15 16:49:52,790 INFO > org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Dispatcher > /user/dispatcher was granted leadership with fencing token > > 2020-07-15 16:49:52,791 INFO > org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Recovering all > persisted jobs. > > 2020-07-15 16:49:52,931 INFO > org.apache.hadoop.yarn.client.ConfiguredRMFailoverProxyProvider - Failing > over to rm1 > > 2020-07-15 16:49:53,014 INFO org.apache.flink.yarn.YarnResourceManager - > Recovered 0 containers from previous attempts ([]). > > 2020-07-15 16:49:53,018 INFO > org.apache.hadoop.yarn.client.api.async.impl.NMClientAsyncImpl - Upper > bound of the thread pool size is 500 > > 2020-07-15 16:49:53,020 INFO > org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy - > yarn.client.max-cached-nodemanagers-proxies : 0 > > 2020-07-15 16:49:53,021 INFO > org.apache.flink.runtime.leaderelection.ZooKeeperLeaderElectionService - > Starting ZooKeeperLeaderElectionService > ZooKeeperLeaderElectionService{leaderPath='/leader/resource_manager_lock'}. > > 2020-07-15 16:49:53,042 INFO org.apache.flink.yarn.YarnResourceManager - > ResourceManager akka.tcp://flink@cluster-dev-001/user/resourcemanager was > granted leadership with fencing token > > 2020-07-15 16:49:53,046 INFO > org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl - > Starting the SlotManager. > > 2020-07-15 16:50:52,217 INFO org.apache.kafka.clients.Metadata - Cluster > ID: FZrfSqHiTpaZwEzIRYkCLQ > > > > > > Thanks > > Best regards > > Rainie >