[
https://issues.apache.org/jira/browse/FLINK-8485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16337852#comment-16337852
]
Xuan Nguyen commented on FLINK-8485:
------------------------------------
Hi [~till.rohrmann] and [~StephanEwen]
# I generated the quickstart using:
{code:java}
mvn archetype:generate -DarchetypeGroupId=org.apache.flink
-DarchetypeArtifactId=flink-quickstart-java -DarchetypeVersion=1.4.0{code}
# Opened the project in Intellij
# Ran the WordCount inside Intellij
Here is my log with
*log4j.logger.org.apache.flink.runtime.jobmanager.JobManager=trace* debugger on:
{code}
/usr/lib/jvm/java-8-oracle/bin/java
-javaagent:/home/xuan/java/idea/lib/idea_rt.jar=36285:/home/xuan/java/idea/bin
-Dfile.encoding=UTF-8 -classpath
/usr/lib/jvm/java-8-oracle/jre/lib/charsets.jar:/usr/lib/jvm/java-8-oracle/jre/lib/deploy.jar:/usr/lib/jvm/java-8-oracle/jre/lib/ext/cldrdata.jar:/usr/lib/jvm/java-8-oracle/jre/lib/ext/dnsns.jar:/usr/lib/jvm/java-8-oracle/jre/lib/ext/jaccess.jar:/usr/lib/jvm/java-8-oracle/jre/lib/ext/jfxrt.jar:/usr/lib/jvm/java-8-oracle/jre/lib/ext/localedata.jar:/usr/lib/jvm/java-8-oracle/jre/lib/ext/nashorn.jar:/usr/lib/jvm/java-8-oracle/jre/lib/ext/sunec.jar:/usr/lib/jvm/java-8-oracle/jre/lib/ext/sunjce_provider.jar:/usr/lib/jvm/java-8-oracle/jre/lib/ext/sunpkcs11.jar:/usr/lib/jvm/java-8-oracle/jre/lib/ext/zipfs.jar:/usr/lib/jvm/java-8-oracle/jre/lib/javaws.jar:/usr/lib/jvm/java-8-oracle/jre/lib/jce.jar:/usr/lib/jvm/java-8-oracle/jre/lib/jfr.jar:/usr/lib/jvm/java-8-oracle/jre/lib/jfxswt.jar:/usr/lib/jvm/java-8-oracle/jre/lib/jsse.jar:/usr/lib/jvm/java-8-oracle/jre/lib/management-agent.jar:/usr/lib/jvm/java-8-oracle/jre/lib/plugin.jar:/usr/lib/jvm/java-8-oracle/jre/lib/resources.jar:/usr/lib/jvm/java-8-oracle/jre/lib/rt.jar:/home/xuan/git/test/oracle-flink/target/classes:/home/xuan/.m2/repository/org/apache/flink/flink-core/1.4.0/flink-core-1.4.0.jar:/home/xuan/.m2/repository/org/apache/flink/flink-annotations/1.4.0/flink-annotations-1.4.0.jar:/home/xuan/.m2/repository/org/apache/flink/flink-metrics-core/1.4.0/flink-metrics-core-1.4.0.jar:/home/xuan/.m2/repository/org/apache/flink/flink-shaded-asm/5.0.4-2.0/flink-shaded-asm-5.0.4-2.0.jar:/home/xuan/.m2/repository/org/apache/commons/commons-lang3/3.3.2/commons-lang3-3.3.2.jar:/home/xuan/.m2/repository/com/esotericsoftware/kryo/kryo/2.24.0/kryo-2.24.0.jar:/home/xuan/.m2/repository/com/esotericsoftware/minlog/minlog/1.2/minlog-1.2.jar:/home/xuan/.m2/repository/org/objenesis/objenesis/2.1/objenesis-2.1.jar:/home/xuan/.m2/repository/commons-collections/commons-collections/3.2.2/commons-collections-3.2.2.jar:/home/xuan/.m2/repository/org/apache/commons/commons-compress/1.4.1/commons-compress-1.4.1.jar:/home/xuan/.m2/repository/org/tukaani/xz/1.0/xz-1.0.jar:/home/xuan/.m2/repository/org/xerial/snappy/snappy-java/1.1.1.3/snappy-java-1.1.1.3.jar:/home/xuan/.m2/repository/org/slf4j/slf4j-api/1.7.7/slf4j-api-1.7.7.jar:/home/xuan/.m2/repository/com/google/code/findbugs/jsr305/1.3.9/jsr305-1.3.9.jar:/home/xuan/.m2/repository/org/apache/flink/force-shading/1.4.0/force-shading-1.4.0.jar:/home/xuan/.m2/repository/org/apache/flink/flink-java/1.4.0/flink-java-1.4.0.jar:/home/xuan/.m2/repository/org/apache/commons/commons-math3/3.5/commons-math3-3.5.jar:/home/xuan/.m2/repository/org/apache/flink/flink-clients_2.11/1.4.0/flink-clients_2.11-1.4.0.jar:/home/xuan/.m2/repository/org/apache/flink/flink-runtime_2.11/1.4.0/flink-runtime_2.11-1.4.0.jar:/home/xuan/.m2/repository/org/apache/flink/flink-queryable-state-client-java_2.11/1.4.0/flink-queryable-state-client-java_2.11-1.4.0.jar:/home/xuan/.m2/repository/org/apache/flink/flink-hadoop-fs/1.4.0/flink-hadoop-fs-1.4.0.jar:/home/xuan/.m2/repository/commons-io/commons-io/2.4/commons-io-2.4.jar:/home/xuan/.m2/repository/org/apache/flink/flink-shaded-netty/4.0.27.Final-2.0/flink-shaded-netty-4.0.27.Final-2.0.jar:/home/xuan/.m2/repository/org/apache/flink/flink-shaded-jackson/2.7.9-2.0/flink-shaded-jackson-2.7.9-2.0.jar:/home/xuan/.m2/repository/org/javassist/javassist/3.18.2-GA/javassist-3.18.2-GA.jar:/home/xuan/.m2/repository/org/scala-lang/scala-library/2.11.11/scala-library-2.11.11.jar:/home/xuan/.m2/repository/com/typesafe/akka/akka-actor_2.11/2.4.20/akka-actor_2.11-2.4.20.jar:/home/xuan/.m2/repository/com/typesafe/config/1.3.0/config-1.3.0.jar:/home/xuan/.m2/repository/org/scala-lang/modules/scala-java8-compat_2.11/0.7.0/scala-java8-compat_2.11-0.7.0.jar:/home/xuan/.m2/repository/com/typesafe/akka/akka-stream_2.11/2.4.20/akka-stream_2.11-2.4.20.jar:/home/xuan/.m2/repository/org/reactivestreams/reactive-streams/1.0.0/reactive-streams-1.0.0.jar:/home/xuan/.m2/repository/com/typesafe/ssl-config-core_2.11/0.2.1/ssl-config-core_2.11-0.2.1.jar:/home/xuan/.m2/repository/org/scala-lang/modules/scala-parser-combinators_2.11/1.0.4/scala-parser-combinators_2.11-1.0.4.jar:/home/xuan/.m2/repository/com/typesafe/akka/akka-protobuf_2.11/2.4.20/akka-protobuf_2.11-2.4.20.jar:/home/xuan/.m2/repository/com/typesafe/akka/akka-slf4j_2.11/2.4.20/akka-slf4j_2.11-2.4.20.jar:/home/xuan/.m2/repository/org/clapper/grizzled-slf4j_2.11/1.0.2/grizzled-slf4j_2.11-1.0.2.jar:/home/xuan/.m2/repository/com/github/scopt/scopt_2.11/3.5.0/scopt_2.11-3.5.0.jar:/home/xuan/.m2/repository/com/twitter/chill_2.11/0.7.4/chill_2.11-0.7.4.jar:/home/xuan/.m2/repository/com/twitter/chill-java/0.7.4/chill-java-0.7.4.jar:/home/xuan/.m2/repository/org/apache/flink/flink-optimizer_2.11/1.4.0/flink-optimizer_2.11-1.4.0.jar:/home/xuan/.m2/repository/commons-cli/commons-cli/1.3.1/commons-cli-1.3.1.jar:/home/xuan/.m2/repository/org/apache/flink/flink-streaming-java_2.11/1.4.0/flink-streaming-java_2.11-1.4.0.jar:/home/xuan/.m2/repository/org/apache/flink/flink-shaded-guava/18.0-2.0/flink-shaded-guava-18.0-2.0.jar:/home/xuan/.m2/repository/org/apache/sling/org.apache.sling.commons.json/2.0.6/org.apache.sling.commons.json-2.0.6.jar:/home/xuan/.m2/repository/org/slf4j/slf4j-log4j12/1.7.7/slf4j-log4j12-1.7.7.jar:/home/xuan/.m2/repository/log4j/log4j/1.2.17/log4j-1.2.17.jar
oracle.flink.WordCount
09:09:04,771 INFO org.apache.flink.api.java.ExecutionEnvironment - The job has
0 registered types and 0 default Kryo serializers
09:09:04,779 DEBUG org.apache.flink.api.java.ExecutionEnvironment - Registered
Kryo types: []
09:09:04,780 DEBUG org.apache.flink.api.java.ExecutionEnvironment - Registered
Kryo with Serializers types: []
09:09:04,780 DEBUG org.apache.flink.api.java.ExecutionEnvironment - Registered
Kryo with Serializer Classes types: []
09:09:04,780 DEBUG org.apache.flink.api.java.ExecutionEnvironment - Registered
Kryo default Serializers: []
09:09:04,784 DEBUG org.apache.flink.api.java.ExecutionEnvironment - Registered
Kryo default Serializers Classes []
09:09:04,784 DEBUG org.apache.flink.api.java.ExecutionEnvironment - Registered
POJO types: []
09:09:04,786 DEBUG org.apache.flink.api.java.ExecutionEnvironment - Static code
analysis mode: DISABLE
09:09:06,358 INFO org.apache.flink.runtime.minicluster.FlinkMiniCluster -
Starting FlinkMiniCluster.
09:09:06,383 INFO org.apache.flink.runtime.metrics.MetricRegistryImpl - No
metrics reporter configured, no metrics will be exposed/reported.
09:09:08,832 INFO akka.event.slf4j.Slf4jLogger - Slf4jLogger started
09:09:08,872 DEBUG akka.event.EventStream - logger log1-Slf4jLogger started
09:09:08,892 DEBUG akka.event.EventStream - Default Loggers started
09:09:09,036 DEBUG org.apache.flink.runtime.jobmanager.JobManager - No archive
directory was configured. Jobs will not be archived.
09:09:09,078 INFO org.apache.flink.runtime.blob.BlobServer - Created BLOB
server storage directory /tmp/blobStore-4eb6c322-ceea-4b73-81bb-8b55705513ac
09:09:09,096 DEBUG org.apache.flink.util.NetUtils - Trying to open socket on
port 0
09:09:09,098 INFO org.apache.flink.runtime.blob.BlobServer - Started BLOB
server at 0.0.0.0:42001 - max concurrent requests: 50 - max backlog: 1000
09:09:09,470 INFO org.apache.flink.runtime.jobmanager.MemoryArchivist - Started
memory archivist akka://flink/user/archive_1
09:09:09,483 INFO org.apache.flink.runtime.jobmanager.JobManager - Starting
JobManager at akka://flink/user/jobmanager_1.
09:09:09,484 INFO
org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService
- Proposing leadership to contender
org.apache.flink.runtime.jobmanager.JobManager@4f8086ab @
akka://flink/user/jobmanager_1
09:09:09,524 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerConfiguration - Messages have
a max timeout of 10000 ms
09:09:09,527 TRACE org.apache.flink.runtime.jobmanager.JobManager - Received
message GrantLeadership(Some(47bf28f8-07c4-449e-9e1f-f437326dc9e4)) at
akka://flink/user/jobmanager_1 from
Actor[akka://flink/user/jobmanager_1#-1543801343].
09:09:09,537 INFO org.apache.flink.runtime.taskexecutor.TaskManagerServices -
Temporary file directory '/tmp': total 19 GB, usable 3 GB (15.79% usable)
09:09:09,605 INFO org.apache.flink.runtime.jobmanager.JobManager - JobManager
akka://flink/user/jobmanager_1 was granted leadership with leader session ID
Some(47bf28f8-07c4-449e-9e1f-f437326dc9e4).
09:09:09,616 TRACE org.apache.flink.runtime.jobmanager.JobManager - Handled
message GrantLeadership(Some(47bf28f8-07c4-449e-9e1f-f437326dc9e4)) in 88 ms
from Actor[akka://flink/user/jobmanager_1#-1543801343].
09:09:09,617 INFO
org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService
- Received confirmation of leadership for leader akka://flink/user/jobmanager_1
, session=47bf28f8-07c4-449e-9e1f-f437326dc9e4
09:09:10,596 DEBUG
org.apache.flink.runtime.clusterframework.standalone.StandaloneResourceManager
- Received new leading JobManager akka://flink/user/jobmanager_1. Connecting.
09:09:10,641 INFO
org.apache.flink.runtime.clusterframework.standalone.StandaloneResourceManager
- Trying to associate with JobManager leader akka://flink/user/jobmanager_1
09:09:10,681 TRACE org.apache.flink.runtime.jobmanager.JobManager - Received
message
LeaderSessionMessage(47bf28f8-07c4-449e-9e1f-f437326dc9e4,RegisterResourceManager
akka://flink/user/resourcemanager_1) at akka://flink/user/jobmanager_1 from
Actor[akka://flink/temp/$a].
09:09:10,686 DEBUG org.apache.flink.runtime.jobmanager.JobManager - Resource
manager registration: RegisterResourceManager
akka://flink/user/resourcemanager_1
09:09:10,736 TRACE org.apache.flink.runtime.jobmanager.JobManager - Handled
message
LeaderSessionMessage(47bf28f8-07c4-449e-9e1f-f437326dc9e4,RegisterResourceManager
akka://flink/user/resourcemanager_1) in 54 ms from Actor[akka://flink/temp/$a].
09:09:10,742 INFO
org.apache.flink.runtime.clusterframework.standalone.StandaloneResourceManager
- Resource Manager associating with leading JobManager
Actor[akka://flink/user/jobmanager_1#-1543801343] - leader session
47bf28f8-07c4-449e-9e1f-f437326dc9e4
09:09:12,256 INFO org.apache.flink.runtime.io.network.buffer.NetworkBufferPool
- Allocated 117 MB for network buffer pool (number of memory segments: 3771,
bytes per segment: 32768).
09:09:12,289 WARN org.apache.flink.runtime.query.QueryableStateUtils - Could
not load Queryable State Client Proxy. Probable reason:
flink-queryable-state-runtime is not in the classpath. Please put the
corresponding jar from the opt to the lib folder.
09:09:12,290 DEBUG org.apache.flink.runtime.query.QueryableStateUtils - Caught
exception
java.lang.ClassNotFoundException:
org.apache.flink.queryablestate.client.proxy.KvStateClientProxyImpl
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at
org.apache.flink.runtime.query.QueryableStateUtils.createKvStateClientProxy(QueryableStateUtils.java:67)
at
org.apache.flink.runtime.taskexecutor.TaskManagerServices.createNetworkEnvironment(TaskManagerServices.java:339)
at
org.apache.flink.runtime.taskexecutor.TaskManagerServices.fromConfiguration(TaskManagerServices.java:159)
at
org.apache.flink.runtime.minicluster.LocalFlinkMiniCluster.startTaskManager(LocalFlinkMiniCluster.scala:240)
at
org.apache.flink.runtime.minicluster.FlinkMiniCluster$$anonfun$3.apply(FlinkMiniCluster.scala:388)
at
org.apache.flink.runtime.minicluster.FlinkMiniCluster$$anonfun$3.apply(FlinkMiniCluster.scala:381)
at
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
at
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
at scala.collection.immutable.Range.foreach(Range.scala:160)
at scala.collection.TraversableLike$class.map(TraversableLike.scala:234)
at scala.collection.AbstractTraversable.map(Traversable.scala:104)
at
org.apache.flink.runtime.minicluster.FlinkMiniCluster.start(FlinkMiniCluster.scala:381)
at
org.apache.flink.runtime.minicluster.FlinkMiniCluster.start(FlinkMiniCluster.scala:323)
at org.apache.flink.client.LocalExecutor.start(LocalExecutor.java:116)
at org.apache.flink.client.LocalExecutor.executePlan(LocalExecutor.java:176)
at org.apache.flink.api.java.LocalEnvironment.execute(LocalEnvironment.java:91)
at
org.apache.flink.api.java.ExecutionEnvironment.execute(ExecutionEnvironment.java:815)
at org.apache.flink.api.java.DataSet.collect(DataSet.java:413)
at org.apache.flink.api.java.DataSet.print(DataSet.java:1652)
at oracle.flink.WordCount.main(WordCount.java:66)
09:09:12,296 WARN org.apache.flink.runtime.query.QueryableStateUtils - Could
not load Queryable State Server. Probable reason: flink-queryable-state-runtime
is not in the classpath. Please put the corresponding jar from the opt to the
lib folder.
09:09:12,297 DEBUG org.apache.flink.runtime.query.QueryableStateUtils - Caught
exception
java.lang.ClassNotFoundException:
org.apache.flink.queryablestate.server.KvStateServerImpl
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at
org.apache.flink.runtime.query.QueryableStateUtils.createKvStateServer(QueryableStateUtils.java:121)
at
org.apache.flink.runtime.taskexecutor.TaskManagerServices.createNetworkEnvironment(TaskManagerServices.java:352)
at
org.apache.flink.runtime.taskexecutor.TaskManagerServices.fromConfiguration(TaskManagerServices.java:159)
at
org.apache.flink.runtime.minicluster.LocalFlinkMiniCluster.startTaskManager(LocalFlinkMiniCluster.scala:240)
at
org.apache.flink.runtime.minicluster.FlinkMiniCluster$$anonfun$3.apply(FlinkMiniCluster.scala:388)
at
org.apache.flink.runtime.minicluster.FlinkMiniCluster$$anonfun$3.apply(FlinkMiniCluster.scala:381)
at
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
at
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
at scala.collection.immutable.Range.foreach(Range.scala:160)
at scala.collection.TraversableLike$class.map(TraversableLike.scala:234)
at scala.collection.AbstractTraversable.map(Traversable.scala:104)
at
org.apache.flink.runtime.minicluster.FlinkMiniCluster.start(FlinkMiniCluster.scala:381)
at
org.apache.flink.runtime.minicluster.FlinkMiniCluster.start(FlinkMiniCluster.scala:323)
at org.apache.flink.client.LocalExecutor.start(LocalExecutor.java:116)
at org.apache.flink.client.LocalExecutor.executePlan(LocalExecutor.java:176)
at org.apache.flink.api.java.LocalEnvironment.execute(LocalEnvironment.java:91)
at
org.apache.flink.api.java.ExecutionEnvironment.execute(ExecutionEnvironment.java:815)
at org.apache.flink.api.java.DataSet.collect(DataSet.java:413)
at org.apache.flink.api.java.DataSet.print(DataSet.java:1652)
at oracle.flink.WordCount.main(WordCount.java:66)
09:09:12,305 INFO org.apache.flink.runtime.io.network.NetworkEnvironment -
Starting the network environment and its components.
09:09:12,305 DEBUG org.apache.flink.runtime.io.network.NetworkEnvironment -
Starting network connection manager
09:09:12,312 INFO org.apache.flink.runtime.taskexecutor.TaskManagerServices -
Limiting managed memory to 368 MB, memory will be allocated lazily.
09:09:12,320 INFO org.apache.flink.runtime.io.disk.iomanager.IOManager - I/O
manager uses directory /tmp/flink-io-c5861126-7acd-4955-a153-53e18143e6a4 for
spill files.
09:09:12,326 INFO org.apache.flink.runtime.filecache.FileCache - User file
cache uses directory /tmp/flink-dist-cache-2ffbed5d-5787-4c69-84a4-12458ad3132e
09:09:12,343 INFO org.apache.flink.runtime.filecache.FileCache - User file
cache uses directory /tmp/flink-dist-cache-a7924e73-47c9-4bec-84ee-1a46f15ed0ba
09:09:12,367 INFO org.apache.flink.runtime.taskmanager.TaskManager - Starting
TaskManager actor at akka://flink/user/taskmanager_1#1824280464.
09:09:12,368 INFO org.apache.flink.runtime.taskmanager.TaskManager -
TaskManager data connection information: 0c13659ec41b6d6f689cb5a12c92e49f @
localhost (dataPort=-1)
09:09:12,368 INFO org.apache.flink.runtime.taskmanager.TaskManager -
TaskManager has 1 task slot(s).
09:09:12,370 INFO org.apache.flink.runtime.taskmanager.TaskManager - Memory
usage stats: [HEAP: 131/158/1185 MB, NON HEAP: 25/25/-1 MB (used/committed/max)]
09:09:12,390 INFO org.apache.flink.runtime.taskmanager.TaskManager - Trying to
register at JobManager akka://flink/user/jobmanager_1 (attempt 1, timeout: 500
milliseconds)
09:09:12,396 TRACE org.apache.flink.runtime.jobmanager.JobManager - Received
message
LeaderSessionMessage(47bf28f8-07c4-449e-9e1f-f437326dc9e4,RegisterTaskManager(0c13659ec41b6d6f689cb5a12c92e49f,0c13659ec41b6d6f689cb5a12c92e49f
@ localhost (dataPort=-1),cores=1, physMem=5136220160, heap=1242759168,
managed=385875968,1)) at akka://flink/user/jobmanager_1 from
Actor[akka://flink/user/taskmanager_1#1824280464].
09:09:12,397 DEBUG org.apache.flink.runtime.jobmanager.JobManager -
RegisterTaskManager:
RegisterTaskManager(0c13659ec41b6d6f689cb5a12c92e49f,0c13659ec41b6d6f689cb5a12c92e49f
@ localhost (dataPort=-1),cores=1, physMem=5136220160, heap=1242759168,
managed=385875968,1)
09:09:12,403 INFO org.apache.flink.runtime.instance.InstanceManager -
Registered TaskManager at localhost (akka://flink/user/taskmanager_1) as
53ed38b0fc8b30aeb39e9f463690eae9. Current number of registered hosts is 1.
Current number of alive task slots is 1.
09:09:12,406 TRACE org.apache.flink.runtime.jobmanager.JobManager - Handled
message
LeaderSessionMessage(47bf28f8-07c4-449e-9e1f-f437326dc9e4,RegisterTaskManager(0c13659ec41b6d6f689cb5a12c92e49f,0c13659ec41b6d6f689cb5a12c92e49f
@ localhost (dataPort=-1),cores=1, physMem=5136220160, heap=1242759168,
managed=385875968,1)) in 9 ms from
Actor[akka://flink/user/taskmanager_1#1824280464].
09:09:12,406 INFO
org.apache.flink.runtime.clusterframework.standalone.StandaloneResourceManager
- TaskManager 0c13659ec41b6d6f689cb5a12c92e49f has started.
09:09:12,411 INFO org.apache.flink.runtime.taskmanager.TaskManager - Successful
registration at JobManager (akka://flink/user/jobmanager_1), starting network
stack and library cache.
09:09:12,425 INFO org.apache.flink.runtime.taskmanager.TaskManager - Determined
BLOB server address to be localhost/127.0.0.1:42001. Starting BLOB cache.
09:09:12,429 INFO org.apache.flink.runtime.blob.PermanentBlobCache - Created
BLOB cache storage directory /tmp/blobStore-2a0b756e-eec1-40e4-bb79-442832d2f296
09:09:12,432 INFO org.apache.flink.runtime.blob.TransientBlobCache - Created
BLOB cache storage directory /tmp/blobStore-426e19d6-b99a-401b-9117-0bb837521b31
09:09:12,454 DEBUG org.apache.flink.optimizer.Optimizer - Beginning compilation
of program 'Flink Java Job at Wed Jan 24 09:09:04 MST 2018'
09:09:12,454 DEBUG org.apache.flink.optimizer.Optimizer - Using a default
parallelism of 1
09:09:12,454 DEBUG org.apache.flink.optimizer.Optimizer - Using default data
exchange mode PIPELINED
09:09:12,848 DEBUG org.apache.flink.optimizer.Optimizer - Assigned 0.5 of total
memory to each local strategy instance of Channel (GroupCombine "SUM(1), at
main(WordCount.java:63" : SORTED_GROUP_COMBINE [[ GlobalProperties
[partitioning=RANDOM_PARTITIONED] ]] [[ LocalProperties [ordering=null,
grouped=null, unique=null] ]]) -> (GroupReduce "SUM(1), at
main(WordCount.java:63" : SORTED_GROUP_REDUCE [[ GlobalProperties
[partitioning=HASH_PARTITIONED, on fields [0]] ]] [[ LocalProperties
[ordering=[0:ASC], grouped=[0], unique=null] ]])[PARTITION_HASH]
[COMBININGSORT] {NO-TEMP}.
09:09:12,848 DEBUG org.apache.flink.optimizer.Optimizer - Assigned 0.5 of total
memory to each subtask of SUM(1), at main(WordCount.java:63.
09:09:12,912 DEBUG org.apache.flink.runtime.taskmanager.TaskManager -
TaskManager was triggered to register at JobManager, but is already registered
09:09:13,265 INFO org.apache.flink.runtime.client.JobSubmissionClientActor -
Disconnect from JobManager null.
09:09:13,273 INFO org.apache.flink.runtime.client.JobSubmissionClientActor -
Received SubmitJobAndWait(JobGraph(jobId: 6b74599c3fcca85adce4caa33a5e2697))
but there is no connection to a JobManager yet.
09:09:13,273 INFO org.apache.flink.runtime.client.JobSubmissionClientActor -
Received job Flink Java Job at Wed Jan 24 09:09:04 MST 2018
(6b74599c3fcca85adce4caa33a5e2697).
09:09:13,280 INFO org.apache.flink.runtime.client.JobSubmissionClientActor -
Connect to JobManager Actor[akka://flink/user/jobmanager_1#-1543801343].
09:09:13,281 INFO org.apache.flink.runtime.client.JobSubmissionClientActor -
Connected to JobManager at Actor[akka://flink/user/jobmanager_1#-1543801343]
with leader session id 47bf28f8-07c4-449e-9e1f-f437326dc9e4.
Connected to JobManager at Actor[akka://flink/user/jobmanager_1#-1543801343]
with leader session id 47bf28f8-07c4-449e-9e1f-f437326dc9e4.
09:09:13,281 INFO org.apache.flink.runtime.client.JobSubmissionClientActor -
Sending message to JobManager akka://flink/user/jobmanager_1 to submit job
Flink Java Job at Wed Jan 24 09:09:04 MST 2018
(6b74599c3fcca85adce4caa33a5e2697) and wait for progress
09:09:13,978 INFO org.apache.flink.runtime.client.JobSubmissionClientActor -
Upload jar files to job manager akka://flink/user/jobmanager_1.
09:09:24,022 TRACE org.apache.flink.runtime.jobmanager.JobManager - Received
message RequestBlobManagerPort at akka://flink/user/jobmanager_1 from
Actor[akka://flink/temp/$c].
09:09:24,034 TRACE org.apache.flink.runtime.jobmanager.JobManager - Handled
message RequestBlobManagerPort in 10 ms from Actor[akka://flink/temp/$c].
09:09:24,034 DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending
heartbeat to JobManager
09:09:24,036 TRACE org.apache.flink.runtime.jobmanager.JobManager - Received
message Heartbeat(53ed38b0fc8b30aeb39e9f463690eae9,ArrayBuffer()) at
akka://flink/user/jobmanager_1 from
Actor[akka://flink/user/taskmanager_1#1824280464].
09:09:24,038 TRACE org.apache.flink.runtime.jobmanager.JobManager - Received
heartbeat message from 53ed38b0fc8b30aeb39e9f463690eae9.
09:09:24,039 TRACE org.apache.flink.runtime.jobmanager.JobManager - Handled
message Heartbeat(53ed38b0fc8b30aeb39e9f463690eae9,ArrayBuffer()) in 3 ms from
Actor[akka://flink/user/taskmanager_1#1824280464].
09:09:24,050 DEBUG org.apache.flink.runtime.client.JobSubmissionClientActor -
Received JobResultFailure message from JobManager
09:09:24,051 INFO org.apache.flink.runtime.client.JobClient - Job execution
failed
09:09:24,051 INFO org.apache.flink.runtime.minicluster.FlinkMiniCluster -
Stopping FlinkMiniCluster.
09:09:24,055 INFO org.apache.flink.runtime.client.JobSubmissionClientActor -
Terminate JobClientActor.
09:09:24,056 INFO org.apache.flink.runtime.client.JobSubmissionClientActor -
Disconnect from JobManager Actor[akka://flink/user/jobmanager_1#-1543801343].
09:09:24,068 INFO org.apache.flink.runtime.taskmanager.TaskManager - Stopping
TaskManager akka://flink/user/taskmanager_1#1824280464.
09:09:24,068 INFO org.apache.flink.runtime.taskmanager.TaskManager -
Disassociating from JobManager
09:09:24,070 INFO org.apache.flink.runtime.blob.PermanentBlobCache - Shutting
down BLOB cache
09:09:24,077 INFO org.apache.flink.runtime.blob.TransientBlobCache - Shutting
down BLOB cache
09:09:24,077 DEBUG org.apache.flink.runtime.io.disk.iomanager.IOManager -
Shutting down I/O manager.
09:09:24,079 INFO org.apache.flink.runtime.io.disk.iomanager.IOManager - I/O
manager removed spill file directory
/tmp/flink-io-c5861126-7acd-4955-a153-53e18143e6a4
09:09:24,079 INFO org.apache.flink.runtime.io.network.NetworkEnvironment -
Shutting down the network environment and its components.
09:09:24,079 DEBUG org.apache.flink.runtime.io.network.NetworkEnvironment -
Shutting down network connection manager
09:09:24,079 DEBUG org.apache.flink.runtime.io.network.NetworkEnvironment -
Shutting down intermediate result partition manager
09:09:24,080 DEBUG
org.apache.flink.runtime.io.network.partition.ResultPartitionManager -
Releasing 0 partitions because of shutdown.
09:09:24,088 DEBUG
org.apache.flink.runtime.io.network.partition.ResultPartitionManager -
Successful shutdown.
09:09:24,102 INFO org.apache.flink.runtime.taskmanager.TaskManager - Task
manager akka://flink/user/taskmanager_1 is completely shut down.
09:09:24,110 INFO org.apache.flink.runtime.jobmanager.JobManager - Stopping
JobManager akka://flink/user/jobmanager_1.
09:09:24,114 INFO org.apache.flink.runtime.blob.BlobServer - Stopped BLOB
server at 0.0.0.0:42001
09:09:24,115 DEBUG org.apache.flink.runtime.jobmanager.JobManager - Job manager
akka://flink/user/jobmanager_1 is completely stopped.
Exception in thread "main"
org.apache.flink.runtime.client.JobSubmissionException: Could not retrieve
BlobServer address.
at
org.apache.flink.runtime.client.JobSubmissionClientActor$1.call(JobSubmissionClientActor.java:166)
at akka.dispatch.Futures$$anonfun$future$1.apply(Future.scala:97)
at
scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:39)
at
akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:415)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at
scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at
scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
Caused by: java.util.concurrent.TimeoutException
at java.util.concurrent.CompletableFuture.timedGet(CompletableFuture.java:1771)
at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1915)
at
org.apache.flink.runtime.client.JobSubmissionClientActor$1.call(JobSubmissionClientActor.java:160)
... 9 more
Process finished with exit code 1
{code}
> Running Flink inside Intellij no longer works after upgrading from 1.3.2 to
> 1.4.0
> ---------------------------------------------------------------------------------
>
> Key: FLINK-8485
> URL: https://issues.apache.org/jira/browse/FLINK-8485
> Project: Flink
> Issue Type: Bug
> Components: Core
> Affects Versions: 1.4.0
> Reporter: Xuan Nguyen
> Priority: Blocker
>
> I upgraded flink from 1.3.2 to 1.4.0 and my simple test case no longer runs
> within Intellij or any other IDE when I click on the "RUN" button. I'm using
> JDK 1.8.
> My Dependencies are:
>
> {code:java}
> dependencies {
> compile group: 'log4j', name: 'log4j', version: '1.2.17'
> compile 'org.apache.flink:flink-java:1.4.0'
> compile 'org.apache.flink:flink-streaming-java_2.11:1.4.0'
> compile 'org.apache.flink:flink-clients_2.11:1.4.0'
> compile 'org.apache.flink:flink-table_2.11:1.4.0'
> compile 'org.apache.flink:flink-scala_2.11:1.4.0'
> compile 'org.apache.flink:flink-streaming-scala_2.11:1.4.0'
> compile 'org.apache.flink:flink-connector-kafka-0.8_2.11:1.4.0'
> compile 'org.apache.flink:flink-queryable-state-runtime_2.11:1.4.0'
> compile 'org.apache.flink:flink-queryable-state-client-java__2.11:1.4.0'
> testCompile 'junit:junit:+'
> }
> {code}
>
> {{ }}
> {{The exception:}}
> {code:java}
> Exception in thread "main"
> org.apache.flink.runtime.client.JobSubmissionException: Could not retrieve
> BlobServer address. at
> org.apache.flink.runtime.client.JobSubmissionClientActor$1.call(JobSubmissionClientActor.java:166)
> at akka.dispatch.Futures$$anonfun$future$1.apply(Future.scala:97) at
> scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
> at
> scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
> at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:39) at
> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:415)
> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) at
> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
> at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
> at
> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
> Caused by: java.util.concurrent.ExecutionException:
> akka.pattern.AskTimeoutException: Ask timed out on
> [Actor[akka://flink/user/jobmanager_1#-1662993273]] after [10000 ms].
> Sender[null] sent message of type
> "org.apache.flink.runtime.messages.JobManagerMessages$RequestBlobManagerPort$".
> at
> java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357)
> at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1915) at
> org.apache.flink.runtime.client.JobSubmissionClientActor$1.call(JobSubmissionClientActor.java:160)
> ... 9 more Caused by: akka.pattern.AskTimeoutException: Ask timed out on
> [Actor[akka://flink/user/jobmanager_1#-1662993273]] after [10000 ms].
> Sender[null] sent message of type
> "org.apache.flink.runtime.messages.JobManagerMessages$RequestBlobManagerPort$".
> at
> akka.pattern.PromiseActorRef$$anonfun$1.apply$mcV$sp(AskSupport.scala:604) at
> akka.actor.Scheduler$$anon$4.run(Scheduler.scala:126) at
> scala.concurrent.Future$InternalCallbackExecutor$.unbatchedExecute(Future.scala:601)
> at
> scala.concurrent.BatchingExecutor$class.execute(BatchingExecutor.scala:109)
> at
> scala.concurrent.Future$InternalCallbackExecutor$.execute(Future.scala:599)
> at
> akka.actor.LightArrayRevolverScheduler$TaskHolder.executeTask(LightArrayRevolverScheduler.scala:329)
> at
> akka.actor.LightArrayRevolverScheduler$$anon$4.executeBucket$1(LightArrayRevolverScheduler.scala:280)
> at
> akka.actor.LightArrayRevolverScheduler$$anon$4.nextTick(LightArrayRevolverScheduler.scala:284)
> at
> akka.actor.LightArrayRevolverScheduler$$anon$4.run(LightArrayRevolverScheduler.scala:236)
> at java.lang.Thread.run(Thread.java:748){code}
>
> The debug full logs are located in
> [https://gist.github.com/xuan/e6d4543c478c30d5747428589b03dd03] along with
> the test case.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
