[
https://issues.apache.org/jira/browse/FLINK-8485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16337854#comment-16337854
]
Xuan Nguyen commented on FLINK-8485:
------------------------------------
I saw the ClassDefNotFound so I included the:
{code:java}
<dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-queryable-state-runtime_2.11</artifactId>
<version>1.4.0</version>
</dependency>{code}
Here is result with the same Exception:
{code:java}
/usr/lib/jvm/java-8-oracle/bin/java
-javaagent:/home/xuan/java/idea/lib/idea_rt.jar=37173:/home/xuan/java/idea/bin
-Dfile.encoding=UTF-8 -classpath
/usr/lib/jvm/java-8-oracle/jre/lib/charsets.jar:/usr/lib/jvm/java-8-oracle/jre/lib/deploy.jar:/usr/lib/jvm/java-8-oracle/jre/lib/ext/cldrdata.jar:/usr/lib/jvm/java-8-oracle/jre/lib/ext/dnsns.jar:/usr/lib/jvm/java-8-oracle/jre/lib/ext/jaccess.jar:/usr/lib/jvm/java-8-oracle/jre/lib/ext/jfxrt.jar:/usr/lib/jvm/java-8-oracle/jre/lib/ext/localedata.jar:/usr/lib/jvm/java-8-oracle/jre/lib/ext/nashorn.jar:/usr/lib/jvm/java-8-oracle/jre/lib/ext/sunec.jar:/usr/lib/jvm/java-8-oracle/jre/lib/ext/sunjce_provider.jar:/usr/lib/jvm/java-8-oracle/jre/lib/ext/sunpkcs11.jar:/usr/lib/jvm/java-8-oracle/jre/lib/ext/zipfs.jar:/usr/lib/jvm/java-8-oracle/jre/lib/javaws.jar:/usr/lib/jvm/java-8-oracle/jre/lib/jce.jar:/usr/lib/jvm/java-8-oracle/jre/lib/jfr.jar:/usr/lib/jvm/java-8-oracle/jre/lib/jfxswt.jar:/usr/lib/jvm/java-8-oracle/jre/lib/jsse.jar:/usr/lib/jvm/java-8-oracle/jre/lib/management-agent.jar:/usr/lib/jvm/java-8-oracle/jre/lib/plugin.jar:/usr/lib/jvm/java-8-oracle/jre/lib/resources.jar:/usr/lib/jvm/java-8-oracle/jre/lib/rt.jar:/home/xuan/git/test/oracle-flink/target/classes:/home/xuan/.m2/repository/org/apache/flink/flink-core/1.4.0/flink-core-1.4.0.jar:/home/xuan/.m2/repository/org/apache/flink/flink-annotations/1.4.0/flink-annotations-1.4.0.jar:/home/xuan/.m2/repository/org/apache/flink/flink-metrics-core/1.4.0/flink-metrics-core-1.4.0.jar:/home/xuan/.m2/repository/org/apache/flink/flink-shaded-asm/5.0.4-2.0/flink-shaded-asm-5.0.4-2.0.jar:/home/xuan/.m2/repository/org/apache/commons/commons-lang3/3.3.2/commons-lang3-3.3.2.jar:/home/xuan/.m2/repository/com/esotericsoftware/kryo/kryo/2.24.0/kryo-2.24.0.jar:/home/xuan/.m2/repository/com/esotericsoftware/minlog/minlog/1.2/minlog-1.2.jar:/home/xuan/.m2/repository/org/objenesis/objenesis/2.1/objenesis-2.1.jar:/home/xuan/.m2/repository/commons-collections/commons-collections/3.2.2/commons-collections-3.2.2.jar:/home/xuan/.m2/repository/org/apache/commons/commons-compress/1.4.1/commons-compress-1.4.1.jar:/home/xuan/.m2/repository/org/tukaani/xz/1.0/xz-1.0.jar:/home/xuan/.m2/repository/org/xerial/snappy/snappy-java/1.1.1.3/snappy-java-1.1.1.3.jar:/home/xuan/.m2/repository/org/slf4j/slf4j-api/1.7.7/slf4j-api-1.7.7.jar:/home/xuan/.m2/repository/com/google/code/findbugs/jsr305/1.3.9/jsr305-1.3.9.jar:/home/xuan/.m2/repository/org/apache/flink/force-shading/1.4.0/force-shading-1.4.0.jar:/home/xuan/.m2/repository/org/apache/flink/flink-java/1.4.0/flink-java-1.4.0.jar:/home/xuan/.m2/repository/org/apache/commons/commons-math3/3.5/commons-math3-3.5.jar:/home/xuan/.m2/repository/org/apache/flink/flink-clients_2.11/1.4.0/flink-clients_2.11-1.4.0.jar:/home/xuan/.m2/repository/org/apache/flink/flink-runtime_2.11/1.4.0/flink-runtime_2.11-1.4.0.jar:/home/xuan/.m2/repository/org/apache/flink/flink-queryable-state-client-java_2.11/1.4.0/flink-queryable-state-client-java_2.11-1.4.0.jar:/home/xuan/.m2/repository/org/apache/flink/flink-hadoop-fs/1.4.0/flink-hadoop-fs-1.4.0.jar:/home/xuan/.m2/repository/commons-io/commons-io/2.4/commons-io-2.4.jar:/home/xuan/.m2/repository/org/apache/flink/flink-shaded-netty/4.0.27.Final-2.0/flink-shaded-netty-4.0.27.Final-2.0.jar:/home/xuan/.m2/repository/org/apache/flink/flink-shaded-jackson/2.7.9-2.0/flink-shaded-jackson-2.7.9-2.0.jar:/home/xuan/.m2/repository/org/javassist/javassist/3.18.2-GA/javassist-3.18.2-GA.jar:/home/xuan/.m2/repository/org/scala-lang/scala-library/2.11.11/scala-library-2.11.11.jar:/home/xuan/.m2/repository/com/typesafe/akka/akka-actor_2.11/2.4.20/akka-actor_2.11-2.4.20.jar:/home/xuan/.m2/repository/com/typesafe/config/1.3.0/config-1.3.0.jar:/home/xuan/.m2/repository/org/scala-lang/modules/scala-java8-compat_2.11/0.7.0/scala-java8-compat_2.11-0.7.0.jar:/home/xuan/.m2/repository/com/typesafe/akka/akka-stream_2.11/2.4.20/akka-stream_2.11-2.4.20.jar:/home/xuan/.m2/repository/org/reactivestreams/reactive-streams/1.0.0/reactive-streams-1.0.0.jar:/home/xuan/.m2/repository/com/typesafe/ssl-config-core_2.11/0.2.1/ssl-config-core_2.11-0.2.1.jar:/home/xuan/.m2/repository/org/scala-lang/modules/scala-parser-combinators_2.11/1.0.4/scala-parser-combinators_2.11-1.0.4.jar:/home/xuan/.m2/repository/com/typesafe/akka/akka-protobuf_2.11/2.4.20/akka-protobuf_2.11-2.4.20.jar:/home/xuan/.m2/repository/com/typesafe/akka/akka-slf4j_2.11/2.4.20/akka-slf4j_2.11-2.4.20.jar:/home/xuan/.m2/repository/org/clapper/grizzled-slf4j_2.11/1.0.2/grizzled-slf4j_2.11-1.0.2.jar:/home/xuan/.m2/repository/com/github/scopt/scopt_2.11/3.5.0/scopt_2.11-3.5.0.jar:/home/xuan/.m2/repository/com/twitter/chill_2.11/0.7.4/chill_2.11-0.7.4.jar:/home/xuan/.m2/repository/com/twitter/chill-java/0.7.4/chill-java-0.7.4.jar:/home/xuan/.m2/repository/org/apache/flink/flink-optimizer_2.11/1.4.0/flink-optimizer_2.11-1.4.0.jar:/home/xuan/.m2/repository/commons-cli/commons-cli/1.3.1/commons-cli-1.3.1.jar:/home/xuan/.m2/repository/org/apache/flink/flink-streaming-java_2.11/1.4.0/flink-streaming-java_2.11-1.4.0.jar:/home/xuan/.m2/repository/org/apache/flink/flink-shaded-guava/18.0-2.0/flink-shaded-guava-18.0-2.0.jar:/home/xuan/.m2/repository/org/apache/sling/org.apache.sling.commons.json/2.0.6/org.apache.sling.commons.json-2.0.6.jar:/home/xuan/.m2/repository/org/apache/flink/flink-queryable-state-runtime_2.11/1.4.0/flink-queryable-state-runtime_2.11-1.4.0.jar:/home/xuan/.m2/repository/org/slf4j/slf4j-log4j12/1.7.7/slf4j-log4j12-1.7.7.jar:/home/xuan/.m2/repository/log4j/log4j/1.2.17/log4j-1.2.17.jar
oracle.flink.WordCount
09:20:02,157 INFO org.apache.flink.api.java.ExecutionEnvironment - The job has
0 registered types and 0 default Kryo serializers
09:20:02,158 DEBUG org.apache.flink.api.java.ExecutionEnvironment - Registered
Kryo types: []
09:20:02,159 DEBUG org.apache.flink.api.java.ExecutionEnvironment - Registered
Kryo with Serializers types: []
09:20:02,159 DEBUG org.apache.flink.api.java.ExecutionEnvironment - Registered
Kryo with Serializer Classes types: []
09:20:02,159 DEBUG org.apache.flink.api.java.ExecutionEnvironment - Registered
Kryo default Serializers: []
09:20:02,159 DEBUG org.apache.flink.api.java.ExecutionEnvironment - Registered
Kryo default Serializers Classes []
09:20:02,159 DEBUG org.apache.flink.api.java.ExecutionEnvironment - Registered
POJO types: []
09:20:02,159 DEBUG org.apache.flink.api.java.ExecutionEnvironment - Static code
analysis mode: DISABLE
09:20:02,979 INFO org.apache.flink.runtime.minicluster.FlinkMiniCluster -
Starting FlinkMiniCluster.
09:20:02,996 INFO org.apache.flink.runtime.metrics.MetricRegistryImpl - No
metrics reporter configured, no metrics will be exposed/reported.
09:20:04,465 INFO akka.event.slf4j.Slf4jLogger - Slf4jLogger started
09:20:04,497 DEBUG akka.event.EventStream - logger log1-Slf4jLogger started
09:20:04,502 DEBUG akka.event.EventStream - Default Loggers started
09:20:04,544 DEBUG org.apache.flink.runtime.jobmanager.JobManager - No archive
directory was configured. Jobs will not be archived.
09:20:04,573 INFO org.apache.flink.runtime.blob.BlobServer - Created BLOB
server storage directory /tmp/blobStore-cd1e5c81-f050-4f23-8817-fe5f0730bd0a
09:20:04,589 DEBUG org.apache.flink.util.NetUtils - Trying to open socket on
port 0
09:20:04,590 INFO org.apache.flink.runtime.blob.BlobServer - Started BLOB
server at 0.0.0.0:42267 - max concurrent requests: 50 - max backlog: 1000
09:20:04,998 INFO org.apache.flink.runtime.jobmanager.MemoryArchivist - Started
memory archivist akka://flink/user/archive_1
09:20:05,019 INFO org.apache.flink.runtime.jobmanager.JobManager - Starting
JobManager at akka://flink/user/jobmanager_1.
09:20:05,019 INFO
org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService
- Proposing leadership to contender
org.apache.flink.runtime.jobmanager.JobManager@41581847 @
akka://flink/user/jobmanager_1
09:20:05,047 TRACE org.apache.flink.runtime.jobmanager.JobManager - Received
message GrantLeadership(Some(76270e89-5874-4a3e-8cd7-106419c0b48f)) at
akka://flink/user/jobmanager_1 from
Actor[akka://flink/user/jobmanager_1#2098462833].
09:20:05,053 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerConfiguration - Messages have
a max timeout of 10000 ms
09:20:05,059 INFO org.apache.flink.runtime.jobmanager.JobManager - JobManager
akka://flink/user/jobmanager_1 was granted leadership with leader session ID
Some(76270e89-5874-4a3e-8cd7-106419c0b48f).
09:20:05,068 INFO org.apache.flink.runtime.taskexecutor.TaskManagerServices -
Temporary file directory '/tmp': total 19 GB, usable 3 GB (15.79% usable)
09:20:05,070 TRACE org.apache.flink.runtime.jobmanager.JobManager - Handled
message GrantLeadership(Some(76270e89-5874-4a3e-8cd7-106419c0b48f)) in 22 ms
from Actor[akka://flink/user/jobmanager_1#2098462833].
09:20:05,091 INFO
org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService
- Received confirmation of leadership for leader akka://flink/user/jobmanager_1
, session=76270e89-5874-4a3e-8cd7-106419c0b48f
09:20:05,097 DEBUG
org.apache.flink.runtime.clusterframework.standalone.StandaloneResourceManager
- Received new leading JobManager akka://flink/user/jobmanager_1. Connecting.
09:20:05,139 INFO
org.apache.flink.runtime.clusterframework.standalone.StandaloneResourceManager
- Trying to associate with JobManager leader akka://flink/user/jobmanager_1
09:20:05,179 TRACE org.apache.flink.runtime.jobmanager.JobManager - Received
message
LeaderSessionMessage(76270e89-5874-4a3e-8cd7-106419c0b48f,RegisterResourceManager
akka://flink/user/resourcemanager_1) at akka://flink/user/jobmanager_1 from
Actor[akka://flink/temp/$a].
09:20:05,182 DEBUG org.apache.flink.runtime.jobmanager.JobManager - Resource
manager registration: RegisterResourceManager
akka://flink/user/resourcemanager_1
09:20:05,611 INFO org.apache.flink.runtime.io.network.buffer.NetworkBufferPool
- Allocated 117 MB for network buffer pool (number of memory segments: 3768,
bytes per segment: 32768).
09:20:05,614 TRACE org.apache.flink.runtime.jobmanager.JobManager - Handled
message
LeaderSessionMessage(76270e89-5874-4a3e-8cd7-106419c0b48f,RegisterResourceManager
akka://flink/user/resourcemanager_1) in 433 ms from
Actor[akka://flink/temp/$a].
09:20:05,616 INFO
org.apache.flink.runtime.clusterframework.standalone.StandaloneResourceManager
- Resource Manager associating with leading JobManager
Actor[akka://flink/user/jobmanager_1#2098462833] - leader session
76270e89-5874-4a3e-8cd7-106419c0b48f
09:20:05,647 INFO org.apache.flink.runtime.io.network.NetworkEnvironment -
Starting the network environment and its components.
09:20:05,648 DEBUG org.apache.flink.runtime.io.network.NetworkEnvironment -
Starting network connection manager
09:20:05,648 DEBUG org.apache.flink.queryablestate.server.KvStateServerImpl -
Attempting to start Queryable State Server on port 9067.
09:20:05,678 DEBUG
org.apache.flink.shaded.netty4.io.netty.util.internal.logging.InternalLoggerFactory
- Using SLF4J as the default logging framework
09:20:05,697 DEBUG
org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent0 -
java.nio.Buffer.address: available
09:20:05,697 DEBUG
org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent0 -
sun.misc.Unsafe.theUnsafe: available
09:20:05,697 DEBUG
org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent0 -
sun.misc.Unsafe.copyMemory: available
09:20:05,698 DEBUG
org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent0 -
java.nio.Bits.unaligned: true
09:20:05,702 DEBUG
org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent - Java
version: 8
09:20:05,702 DEBUG
org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent -
-Dio.netty.noUnsafe: false
09:20:05,702 DEBUG
org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent -
sun.misc.Unsafe: available
09:20:05,703 DEBUG
org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent -
-Dio.netty.noJavassist: false
09:20:05,871 DEBUG
org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent -
Javassist: available
09:20:05,871 DEBUG
org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent -
-Dio.netty.tmpdir: /tmp (java.io.tmpdir)
09:20:05,884 DEBUG
org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent -
-Dio.netty.bitMode: 64 (sun.arch.data.model)
09:20:05,884 DEBUG
org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent -
-Dio.netty.noPreferDirect: false
09:20:05,884 DEBUG
org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator -
-Dio.netty.allocator.numHeapArenas: 1
09:20:05,947 DEBUG
org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator -
-Dio.netty.allocator.numDirectArenas: 1
09:20:05,948 DEBUG
org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator -
-Dio.netty.allocator.pageSize: 8192
09:20:05,949 DEBUG
org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator -
-Dio.netty.allocator.maxOrder: 11
09:20:05,949 DEBUG
org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator -
-Dio.netty.allocator.chunkSize: 16777216
09:20:05,949 DEBUG
org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator -
-Dio.netty.allocator.tinyCacheSize: 512
09:20:05,949 DEBUG
org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator -
-Dio.netty.allocator.smallCacheSize: 256
09:20:05,949 DEBUG
org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator -
-Dio.netty.allocator.normalCacheSize: 64
09:20:05,949 DEBUG
org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator -
-Dio.netty.allocator.maxCachedBufferCapacity: 32768
09:20:05,949 DEBUG
org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator -
-Dio.netty.allocator.cacheTrimInterval: 8192
09:20:05,965 DEBUG
org.apache.flink.shaded.netty4.io.netty.channel.MultithreadEventLoopGroup -
-Dio.netty.eventLoopThreads: 2
09:20:06,008 DEBUG
org.apache.flink.shaded.netty4.io.netty.channel.nio.NioEventLoop -
-Dio.netty.noKeySetOptimization: false
09:20:06,008 DEBUG
org.apache.flink.shaded.netty4.io.netty.channel.nio.NioEventLoop -
-Dio.netty.selectorAutoRebuildThreshold: 512
09:20:06,057 DEBUG
org.apache.flink.shaded.netty4.io.netty.util.internal.ThreadLocalRandom -
-Dio.netty.initialSeedUniquifier: 0x96b4842ea0fcce57 (took 1 ms)
09:20:06,110 DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.ByteBufUtil -
-Dio.netty.allocator.type: unpooled
09:20:06,118 DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.ByteBufUtil -
-Dio.netty.threadLocalDirectBufferSize: 65536
09:20:06,136 DEBUG org.apache.flink.shaded.netty4.io.netty.util.NetUtil -
Loopback interface: lo (lo, 0:0:0:0:0:0:0:1%lo)
09:20:06,150 DEBUG org.apache.flink.shaded.netty4.io.netty.util.NetUtil -
/proc/sys/net/core/somaxconn: 128
09:20:06,203 INFO org.apache.flink.queryablestate.server.KvStateServerImpl -
Started Queryable State Server @ /127.0.0.1:9067.
09:20:06,203 DEBUG
org.apache.flink.queryablestate.client.proxy.KvStateClientProxyImpl -
Attempting to start Queryable State Proxy Server on port 9069.
09:20:06,217 INFO
org.apache.flink.queryablestate.client.proxy.KvStateClientProxyImpl - Started
Queryable State Proxy Server @ /127.0.0.1:9069.
09:20:06,218 INFO org.apache.flink.runtime.taskexecutor.TaskManagerServices -
Limiting managed memory to 368 MB, memory will be allocated lazily.
09:20:06,226 INFO org.apache.flink.runtime.io.disk.iomanager.IOManager - I/O
manager uses directory /tmp/flink-io-891de4cd-b7e6-4bae-b5a1-f728c45c3e2b for
spill files.
09:20:06,240 INFO org.apache.flink.runtime.filecache.FileCache - User file
cache uses directory /tmp/flink-dist-cache-cd9e1e26-d59d-4152-b9a7-5393e1d6875f
09:20:06,267 INFO org.apache.flink.runtime.filecache.FileCache - User file
cache uses directory /tmp/flink-dist-cache-a6c86c8f-6fc3-49c5-964d-e9001bf7c645
09:20:06,291 INFO org.apache.flink.runtime.taskmanager.TaskManager - Starting
TaskManager actor at akka://flink/user/taskmanager_1#1484905670.
09:20:06,292 INFO org.apache.flink.runtime.taskmanager.TaskManager -
TaskManager data connection information: efc30595885e54826a756f9534875a40 @
localhost (dataPort=-1)
09:20:06,292 INFO org.apache.flink.runtime.taskmanager.TaskManager -
TaskManager has 1 task slot(s).
09:20:06,297 INFO org.apache.flink.runtime.taskmanager.TaskManager - Memory
usage stats: [HEAP: 149/157/1185 MB, NON HEAP: 28/29/-1 MB (used/committed/max)]
09:20:06,309 INFO org.apache.flink.runtime.taskmanager.TaskManager - Trying to
register at JobManager akka://flink/user/jobmanager_1 (attempt 1, timeout: 500
milliseconds)
09:20:06,312 TRACE org.apache.flink.runtime.jobmanager.JobManager - Received
message
LeaderSessionMessage(76270e89-5874-4a3e-8cd7-106419c0b48f,RegisterTaskManager(efc30595885e54826a756f9534875a40,efc30595885e54826a756f9534875a40
@ localhost (dataPort=-1),cores=1, physMem=5136220160, heap=1242759168,
managed=385875968,1)) at akka://flink/user/jobmanager_1 from
Actor[akka://flink/user/taskmanager_1#1484905670].
09:20:06,318 DEBUG org.apache.flink.runtime.jobmanager.JobManager -
RegisterTaskManager:
RegisterTaskManager(efc30595885e54826a756f9534875a40,efc30595885e54826a756f9534875a40
@ localhost (dataPort=-1),cores=1, physMem=5136220160, heap=1242759168,
managed=385875968,1)
09:20:06,344 INFO org.apache.flink.runtime.instance.InstanceManager -
Registered TaskManager at localhost (akka://flink/user/taskmanager_1) as
1b6a6f873011df519d51723fede7ca74. Current number of registered hosts is 1.
Current number of alive task slots is 1.
09:20:06,357 TRACE org.apache.flink.runtime.jobmanager.JobManager - Handled
message
LeaderSessionMessage(76270e89-5874-4a3e-8cd7-106419c0b48f,RegisterTaskManager(efc30595885e54826a756f9534875a40,efc30595885e54826a756f9534875a40
@ localhost (dataPort=-1),cores=1, physMem=5136220160, heap=1242759168,
managed=385875968,1)) in 45 ms from
Actor[akka://flink/user/taskmanager_1#1484905670].
09:20:06,367 INFO
org.apache.flink.runtime.clusterframework.standalone.StandaloneResourceManager
- TaskManager efc30595885e54826a756f9534875a40 has started.
09:20:06,375 INFO org.apache.flink.runtime.taskmanager.TaskManager - Successful
registration at JobManager (akka://flink/user/jobmanager_1), starting network
stack and library cache.
09:20:06,400 INFO org.apache.flink.runtime.taskmanager.TaskManager - Determined
BLOB server address to be localhost/127.0.0.1:42267. Starting BLOB cache.
09:20:06,415 INFO org.apache.flink.runtime.blob.PermanentBlobCache - Created
BLOB cache storage directory /tmp/blobStore-9feebc6d-54ec-47d3-ac96-23b7c6d2d779
09:20:06,427 INFO org.apache.flink.runtime.blob.TransientBlobCache - Created
BLOB cache storage directory /tmp/blobStore-f4bd2ea2-4f0a-45bb-adff-b6b7774ff0d3
09:20:06,458 DEBUG org.apache.flink.optimizer.Optimizer - Beginning compilation
of program 'Flink Java Job at Wed Jan 24 09:20:02 MST 2018'
09:20:06,458 DEBUG org.apache.flink.optimizer.Optimizer - Using a default
parallelism of 1
09:20:06,458 DEBUG org.apache.flink.optimizer.Optimizer - Using default data
exchange mode PIPELINED
09:20:06,826 DEBUG org.apache.flink.runtime.taskmanager.TaskManager -
TaskManager was triggered to register at JobManager, but is already registered
09:20:06,873 DEBUG org.apache.flink.optimizer.Optimizer - Assigned 0.5 of total
memory to each local strategy instance of Channel (GroupCombine "SUM(1), at
main(WordCount.java:63" : SORTED_GROUP_COMBINE [[ GlobalProperties
[partitioning=RANDOM_PARTITIONED] ]] [[ LocalProperties [ordering=null,
grouped=null, unique=null] ]]) -> (GroupReduce "SUM(1), at
main(WordCount.java:63" : SORTED_GROUP_REDUCE [[ GlobalProperties
[partitioning=HASH_PARTITIONED, on fields [0]] ]] [[ LocalProperties
[ordering=[0:ASC], grouped=[0], unique=null] ]])[PARTITION_HASH]
[COMBININGSORT] {NO-TEMP}.
09:20:06,874 DEBUG org.apache.flink.optimizer.Optimizer - Assigned 0.5 of total
memory to each subtask of SUM(1), at main(WordCount.java:63.
09:20:07,120 INFO org.apache.flink.runtime.client.JobSubmissionClientActor -
Disconnect from JobManager null.
09:20:07,122 INFO org.apache.flink.runtime.client.JobSubmissionClientActor -
Connect to JobManager Actor[akka://flink/user/jobmanager_1#2098462833].
09:20:07,122 INFO org.apache.flink.runtime.client.JobSubmissionClientActor -
Connected to JobManager at Actor[akka://flink/user/jobmanager_1#2098462833]
with leader session id 76270e89-5874-4a3e-8cd7-106419c0b48f.
Connected to JobManager at Actor[akka://flink/user/jobmanager_1#2098462833]
with leader session id 76270e89-5874-4a3e-8cd7-106419c0b48f.
09:20:07,127 INFO org.apache.flink.runtime.client.JobSubmissionClientActor -
Received job Flink Java Job at Wed Jan 24 09:20:02 MST 2018
(1bc8208d071c30306649e4f4c3c92f3b).
09:20:07,127 INFO org.apache.flink.runtime.client.JobSubmissionClientActor -
Sending message to JobManager akka://flink/user/jobmanager_1 to submit job
Flink Java Job at Wed Jan 24 09:20:02 MST 2018
(1bc8208d071c30306649e4f4c3c92f3b) and wait for progress
09:20:07,143 INFO org.apache.flink.runtime.client.JobSubmissionClientActor -
Upload jar files to job manager akka://flink/user/jobmanager_1.
09:20:17,192 DEBUG org.apache.flink.runtime.client.JobSubmissionClientActor -
Received JobResultFailure message from JobManager
09:20:17,197 INFO org.apache.flink.runtime.client.JobClient - Job execution
failed
09:20:17,197 INFO org.apache.flink.runtime.minicluster.FlinkMiniCluster -
Stopping FlinkMiniCluster.
09:20:17,201 INFO org.apache.flink.runtime.client.JobSubmissionClientActor -
Terminate JobClientActor.
09:20:17,201 INFO org.apache.flink.runtime.client.JobSubmissionClientActor -
Disconnect from JobManager Actor[akka://flink/user/jobmanager_1#2098462833].
09:20:17,206 TRACE org.apache.flink.runtime.jobmanager.JobManager - Received
message RequestBlobManagerPort at akka://flink/user/jobmanager_1 from
Actor[akka://flink/temp/$d].
09:20:17,210 TRACE org.apache.flink.runtime.jobmanager.JobManager - Handled
message RequestBlobManagerPort in 3 ms from Actor[akka://flink/temp/$d].
09:20:17,215 INFO org.apache.flink.runtime.jobmanager.JobManager - Stopping
JobManager akka://flink/user/jobmanager_1.
09:20:17,223 DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending
heartbeat to JobManager
09:20:17,224 INFO org.apache.flink.runtime.taskmanager.TaskManager - Stopping
TaskManager akka://flink/user/taskmanager_1#1484905670.
09:20:17,225 INFO org.apache.flink.runtime.taskmanager.TaskManager -
Disassociating from JobManager
09:20:17,225 INFO org.apache.flink.runtime.blob.BlobServer - Stopped BLOB
server at 0.0.0.0:42267
09:20:17,232 DEBUG org.apache.flink.runtime.jobmanager.JobManager - Job manager
akka://flink/user/jobmanager_1 is completely stopped.
09:20:17,237 INFO org.apache.flink.runtime.blob.PermanentBlobCache - Shutting
down BLOB cache
09:20:17,237 INFO org.apache.flink.runtime.blob.TransientBlobCache - Shutting
down BLOB cache
09:20:17,237 DEBUG org.apache.flink.runtime.io.disk.iomanager.IOManager -
Shutting down I/O manager.
09:20:17,239 INFO org.apache.flink.runtime.io.disk.iomanager.IOManager - I/O
manager removed spill file directory
/tmp/flink-io-891de4cd-b7e6-4bae-b5a1-f728c45c3e2b
09:20:17,239 INFO org.apache.flink.runtime.io.network.NetworkEnvironment -
Shutting down the network environment and its components.
09:20:17,239 DEBUG org.apache.flink.runtime.io.network.NetworkEnvironment -
Shutting down Queryable State Client Proxy.
09:20:17,239 INFO
org.apache.flink.queryablestate.client.proxy.KvStateClientProxyImpl - Shutting
down Queryable State Proxy Server @ /127.0.0.1:9069
09:20:17,239 DEBUG org.apache.flink.runtime.io.network.NetworkEnvironment -
Shutting down Queryable State Data Server.
09:20:17,239 INFO org.apache.flink.queryablestate.server.KvStateServerImpl -
Shutting down Queryable State Server @ /127.0.0.1:9067
09:20:17,241 DEBUG org.apache.flink.runtime.io.network.NetworkEnvironment -
Shutting down network connection manager
09:20:17,241 DEBUG org.apache.flink.runtime.io.network.NetworkEnvironment -
Shutting down intermediate result partition manager
09:20:17,242 DEBUG
org.apache.flink.runtime.io.network.partition.ResultPartitionManager -
Releasing 0 partitions because of shutdown.
09:20:17,255 DEBUG
org.apache.flink.runtime.io.network.partition.ResultPartitionManager -
Successful shutdown.
09:20:17,268 INFO org.apache.flink.runtime.taskmanager.TaskManager - Task
manager akka://flink/user/taskmanager_1 is completely shut down.
Exception in thread "main"
org.apache.flink.runtime.client.JobSubmissionException: Could not retrieve
BlobServer address.
at
org.apache.flink.runtime.client.JobSubmissionClientActor$1.call(JobSubmissionClientActor.java:166)
at akka.dispatch.Futures$$anonfun$future$1.apply(Future.scala:97)
at
scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:39)
at
akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:415)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at
scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at
scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
Caused by: java.util.concurrent.TimeoutException
at java.util.concurrent.CompletableFuture.timedGet(CompletableFuture.java:1771)
at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1915)
at
org.apache.flink.runtime.client.JobSubmissionClientActor$1.call(JobSubmissionClientActor.java:160)
... 9 more
Process finished with exit code 1
{code}
> Running Flink inside Intellij no longer works after upgrading from 1.3.2 to
> 1.4.0
> ---------------------------------------------------------------------------------
>
> Key: FLINK-8485
> URL: https://issues.apache.org/jira/browse/FLINK-8485
> Project: Flink
> Issue Type: Bug
> Components: Core
> Affects Versions: 1.4.0
> Reporter: Xuan Nguyen
> Priority: Blocker
>
> I upgraded flink from 1.3.2 to 1.4.0 and my simple test case no longer runs
> within Intellij or any other IDE when I click on the "RUN" button. I'm using
> JDK 1.8.
> My Dependencies are:
>
> {code:java}
> dependencies {
> compile group: 'log4j', name: 'log4j', version: '1.2.17'
> compile 'org.apache.flink:flink-java:1.4.0'
> compile 'org.apache.flink:flink-streaming-java_2.11:1.4.0'
> compile 'org.apache.flink:flink-clients_2.11:1.4.0'
> compile 'org.apache.flink:flink-table_2.11:1.4.0'
> compile 'org.apache.flink:flink-scala_2.11:1.4.0'
> compile 'org.apache.flink:flink-streaming-scala_2.11:1.4.0'
> compile 'org.apache.flink:flink-connector-kafka-0.8_2.11:1.4.0'
> compile 'org.apache.flink:flink-queryable-state-runtime_2.11:1.4.0'
> compile 'org.apache.flink:flink-queryable-state-client-java__2.11:1.4.0'
> testCompile 'junit:junit:+'
> }
> {code}
>
> {{ }}
> {{The exception:}}
> {code:java}
> Exception in thread "main"
> org.apache.flink.runtime.client.JobSubmissionException: Could not retrieve
> BlobServer address. at
> org.apache.flink.runtime.client.JobSubmissionClientActor$1.call(JobSubmissionClientActor.java:166)
> at akka.dispatch.Futures$$anonfun$future$1.apply(Future.scala:97) at
> scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
> at
> scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
> at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:39) at
> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:415)
> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) at
> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
> at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
> at
> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
> Caused by: java.util.concurrent.ExecutionException:
> akka.pattern.AskTimeoutException: Ask timed out on
> [Actor[akka://flink/user/jobmanager_1#-1662993273]] after [10000 ms].
> Sender[null] sent message of type
> "org.apache.flink.runtime.messages.JobManagerMessages$RequestBlobManagerPort$".
> at
> java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357)
> at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1915) at
> org.apache.flink.runtime.client.JobSubmissionClientActor$1.call(JobSubmissionClientActor.java:160)
> ... 9 more Caused by: akka.pattern.AskTimeoutException: Ask timed out on
> [Actor[akka://flink/user/jobmanager_1#-1662993273]] after [10000 ms].
> Sender[null] sent message of type
> "org.apache.flink.runtime.messages.JobManagerMessages$RequestBlobManagerPort$".
> at
> akka.pattern.PromiseActorRef$$anonfun$1.apply$mcV$sp(AskSupport.scala:604) at
> akka.actor.Scheduler$$anon$4.run(Scheduler.scala:126) at
> scala.concurrent.Future$InternalCallbackExecutor$.unbatchedExecute(Future.scala:601)
> at
> scala.concurrent.BatchingExecutor$class.execute(BatchingExecutor.scala:109)
> at
> scala.concurrent.Future$InternalCallbackExecutor$.execute(Future.scala:599)
> at
> akka.actor.LightArrayRevolverScheduler$TaskHolder.executeTask(LightArrayRevolverScheduler.scala:329)
> at
> akka.actor.LightArrayRevolverScheduler$$anon$4.executeBucket$1(LightArrayRevolverScheduler.scala:280)
> at
> akka.actor.LightArrayRevolverScheduler$$anon$4.nextTick(LightArrayRevolverScheduler.scala:284)
> at
> akka.actor.LightArrayRevolverScheduler$$anon$4.run(LightArrayRevolverScheduler.scala:236)
> at java.lang.Thread.run(Thread.java:748){code}
>
> The debug full logs are located in
> [https://gist.github.com/xuan/e6d4543c478c30d5747428589b03dd03] along with
> the test case.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
