Hi,
I am trying to setup cluster with 2 EC2 instances. Able to bring up the
cluser with 1 master and 2 slaves. But I am not able to connect to master
to submit my job.
Here is how my attempt,
ExecutionEnvironment.createRemoteEnvironment("18.225.26.184", 6123, new
Configuration());
Tried with public ip and elastic ip of EC2 master instance, allowed all TCP
connections in security settings.
Please suggest.
Attaching the log.
--
Thank you,
Madan.
/usr/lib/jvm/java-8-oracle/bin/java -ea -Didea.test.cyclic.buffer.size=1048576
-javaagent:/home/mmyellanki/.local/share/JetBrains/Toolbox/apps/IDEA-C/ch-0/183.3795.13/lib/idea_rt.jar=34727:/home/mmyellanki/.local/share/JetBrains/Toolbox/apps/IDEA-C/ch-0/183.3795.13/bin
-Dfile.encoding=UTF-8 -classpath
/home/mmyellanki/.local/share/JetBrains/Toolbox/apps/IDEA-C/ch-0/183.3795.13/lib/idea_rt.jar:/home/mmyellanki/.local/share/JetBrains/Toolbox/apps/IDEA-C/ch-0/183.3795.13/plugins/junit/lib/junit-rt.jar:/home/mmyellanki/.local/share/JetBrains/Toolbox/apps/IDEA-C/ch-0/183.3795.13/plugins/junit/lib/junit5-rt.jar:/usr/lib/jvm/java-8-oracle/jre/lib/charsets.jar:/usr/lib/jvm/java-8-oracle/jre/lib/deploy.jar:/usr/lib/jvm/java-8-oracle/jre/lib/ext/cldrdata.jar:/usr/lib/jvm/java-8-oracle/jre/lib/ext/dnsns.jar:/usr/lib/jvm/java-8-oracle/jre/lib/ext/jaccess.jar:/usr/lib/jvm/java-8-oracle/jre/lib/ext/jfxrt.jar:/usr/lib/jvm/java-8-oracle/jre/lib/ext/localedata.jar:/usr/lib/jvm/java-8-oracle/jre/lib/ext/nashorn.jar:/usr/lib/jvm/java-8-oracle/jre/lib/ext/sunec.jar:/usr/lib/jvm/java-8-oracle/jre/lib/ext/sunjce_provider.jar:/usr/lib/jvm/java-8-oracle/jre/lib/ext/sunpkcs11.jar:/usr/lib/jvm/java-8-oracle/jre/lib/ext/zipfs.jar:/usr/lib/jvm/java-8-oracle/jre/lib/javaws.jar:/usr/lib/jvm/java-8-oracle/jre/lib/jce.jar:/usr/lib/jvm/java-8-oracle/jre/lib/jfr.jar:/usr/lib/jvm/java-8-oracle/jre/lib/jfxswt.jar:/usr/lib/jvm/java-8-oracle/jre/lib/jsse.jar:/usr/lib/jvm/java-8-oracle/jre/lib/management-agent.jar:/usr/lib/jvm/java-8-oracle/jre/lib/plugin.jar:/usr/lib/jvm/java-8-oracle/jre/lib/resources.jar:/usr/lib/jvm/java-8-oracle/jre/lib/rt.jar:/home/mmyellanki/workspace/adaequare-taxilla.etl2/etl2/out/test/classes:/home/mmyellanki/workspace/adaequare-taxilla.etl2/etl2/out/production/classes:/home/mmyellanki/workspace/adaequare-taxilla.etl2/etl2/out/test/resources:/home/mmyellanki/workspace/adaequare-taxilla.etl2/etl2/out/production/resources:/home/mmyellanki/workspace/adaequare-taxilla.etl2/etl2-metadata/out/production/classes:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/org.apache.flink/flink-queryable-state-client-java_2.11/1.6.1/47af18d32feaad5392c2bc48ef402ef841dc82b5/flink-queryable-state-client-java_2.11-1.6.1.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/log4j/log4j/1.2.17/5af35056b4d257e4b64b9e8069c0746e8b08629f/log4j-1.2.17.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/org.apache.flink/flink-java/1.6.1/d628e424808e267caf67a4a7d0bca433f8b8d701/flink-java-1.6.1.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/org.apache.flink/flink-streaming-java_2.11/1.6.1/919a1c098b03b9b54a28a4777fc3415501b3b357/flink-streaming-java_2.11-1.6.1.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/org.apache.flink/flink-hadoop-fs/1.6.1/4a9242a13d2d980769af1a17036f0cfe1253634/flink-hadoop-fs-1.6.1.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/org.apache.flink/flink-clients_2.11/1.6.1/9b3063f93f99bb254c9f8b1ec49130ea65641fe2/flink-clients_2.11-1.6.1.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/com.google.guava/guava/25.1-jre/6c57e4b22b44e89e548b5c9f70f0c45fe10fb0b4/guava-25.1-jre.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.25/da76ca59f6a57ee3102f8f9bd9cee742973efa8a/slf4j-api-1.7.25.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/commons-io/commons-io/2.4/b1b6ea3b7e4aa4f492509a4952029cd8e48019ad/commons-io-2.4.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/com.opencsv/opencsv/4.2/a65fb7d2ee2b5ea64b7887ed6dbce3d1fbef990e/opencsv-4.2.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/org.apache.poi/poi/3.17/ae92292a2043888b40d418da97dc0b669fde326/poi-3.17.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/org.apache.poi/poi-ooxml/3.17/7d8c44407178b73246462842bf1e206e99c8e0a/poi-ooxml-3.17.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/org.apache.ftpserver/ftpserver-core/1.1.1/61e1a6dbc536768b8f39dcdd8903ecdbf4bbb59e/ftpserver-core-1.1.1.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/org.apache.flink/flink-shaded-netty/4.1.24.Final-4.0/c39c841f2739a002f7a0a891f91b54e9937bfb19/flink-shaded-netty-4.1.24.Final-4.0.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/org.json/json/20180130/26ba2ec0e791a32ea5dfbedfcebf36447ee5b12c/json-20180130.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/commons-net/commons-net/3.3/cd0d5510908225f76c5fe5a3f1df4fa44866f81e/commons-net-3.3.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/com.amazonaws/aws-java-sdk-s3/1.11.434/3bc3719d7c917c5062e710009c32014dae39c2c/aws-java-sdk-s3-1.11.434.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/io.vertx/vertx-core/3.5.1/863b28bd60ebcc6820beb1dc7f44b777936e6ad3/vertx-core-3.5.1.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/io.vertx/vertx-web/3.5.1/83c678f08949092e93540b2d143cda23e4633199/vertx-web-3.5.1.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/io.vertx/vertx-codegen/3.5.1/7d20145d165b5c189dfc138134d488941a186fe2/vertx-codegen-3.5.1.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/org.apache.commons/commons-lang3/3.7/557edd918fd41f9260963583ebf5a61a43a6b423/commons-lang3-3.7.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/org.apache.flink/flink-core/1.6.1/fe7bad6aec8f34d53cdaafb1a25a19fa44b027ea/flink-core-1.6.1.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/org.apache.flink/flink-shaded-jackson/2.7.9-4.0/81ac0808c558977d222bea67d232fac79799de5/flink-shaded-jackson-2.7.9-4.0.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/org.javassist/javassist/3.19.0-GA/50120f69224dd8684b445a6f3a5b08fe9b5c60f6/javassist-3.19.0-GA.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/org.scala-lang/scala-library/2.11.12/bf5534e6fec3d665bd6419c952a929a8bdd4b591/scala-library-2.11.12.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/com.typesafe.akka/akka-actor_2.11/2.4.20/251b1d970698b81dad5aa8b84eec3eea835259d2/akka-actor_2.11-2.4.20.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/com.typesafe.akka/akka-stream_2.11/2.4.20/7545a4f86cbb372c337dbdb2846110df86a8cc70/akka-stream_2.11-2.4.20.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/org.apache.flink/flink-shaded-asm/5.0.4-4.0/69020db222a175b13b477fea12c5c7f74fca026f/flink-shaded-asm-5.0.4-4.0.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/com.typesafe.akka/akka-protobuf_2.11/2.4.20/6833d6256aaffe33caccd29acec3f4dedcb1086e/akka-protobuf_2.11-2.4.20.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/com.typesafe.akka/akka-slf4j_2.11/2.4.20/41e4c7fac2c9c36dbeafa6826f8cd62f4f857e70/akka-slf4j_2.11-2.4.20.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/org.clapper/grizzled-slf4j_2.11/1.0.2/55f84482ff1122a9d559179841a34d2c7d48e057/grizzled-slf4j_2.11-1.0.2.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/com.github.scopt/scopt_2.11/3.5.0/4adcea609ae83ae73be401872f0a36c018b34fea/scopt_2.11-3.5.0.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/org.xerial.snappy/snappy-java/1.1.4/d94ae6d7d27242eaa4b6c323f881edbb98e48da6/snappy-java-1.1.4.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/org.apache.commons/commons-math3/3.5/13af68e9a11576953f5c4b09436f8207be9d3a27/commons-math3-3.5.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/com.twitter/chill_2.11/0.7.4/5c20888747a8ec2c05d4ea3292eadd6ead31eb2a/chill_2.11-0.7.4.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/org.apache.flink/force-shading/1.6.1/c0d120fa58cb065b8e59bf5cdc0d0dc30f32b663/force-shading-1.6.1.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/commons-logging/commons-logging/1.2/4bfc12adfe4842bf07b657f0369c4cb522955686/commons-logging-1.2.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/org.apache.xmlbeans/xmlbeans/2.6.0/29e80d2dd51f9dcdef8f9ffaee0d4dc1c9bbfc87/xmlbeans-2.6.0.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/org.apache.httpcomponents/httpclient/4.5.5/1603dfd56ebcd583ccdf337b6c3984ac55d89e58/httpclient-4.5.5.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/software.amazon.ion/ion-java/1.0.2/ee9dacea7726e495f8352b81c12c23834ffbc564/ion-java-1.0.2.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-cbor/2.6.7/ba9e74b11135b18248e960df657a2b86ae77a079/jackson-dataformat-cbor-2.6.7.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/joda-time/joda-time/2.8.1/f5bfc718c95a7b1d3c371bb02a188a4df18361a9/joda-time-2.8.1.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/org.apache.flink/flink-runtime_2.11/1.6.1/1b3fc586d241a02f8c437afe2c686d693deb97b/flink-runtime_2.11-1.6.1.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.19.Final/ad4d4309c5b011036ca4df6aca190983d75c6b19/netty-codec-4.1.19.Final.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/org.apache.flink/flink-shaded-guava/18.0-4.0/4daca907bb191aabf8bde81448649b090eea49b1/flink-shaded-guava-18.0-4.0.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.19.Final/c84f0540fceccae979d7aeb17b1fa0057c038df9/netty-codec-socks-4.1.19.Final.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.19.Final/8b0a7fd3c67e8bd5e3d347f9bb200ae0aaa5c1b7/netty-codec-dns-4.1.19.Final.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/com.esotericsoftware.minlog/minlog/1.2/59bfcd171d82f9981a5e242b9e840191f650e209/minlog-1.2.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/org.objenesis/objenesis/2.1/87c0ea803b69252868d09308b4618f766f135a96/objenesis-2.1.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/org.apache.flink/flink-optimizer_2.11/1.6.1/9cdea990712c04a56920464b202b80902d18fe4e/flink-optimizer_2.11-1.6.1.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/org.tukaani/xz/1.0/ecff5cb8b1189514c9d1d8d68eb77ac372e000c9/xz-1.0.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/com.typesafe/config/1.3.0/f533aa6ea13e443b50e639d070986c42d03efc35/config-1.3.0.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/org.scala-lang.modules/scala-java8-compat_2.11/0.7.0/a31b1b36bcf0d53657733b5d40c78d5f090a5dea/scala-java8-compat_2.11-0.7.0.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.0/14b8c877d98005ba3941c9257cfe09f6ed0e0d74/reactive-streams-1.0.0.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/com.typesafe/ssl-config-core_2.11/0.2.1/3d2e6a36a7427d6f9d3921c91d6ac1f57dc47b57/ssl-config-core_2.11-0.2.1.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/com.twitter/chill-java/0.7.4/c4c005297ce8b29749edecd06f97329f25df70d/chill-java-0.7.4.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/commons-cli/commons-cli/1.3.1/1303efbc4b181e5a58bf2e967dc156a3132b97c0/commons-cli-1.3.1.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/stax/stax-api/1.0.1/49c100caf72d658aca8e58bd74a4ba90fa2b0d70/stax-api-1.0.1.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/org.checkerframework/checker-qual/2.0.0/518929596ee3249127502a8573b2e008e2d51ed3/checker-qual-2.0.0.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/org.apache.httpcomponents/httpcore/4.4.9/a86ce739e5a7175b4b234c290a00a5fdb80957a0/httpcore-4.4.9.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/com.google.errorprone/error_prone_annotations/2.1.3/39b109f2cd352b2d71b52a3b5a1a9850e1dc304b/error_prone_annotations-2.1.3.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/org.scala-lang.modules/scala-parser-combinators_2.11/1.0.4/7369d653bcfa95d321994660477a4d7e81d7f490/scala-parser-combinators_2.11-1.0.4.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/com.google.j2objc/j2objc-annotations/1.1/ed28ded51a8b1c6b112568def5f4b455e6809019/j2objc-annotations-1.1.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/org.codehaus.mojo/animal-sniffer-annotations/1.14/775b7e22fb10026eed3f86e8dc556dfafe35f2d5/animal-sniffer-annotations-1.14.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/org.apache.commons/commons-text/1.3/9abf61708a66ab5e55f6169a200dbfc584b546d9/commons-text-1.3.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/commons-beanutils/commons-beanutils/1.9.3/c845703de334ddc6b4b3cd26835458cb1cba1f3d/commons-beanutils-1.9.3.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/org.apache.commons/commons-collections4/4.1/a4cf4688fe1c7e3a63aa636cc96d013af537768e/commons-collections4-4.1.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/commons-codec/commons-codec/1.10/4b95f4897fa13f2cd904aee711aeafc0c5295cd8/commons-codec-1.10.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/org.apache.poi/poi-ooxml-schemas/3.17/890114bfa82f5b6380ea0e9b0bf49b0af797b414/poi-ooxml-schemas-3.17.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/com.github.virtuald/curvesapi/1.04/3386abf821719bc89c7685f9eaafaf4a842f0199/curvesapi-1.04.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/org.apache.ftpserver/ftplet-api/1.1.1/22e13a068e531de4108c8a89ea5d485136a34943/ftplet-api-1.1.1.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/org.apache.mina/mina-core/2.0.16/f720f17643eaa7b0fec07c1d7f6272972c02bba4/mina-core-2.0.16.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/com.amazonaws/aws-java-sdk-kms/1.11.434/40f7c777dbc4c94c4dc6de7fbc2226173e9f29d6/aws-java-sdk-kms-1.11.434.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/com.amazonaws/aws-java-sdk-core/1.11.434/a52017f938182fb614911edfe49c19ee9a17b61e/aws-java-sdk-core-1.11.434.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/com.amazonaws/jmespath-java/1.11.434/b8750259ba1169a2b7644ea35e916048b97931fa/jmespath-java-1.11.434.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/io.netty/netty-common/4.1.19.Final/b281916c11d3eeec5e839677ec4f2eb9d7586928/netty-common-4.1.19.Final.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.19.Final/65abf40a28ce4f52dd763d0b4f740066a87b5c9e/netty-buffer-4.1.19.Final.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/com.google.code.findbugs/jsr305/3.0.2/25ea2e8b0c338a877313bd4672d3fe056ea78f0d/jsr305-3.0.2.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.19.Final/4f26f51b86dc1ab19621eb2ac39f1a63682f17f2/netty-transport-4.1.19.Final.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.19.Final/9c784510bc6f81177c4f2c2956144438863cdac4/netty-handler-4.1.19.Final.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.9.0/7c10d545325e3a6e72e06381afe469fd40eb701/jackson-annotations-2.9.0.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.19.Final/47c7f7977cea190351962bee726f663eb6488a22/netty-handler-proxy-4.1.19.Final.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.19.Final/f7edff289d10cc03cdb97ad99e2722f9d61ffdc3/netty-codec-http-4.1.19.Final.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.19.Final/665bd06aed74b3f5592465dda2e00e3d03f41048/netty-codec-http2-4.1.19.Final.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.19.Final/7d97be8b3fb195f9d94d9a4afcadef25e08bde2/netty-resolver-4.1.19.Final.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.19.Final/67a1e265bcbc49160417c81fdf2fdc50ea423727/netty-resolver-dns-4.1.19.Final.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.9.3/ea9b6fc7bc3ccba9777b0827091f9aa1f8580371/jackson-core-2.9.3.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.9.3/193b96ef555b2f2573b576887ba9a93e4bf48e8c/jackson-databind-2.9.3.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/io.vertx/vertx-auth-common/3.5.1/bed30ed06cea829c11cde1f50aeafcfea8ede1c0/vertx-auth-common-3.5.1.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/io.vertx/vertx-bridge-common/3.5.1/35c619948ec4ce81a45e9cda1c3669fff70a2ea9/vertx-bridge-common-3.5.1.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/org.mvel/mvel2/2.3.1.Final/3b1a1cf9b3da25500e2703a9d7c26a486b3719f9/mvel2-2.3.1.Final.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/org.apache.flink/flink-annotations/1.6.1/4b3a8be217f27182f92c9c27b4a02095ec48df8e/flink-annotations-1.6.1.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/org.apache.flink/flink-metrics-core/1.6.1/7b708f239b398eedfe51e66602132bc08b2beff1/flink-metrics-core-1.6.1.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/com.esotericsoftware.kryo/kryo/2.24.0/c6b206e80cfd97e66a1364003724491c757b92f/kryo-2.24.0.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/commons-collections/commons-collections/3.2.2/8ad72fe39fa8c91eaaf12aadb21e0c3661fe26d5/commons-collections-3.2.2.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/org.apache.commons/commons-compress/1.4.1/b02e84a993d88568417536240e970c4b809126fd/commons-compress-1.4.1.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/ch.qos.logback/logback-classic/1.2.3/7c4f3c474fb2c041d8028740440937705ebb473a/logback-classic-1.2.3.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/io.vertx/vertx-unit/3.5.1/ad65b90d342c0a85b3fe873a294ed34b2281c64f/vertx-unit-3.5.1.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/junit/junit/4.12/2973d150c0dc1fefe998f834810d68f278ea58ec/junit-4.12.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/ch.qos.logback/logback-core/1.2.3/864344400c3d4d92dfeb0a305dc87d953677c03c/logback-core-1.2.3.jar:/home/mmyellanki/activeprograms/mavenrepos/caches/modules-2/files-2.1/org.hamcrest/hamcrest-core/1.3/42a25dc3219429f0e5d060061f71acb49bf010a0/hamcrest-core-1.3.jar
com.intellij.rt.execution.junit.JUnitStarter -ideVersion5 -junit4
etl2.batch.EmployeeSamples,basic
16:19:25,687 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could
NOT find resource [logback-test.xml]
16:19:25,688 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could
NOT find resource [logback.groovy]
16:19:25,688 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found
resource [logback.xml] at
[file:/home/mmyellanki/workspace/adaequare-taxilla.etl2/etl2/out/production/resources/logback.xml]
16:19:25,781 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About
to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
16:19:25,786 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming
appender as [console]
16:19:25,796 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA
- Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder]
for [encoder] property
16:19:25,837 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About
to instantiate appender of type
[ch.qos.logback.core.rolling.RollingFileAppender]
16:19:25,842 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming
appender as [file]
16:19:25,857 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@731260860 -
Will use gz compression
16:19:25,858 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@731260860 -
Will use the pattern logs/etl.%d{dd-MM-yyyy}.%i.log for the active file
16:19:25,861 |-INFO in
ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@23e028a9 - The date pattern
is 'dd-MM-yyyy' from file name pattern 'logs/etl.%d{dd-MM-yyyy}.%i.log.gz'.
16:19:25,861 |-INFO in
ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@23e028a9 - Roll-over at
midnight.
16:19:25,866 |-INFO in
ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@23e028a9 - Setting initial
period to Tue Oct 23 16:10:44 IST 2018
16:19:25,866 |-WARN in
ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@23e028a9 -
SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
16:19:25,866 |-WARN in
ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@23e028a9 - For more
information see
http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
16:19:25,869 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA
- Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder]
for [encoder] property
16:19:25,872 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[file] -
Active log file name: logs/etl.log
16:19:25,872 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[file] -
File property is set to [logs/etl.log]
16:19:25,873 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction -
Setting level of ROOT logger to TRACE
16:19:25,874 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction -
Attaching appender named [file] to Logger[ROOT]
16:19:25,875 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction -
Attaching appender named [console] to Logger[ROOT]
16:19:25,875 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction
- End of configuration.
16:19:25,876 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@cd2dae5 -
Registering current configuration as safe fallback point
23 Oct 2018 16:19:25.933 [main] INFO
org.apache.flink.api.java.typeutils.TypeExtractor.isValidPojoField
1818 - class
com.adaequare.etl2.batch.operator.EntityType does not contain a setter for
field targetEntity
23 Oct 2018 16:19:25.938 [main] INFO
org.apache.flink.api.java.typeutils.TypeExtractor.analyzePojo
1857 - Class class
com.adaequare.etl2.batch.operator.EntityType cannot be used as a POJO type
because not all fields are valid POJO fields, and must be processed as
GenericType. Please read the Flink documentation on "Data Types &
Serialization" for details of the effect on performance.
23 Oct 2018 16:19:26.367 [main] DEBUG
org.apache.flink.api.java.ClosureCleaner.cleanThis0
120 - this$0 is accessed: false
23 Oct 2018 16:19:26.379 [main] DEBUG
org.apache.flink.api.java.ClosureCleaner.cleanThis0
120 - this$0 is accessed: false
23 Oct 2018 16:19:26.428 [main] INFO
org.apache.flink.api.java.ExecutionEnvironment.createProgramPlan
999 - The job has 2 registered types and 0
default Kryo serializers
23 Oct 2018 16:19:26.439 [main] DEBUG
org.apache.flink.api.java.ExecutionEnvironment.createProgramPlan
1012 - Registered Kryo types: [class
com.adaequare.etl2.batch.operator.EntityType, interface java.util.List]
23 Oct 2018 16:19:26.440 [main] DEBUG
org.apache.flink.api.java.ExecutionEnvironment.createProgramPlan
1013 - Registered Kryo with Serializers types:
[]
23 Oct 2018 16:19:26.441 [main] DEBUG
org.apache.flink.api.java.ExecutionEnvironment.createProgramPlan
1014 - Registered Kryo with Serializer Classes
types: []
23 Oct 2018 16:19:26.441 [main] DEBUG
org.apache.flink.api.java.ExecutionEnvironment.createProgramPlan
1015 - Registered Kryo default Serializers: []
23 Oct 2018 16:19:26.442 [main] DEBUG
org.apache.flink.api.java.ExecutionEnvironment.createProgramPlan
1016 - Registered Kryo default Serializers
Classes []
23 Oct 2018 16:19:26.442 [main] DEBUG
org.apache.flink.api.java.ExecutionEnvironment.createProgramPlan
1017 - Registered POJO types: []
23 Oct 2018 16:19:26.442 [main] DEBUG
org.apache.flink.api.java.ExecutionEnvironment.createProgramPlan
1020 - Static code analysis mode: DISABLE
23 Oct 2018 16:19:26.479 [main] DEBUG
org.apache.flink.optimizer.Optimizer.compile
433 - Beginning compilation of program 'plan'
23 Oct 2018 16:19:26.489 [main] DEBUG
org.apache.flink.optimizer.Optimizer.compile
442 - Using a default parallelism of 1
23 Oct 2018 16:19:26.491 [main] DEBUG
org.apache.flink.optimizer.Optimizer.compile
443 - Using default data exchange mode PIPELINED
23 Oct 2018 16:19:26.548 [main] DEBUG
org.apache.flink.core.fs.FileSystem.loadFileSystems
953 - Loading extension file systems via
services
23 Oct 2018 16:19:26.555 [main] INFO
org.apache.flink.core.fs.FileSystem.loadHadoopFsFactory
1021 - Hadoop is not in the
classpath/dependencies. The extended set of supported File Systems via Hadoop
is not available.
23 Oct 2018 16:19:26.565 [main] WARN
org.apache.flink.api.common.io.DelimitedInputFormat.getStatistics
440 - Could not determine statistics for files
'[stream2file7838895951879167848.tmp.csv]' due to an io error: File
stream2file7838895951879167848.tmp.csv does not exist or the user running Flink
('mmyellanki') has insufficient permissions to access it.
23 Oct 2018 16:19:26.566 [main] WARN
org.apache.flink.api.common.io.DelimitedInputFormat.getStatistics
440 - Could not determine statistics for files
'[stream2file2196887288130474065.tmp.csv]' due to an io error: File
stream2file2196887288130474065.tmp.csv does not exist or the user running Flink
('mmyellanki') has insufficient permissions to access it.
{
"nodes": [
{
"id": 2,
"type": "source",
"pact": "Data Source",
"contents": "at readFile(ExecutionEnvironment.java:515)
(com.adaequare.etl2.batch.operator.EntityCsvInputFormat)",
"parallelism": "1",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM_PARTITIONED"
},
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" }
],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "0.0" },
{ "name": "Cumulative Disk I/O", "value": "0.0" },
{ "name": "Cumulative CPU", "value": "0.0" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value":
"(none)" },
{ "name": "Filter Factor", "value": "(none)" }
]
},
{
"id": 1,
"type": "pact",
"pact": "Map",
"contents": "Map at lambda$configure$0(MapOperator.java:21)",
"parallelism": "1",
"predecessors": [
{"id": 2, "ship_strategy": "Forward", "exchange_mode":
"PIPELINED"}
],
"driver_strategy": "Map",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM_PARTITIONED"
},
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" }
],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "0.0" },
{ "name": "Cumulative Disk I/O", "value": "0.0" },
{ "name": "Cumulative CPU", "value": "0.0" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value":
"(none)" },
{ "name": "Filter Factor", "value": "(none)" }
]
},
{
"id": 0,
"type": "sink",
"pact": "Data Sink",
"contents":
"com.adaequare.etl2.batch.operator.EntityCsvOutputFormat@3e92efc3",
"parallelism": "1",
"predecessors": [
{"id": 1, "ship_strategy": "Forward", "exchange_mode":
"PIPELINED"}
],
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM_PARTITIONED"
},
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" }
],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "0.0" },
{ "name": "Cumulative Disk I/O", "value": "0.0" },
{ "name": "Cumulative CPU", "value": "0.0" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value":
"(none)" },
{ "name": "Filter Factor", "value": "(none)" }
]
},
{
"id": 5,
"type": "source",
"pact": "Data Source",
"contents": "at readFile(ExecutionEnvironment.java:515)
(com.adaequare.etl2.batch.operator.EntityCsvInputFormat)",
"parallelism": "1",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM_PARTITIONED"
},
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" }
],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "0.0" },
{ "name": "Cumulative Disk I/O", "value": "0.0" },
{ "name": "Cumulative CPU", "value": "0.0" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value":
"(none)" },
{ "name": "Filter Factor", "value": "(none)" }
]
},
{
"id": 4,
"type": "pact",
"pact": "Map",
"contents": "Map at lambda$configure$0(MapOperator.java:21)",
"parallelism": "1",
"predecessors": [
{"id": 5, "ship_strategy": "Forward", "exchange_mode":
"PIPELINED"}
],
"driver_strategy": "Map",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM_PARTITIONED"
},
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" }
],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "0.0" },
{ "name": "Cumulative Disk I/O", "value": "0.0" },
{ "name": "Cumulative CPU", "value": "0.0" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value":
"(none)" },
{ "name": "Filter Factor", "value": "(none)" }
]
},
{
"id": 3,
"type": "sink",
"pact": "Data Sink",
"contents":
"com.adaequare.etl2.batch.operator.EntityCsvOutputFormat@5bd03f44",
"parallelism": "1",
"predecessors": [
{"id": 4, "ship_strategy": "Forward", "exchange_mode":
"PIPELINED"}
],
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM_PARTITIONED"
},
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" }
],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "0.0" },
{ "name": "Cumulative Disk I/O", "value": "0.0" },
{ "name": "Cumulative CPU", "value": "0.0" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value":
"(none)" },
{ "name": "Filter Factor", "value": "(none)" }
]
}
]
}
23 Oct 2018 16:19:26.791 [main] INFO
org.apache.flink.api.java.ExecutionEnvironment.createProgramPlan
999 - The job has 2 registered types and 0
default Kryo serializers
23 Oct 2018 16:19:26.792 [main] DEBUG
org.apache.flink.api.java.ExecutionEnvironment.createProgramPlan
1012 - Registered Kryo types: [class
com.adaequare.etl2.batch.operator.EntityType, interface java.util.List]
23 Oct 2018 16:19:26.792 [main] DEBUG
org.apache.flink.api.java.ExecutionEnvironment.createProgramPlan
1013 - Registered Kryo with Serializers types:
[]
23 Oct 2018 16:19:26.793 [main] DEBUG
org.apache.flink.api.java.ExecutionEnvironment.createProgramPlan
1014 - Registered Kryo with Serializer Classes
types: []
23 Oct 2018 16:19:26.793 [main] DEBUG
org.apache.flink.api.java.ExecutionEnvironment.createProgramPlan
1015 - Registered Kryo default Serializers: []
23 Oct 2018 16:19:26.793 [main] DEBUG
org.apache.flink.api.java.ExecutionEnvironment.createProgramPlan
1016 - Registered Kryo default Serializers
Classes []
23 Oct 2018 16:19:26.793 [main] DEBUG
org.apache.flink.api.java.ExecutionEnvironment.createProgramPlan
1017 - Registered POJO types: []
23 Oct 2018 16:19:26.794 [main] DEBUG
org.apache.flink.api.java.ExecutionEnvironment.createProgramPlan
1020 - Static code analysis mode: DISABLE
23 Oct 2018 16:19:26.822 [main] WARN
org.apache.flink.configuration.Configuration.getRawValueFromOption
797 - Config uses deprecated configuration key
'jobmanager.rpc.address' instead of proper key 'rest.address'
23 Oct 2018 16:19:27.084 [main] DEBUG
org.apache.flink.shaded.netty4.io.netty.util.internal.logging.InternalLoggerFactory.debug
71 - Using SLF4J as the default logging
framework
23 Oct 2018 16:19:27.123 [main] DEBUG
org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent0.debug
76 - -Dio.netty.noUnsafe: false
23 Oct 2018 16:19:27.123 [main] DEBUG
org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent0.debug
76 - Java version: 8
23 Oct 2018 16:19:27.124 [main] DEBUG
org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent0.debug
71 - sun.misc.Unsafe.theUnsafe: available
23 Oct 2018 16:19:27.125 [main] DEBUG
org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent0.debug
71 - sun.misc.Unsafe.copyMemory: available
23 Oct 2018 16:19:27.125 [main] DEBUG
org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent0.debug
71 - java.nio.Buffer.address: available
23 Oct 2018 16:19:27.126 [main] DEBUG
org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent0.debug
71 - direct buffer constructor: available
23 Oct 2018 16:19:27.127 [main] DEBUG
org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent0.debug
76 - java.nio.Bits.unaligned: available, true
23 Oct 2018 16:19:27.127 [main] DEBUG
org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent0.debug
71 -
jdk.internal.misc.Unsafe.allocateUninitializedArray(int): unavailable prior to
Java9
23 Oct 2018 16:19:27.127 [main] DEBUG
org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent0.debug
76 - java.nio.DirectByteBuffer.<init>(long,
int): available
23 Oct 2018 16:19:27.127 [main] DEBUG
org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent.debug
76 - sun.misc.Unsafe: available
23 Oct 2018 16:19:27.127 [main] DEBUG
org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent.debug
76 - -Dio.netty.tmpdir: /tmp (java.io.tmpdir)
23 Oct 2018 16:19:27.128 [main] DEBUG
org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent.debug
76 - -Dio.netty.bitMode: 64
(sun.arch.data.model)
23 Oct 2018 16:19:27.129 [main] DEBUG
org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent.debug
76 - -Dio.netty.noPreferDirect: false
23 Oct 2018 16:19:27.129 [main] DEBUG
org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent.debug
76 - -Dio.netty.maxDirectMemory: 3715629056
bytes
23 Oct 2018 16:19:27.129 [main] DEBUG
org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent.debug
76 -
-Dio.netty.uninitializedArrayAllocationThreshold: -1
23 Oct 2018 16:19:27.130 [main] DEBUG
org.apache.flink.shaded.netty4.io.netty.util.internal.CleanerJava6.debug
71 - java.nio.ByteBuffer.cleaner(): available
23 Oct 2018 16:19:27.136 [main] DEBUG
org.apache.flink.shaded.netty4.io.netty.channel.MultithreadEventLoopGroup.debug
76 - -Dio.netty.eventLoopThreads: 8
23 Oct 2018 16:19:27.154 [main] DEBUG
org.apache.flink.shaded.netty4.io.netty.channel.nio.NioEventLoop.debug
76 - -Dio.netty.noKeySetOptimization: false
23 Oct 2018 16:19:27.154 [main] DEBUG
org.apache.flink.shaded.netty4.io.netty.channel.nio.NioEventLoop.debug
76 - -Dio.netty.selectorAutoRebuildThreshold:
512
23 Oct 2018 16:19:27.160 [main] DEBUG
org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent.debug
71 - org.jctools-core.MpscChunkedArrayQueue:
available
23 Oct 2018 16:19:27.164 [main] TRACE
org.apache.flink.shaded.netty4.io.netty.channel.nio.NioEventLoop.trace
46 - instrumented a special java.util.Set into:
sun.nio.ch.EPollSelectorImpl@497486b3
23 Oct 2018 16:19:27.172 [main] INFO
org.apache.flink.runtime.rest.RestClient.<init>
133 - Rest client endpoint started.
23 Oct 2018 16:19:27.174 [main] DEBUG
org.apache.flink.client.program.ClusterClient.getOptimizedPlan
377 - Set parallelism 1, plan default
parallelism 1
23 Oct 2018 16:19:27.175 [main] DEBUG
org.apache.flink.optimizer.Optimizer.compile
433 - Beginning compilation of program 'Flink
Java Job at Tue Oct 23 16:19:26 IST 2018'
23 Oct 2018 16:19:27.175 [main] DEBUG
org.apache.flink.optimizer.Optimizer.compile
442 - Using a default parallelism of 1
23 Oct 2018 16:19:27.175 [main] DEBUG
org.apache.flink.optimizer.Optimizer.compile
443 - Using default data exchange mode PIPELINED
23 Oct 2018 16:19:27.175 [main] WARN
org.apache.flink.api.common.io.DelimitedInputFormat.getStatistics
440 - Could not determine statistics for files
'[stream2file7838895951879167848.tmp.csv]' due to an io error: File
stream2file7838895951879167848.tmp.csv does not exist or the user running Flink
('mmyellanki') has insufficient permissions to access it.
23 Oct 2018 16:19:27.176 [main] WARN
org.apache.flink.api.common.io.DelimitedInputFormat.getStatistics
440 - Could not determine statistics for files
'[stream2file2196887288130474065.tmp.csv]' due to an io error: File
stream2file2196887288130474065.tmp.csv does not exist or the user running Flink
('mmyellanki') has insufficient permissions to access it.
23 Oct 2018 16:19:27.237 [main] INFO
org.apache.flink.client.program.rest.RestClusterClient.submitJob
240 - Submitting job
10b49019ffc0cd92f9d23a83aaf7efbd (detached: false).
23 Oct 2018 16:19:27.281 [Flink-RestClusterClient-IO-thread-1] DEBUG
org.apache.flink.runtime.rest.RestClient.sendRequest
186 - Sending request of class class
org.apache.flink.runtime.rest.messages.job.JobSubmitRequestBody to
ec2-18-225-26-184.us-east-2.compute.amazonaws.com:6123/jobs
23 Oct 2018 16:19:27.352 [Flink-RestClusterClient-IO-thread-1] DEBUG
org.apache.flink.shaded.netty4.io.netty.util.ResourceLeakDetector.debug
81 -
-Dorg.apache.flink.shaded.netty4.io.netty.leakDetection.level: simple
23 Oct 2018 16:19:27.352 [Flink-RestClusterClient-IO-thread-1] DEBUG
org.apache.flink.shaded.netty4.io.netty.util.ResourceLeakDetector.debug
81 -
-Dorg.apache.flink.shaded.netty4.io.netty.leakDetection.targetRecords: 4
23 Oct 2018 16:19:27.359 [Flink-RestClusterClient-IO-thread-1] DEBUG
org.apache.flink.shaded.netty4.io.netty.buffer.AbstractByteBuf.debug
81 -
-Dorg.apache.flink.shaded.netty4.io.netty.buffer.bytebuf.checkAccessible: true
23 Oct 2018 16:19:27.361 [Flink-RestClusterClient-IO-thread-1] DEBUG
org.apache.flink.shaded.netty4.io.netty.util.ResourceLeakDetectorFactory.debug
76 - Loaded default ResourceLeakDetector:
org.apache.flink.shaded.netty4.io.netty.util.ResourceLeakDetector@53d32519
23 Oct 2018 16:19:27.383 [Flink-RestClusterClient-IO-thread-1] DEBUG
org.apache.flink.shaded.netty4.io.netty.util.internal.InternalThreadLocalMap.debug
76 -
-Dio.netty.threadLocalMap.stringBuilder.initialSize: 1024
23 Oct 2018 16:19:27.383 [Flink-RestClusterClient-IO-thread-1] DEBUG
org.apache.flink.shaded.netty4.io.netty.util.internal.InternalThreadLocalMap.debug
76 -
-Dio.netty.threadLocalMap.stringBuilder.maxSize: 4096
23 Oct 2018 16:19:27.385 [Flink-RestClusterClient-IO-thread-1] DEBUG
org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator.debug
76 - -Dio.netty.allocator.numHeapArenas: 8
23 Oct 2018 16:19:27.385 [Flink-RestClusterClient-IO-thread-1] DEBUG
org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator.debug
76 - -Dio.netty.allocator.numDirectArenas: 8
23 Oct 2018 16:19:27.385 [Flink-RestClusterClient-IO-thread-1] DEBUG
org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator.debug
76 - -Dio.netty.allocator.pageSize: 8192
23 Oct 2018 16:19:27.386 [Flink-RestClusterClient-IO-thread-1] DEBUG
org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator.debug
76 - -Dio.netty.allocator.maxOrder: 11
23 Oct 2018 16:19:27.386 [Flink-RestClusterClient-IO-thread-1] DEBUG
org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator.debug
76 - -Dio.netty.allocator.chunkSize: 16777216
23 Oct 2018 16:19:27.386 [Flink-RestClusterClient-IO-thread-1] DEBUG
org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator.debug
76 - -Dio.netty.allocator.tinyCacheSize: 512
23 Oct 2018 16:19:27.386 [Flink-RestClusterClient-IO-thread-1] DEBUG
org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator.debug
76 - -Dio.netty.allocator.smallCacheSize: 256
23 Oct 2018 16:19:27.386 [Flink-RestClusterClient-IO-thread-1] DEBUG
org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator.debug
76 - -Dio.netty.allocator.normalCacheSize: 64
23 Oct 2018 16:19:27.387 [Flink-RestClusterClient-IO-thread-1] DEBUG
org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator.debug
76 -
-Dio.netty.allocator.maxCachedBufferCapacity: 32768
23 Oct 2018 16:19:27.387 [Flink-RestClusterClient-IO-thread-1] DEBUG
org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator.debug
76 - -Dio.netty.allocator.cacheTrimInterval:
8192
23 Oct 2018 16:19:27.387 [Flink-RestClusterClient-IO-thread-1] DEBUG
org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator.debug
76 -
-Dio.netty.allocator.useCacheForAllThreads: true
23 Oct 2018 16:19:27.393 [Flink-RestClusterClient-IO-thread-1] DEBUG
org.apache.flink.shaded.netty4.io.netty.buffer.ByteBufUtil.debug
76 - -Dio.netty.allocator.type: pooled
23 Oct 2018 16:19:27.394 [Flink-RestClusterClient-IO-thread-1] DEBUG
org.apache.flink.shaded.netty4.io.netty.buffer.ByteBufUtil.debug
76 - -Dio.netty.threadLocalDirectBufferSize: 0
23 Oct 2018 16:19:27.394 [Flink-RestClusterClient-IO-thread-1] DEBUG
org.apache.flink.shaded.netty4.io.netty.buffer.ByteBufUtil.debug
76 - -Dio.netty.maxThreadLocalCharBufferSize:
16384
23 Oct 2018 16:19:27.397 [Flink-RestClusterClient-IO-thread-1] TRACE
org.apache.flink.runtime.rest.RestClient.createRequest
248 - Adding file
/tmp/flink-jobgraph775054359384139895.bin to request.
23 Oct 2018 16:19:27.412 [Flink-RestClusterClient-IO-thread-1] DEBUG
org.apache.flink.shaded.netty4.io.netty.channel.DefaultChannelId.debug
76 - -Dio.netty.processId: 24940 (auto-detected)
23 Oct 2018 16:19:27.414 [Flink-RestClusterClient-IO-thread-1] DEBUG
org.apache.flink.shaded.netty4.io.netty.util.NetUtil.debug
76 - -Djava.net.preferIPv4Stack: false
23 Oct 2018 16:19:27.415 [Flink-RestClusterClient-IO-thread-1] DEBUG
org.apache.flink.shaded.netty4.io.netty.util.NetUtil.debug
76 - -Djava.net.preferIPv6Addresses: false
23 Oct 2018 16:19:27.416 [Flink-RestClusterClient-IO-thread-1] DEBUG
org.apache.flink.shaded.netty4.io.netty.util.NetUtil.debug
86 - Loopback interface: lo (lo,
0:0:0:0:0:0:0:1%lo)
23 Oct 2018 16:19:27.417 [Flink-RestClusterClient-IO-thread-1] DEBUG
org.apache.flink.shaded.netty4.io.netty.util.NetUtil.debug
81 - /proc/sys/net/core/somaxconn: 128
23 Oct 2018 16:19:27.419 [Flink-RestClusterClient-IO-thread-1] DEBUG
org.apache.flink.shaded.netty4.io.netty.channel.DefaultChannelId.debug
76 - -Dio.netty.machineId:
40:b8:9a:ff:fe:03:a4:c7 (auto-detected)
23 Oct 2018 16:19:27.693 [Flink-RestClusterClient-IO-thread-3] DEBUG
org.apache.flink.shaded.netty4.io.netty.util.Recycler.debug
76 - -Dio.netty.recycler.maxCapacityPerThread:
4096
23 Oct 2018 16:19:27.693 [Flink-RestClusterClient-IO-thread-3] DEBUG
org.apache.flink.shaded.netty4.io.netty.util.Recycler.debug
76 -
-Dio.netty.recycler.maxSharedCapacityFactor: 2
23 Oct 2018 16:19:27.694 [Flink-RestClusterClient-IO-thread-3] DEBUG
org.apache.flink.shaded.netty4.io.netty.util.Recycler.debug
76 - -Dio.netty.recycler.linkCapacity: 16
23 Oct 2018 16:19:27.694 [Flink-RestClusterClient-IO-thread-3] DEBUG
org.apache.flink.shaded.netty4.io.netty.util.Recycler.debug
76 - -Dio.netty.recycler.ratio: 8
