I have seen NoClassDefFoundErrors even when the class is there if there is an issue loading the class (usually related to JNI failing to load or a static block failing). Try to find the first linkage error (ExceptionInInitializer / UnsatisifedLinkError / ...) in the logs as it typically has more details as to why loading failed.
On Fri, Oct 2, 2020 at 8:30 AM Tomo Suzuki <suzt...@google.com> wrote: > I suspected that io.grpc:grpc-netty-shaded:jar:1.27.2 was incorrectly > shaded, but the JAR file contains the > io/grpc/netty/shaded/io/netty/util/collection/IntObjectHashMap$2 which is > reported as missing. Strange. > > suztomo-macbookpro44% jar tf grpc-netty-shaded-1.27.2.jar |grep > IntObjectHashMap > *io/grpc/netty/shaded/io/netty/util/collection/IntObjectHashMap$2*.class > io/grpc/netty/shaded/io/netty/util/collection/IntObjectHashMap$KeySet.class > > io/grpc/netty/shaded/io/netty/util/collection/IntObjectHashMap$MapIterator.class > > io/grpc/netty/shaded/io/netty/util/collection/IntObjectHashMap$MapEntry.class > io/grpc/netty/shaded/io/netty/util/collection/IntObjectHashMap$2$1.class > > io/grpc/netty/shaded/io/netty/util/collection/IntObjectHashMap$PrimitiveIterator.class > io/grpc/netty/shaded/io/netty/util/collection/IntObjectHashMap.class > io/grpc/netty/shaded/io/netty/util/collection/IntObjectHashMap$1.class > > io/grpc/netty/shaded/io/netty/util/collection/IntObjectHashMap$KeySet$1.class > > io/grpc/netty/shaded/io/netty/util/collection/IntObjectHashMap$EntrySet.class > > On Fri, Oct 2, 2020 at 6:37 AM Kaymak, Tobias <tobias.kay...@ricardo.ch> > wrote: > >> No, that was not the case. I'm still seeing this message when canceling a >> pipeline. Sorry the spam. >> >> On Fri, Oct 2, 2020 at 12:22 PM Kaymak, Tobias <tobias.kay...@ricardo.ch> >> wrote: >> >>> I think this was caused by having the flink-runner defined twice in my >>> pom. Oo >>> (one time as defined with scope runtime, and one time without) >>> >>> >>> On Fri, Oct 2, 2020 at 9:38 AM Kaymak, Tobias <tobias.kay...@ricardo.ch> >>> wrote: >>> >>>> Sorry that I forgot to include the versions, currently I'm on Beam >>>> 2.23.0 / Flink 1.10.2 - I have a test dependency for cassandra (archinnov) >>>> which should *not *be available at runtime, refers to netty and is >>>> included in this tree, but the other two places where I find netty is in >>>> Flink and the beam-sdks-java-io-google-cloud-platform -> >>>> io.grpc:grpc-netty 1.27.2 >>>> >>>> Stupid question: How can I check which version Flink 1.10.2 is >>>> expecting in the runtime? >>>> >>>> output of mvn -Pflink-runner dependency:tree >>>> >>>> --- maven-dependency-plugin:2.8:tree (default-cli) --- >>>> ch.ricardo.di:di-beam:jar:2.11.0 >>>> +- org.apache.beam:beam-sdks-java-core:jar:2.23.0:compile >>>> | +- org.apache.beam:beam-model-pipeline:jar:2.23.0:compile >>>> | | +- com.google.errorprone:error_prone_annotations:jar:2.3.3:compile >>>> | | +- commons-logging:commons-logging:jar:1.2:compile >>>> | | +- org.apache.logging.log4j:log4j-api:jar:2.6.2:compile >>>> | | \- org.conscrypt:conscrypt-openjdk-uber:jar:1.3.0:compile >>>> | +- org.apache.beam:beam-model-job-management:jar:2.23.0:compile >>>> | +- org.apache.beam:beam-vendor-bytebuddy-1_10_8:jar:0.1:compile >>>> | +- org.apache.beam:beam-vendor-grpc-1_26_0:jar:0.3:compile >>>> | +- org.apache.beam:beam-vendor-guava-26_0-jre:jar:0.1:compile >>>> | +- com.google.code.findbugs:jsr305:jar:3.0.2:compile >>>> | +- com.fasterxml.jackson.core:jackson-core:jar:2.10.2:compile >>>> | +- com.fasterxml.jackson.core:jackson-annotations:jar:2.10.2:compile >>>> | +- com.fasterxml.jackson.core:jackson-databind:jar:2.10.2:compile >>>> | +- org.apache.avro:avro:jar:1.8.2:compile >>>> | | +- org.codehaus.jackson:jackson-core-asl:jar:1.9.13:compile >>>> | | +- org.codehaus.jackson:jackson-mapper-asl:jar:1.9.13:compile >>>> | | \- com.thoughtworks.paranamer:paranamer:jar:2.7:compile >>>> | +- org.xerial.snappy:snappy-java:jar:1.1.4:compile >>>> | \- org.tukaani:xz:jar:1.8:compile >>>> +- >>>> org.apache.beam:beam-sdks-java-io-google-cloud-platform:jar:2.23.0:compile >>>> | +- >>>> org.apache.beam:beam-sdks-java-expansion-service:jar:2.23.0:compile >>>> | | \- org.apache.beam:beam-model-fn-execution:jar:2.23.0:compile >>>> | +- >>>> org.apache.beam:beam-sdks-java-extensions-google-cloud-platform-core:jar:2.23.0:compile >>>> | | +- com.google.cloud.bigdataoss:gcsio:jar:2.1.3:compile >>>> | | \- >>>> com.google.apis:google-api-services-cloudresourcemanager:jar:v1-rev20200311-1.30.9:compile >>>> | +- com.google.cloud.bigdataoss:util:jar:2.1.3:compile >>>> | | +- >>>> com.google.api-client:google-api-client-java6:jar:1.30.9:compile >>>> | | +- >>>> com.google.api-client:google-api-client-jackson2:jar:1.30.9:compile >>>> | | +- >>>> com.google.oauth-client:google-oauth-client-java6:jar:1.30.6:compile >>>> | | +- com.google.flogger:google-extensions:jar:0.5.1:compile >>>> | | | \- com.google.flogger:flogger:jar:0.5.1:compile >>>> | | \- com.google.flogger:flogger-system-backend:jar:0.5.1:runtime >>>> | | \- org.checkerframework:checker-compat-qual:jar:2.5.3:runtime >>>> | +- com.google.api:gax:jar:1.54.0:compile >>>> | | \- org.threeten:threetenbp:jar:1.4.0:compile >>>> | +- com.google.api:gax-grpc:jar:1.54.0:compile >>>> | | \- io.grpc:grpc-protobuf:jar:1.27.2:compile >>>> | | \- io.grpc:grpc-protobuf-lite:jar:1.27.2:compile >>>> | +- >>>> com.google.apis:google-api-services-healthcare:jar:v1beta1-rev20200525-1.30.9:compile >>>> | +- com.google.auth:google-auth-library-credentials:jar:0.19.0:compile >>>> | +- com.google.auth:google-auth-library-oauth2-http:jar:0.19.0:compile >>>> | +- >>>> com.google.cloud:google-cloud-bigquerystorage:jar:0.125.0-beta:compile >>>> | | +- >>>> com.google.api.grpc:proto-google-cloud-bigquerystorage-v1alpha2:jar:0.90.0:compile >>>> | | +- >>>> com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta2:jar:0.90.0:compile >>>> | | \- >>>> com.google.api.grpc:proto-google-cloud-bigquerystorage-v1:jar:0.90.0:compile >>>> | +- com.google.cloud.bigtable:bigtable-client-core:jar:1.13.0:compile >>>> | | +- com.google.cloud:google-cloud-bigtable:jar:1.9.1:compile >>>> | | +- >>>> com.google.api.grpc:grpc-google-common-protos:jar:1.17.0:compile >>>> | | +- >>>> com.google.api.grpc:grpc-google-cloud-bigtable-v2:jar:1.9.1:compile >>>> | | +- >>>> com.google.api.grpc:proto-google-cloud-bigtable-admin-v2:jar:1.9.1:compile >>>> | | +- >>>> com.google.api.grpc:grpc-google-cloud-bigtable-admin-v2:jar:1.9.1:compile >>>> | | +- com.google.api.grpc:proto-google-iam-v1:jar:0.13.0:compile >>>> | | +- io.opencensus:opencensus-contrib-grpc-util:jar:0.24.0:compile >>>> | | +- io.dropwizard.metrics:metrics-core:jar:3.2.6:compile >>>> | | \- commons-codec:commons-codec:jar:1.13:compile >>>> | +- com.google.cloud:google-cloud-core:jar:1.92.2:compile >>>> | +- com.google.cloud:google-cloud-core-grpc:jar:1.92.2:compile >>>> | +- >>>> com.google.cloud.datastore:datastore-v1-proto-client:jar:1.6.3:compile >>>> | | \- >>>> com.google.http-client:google-http-client-protobuf:jar:1.33.0:compile >>>> | +- com.google.cloud:google-cloud-spanner:jar:1.49.1:compile >>>> | | +- >>>> com.google.api.grpc:proto-google-cloud-spanner-admin-instance-v1:jar:1.49.1:compile >>>> | | \- >>>> com.google.api.grpc:proto-google-cloud-spanner-v1:jar:1.49.1:compile >>>> | +- >>>> com.google.http-client:google-http-client-jackson2:jar:1.34.0:compile >>>> | +- io.grpc:grpc-all:jar:1.27.2:compile >>>> | | +- io.grpc:grpc-api:jar:1.27.2:compile (version selected from >>>> constraint [1.27.2,1.27.2]) >>>> | | +- io.grpc:grpc-okhttp:jar:1.27.2:compile >>>> | | | +- com.squareup.okio:okio:jar:1.13.0:compile >>>> | | | \- com.squareup.okhttp:okhttp:jar:2.5.0:compile >>>> | | \- io.grpc:grpc-testing:jar:1.27.2:compile >>>> | +- io.grpc:grpc-alts:jar:1.27.2:compile >>>> | +- io.grpc:grpc-auth:jar:1.27.2:compile >>>> | +- io.grpc:grpc-core:jar:1.27.2:compile >>>> | | +- com.google.android:annotations:jar:4.1.1.4:compile >>>> | | \- io.perfmark:perfmark-api:jar:0.19.0:compile >>>> | +- io.grpc:grpc-context:jar:1.27.2:compile >>>> | +- io.grpc:grpc-grpclb:jar:1.27.2:compile >>>> | +- io.grpc:grpc-netty:jar:1.27.2:compile >>>> | | +- io.netty:netty-codec-http2:jar:4.1.42.Final:compile (version >>>> selected from constraint [4.1.42.Final,4.1.42.Final]) >>>> | | | +- io.netty:netty-common:jar:4.1.42.Final:compile >>>> | | | \- io.netty:netty-codec-http:jar:4.1.42.Final:compile >>>> | | \- io.netty:netty-handler-proxy:jar:4.1.42.Final:compile >>>> | | \- io.netty:netty-codec-socks:jar:4.1.42.Final:compile >>>> | +- io.grpc:grpc-netty-shaded:jar:1.27.2:compile >>>> | +- io.grpc:grpc-stub:jar:1.27.2:compile >>>> | +- com.google.api.grpc:grpc-google-cloud-pubsub-v1:jar:1.85.1:compile >>>> | +- com.google.guava:guava:jar:25.1-jre:compile >>>> | | +- org.checkerframework:checker-qual:jar:2.0.0:compile >>>> | | \- org.codehaus.mojo:animal-sniffer-annotations:jar:1.14:compile >>>> | +- io.netty:netty-handler:jar:4.1.30.Final:compile >>>> | | +- io.netty:netty-buffer:jar:4.1.30.Final:compile >>>> | | +- io.netty:netty-transport:jar:4.1.30.Final:compile >>>> | | | \- io.netty:netty-resolver:jar:4.1.30.Final:compile >>>> | | \- io.netty:netty-codec:jar:4.1.30.Final:compile >>>> | +- io.netty:netty-tcnative-boringssl-static:jar:2.0.17.Final:compile >>>> | +- >>>> com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta1:jar:0.85.1:compile >>>> | +- >>>> com.google.api.grpc:proto-google-cloud-bigtable-v2:jar:1.9.1:compile >>>> | +- >>>> com.google.api.grpc:proto-google-cloud-datastore-v1:jar:0.85.0:compile >>>> | | \- javax.annotation:javax.annotation-api:jar:1.3.2:compile >>>> | +- >>>> com.google.api.grpc:proto-google-cloud-pubsub-v1:jar:1.85.1:compile >>>> | +- >>>> com.google.api.grpc:proto-google-cloud-spanner-admin-database-v1:jar:1.49.1:compile >>>> | +- com.google.api.grpc:proto-google-common-protos:jar:1.17.0:compile >>>> | \- com.google.protobuf:protobuf-java:jar:3.11.1:compile >>>> +- com.google.api-client:google-api-client:jar:1.30.9:compile >>>> | \- com.google.oauth-client:google-oauth-client:jar:1.30.5:compile >>>> +- >>>> com.google.apis:google-api-services-bigquery:jar:v2-rev20191211-1.30.9:compile >>>> +- com.google.http-client:google-http-client:jar:1.34.0:compile >>>> | +- org.apache.httpcomponents:httpclient:jar:4.5.10:compile >>>> | +- org.apache.httpcomponents:httpcore:jar:4.4.12:compile >>>> | +- com.google.j2objc:j2objc-annotations:jar:1.3:compile >>>> | +- io.opencensus:opencensus-api:jar:0.24.0:compile >>>> | \- io.opencensus:opencensus-contrib-http-util:jar:0.24.0:compile >>>> +- >>>> com.google.apis:google-api-services-pubsub:jar:v1-rev20200312-1.30.9:compile >>>> +- joda-time:joda-time:jar:2.10.5:compile >>>> +- org.slf4j:slf4j-api:jar:1.7.25:compile >>>> +- org.hamcrest:hamcrest-core:jar:2.1:compile >>>> | \- org.hamcrest:hamcrest:jar:2.1:compile >>>> +- org.hamcrest:hamcrest-library:jar:2.1:compile >>>> +- junit:junit:jar:4.13-beta-3:compile >>>> +- org.apache.beam:beam-runners-direct-java:jar:2.23.0:compile >>>> | \- args4j:args4j:jar:2.33:compile >>>> +- org.apache.beam:beam-sdks-java-io-solr:jar:2.23.0:compile >>>> | +- org.apache.commons:commons-compress:jar:1.20:compile >>>> | \- org.apache.solr:solr-solrj:jar:5.5.4:compile >>>> | +- commons-io:commons-io:jar:2.4:compile >>>> | +- org.apache.httpcomponents:httpmime:jar:4.4.1:compile >>>> | +- org.apache.zookeeper:zookeeper:jar:3.4.6:compile >>>> | +- org.codehaus.woodstox:stax2-api:jar:3.1.4:compile >>>> | +- org.codehaus.woodstox:woodstox-core-asl:jar:4.4.1:compile >>>> | +- org.noggit:noggit:jar:0.6:compile >>>> | \- org.slf4j:jcl-over-slf4j:jar:1.7.7:compile >>>> +- org.apache.beam:beam-sdks-java-io-kafka:jar:2.23.0:compile >>>> | +- org.springframework:spring-expression:jar:4.3.18.RELEASE:compile >>>> | | \- org.springframework:spring-core:jar:4.3.18.RELEASE:compile >>>> | \- io.confluent:kafka-avro-serializer:jar:5.3.2:compile >>>> | +- io.confluent:kafka-schema-registry-client:jar:5.3.2:compile >>>> | +- io.confluent:common-config:jar:5.3.2:compile >>>> | \- io.confluent:common-utils:jar:5.3.2:compile >>>> | \- com.101tec:zkclient:jar:0.10:compile >>>> +- org.apache.beam:beam-sdks-java-io-cassandra:jar:2.23.0:compile >>>> | +- com.datastax.cassandra:cassandra-driver-core:jar:3.8.0:compile >>>> | | +- com.github.jnr:jnr-ffi:jar:2.1.7:compile >>>> | | | +- com.github.jnr:jffi:jar:1.2.16:compile >>>> | | | +- com.github.jnr:jffi:jar:native:1.2.16:runtime >>>> | | | +- org.ow2.asm:asm-commons:jar:5.0.3:compile >>>> | | | +- org.ow2.asm:asm-analysis:jar:5.0.3:compile >>>> | | | +- org.ow2.asm:asm-tree:jar:5.0.3:compile >>>> | | | +- org.ow2.asm:asm-util:jar:5.0.3:compile >>>> | | | \- com.github.jnr:jnr-x86asm:jar:1.0.2:compile >>>> | | \- com.github.jnr:jnr-posix:jar:3.0.44:compile >>>> | | \- com.github.jnr:jnr-constants:jar:0.9.9:compile >>>> | \- com.datastax.cassandra:cassandra-driver-mapping:jar:3.8.0:compile >>>> +- org.apache.kafka:kafka-clients:jar:2.3.0:compile >>>> | +- com.github.luben:zstd-jni:jar:1.4.0-1:compile >>>> | \- org.lz4:lz4-java:jar:1.6.0:compile >>>> +- com.google.protobuf:protobuf-java-util:jar:3.6.1:compile >>>> | \- com.google.code.gson:gson:jar:2.7:compile >>>> +- ch.ricardo.schema:proto-schemas:jar:3.1.12:compile >>>> +- org.mockito:mockito-core:jar:3.0.0:test >>>> | +- net.bytebuddy:byte-buddy:jar:1.9.10:test >>>> | +- net.bytebuddy:byte-buddy-agent:jar:1.9.10:test >>>> | \- org.objenesis:objenesis:jar:2.6:runtime >>>> +- com.google.auto.value:auto-value-annotations:jar:1.6.2:compile >>>> +- com.google.auto.value:auto-value:jar:1.6.2:provided >>>> +- org.projectlombok:lombok:jar:1.16.22:compile >>>> +- com.jayway.jsonpath:json-path:jar:2.3.0:compile >>>> | \- net.minidev:json-smart:jar:2.3:compile >>>> | \- net.minidev:accessors-smart:jar:1.2:compile >>>> +- org.apache.commons:commons-lang3:jar:3.8.1:compile >>>> +- com.google.cloud:google-cloud-bigquery:jar:0.38.0-beta:compile >>>> | \- com.google.cloud:google-cloud-core-http:jar:1.20.0:compile >>>> | +- >>>> com.google.http-client:google-http-client-appengine:jar:1.23.0:compile >>>> | +- >>>> com.google.http-client:google-http-client-jackson:jar:1.23.0:compile >>>> | \- com.google.api:gax-httpjson:jar:0.36.0:compile >>>> +- org.apache.beam:beam-sdks-java-extensions-protobuf:jar:2.23.0:compile >>>> +- info.archinnov:achilles-junit:jar:6.0.4:test >>>> | +- info.archinnov:achilles-embedded:jar:6.0.4:test >>>> | | +- info.archinnov:achilles-common:jar:6.0.4:test >>>> | | | \- info.archinnov:achilles-model:jar:6.0.4:test >>>> | | +- org.apache.cassandra:cassandra-all:jar:3.11.4:test >>>> | | | +- net.jpountz.lz4:lz4:jar:1.3.0:test >>>> | | | +- com.ning:compress-lzf:jar:0.8.4:test >>>> | | | +- >>>> com.googlecode.concurrentlinkedhashmap:concurrentlinkedhashmap-lru:jar:1.4:test >>>> | | | +- org.antlr:antlr:jar:3.5.2:test >>>> | | | | \- org.antlr:ST4:jar:4.0.8:test >>>> | | | +- org.antlr:antlr-runtime:jar:3.5.2:test >>>> | | | +- com.googlecode.json-simple:json-simple:jar:1.1:test >>>> | | | +- com.boundary:high-scale-lib:jar:1.0.6:test >>>> | | | +- org.yaml:snakeyaml:jar:1.11:test >>>> | | | +- org.mindrot:jbcrypt:jar:0.3m:test >>>> | | | +- io.airlift:airline:jar:0.6:test >>>> | | | | \- javax.inject:javax.inject:jar:1:test >>>> | | | +- io.dropwizard.metrics:metrics-jvm:jar:3.1.5:test >>>> | | | +- com.addthis.metrics:reporter-config3:jar:3.0.3:test >>>> | | | | +- com.addthis.metrics:reporter-config-base:jar:3.0.3:test >>>> | | | | \- org.hibernate:hibernate-validator:jar:4.3.0.Final:test >>>> | | | | \- org.jboss.logging:jboss-logging:jar:3.1.0.CR2:test >>>> | | | +- com.thinkaurelius.thrift:thrift-server:jar:0.3.7:test >>>> | | | | \- com.lmax:disruptor:jar:3.0.1:test >>>> | | | +- com.clearspring.analytics:stream:jar:2.5.2:test >>>> | | | | \- it.unimi.dsi:fastutil:jar:6.5.7:test >>>> | | | +- org.apache.thrift:libthrift:jar:0.9.2:test >>>> | | | +- org.apache.cassandra:cassandra-thrift:jar:3.11.4:test >>>> | | | | +- com.carrotsearch:hppc:jar:0.5.4:test >>>> | | | | +- de.jflex:jflex:jar:1.6.0:test >>>> | | | | | \- org.apache.ant:ant:jar:1.7.0:test >>>> | | | | | \- org.apache.ant:ant-launcher:jar:1.7.0:test >>>> | | | | +- com.github.rholder:snowball-stemmer:jar:1.3.0.581.1:test >>>> | | | | \- >>>> com.googlecode.concurrent-trees:concurrent-trees:jar:2.4.0:test >>>> | | | +- net.java.dev.jna:jna:jar:4.2.2:test >>>> | | | +- com.github.jbellis:jamm:jar:0.3.0:test >>>> | | | +- io.netty:netty-all:jar:4.0.44.Final:test >>>> | | | +- org.fusesource:sigar:jar:1.6.4:test >>>> | | | +- org.caffinitas.ohc:ohc-core:jar:0.4.4:test >>>> | | | +- org.caffinitas.ohc:ohc-core-j8:jar:0.4.4:test >>>> | | | +- com.github.ben-manes.caffeine:caffeine:jar:2.2.6:test >>>> | | | \- org.jctools:jctools-core:jar:1.2.1:test >>>> | | +- >>>> com.datastax.cassandra:cassandra-driver-core:jar:shaded:3.6.0:test >>>> | | \- org.ow2.asm:asm:jar:5.0.4:compile >>>> | \- info.archinnov:achilles-core:jar:6.0.4:test >>>> | +- com.datastax.cassandra:cassandra-driver-extras:jar:3.6.0:test >>>> | +- commons-collections:commons-collections:jar:3.2.2:runtime >>>> | +- com.google.auto.service:auto-service:jar:1.0-rc2:test >>>> | +- com.google.auto:auto-common:jar:0.4:test >>>> | +- org.eclipse.jdt.core.compiler:ecj:jar:4.4.2:test >>>> | +- com.squareup:javapoet:jar:1.5.1:test >>>> | +- javax.validation:validation-api:jar:1.1.0.Final:test >>>> | \- >>>> com.fasterxml.jackson.module:jackson-module-jaxb-annotations:jar:2.9.9:test >>>> +- org.jetbrains:annotations:jar:20.1.0:compile >>>> +- com.google.cloud:google-cloud-bigtable-emulator:jar:0.124.0:test >>>> | \- com.google.api:api-common:jar:1.10.0:compile >>>> +- >>>> org.apache.beam:beam-runners-google-cloud-dataflow-java:jar:2.23.0:runtime >>>> | +- >>>> org.apache.beam:beam-runners-core-construction-java:jar:2.23.0:compile >>>> | | \- io.github.classgraph:classgraph:jar:4.8.65:compile >>>> | +- >>>> com.google.apis:google-api-services-clouddebugger:jar:v2-rev20200313-1.30.9:runtime >>>> | +- >>>> com.google.apis:google-api-services-dataflow:jar:v1b3-rev20200305-1.30.9:runtime >>>> | \- >>>> com.google.apis:google-api-services-storage:jar:v1-rev20200226-1.30.9:compile >>>> \- org.apache.beam:beam-runners-flink-1.10:jar:2.23.0:runtime >>>> +- org.apache.beam:beam-runners-core-java:jar:2.23.0:runtime >>>> | \- org.apache.beam:beam-sdks-java-fn-execution:jar:2.23.0:compile >>>> +- org.apache.beam:beam-runners-java-fn-execution:jar:2.23.0:compile >>>> | \- >>>> org.apache.beam:beam-vendor-sdks-java-extensions-protobuf:jar:2.23.0:compile >>>> +- org.apache.beam:beam-runners-java-job-service:jar:2.23.0:runtime >>>> +- org.apache.flink:flink-clients_2.11:jar:1.10.1:runtime >>>> | +- org.apache.flink:flink-optimizer_2.11:jar:1.10.1:runtime >>>> | +- commons-cli:commons-cli:jar:1.3.1:runtime >>>> | \- org.apache.flink:force-shading:jar:1.10.1:runtime >>>> +- org.apache.flink:flink-core:jar:1.10.1:runtime >>>> | +- org.apache.flink:flink-annotations:jar:1.10.1:runtime >>>> | +- org.apache.flink:flink-shaded-asm-7:jar:7.1-9.0:runtime >>>> | +- com.esotericsoftware.kryo:kryo:jar:2.24.0:runtime >>>> | | \- com.esotericsoftware.minlog:minlog:jar:1.2:runtime >>>> | \- org.apache.flink:flink-shaded-guava:jar:18.0-9.0:runtime >>>> +- org.apache.flink:flink-metrics-core:jar:1.10.1:runtime >>>> +- org.apache.flink:flink-java:jar:1.10.1:runtime >>>> | \- org.apache.commons:commons-math3:jar:3.5:runtime >>>> +- org.apache.flink:flink-runtime_2.11:jar:1.10.1:runtime >>>> | +- >>>> org.apache.flink:flink-queryable-state-client-java:jar:1.10.1:runtime >>>> | +- org.apache.flink:flink-hadoop-fs:jar:1.10.1:runtime >>>> | +- >>>> org.apache.flink:flink-shaded-netty:jar:4.1.39.Final-9.0:runtime >>>> | +- org.apache.flink:flink-shaded-jackson:jar:2.10.1-9.0:runtime >>>> | +- org.javassist:javassist:jar:3.24.0-GA:runtime >>>> | +- org.scala-lang:scala-library:jar:2.11.12:runtime >>>> | +- com.typesafe.akka:akka-actor_2.11:jar:2.5.21:runtime >>>> | | +- com.typesafe:config:jar:1.3.3:runtime >>>> | | \- >>>> org.scala-lang.modules:scala-java8-compat_2.11:jar:0.7.0:runtime >>>> | +- com.typesafe.akka:akka-stream_2.11:jar:2.5.21:runtime >>>> | | +- org.reactivestreams:reactive-streams:jar:1.0.2:runtime >>>> | | \- com.typesafe:ssl-config-core_2.11:jar:0.3.7:runtime >>>> | | \- >>>> org.scala-lang.modules:scala-parser-combinators_2.11:jar:1.1.1:runtime >>>> | +- com.typesafe.akka:akka-protobuf_2.11:jar:2.5.21:runtime >>>> | +- com.typesafe.akka:akka-slf4j_2.11:jar:2.5.21:runtime >>>> | +- org.clapper:grizzled-slf4j_2.11:jar:1.3.2:runtime >>>> | +- com.github.scopt:scopt_2.11:jar:3.5.0:runtime >>>> | \- com.twitter:chill_2.11:jar:0.7.6:runtime >>>> | \- com.twitter:chill-java:jar:0.7.6:runtime >>>> \- org.apache.flink:flink-streaming-java_2.11:jar:1.10.1:runtime >>>> >>>> >>>> On Thu, Oct 1, 2020 at 5:23 PM Kyle Weaver <kcwea...@google.com> wrote: >>>> >>>>> Can you provide your beam and flink versions as well? >>>>> >>>>> On Thu, Oct 1, 2020 at 5:59 AM Tomo Suzuki <suzt...@google.com> wrote: >>>>> >>>>>> To fix the problem we need to identify which JAR file contains >>>>>> io.grpc.netty.shaded.io.netty.util.collection.IntObjectHashMap. Can >>>>>> you check which version of which artifact (I suspect io.grpc:grpc-netty) >>>>>> has the class in your runtime? >>>>>> >>>>>> As far as I know, Beam's vendored (shaded) class files have the >>>>>> package name "org.apache.beam.vendor" prefix. >>>>>> >>>>>> On Thu, Oct 1, 2020 at 3:48 AM Kaymak, Tobias < >>>>>> tobias.kay...@ricardo.ch> wrote: >>>>>> >>>>>>> Hello, >>>>>>> >>>>>>> when deploying a Beam streaming pipeline on Flink and canceling it >>>>>>> after some time, the following can be seen in the logs: >>>>>>> >>>>>>> 2020-10-01 07:36:47,605 WARN >>>>>>> io.grpc.netty.shaded.io.netty.channel.epoll.EpollEventLoop - >>>>>>> Unexpected >>>>>>> exception in the selector loop. >>>>>>> flink-taskmanager-7695c66775-xtz4l taskmanager >>>>>>> java.lang.NoClassDefFoundError: >>>>>>> io/grpc/netty/shaded/io/netty/util/collection/IntObjectHashMap$2 >>>>>>> flink-taskmanager-7695c66775-xtz4l taskmanager at >>>>>>> io.grpc.netty.shaded.io.netty.util.collection.IntObjectHashMap.values(IntObjectHashMap.java:221) >>>>>>> flink-taskmanager-7695c66775-xtz4l taskmanager at >>>>>>> io.grpc.netty.shaded.io.netty.channel.epoll.EpollEventLoop.closeAll(EpollEventLoop.java:436) >>>>>>> flink-taskmanager-7695c66775-xtz4l taskmanager at >>>>>>> io.grpc.netty.shaded.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:401) >>>>>>> flink-taskmanager-7695c66775-xtz4l taskmanager at >>>>>>> io.grpc.netty.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1044) >>>>>>> flink-taskmanager-7695c66775-xtz4l taskmanager at >>>>>>> io.grpc.netty.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) >>>>>>> flink-taskmanager-7695c66775-xtz4l taskmanager at >>>>>>> io.grpc.netty.shaded.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) >>>>>>> flink-taskmanager-7695c66775-xtz4l taskmanager at >>>>>>> java.lang.Thread.run(Thread.java:748) >>>>>>> >>>>>>> A mvn dependency:tree reveals that >>>>>>> >>>>>>> org.apache.beam:beam-sdks-java-io-google-cloud-platform >>>>>>> >>>>>>> and the Flink runner itself defines netty, where Flink uses a shaded >>>>>>> one - if I get this right. >>>>>>> >>>>>>> What is the best way to fix this? >>>>>>> >>>>>>> >>>>>>> >>>>>> >>>>>> -- >>>>>> Regards, >>>>>> Tomo >>>>>> >>>>>> >>>>>> > > -- > Regards, > Tomo >
