On Mon, Jun 06, 2022 at 10:42:08AM +0800, Shengkai Fang wrote: > Hi. In my experience, the step to debug classloading problems are as > follows:
Thanks for the help. We get the following log when using
`-verbose:class`:
[2.074s][info][class,load] org.apache.hadoop.fs.FileSystem source:
file:/opt/flink/opt/flink-s3-fs-hadoop-1.15.0.jar
...
[8.094s][info][class,load]
com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystem source:
file:/opt/flink/opt/flink-gs-fs-hadoop-1.15.0.jar
It looks like application uses hadoop.fs.FileSystem from
flink-s3-fs-hadoop-1.15.0.jar, and use GoogleHadoopFileSystem from
flink-gs-fs-hadoop-1.15.0.jar, and they are incompatible. Since we run
Flink in both AWS and GCP, our base image contains both plugins at the
same time. Any idea how to workaround it?
We also try to set `classloader.resolve-order: parent-first`. However,
we got another error causing by library conflict between Flink and our
application:
Caused by: com.fasterxml.jackson.databind.JsonMappingException: Scala module
2.11.3 requires Jackson Databind version >= 2.11.0 and < 2.12.0
--
ChangZhuo Chen (陳昌倬) czchen@{czchen,debian}.org
http://czchen.info/
Key fingerprint = BA04 346D C2E1 FE63 C790 8793 CC65 B0CD EC27 5D5B
signature.asc
Description: PGP signature
