Hi Stephen,
Thanks for the suggestions!
I had come to the same conclusion but haven't been able to shade or set
"provides" to work around it.
The "mvn dependency:tree" looks good to me...
Can anyone share a pom dependencies/exclusions fragment that is working
for them with KafkaIO on a Flink/Yarn cluster?
Thanks,
Wayne
Subject:
Re: java.lang.IllegalAccessError with KafkaIO
From:
Stephan Ewen <[email protected]>
Date:
2016-11-24 02:38 PM
To:
[email protected], [email protected]
I think have seen these kind of errors before.
It is the JVM checking upon class loading (lazy linking) that a
private/protected access is valid.
It could be that this violation is because there are multiple versions
of that class loaded - some in the SystemClassLoader and some in the
user library jar file.
Fixing this probably needs some dependency cleanup, for example
properly setting dependencies as "provided" that should not be
packaged again into the user code jar. Also, reducing visible
dependencies by shading them away helps.
(snip)
