Github user Fokko commented on the issue:
https://github.com/apache/spark/pull/21596
@srowen I understand the situation, looking at the fasterxml dependency:
Not used by Hadoop 2.6:
https://hadoop.apache.org/docs/r2.6.5/hadoop-project-dist/hadoop-hdfs/dependency-analysis.html
Not used by Hadoop 2.7:
https://hadoop.apache.org/docs/r2.7.6/hadoop-project-dist/hadoop-hdfs/dependency-analysis.html
Not used by Hadoop 2.8:
https://hadoop.apache.org/docs/r2.8.4/hadoop-project-dist/hadoop-hdfs/dependency-analysis.html
Version 2.7.8 used by Hadoop 2.9:
https://hadoop.apache.org/docs/r2.9.1/hadoop-project-dist/hadoop-hdfs/dependency-analysis.html
Version 2.7.8 used by Hadoop 3.0:
https://hadoop.apache.org/docs/r3.0.3/hadoop-project-dist/hadoop-hdfs/dependency-analysis.html
Version 2.7.8 used by Hadoop 3.1:
https://hadoop.apache.org/docs/r3.1.0/hadoop-project-dist/hadoop-hdfs/dependency-analysis.html
`NON_ABSENT` has been introduced in Version 2.6 of fasterxml, so that
should not be a problem:
https://fasterxml.github.io/jackson-annotations/javadoc/2.6/com/fasterxml/jackson/annotation/JsonInclude.Include.html
It could be that different versions are pulled in transitively, but this is
hard to tell without diving in into the dependency trees. But when Hadoop
itself is set a version, I would not expect it to be overridden with a lower
version.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
