Github user srowen commented on the issue:
https://github.com/apache/spark/pull/17477
The build should use 1.7.7, yes. Hadoop pulls in 1.7.4, but, it does so in
2.6 and 2.7. And the SBT and Maven builds seem to get that right as intended
because the POM directly overrides this version. (The only component on a
different Avro is the Flume module but that's not the problem here.)
I also can't reproduce this locally. It builds fine for me too with the
same commands.
I am open to workarounds, though I also don't know what will be sufficient
because we can't reproduce it. I am pretty sure the Avro 1.7.4 dependency is
coming from `hadoop-common` but no idea why only in 2.6.
sbt-unidoc has a newer version, 0.4.0, but updating it requires other
changes I don't know how to make and I don't see a reason to think it's the
problem.
I wonder if the problem is that `core` does not directly declare a
dependency on `org.apache.avro:avro` but uses it. If so then adding this might
do the trick in the core POM:
```
<dependency>
<groupId>org.apache.avro</groupId>
<artifactId>avro</artifactId>
</dependency>
```
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
