So when building 1.3.0-rc1 I see the following warning: [WARNING] spark-streaming-kafka_2.10-1.3.0.jar, unused-1.0.0.jar define 1 overlappping classes:
[WARNING] - org.apache.spark.unused.UnusedStubClass and when trying to build an assembly of a project that was previously using 1.3 snapshots without difficulty, I see the following errors: [error] (*:assembly) deduplicate: different file contents found in the following: [error] /Users/cody/.m2/repository/org/apache/spark/spark-streaming-kafka_2.10/1.3.0/spark-streaming-kafka_2.10-1.3.0.jar:org/apache/spark/unused/UnusedStubClass.class [error] /Users/cody/.m2/repository/org/spark-project/spark/unused/1.0.0/unused-1.0.0.jar:org/apache/spark/unused/UnusedStubClass.class This persists even after a clean / rebuild of both 1.3.0-rc1 and the project using it. I can just exclude that jar in the assembly definition, but is anyone else seeing similar issues? If so, might be worth resolving rather than make users mess with assembly exclusions. I see that this class was introduced a while ago, related to SPARK-3812 but the jira issue doesn't have much detail.
