rdblue commented on pull request #3642: URL: https://github.com/apache/iceberg/pull/3642#issuecomment-990171336
I looked into this a bit more since @racevedoo mentioned that this affects other Spark versions. It looks like something caused the runtime Jars to start declaring dependencies and that's the problem. The 0.12.1 runtime Jar doesn't declare any dependencies, which is correct: https://repo1.maven.org/maven2/org/apache/iceberg/iceberg-spark3-runtime/0.12.1/iceberg-spark3-runtime-0.12.1.pom. But the 0.13.0-SNAPSHOT runtime Jar does have dependencies: https://repository.apache.org/content/repositories/snapshots/org/apache/iceberg/iceberg-spark-runtime-3.2_2.12/0.13.0-SNAPSHOT/iceberg-spark-runtime-3.2_2.12-0.13.0-20211209.000820-7.pom My guess is that the move to gradle 7 changed this and we didn't notice at the time. That PR updated the configuration of the shadow plugin that we use to create the Jars. We'll need to remove the bundled dependencies from being listed in the POM file. I don't think that this PR is the right path forward. It isn't that the version isn't populated, it is that the dependency is declared even though the code is bundled in the runtime Jar. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
