EnricoMi commented on PR #40933: URL: https://github.com/apache/spark/pull/40933#issuecomment-1536432927
Spark pulls in Jackson 2.15.0 for compile scope. Projects depending on Spark do not transitively depend on Jackson 2.15.0. Spark depends on Avro which depends on Jackson 2.12.7. Projects that depend on Spark transitively depend on Jackson 2.12.7. Maybe spark-core should depend on Jackson 2.15.0 with runtime scope, rather than compile scope. The following pom reproduces the issue: ```xml <project xmlns="http://maven.apache.org/POM/4.0.0"; xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"; xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/maven-v4_0_0.xsd";> <modelVersion>4.0.0</modelVersion> <groupId>uk.co.gresearch.spark</groupId> <artifactId>spark-example_2.13</artifactId> <version>1.0.0-SNAPSHOT</version> <dependencies> <dependency> <groupId>org.apache.spark</groupId> <artifactId>spark-core_2.13</artifactId> <version>3.5.0-SNAPSHOT</version> <scope>provided</scope> </dependency> </dependencies> <repositories> <!-- required to resolve Spark snapshot versions --> <repository> <id>apache snapshots</id> <name>Apache Snapshots</name> <url>https://repository.apache.org/snapshots/</url> </repository> </repositories> </project> ``` ```bash mvn dependency:tree ``` ``` [INFO] uk.co.gresearch.spark:spark-example_2.13:jar:1.0.0-SNAPSHOT [INFO] \- org.apache.spark:spark-core_2.13:jar:3.5.0-SNAPSHOT:provided [INFO] +- org.scala-lang.modules:scala-parallel-collections_2.13:jar:1.0.4:provided [INFO] +- org.apache.avro:avro:jar:1.11.1:provided [INFO] | \- com.fasterxml.jackson.core:jackson-core:jar:2.12.7:provided ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
