[ https://issues.apache.org/jira/browse/BEAM-349 ]
Danny McCormick deleted comment on BEAM-349:
--------------------------------------
was (Author: JIRAUSER282469):
This issue has been migrated to [https://github.com/apache/beam/issues/17899]
> Spark runner should provide a default BoM
> -----------------------------------------
>
> Key: BEAM-349
> URL: https://issues.apache.org/jira/browse/BEAM-349
> Project: Beam
> Issue Type: Improvement
> Components: runner-spark
> Reporter: Jean-Baptiste Onofré
> Priority: P3
>
> When an user defines a pipeline, he has to define the following dependencies
> in order to work with the Spark runner (in addition of the Spark runner
> artifact itself):
> {code}
> <dependency>
> <groupId>org.apache.spark</groupId>
> <artifactId>spark-core_2.10</artifactId>
> <version>${spark.version}</version>
> </dependency>
> <dependency>
> <groupId>org.apache.spark</groupId>
> <artifactId>spark-streaming_2.10</artifactId>
> <version>${spark.version}</version>
> </dependency>
> <dependency>
> <groupId>com.fasterxml.jackson.core</groupId>
> <artifactId>jackson-core</artifactId>
> <version>${jackson.version}</version>
> </dependency>
> <dependency>
> <groupId>com.fasterxml.jackson.core</groupId>
> <artifactId>jackson-annotations</artifactId>
> <version>${jackson.version}</version>
> </dependency>
> <dependency>
> <groupId>com.fasterxml.jackson.core</groupId>
> <artifactId>jackson-databind</artifactId>
> <version>${jackson.version}</version>
> </dependency>
> <dependency>
> <groupId>com.fasterxml.jackson.module</groupId>
> <artifactId>jackson-module-scala_2.10</artifactId>
> <version>${jackson.version}</version>
> </dependency>
> {code}
> These dependencies should come as transitive dependencies from the Spark
> runner (as Flink or dataflow runners do). It means we should change the scope
> of the dependencies in the Spark runner pom to create a BoM (Bill of
> Material).
> I will experiment a bit (with [~amitsela]).
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
