[
https://issues.apache.org/jira/browse/BEAM-349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Beam JIRA Bot updated BEAM-349:
-------------------------------
Labels: stale-assigned (was: )
> Spark runner should provide a default BoM
> -----------------------------------------
>
> Key: BEAM-349
> URL: https://issues.apache.org/jira/browse/BEAM-349
> Project: Beam
> Issue Type: Improvement
> Components: runner-spark
> Reporter: Jean-Baptiste Onofré
> Assignee: Jean-Baptiste Onofré
> Priority: P2
> Labels: stale-assigned
>
> When an user defines a pipeline, he has to define the following dependencies
> in order to work with the Spark runner (in addition of the Spark runner
> artifact itself):
> {code}
> <dependency>
> <groupId>org.apache.spark</groupId>
> <artifactId>spark-core_2.10</artifactId>
> <version>${spark.version}</version>
> </dependency>
> <dependency>
> <groupId>org.apache.spark</groupId>
> <artifactId>spark-streaming_2.10</artifactId>
> <version>${spark.version}</version>
> </dependency>
> <dependency>
> <groupId>com.fasterxml.jackson.core</groupId>
> <artifactId>jackson-core</artifactId>
> <version>${jackson.version}</version>
> </dependency>
> <dependency>
> <groupId>com.fasterxml.jackson.core</groupId>
> <artifactId>jackson-annotations</artifactId>
> <version>${jackson.version}</version>
> </dependency>
> <dependency>
> <groupId>com.fasterxml.jackson.core</groupId>
> <artifactId>jackson-databind</artifactId>
> <version>${jackson.version}</version>
> </dependency>
> <dependency>
> <groupId>com.fasterxml.jackson.module</groupId>
> <artifactId>jackson-module-scala_2.10</artifactId>
> <version>${jackson.version}</version>
> </dependency>
> {code}
> These dependencies should come as transitive dependencies from the Spark
> runner (as Flink or dataflow runners do). It means we should change the scope
> of the dependencies in the Spark runner pom to create a BoM (Bill of
> Material).
> I will experiment a bit (with [~amitsela]).
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
