Luke Cwik created BEAM-2662:
-------------------------------
Summary: Quickstart for Spark Java not working
Key: BEAM-2662
URL: https://issues.apache.org/jira/browse/BEAM-2662
Project: Beam
Issue Type: Bug
Components: examples-java, runner-spark
Affects Versions: 2.1.0
Reporter: Luke Cwik
Assignee: Luke Cwik
Priority: Blocker
Spark version is missing in examples archetype pom.xml:
{code}
<dependency>
<groupId>org.apache.spark</groupId>
<artifactId>spark-streaming_2.10</artifactId>
<version>${spark.version}</version> <--- Missing
<scope>runtime</scope>
<exclusions>
<exclusion>
<groupId>org.slf4j</groupId>
<artifactId>jul-to-slf4j</artifactId>
</exclusion>
</exclusions>
</dependency>
{code}
Quickstart fails with:
{code}
lcwik@lcwik0:~/release/word-count-beam$ mvn compile exec:java
-Dexec.mainClass=org.apache.beam.examples.WordCount
-Dexec.args="--runner=SparkRunner --inputFile=pom.xml --output=counts"
-Pspark-runner
[INFO] Scanning for projects...
[ERROR] [ERROR] Some problems were encountered while processing the POMs:
[ERROR] 'dependencies.dependency.version' for
org.apache.spark:spark-streaming_2.10:jar is missing. @ line 241, column 21
@
[ERROR] The build could not read 1 project -> [Help 1]
[ERROR]
[ERROR] The project org.example:word-count-beam:0.1
(/usr/local/google/home/lcwik/release/word-count-beam/pom.xml) has 1 error
[ERROR] 'dependencies.dependency.version' for
org.apache.spark:spark-streaming_2.10:jar is missing. @ line 241, column 21
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please
read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/ProjectBuildingException
{code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
