[ https://issues.apache.org/jira/browse/BEAM-2662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Luke Cwik updated BEAM-2662: ---------------------------- Description: Spark version is missing in generated examples archetype pom.xml: {code} <dependency> <groupId>org.apache.spark</groupId> <artifactId>spark-streaming_2.10</artifactId> <version>${spark.version}</version> <--- Missing <scope>runtime</scope> <exclusions> <exclusion> <groupId>org.slf4j</groupId> <artifactId>jul-to-slf4j</artifactId> </exclusion> </exclusions> </dependency> {code} Quickstart fails with: {code} lcwik@lcwik0:~/release/word-count-beam$ mvn compile exec:java -Dexec.mainClass=org.apache.beam.examples.WordCount -Dexec.args="--runner=SparkRunner --inputFile=pom.xml --output=counts" -Pspark-runner [INFO] Scanning for projects... [ERROR] [ERROR] Some problems were encountered while processing the POMs: [ERROR] 'dependencies.dependency.version' for org.apache.spark:spark-streaming_2.10:jar is missing. @ line 241, column 21 @ [ERROR] The build could not read 1 project -> [Help 1] [ERROR] [ERROR] The project org.example:word-count-beam:0.1 (/usr/local/google/home/lcwik/release/word-count-beam/pom.xml) has 1 error [ERROR] 'dependencies.dependency.version' for org.apache.spark:spark-streaming_2.10:jar is missing. @ line 241, column 21 [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/ProjectBuildingException {code} was: Spark version is missing in examples archetype pom.xml: {code} <dependency> <groupId>org.apache.spark</groupId> <artifactId>spark-streaming_2.10</artifactId> <version>${spark.version}</version> <--- Missing <scope>runtime</scope> <exclusions> <exclusion> <groupId>org.slf4j</groupId> <artifactId>jul-to-slf4j</artifactId> </exclusion> </exclusions> </dependency> {code} Quickstart fails with: {code} lcwik@lcwik0:~/release/word-count-beam$ mvn compile exec:java -Dexec.mainClass=org.apache.beam.examples.WordCount -Dexec.args="--runner=SparkRunner --inputFile=pom.xml --output=counts" -Pspark-runner [INFO] Scanning for projects... [ERROR] [ERROR] Some problems were encountered while processing the POMs: [ERROR] 'dependencies.dependency.version' for org.apache.spark:spark-streaming_2.10:jar is missing. @ line 241, column 21 @ [ERROR] The build could not read 1 project -> [Help 1] [ERROR] [ERROR] The project org.example:word-count-beam:0.1 (/usr/local/google/home/lcwik/release/word-count-beam/pom.xml) has 1 error [ERROR] 'dependencies.dependency.version' for org.apache.spark:spark-streaming_2.10:jar is missing. @ line 241, column 21 [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/ProjectBuildingException {code} > Quickstart for Spark Java not working > ------------------------------------- > > Key: BEAM-2662 > URL: https://issues.apache.org/jira/browse/BEAM-2662 > Project: Beam > Issue Type: Bug > Components: examples-java, runner-spark > Affects Versions: 2.1.0 > Reporter: Luke Cwik > Assignee: Luke Cwik > Priority: Blocker > > Spark version is missing in generated examples archetype pom.xml: > {code} > <dependency> > <groupId>org.apache.spark</groupId> > <artifactId>spark-streaming_2.10</artifactId> > <version>${spark.version}</version> <--- Missing > <scope>runtime</scope> > <exclusions> > <exclusion> > <groupId>org.slf4j</groupId> > <artifactId>jul-to-slf4j</artifactId> > </exclusion> > </exclusions> > </dependency> > {code} > Quickstart fails with: > {code} > lcwik@lcwik0:~/release/word-count-beam$ mvn compile exec:java > -Dexec.mainClass=org.apache.beam.examples.WordCount > -Dexec.args="--runner=SparkRunner --inputFile=pom.xml --output=counts" > -Pspark-runner > [INFO] Scanning for projects... > [ERROR] [ERROR] Some problems were encountered while processing the POMs: > [ERROR] 'dependencies.dependency.version' for > org.apache.spark:spark-streaming_2.10:jar is missing. @ line 241, column 21 > @ > [ERROR] The build could not read 1 project -> [Help 1] > [ERROR] > [ERROR] The project org.example:word-count-beam:0.1 > (/usr/local/google/home/lcwik/release/word-count-beam/pom.xml) has 1 error > [ERROR] 'dependencies.dependency.version' for > org.apache.spark:spark-streaming_2.10:jar is missing. @ line 241, column 21 > [ERROR] > [ERROR] To see the full stack trace of the errors, re-run Maven with the -e > switch. > [ERROR] Re-run Maven using the -X switch to enable full debug logging. > [ERROR] > [ERROR] For more information about the errors and possible solutions, please > read the following articles: > [ERROR] [Help 1] > http://cwiki.apache.org/confluence/display/MAVEN/ProjectBuildingException > {code} -- This message was sent by Atlassian JIRA (v6.4.14#64029)