[
https://issues.apache.org/jira/browse/SPARK-7820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14555764#comment-14555764
]
Sean Owen commented on SPARK-7820:
----------------------------------
I meant your test fails because your command line has a typo, right?
-Pjava8-test does not activate a profile.
> Java8-tests suite compile error under SBT
> -----------------------------------------
>
> Key: SPARK-7820
> URL: https://issues.apache.org/jira/browse/SPARK-7820
> Project: Spark
> Issue Type: Bug
> Components: Build, Streaming
> Affects Versions: 1.4.0
> Reporter: Saisai Shao
> Priority: Minor
>
> Lots of compilation error is shown when java 8 test suite is enabled in SBT:
> {{JAVA_HOME=/usr/java/jdk1.8.0_45 ./sbt/sbt -Pyarn -Phadoop-2.4
> -Dhadoop.version=2.6.0 -Pjava8-test}}
> {code}
> [error]
> /mnt/data/project/apache-spark/extras/java8-tests/src/test/java/org/apache/spark/streaming/Java8APISuite.java:43:
> error: cannot find symbol
> [error] public class Java8APISuite extends LocalJavaStreamingContext
> implements Serializable {
> [error] ^
> [error] symbol: class LocalJavaStreamingContext
> [error]
> /mnt/data/project/apache-spark/extras/java8-tests/src/test/java/org/apache/spark/streaming/Java8APISuite.java:55:
> error: cannot find symbol
> [error] JavaDStream<String> stream =
> JavaTestUtils.attachTestInputStream(ssc, inputData, 1);
> [error] ^
> [error] symbol: variable ssc
> [error] location: class Java8APISuite
> [error]
> /mnt/data/project/apache-spark/extras/java8-tests/src/test/java/org/apache/spark/streaming/Java8APISuite.java:55:
> error: cannot find symbol
> [error] JavaDStream<String> stream =
> JavaTestUtils.attachTestInputStream(ssc, inputData, 1);
> [error] ^
> [error] symbol: variable JavaTestUtils
> [error] location: class Java8APISuite
> [error]
> /mnt/data/project/apache-spark/extras/java8-tests/src/test/java/org/apache/spark/streaming/Java8APISuite.java:57:
> error: cannot find symbol
> [error] JavaTestUtils.attachTestOutputStream(letterCount);
> [error] ^
> [error] symbol: variable JavaTestUtils
> [error] location: class Java8APISuite
> [error]
> /mnt/data/project/apache-spark/extras/java8-tests/src/test/java/org/apache/spark/streaming/Java8APISuite.java:58:
> error: cannot find symbol
> [error] List<List<Integer>> result = JavaTestUtils.runStreams(ssc, 2, 2);
> [error] ^
> [error] symbol: variable ssc
> [error] location: class Java8APISuite
> [error]
> /mnt/data/project/apache-spark/extras/java8-tests/src/test/java/org/apache/spark/streaming/Java8APISuite.java:58:
> error: cannot find symbol
> [error] List<List<Integer>> result = JavaTestUtils.runStreams(ssc, 2, 2);
> [error] ^
> [error] symbol: variable JavaTestUtils
> [error] location: class Java8APISuite
> [error]
> /mnt/data/project/apache-spark/extras/java8-tests/src/test/java/org/apache/spark/streaming/Java8APISuite.java:73:
> error: cannot find symbol
> [error] JavaDStream<String> stream =
> JavaTestUtils.attachTestInputStream(ssc, inputData, 1);
> [error] ^
> [error] symbol: variable ssc
> [error] location: class Java8APISuite
> {code}
> The class {{JavaAPISuite}} relies on {{LocalJavaStreamingContext}} which
> exists in streaming test jar. It is OK for maven compile, since it will
> generate test jar, but will be failed in sbt test compile, sbt do not
> generate test jar by default.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
