Saisai Shao created SPARK-7820:
----------------------------------
Summary: Java 8 test suite compile error under SBT
Key: SPARK-7820
URL: https://issues.apache.org/jira/browse/SPARK-7820
Project: Spark
Issue Type: Bug
Components: Build
Affects Versions: 1.4.0
Reporter: Saisai Shao
Lots of compilation error is shown when java 8 test suite is enabled in SBT:
{{JAVA_HOME=/usr/java/jdk1.8.0_45 ./sbt/sbt -Pyarn -Phadoop-2.4
-Dhadoop.version=2.6.0 -Pjava8-test}}
{code}
[error]
/mnt/data/project/apache-spark/extras/java8-tests/src/test/java/org/apache/spark/streaming/Java8APISuite.java:43:
error: cannot find symbol
[error] public class Java8APISuite extends LocalJavaStreamingContext implements
Serializable {
[error] ^
[error] symbol: class LocalJavaStreamingContext
[error]
/mnt/data/project/apache-spark/extras/java8-tests/src/test/java/org/apache/spark/streaming/Java8APISuite.java:55:
error: cannot find symbol
[error] JavaDStream<String> stream =
JavaTestUtils.attachTestInputStream(ssc, inputData, 1);
[error] ^
[error] symbol: variable ssc
[error] location: class Java8APISuite
[error]
/mnt/data/project/apache-spark/extras/java8-tests/src/test/java/org/apache/spark/streaming/Java8APISuite.java:55:
error: cannot find symbol
[error] JavaDStream<String> stream =
JavaTestUtils.attachTestInputStream(ssc, inputData, 1);
[error] ^
[error] symbol: variable JavaTestUtils
[error] location: class Java8APISuite
[error]
/mnt/data/project/apache-spark/extras/java8-tests/src/test/java/org/apache/spark/streaming/Java8APISuite.java:57:
error: cannot find symbol
[error] JavaTestUtils.attachTestOutputStream(letterCount);
[error] ^
[error] symbol: variable JavaTestUtils
[error] location: class Java8APISuite
[error]
/mnt/data/project/apache-spark/extras/java8-tests/src/test/java/org/apache/spark/streaming/Java8APISuite.java:58:
error: cannot find symbol
[error] List<List<Integer>> result = JavaTestUtils.runStreams(ssc, 2, 2);
[error] ^
[error] symbol: variable ssc
[error] location: class Java8APISuite
[error]
/mnt/data/project/apache-spark/extras/java8-tests/src/test/java/org/apache/spark/streaming/Java8APISuite.java:58:
error: cannot find symbol
[error] List<List<Integer>> result = JavaTestUtils.runStreams(ssc, 2, 2);
[error] ^
[error] symbol: variable JavaTestUtils
[error] location: class Java8APISuite
[error]
/mnt/data/project/apache-spark/extras/java8-tests/src/test/java/org/apache/spark/streaming/Java8APISuite.java:73:
error: cannot find symbol
[error] JavaDStream<String> stream =
JavaTestUtils.attachTestInputStream(ssc, inputData, 1);
[error] ^
[error] symbol: variable ssc
[error] location: class Java8APISuite
{code}
The class {{JavaAPISuite}} relies on {{LocalJavaStreamingContext}} which exists
in streaming test jar. It is OK for maven compile, since it will generate test
jar, but will be failed in sbt test compile, sbt do not generate test jar by
default.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]