Hi all,
Today I use new PC to compile SPARK. At the beginning, it worked well. But it stop at some point. the content in consle is : ============================ [INFO] [INFO] --- maven-jar-plugin:2.6:test-jar (prepare-test-jar) @ spark-parent_2.11 --- [INFO] [INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-parent_2.11 --- [INFO] [INFO] --- maven-shade-plugin:2.4.3:shade (default) @ spark-parent_2.11 --- [INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar. [INFO] Replacing original artifact with shaded artifact. [INFO] [INFO] --- maven-source-plugin:2.4:jar-no-fork (create-source-jar) @ spark-parent_2.11 --- [INFO] [INFO] --- maven-source-plugin:2.4:test-jar-no-fork (create-source-jar) @ spark-parent_2.11 --- [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building Spark Project Tags 2.1.2-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-enforcer-plugin:1.4.1:enforce (enforce-versions) @ spark-tags_2.11 --- [INFO] [INFO] --- scala-maven-plugin:3.2.2:add-source (eclipse-add-source) @ spark-tags_2.11 --- [INFO] Add Source directory: E:\spark\fromweb\spark-branch-2.1\common\tags\src\main\scala [INFO] Add Test Source directory: E:\spark\fromweb\spark-branch-2.1\common\tags\src\test\scala [INFO] [INFO] --- maven-dependency-plugin:2.10:build-classpath (default-cli) @ spark-tags_2.11 --- [INFO] Dependencies classpath: C:\Users\shaof\.m2\repository\org\spark-project\spark\unused\1.0.0\unused-1.0.0.jar;C:\Users\shaof\.m2\repository\org\scala-lang\scala-library\2.11.8\scala-library-2.11.8.jar [INFO] [INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-tags_2.11 --- [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-tags_2.11 --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory E:\spark\fromweb\spark-branch-2.1\common\tags\src\main\resources [INFO] Copying 3 resources [INFO] [INFO] --- scala-maven-plugin:3.2.2:compile (scala-compile-first) @ spark-tags_2.11 --- [WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile [INFO] Using incremental compilation [INFO] Compiling 2 Scala sources and 6 Java sources to E:\spark\fromweb\spark-branch-2.1\common\tags\target\scala-2.11\classes... [WARNING] ????: [options] ???? -source 1.7 ?????????????????? [WARNING] 1 ?????? [INFO] [INFO] --- maven-compiler-plugin:3.5.1:compile (default-compile) @ spark-tags_2.11 --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 6 source files to E:\spark\fromweb\spark-branch-2.1\common\tags\target\scala-2.11\classes [INFO] [INFO] --- maven-antrun-plugin:1.8:run (create-tmp-dir) @ spark-tags_2.11 --- [INFO] Executing tasks main: [INFO] Executed tasks [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ spark-tags_2.11 --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory E:\spark\fromweb\spark-branch-2.1\common\tags\src\test\resources [INFO] Copying 3 resources [INFO] [INFO] --- scala-maven-plugin:3.2.2:testCompile (scala-test-compile-first) @ spark-tags_2.11 --- [WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile [INFO] Using incremental compilation [INFO] Compiling 3 Java sources to E:\spark\fromweb\spark-branch-2.1\common\tags\target\scala-2.11\test-classes... [WARNING] ????: [options] ???? -source 1.7 ?????????????????? [WARNING] 1 ?????? [INFO] [INFO] --- maven-compiler-plugin:3.5.1:testCompile (default-testCompile) @ spark-tags_2.11 --- [INFO] Nothing to compile - all classes are up to date [INFO] [INFO] --- maven-dependency-plugin:2.10:build-classpath (generate-test-classpath) @ spark-tags_2.11 --- [INFO] [INFO] --- maven-surefire-plugin:2.19.1:test (default-test) @ spark-tags_2.11 --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-surefire-plugin:2.19.1:test (test) @ spark-tags_2.11 --- [INFO] Tests are skipped. [INFO] [INFO] --- scalatest-maven-plugin:1.0:test (test) @ spark-tags_2.11 --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jar-plugin:2.6:test-jar (prepare-test-jar) @ spark-tags_2.11 --- [INFO] Building jar: E:\spark\fromweb\spark-branch-2.1\common\tags\target\spark-tags_2.11-2.1.2-SNAPSHOT-tests.jar [INFO] [INFO] --- maven-jar-plugin:2.6:jar (default-jar) @ spark-tags_2.11 --- [INFO] Building jar: E:\spark\fromweb\spark-branch-2.1\common\tags\target\spark-tags_2.11-2.1.2-SNAPSHOT.jar [INFO] [INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-tags_2.11 --- [INFO] [INFO] --- maven-shade-plugin:2.4.3:shade (default) @ spark-tags_2.11 --- [INFO] Excluding org.scala-lang:scala-library:jar:2.11.8 from the shaded jar. [INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar. [INFO] Replacing original artifact with shaded artifact. [INFO] Replacing E:\spark\fromweb\spark-branch-2.1\common\tags\target\spark-tags_2.11-2.1.2-SNAPSHOT.jar with E:\spark\fromweb\spark-branch-2.1\common\tags\target\spark-tags_2.11-2.1.2-SNAPSHOT-shaded.jar [INFO] Dependency-reduced POM written at: E:\spark\fromweb\spark-branch-2.1\common\tags\dependency-reduced-pom.xml [INFO] Dependency-reduced POM written at: E:\spark\fromweb\spark-branch-2.1\common\tags\dependency-reduced-pom.xml [INFO] [INFO] --- maven-source-plugin:2.4:jar-no-fork (create-source-jar) @ spark-tags_2.11 --- [INFO] Building jar: E:\spark\fromweb\spark-branch-2.1\common\tags\target\spark-tags_2.11-2.1.2-SNAPSHOT-sources.jar [INFO] [INFO] --- maven-source-plugin:2.4:test-jar-no-fork (create-source-jar) @ spark-tags_2.11 --- [INFO] Building jar: E:\spark\fromweb\spark-branch-2.1\common\tags\target\spark-tags_2.11-2.1.2-SNAPSHOT-test-sources.jar [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building Spark Project Sketch 2.1.2-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-enforcer-plugin:1.4.1:enforce (enforce-versions) @ spark-sketch_2.11 --- [INFO] [INFO] --- scala-maven-plugin:3.2.2:add-source (eclipse-add-source) @ spark-sketch_2.11 --- [INFO] Add Source directory: E:\spark\fromweb\spark-branch-2.1\common\sketch\src\main\scala [INFO] Add Test Source directory: E:\spark\fromweb\spark-branch-2.1\common\sketch\src\test\scala [INFO] [INFO] --- maven-dependency-plugin:2.10:build-classpath (default-cli) @ spark-sketch_2.11 --- [INFO] Dependencies classpath: C:\Users\shaof\.m2\repository\org\spark-project\spark\unused\1.0.0\unused-1.0.0.jar;E:\spark\fromweb\spark-branch-2.1\common\tags\target\spark-tags_2.11-2.1.2-SNAPSHOT.jar;C:\Users\shaof\.m2\repository\org\scala-lang\scala-library\2.11.8\scala-library-2.11.8.jar [INFO] [INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-sketch_2.11 --- [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-sketch_2.11 --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory E:\spark\fromweb\spark-branch-2.1\common\sketch\src\main\resources [INFO] Copying 3 resources [INFO] [INFO] --- scala-maven-plugin:3.2.2:compile (scala-compile-first) @ spark-sketch_2.11 --- [WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile [INFO] Using incremental compilation [INFO] Compiling 9 Java sources to E:\spark\fromweb\spark-branch-2.1\common\sketch\target\scala-2.11\classes... [WARNING] ????: [options] ???? -source 1.7 ?????????????????? [WARNING] 1 ?????? [INFO] [INFO] --- maven-compiler-plugin:3.5.1:compile (default-compile) @ spark-sketch_2.11 --- [INFO] Nothing to compile - all classes are up to date [INFO] [INFO] --- maven-antrun-plugin:1.8:run (create-tmp-dir) @ spark-sketch_2.11 --- [INFO] Executing tasks main: [INFO] Executed tasks [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ spark-sketch_2.11 --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory E:\spark\fromweb\spark-branch-2.1\common\sketch\src\test\resources [INFO] Copying 3 resources [INFO] [INFO] --- scala-maven-plugin:3.2.2:testCompile (scala-test-compile-first) @ spark-sketch_2.11 --- [WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile [INFO] Using incremental compilation [INFO] [INFO] --- maven-compiler-plugin:3.5.1:testCompile (default-testCompile) @ spark-sketch_2.11 --- [INFO] Nothing to compile - all classes are up to date [INFO] [INFO] --- maven-dependency-plugin:2.10:build-classpath (generate-test-classpath) @ spark-sketch_2.11 --- [INFO] [INFO] --- maven-surefire-plugin:2.19.1:test (default-test) @ spark-sketch_2.11 --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-surefire-plugin:2.19.1:test (test) @ spark-sketch_2.11 --- [INFO] Tests are skipped. [INFO] [INFO] --- scalatest-maven-plugin:1.0:test (test) @ spark-sketch_2.11 --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jar-plugin:2.6:test-jar (prepare-test-jar) @ spark-sketch_2.11 --- [INFO] Building jar: E:\spark\fromweb\spark-branch-2.1\common\sketch\target\spark-sketch_2.11-2.1.2-SNAPSHOT-tests.jar [INFO] [INFO] --- maven-jar-plugin:2.6:jar (default-jar) @ spark-sketch_2.11 --- [INFO] Building jar: E:\spark\fromweb\spark-branch-2.1\common\sketch\target\spark-sketch_2.11-2.1.2-SNAPSHOT.jar [INFO] [INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-sketch_2.11 --- [INFO] [INFO] --- maven-shade-plugin:2.4.3:shade (default) @ spark-sketch_2.11 --- [INFO] Excluding org.apache.spark:spark-tags_2.11:jar:2.1.2-SNAPSHOT from the shaded jar. [INFO] Excluding org.scala-lang:scala-library:jar:2.11.8 from the shaded jar. [INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar. [INFO] Replacing original artifact with shaded artifact. [INFO] Replacing E:\spark\fromweb\spark-branch-2.1\common\sketch\target\spark-sketch_2.11-2.1.2-SNAPSHOT.jar with E:\spark\fromweb\spark-branch-2.1\common\sketch\target\spark-sketch_2.11-2.1.2-SNAPSHOT-shaded.jar [INFO] Dependency-reduced POM written at: E:\spark\fromweb\spark-branch-2.1\common\sketch\dependency-reduced-pom.xml [INFO] Dependency-reduced POM written at: E:\spark\fromweb\spark-branch-2.1\common\sketch\dependency-reduced-pom.xml [INFO] [INFO] --- maven-source-plugin:2.4:jar-no-fork (create-source-jar) @ spark-sketch_2.11 --- [INFO] Building jar: E:\spark\fromweb\spark-branch-2.1\common\sketch\target\spark-sketch_2.11-2.1.2-SNAPSHOT-sources.jar [INFO] [INFO] --- maven-source-plugin:2.4:test-jar-no-fork (create-source-jar) @ spark-sketch_2.11 --- [INFO] Building jar: E:\spark\fromweb\spark-branch-2.1\common\sketch\target\spark-sketch_2.11-2.1.2-SNAPSHOT-test-sources.jar [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building Spark Project Networking 2.1.2-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-enforcer-plugin:1.4.1:enforce (enforce-versions) @ spark-network-common_2.11 --- [INFO] [INFO] --- scala-maven-plugin:3.2.2:add-source (eclipse-add-source) @ spark-network-common_2.11 --- [INFO] Add Source directory: E:\spark\fromweb\spark-branch-2.1\common\network-common\src\main\scala [INFO] Add Test Source directory: E:\spark\fromweb\spark-branch-2.1\common\network-common\src\test\scala [INFO] [INFO] --- maven-dependency-plugin:2.10:build-classpath (default-cli) @ spark-network-common_2.11 --- [INFO] Dependencies classpath: C:\Users\shaof\.m2\repository\io\netty\netty-all\4.0.42.Final\netty-all-4.0.42.Final.jar;C:\Users\shaof\.m2\repository\com\fasterxml\jackson\core\jackson-core\2.6.5\jackson-core-2.6.5.jar;C:\Users\shaof\.m2\repository\org\spark-project\spark\unused\1.0.0\unused-1.0.0.jar;C:\Users\shaof\.m2\repository\com\fasterxml\jackson\core\jackson-annotations\2.6.5\jackson-annotations-2.6.5.jar;C:\Users\shaof\.m2\repository\com\google\code\findbugs\jsr305\1.3.9\jsr305-1.3.9.jar;E:\spark\fromweb\spark-branch-2.1\common\tags\target\spark-tags_2.11-2.1.2-SNAPSHOT.jar;C:\Users\shaof\.m2\repository\org\scala-lang\scala-library\2.11.8\scala-library-2.11.8.jar;C:\Users\shaof\.m2\repository\org\fusesource\leveldbjni\leveldbjni-all\1.8\leveldbjni-all-1.8.jar;C:\Users\shaof\.m2\repository\org\apache\commons\commons-lang3\3.5\commons-lang3-3.5.jar;C:\Users\shaof\.m2\repository\com\fasterxml\jackson\core\jackson-databind\2.6.5\jackson-databind-2.6.5.jar;C:\Users\shaof\.m2\repository\com\google\guava\guava\14.0.1\guava-14.0.1.jar [INFO] [INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-network-common_2.11 --- [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-network-common_2.11 --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory E:\spark\fromweb\spark-branch-2.1\common\network-common\src\main\resources [INFO] Copying 3 resources [INFO] [INFO] --- scala-maven-plugin:3.2.2:compile (scala-compile-first) @ spark-network-common_2.11 --- <====stop here for more than 30 minutes. ================================ I stopped it and retried again. It stopped at the same point. Would you like help me please?Or tell me which log file I can check to find the reason. My OS is WIN10, SPARK code is 2.1. Maven is 3.5.0. jdk is 1.8. Compile command is "mvn -Phadoop-2.7 -Dhadoop.version=2.7.0 -DskipTests clean package" Thanks Fei Shao
