Does adding -X to mvn command give you more information ? Cheers
On Sun, Jun 25, 2017 at 5:29 AM, 萝卜丝炒饭 <1427357...@qq.com> wrote: > Hi all, > > Today I use new PC to compile SPARK. > At the beginning, it worked well. > But it stop at some point. > the content in consle is : > ============================ > [INFO] > [INFO] --- maven-jar-plugin:2.6:test-jar (prepare-test-jar) @ > spark-parent_2.11 --- > [INFO] > [INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ > spark-parent_2.11 --- > [INFO] > [INFO] --- maven-shade-plugin:2.4.3:shade (default) @ spark-parent_2.11 --- > [INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded > jar. > [INFO] Replacing original artifact with shaded artifact. > [INFO] > [INFO] --- maven-source-plugin:2.4:jar-no-fork (create-source-jar) @ > spark-parent_2.11 --- > [INFO] > [INFO] --- maven-source-plugin:2.4:test-jar-no-fork (create-source-jar) @ > spark-parent_2.11 --- > [INFO] > [INFO] ------------------------------------------------------------ > ------------ > [INFO] Building Spark Project Tags 2.1.2-SNAPSHOT > [INFO] ------------------------------------------------------------ > ------------ > [INFO] > [INFO] --- maven-enforcer-plugin:1.4.1:enforce (enforce-versions) @ > spark-tags_2.11 --- > [INFO] > [INFO] --- scala-maven-plugin:3.2.2:add-source (eclipse-add-source) @ > spark-tags_2.11 --- > [INFO] Add Source directory: E:\spark\fromweb\spark-branch- > 2.1\common\tags\src\main\scala > [INFO] Add Test Source directory: E:\spark\fromweb\spark-branch- > 2.1\common\tags\src\test\scala > [INFO] > [INFO] --- maven-dependency-plugin:2.10:build-classpath (default-cli) @ > spark-tags_2.11 --- > [INFO] Dependencies classpath: > C:\Users\shaof\.m2\repository\org\spark-project\spark\ > unused\1.0.0\unused-1.0.0.jar;C:\Users\shaof\.m2\repository\ > org\scala-lang\scala-library\2.11.8\scala-library-2.11.8.jar > [INFO] > [INFO] --- maven-remote-resources-plugin:1.5:process (default) @ > spark-tags_2.11 --- > [INFO] > [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ > spark-tags_2.11 --- > [INFO] Using 'UTF-8' encoding to copy filtered resources. > [INFO] skip non existing resourceDirectory E:\spark\fromweb\spark-branch- > 2.1\common\tags\src\main\resources > [INFO] Copying 3 resources > [INFO] > [INFO] --- scala-maven-plugin:3.2.2:compile (scala-compile-first) @ > spark-tags_2.11 --- > [WARNING] Zinc server is not available at port 3030 - reverting to normal > incremental compile > [INFO] Using incremental compilation > [INFO] Compiling 2 Scala sources and 6 Java sources to > E:\spark\fromweb\spark-branch-2.1\common\tags\target\scala-2.11\classes... > [WARNING] 警告: [options] 未与 -source 1.7 一起设置引导类路径 > [WARNING] 1 个警告 > [INFO] > [INFO] --- maven-compiler-plugin:3.5.1:compile (default-compile) @ > spark-tags_2.11 --- > [INFO] Changes detected - recompiling the module! > [INFO] Compiling 6 source files to E:\spark\fromweb\spark-branch- > 2.1\common\tags\target\scala-2.11\classes > [INFO] > [INFO] --- maven-antrun-plugin:1.8:run (create-tmp-dir) @ spark-tags_2.11 > --- > [INFO] Executing tasks > > main: > [INFO] Executed tasks > [INFO] > [INFO] --- maven-resources-plugin:2.6:testResources > (default-testResources) @ spark-tags_2.11 --- > [INFO] Using 'UTF-8' encoding to copy filtered resources. > [INFO] skip non existing resourceDirectory E:\spark\fromweb\spark-branch- > 2.1\common\tags\src\test\resources > [INFO] Copying 3 resources > [INFO] > [INFO] --- scala-maven-plugin:3.2.2:testCompile > (scala-test-compile-first) @ spark-tags_2.11 --- > [WARNING] Zinc server is not available at port 3030 - reverting to normal > incremental compile > [INFO] Using incremental compilation > [INFO] Compiling 3 Java sources to E:\spark\fromweb\spark-branch- > 2.1\common\tags\target\scala-2.11\test-classes... > [WARNING] 警告: [options] 未与 -source 1.7 一起设置引导类路径 > [WARNING] 1 个警告 > [INFO] > [INFO] --- maven-compiler-plugin:3.5.1:testCompile (default-testCompile) > @ spark-tags_2.11 --- > [INFO] Nothing to compile - all classes are up to date > [INFO] > [INFO] --- maven-dependency-plugin:2.10:build-classpath > (generate-test-classpath) @ spark-tags_2.11 --- > [INFO] > [INFO] --- maven-surefire-plugin:2.19.1:test (default-test) @ > spark-tags_2.11 --- > [INFO] Tests are skipped. > [INFO] > [INFO] --- maven-surefire-plugin:2.19.1:test (test) @ spark-tags_2.11 --- > [INFO] Tests are skipped. > [INFO] > [INFO] --- scalatest-maven-plugin:1.0:test (test) @ spark-tags_2.11 --- > [INFO] Tests are skipped. > [INFO] > [INFO] --- maven-jar-plugin:2.6:test-jar (prepare-test-jar) @ > spark-tags_2.11 --- > [INFO] Building jar: E:\spark\fromweb\spark-branch- > 2.1\common\tags\target\spark-tags_2.11-2.1.2-SNAPSHOT-tests.jar > [INFO] > [INFO] --- maven-jar-plugin:2.6:jar (default-jar) @ spark-tags_2.11 --- > [INFO] Building jar: E:\spark\fromweb\spark-branch- > 2.1\common\tags\target\spark-tags_2.11-2.1.2-SNAPSHOT.jar > [INFO] > [INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ > spark-tags_2.11 --- > [INFO] > [INFO] --- maven-shade-plugin:2.4.3:shade (default) @ spark-tags_2.11 --- > [INFO] Excluding org.scala-lang:scala-library:jar:2.11.8 from the shaded > jar. > [INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded > jar. > [INFO] Replacing original artifact with shaded artifact. > [INFO] Replacing E:\spark\fromweb\spark-branch- > 2.1\common\tags\target\spark-tags_2.11-2.1.2-SNAPSHOT.jar with > E:\spark\fromweb\spark-branch-2.1\common\tags\target\spark- > tags_2.11-2.1.2-SNAPSHOT-shaded.jar > [INFO] Dependency-reduced POM written at: E:\spark\fromweb\spark-branch- > 2.1\common\tags\dependency-reduced-pom.xml > [INFO] Dependency-reduced POM written at: E:\spark\fromweb\spark-branch- > 2.1\common\tags\dependency-reduced-pom.xml > [INFO] > [INFO] --- maven-source-plugin:2.4:jar-no-fork (create-source-jar) @ > spark-tags_2.11 --- > [INFO] Building jar: E:\spark\fromweb\spark-branch- > 2.1\common\tags\target\spark-tags_2.11-2.1.2-SNAPSHOT-sources.jar > [INFO] > [INFO] --- maven-source-plugin:2.4:test-jar-no-fork (create-source-jar) @ > spark-tags_2.11 --- > [INFO] Building jar: E:\spark\fromweb\spark-branch- > 2.1\common\tags\target\spark-tags_2.11-2.1.2-SNAPSHOT-test-sources.jar > [INFO] > [INFO] ------------------------------------------------------------ > ------------ > [INFO] Building Spark Project Sketch 2.1.2-SNAPSHOT > [INFO] ------------------------------------------------------------ > ------------ > [INFO] > [INFO] --- maven-enforcer-plugin:1.4.1:enforce (enforce-versions) @ > spark-sketch_2.11 --- > [INFO] > [INFO] --- scala-maven-plugin:3.2.2:add-source (eclipse-add-source) @ > spark-sketch_2.11 --- > [INFO] Add Source directory: E:\spark\fromweb\spark-branch- > 2.1\common\sketch\src\main\scala > [INFO] Add Test Source directory: E:\spark\fromweb\spark-branch- > 2.1\common\sketch\src\test\scala > [INFO] > [INFO] --- maven-dependency-plugin:2.10:build-classpath (default-cli) @ > spark-sketch_2.11 --- > [INFO] Dependencies classpath: > C:\Users\shaof\.m2\repository\org\spark-project\spark\ > unused\1.0.0\unused-1.0.0.jar;E:\spark\fromweb\spark-branch- > 2.1\common\tags\target\spark-tags_2.11-2.1.2-SNAPSHOT.jar; > C:\Users\shaof\.m2\repository\org\scala-lang\scala-library\ > 2.11.8\scala-library-2.11.8.jar > [INFO] > [INFO] --- maven-remote-resources-plugin:1.5:process (default) @ > spark-sketch_2.11 --- > [INFO] > [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ > spark-sketch_2.11 --- > [INFO] Using 'UTF-8' encoding to copy filtered resources. > [INFO] skip non existing resourceDirectory E:\spark\fromweb\spark-branch- > 2.1\common\sketch\src\main\resources > [INFO] Copying 3 resources > [INFO] > [INFO] --- scala-maven-plugin:3.2.2:compile (scala-compile-first) @ > spark-sketch_2.11 --- > [WARNING] Zinc server is not available at port 3030 - reverting to normal > incremental compile > [INFO] Using incremental compilation > [INFO] Compiling 9 Java sources to E:\spark\fromweb\spark-branch- > 2.1\common\sketch\target\scala-2.11\classes... > [WARNING] 警告: [options] 未与 -source 1.7 一起设置引导类路径 > [WARNING] 1 个警告 > [INFO] > [INFO] --- maven-compiler-plugin:3.5.1:compile (default-compile) @ > spark-sketch_2.11 --- > [INFO] Nothing to compile - all classes are up to date > [INFO] > [INFO] --- maven-antrun-plugin:1.8:run (create-tmp-dir) @ > spark-sketch_2.11 --- > [INFO] Executing tasks > > main: > [INFO] Executed tasks > [INFO] > [INFO] --- maven-resources-plugin:2.6:testResources > (default-testResources) @ spark-sketch_2.11 --- > [INFO] Using 'UTF-8' encoding to copy filtered resources. > [INFO] skip non existing resourceDirectory E:\spark\fromweb\spark-branch- > 2.1\common\sketch\src\test\resources > [INFO] Copying 3 resources > [INFO] > [INFO] --- scala-maven-plugin:3.2.2:testCompile > (scala-test-compile-first) @ spark-sketch_2.11 --- > [WARNING] Zinc server is not available at port 3030 - reverting to normal > incremental compile > [INFO] Using incremental compilation > [INFO] > [INFO] --- maven-compiler-plugin:3.5.1:testCompile (default-testCompile) > @ spark-sketch_2.11 --- > [INFO] Nothing to compile - all classes are up to date > [INFO] > [INFO] --- maven-dependency-plugin:2.10:build-classpath > (generate-test-classpath) @ spark-sketch_2.11 --- > [INFO] > [INFO] --- maven-surefire-plugin:2.19.1:test (default-test) @ > spark-sketch_2.11 --- > [INFO] Tests are skipped. > [INFO] > [INFO] --- maven-surefire-plugin:2.19.1:test (test) @ spark-sketch_2.11 > --- > [INFO] Tests are skipped. > [INFO] > [INFO] --- scalatest-maven-plugin:1.0:test (test) @ spark-sketch_2.11 --- > [INFO] Tests are skipped. > [INFO] > [INFO] --- maven-jar-plugin:2.6:test-jar (prepare-test-jar) @ > spark-sketch_2.11 --- > [INFO] Building jar: E:\spark\fromweb\spark-branch- > 2.1\common\sketch\target\spark-sketch_2.11-2.1.2-SNAPSHOT-tests.jar > [INFO] > [INFO] --- maven-jar-plugin:2.6:jar (default-jar) @ spark-sketch_2.11 --- > [INFO] Building jar: E:\spark\fromweb\spark-branch- > 2.1\common\sketch\target\spark-sketch_2.11-2.1.2-SNAPSHOT.jar > [INFO] > [INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ > spark-sketch_2.11 --- > [INFO] > [INFO] --- maven-shade-plugin:2.4.3:shade (default) @ spark-sketch_2.11 --- > [INFO] Excluding org.apache.spark:spark-tags_2.11:jar:2.1.2-SNAPSHOT from > the shaded jar. > [INFO] Excluding org.scala-lang:scala-library:jar:2.11.8 from the shaded > jar. > [INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded > jar. > [INFO] Replacing original artifact with shaded artifact. > [INFO] Replacing E:\spark\fromweb\spark-branch-2.1\common\sketch\target\ > spark-sketch_2.11-2.1.2-SNAPSHOT.jar with E:\spark\fromweb\spark-branch- > 2.1\common\sketch\target\spark-sketch_2.11-2.1.2-SNAPSHOT-shaded.jar > [INFO] Dependency-reduced POM written at: E:\spark\fromweb\spark-branch- > 2.1\common\sketch\dependency-reduced-pom.xml > [INFO] Dependency-reduced POM written at: E:\spark\fromweb\spark-branch- > 2.1\common\sketch\dependency-reduced-pom.xml > [INFO] > [INFO] --- maven-source-plugin:2.4:jar-no-fork (create-source-jar) @ > spark-sketch_2.11 --- > [INFO] Building jar: E:\spark\fromweb\spark-branch- > 2.1\common\sketch\target\spark-sketch_2.11-2.1.2-SNAPSHOT-sources.jar > [INFO] > [INFO] --- maven-source-plugin:2.4:test-jar-no-fork (create-source-jar) @ > spark-sketch_2.11 --- > [INFO] Building jar: E:\spark\fromweb\spark-branch- > 2.1\common\sketch\target\spark-sketch_2.11-2.1.2-SNAPSHOT-test-sources.jar > [INFO] > [INFO] ------------------------------------------------------------ > ------------ > [INFO] Building Spark Project Networking 2.1.2-SNAPSHOT > [INFO] ------------------------------------------------------------ > ------------ > [INFO] > [INFO] --- maven-enforcer-plugin:1.4.1:enforce (enforce-versions) @ > spark-network-common_2.11 --- > [INFO] > [INFO] --- scala-maven-plugin:3.2.2:add-source (eclipse-add-source) @ > spark-network-common_2.11 --- > [INFO] Add Source directory: E:\spark\fromweb\spark-branch- > 2.1\common\network-common\src\main\scala > [INFO] Add Test Source directory: E:\spark\fromweb\spark-branch- > 2.1\common\network-common\src\test\scala > [INFO] > [INFO] --- maven-dependency-plugin:2.10:build-classpath (default-cli) @ > spark-network-common_2.11 --- > [INFO] Dependencies classpath: > C:\Users\shaof\.m2\repository\io\netty\netty-all\4.0.42. > Final\netty-all-4.0.42.Final.jar;C:\Users\shaof\.m2\ > repository\com\fasterxml\jackson\core\jackson-core\2.6. > 5\jackson-core-2.6.5.jar;C:\Users\shaof\.m2\repository\ > org\spark-project\spark\unused\1.0.0\unused-1.0.0.jar; > C:\Users\shaof\.m2\repository\com\fasterxml\jackson\core\ > jackson-annotations\2.6.5\jackson-annotations-2.6.5.jar; > C:\Users\shaof\.m2\repository\com\google\code\findbugs\ > jsr305\1.3.9\jsr305-1.3.9.jar;E:\spark\fromweb\spark-branch- > 2.1\common\tags\target\spark-tags_2.11-2.1.2-SNAPSHOT.jar; > C:\Users\shaof\.m2\repository\org\scala-lang\scala-library\ > 2.11.8\scala-library-2.11.8.jar;C:\Users\shaof\.m2\ > repository\org\fusesource\leveldbjni\leveldbjni-all\1.8\ > leveldbjni-all-1.8.jar;C:\Users\shaof\.m2\repository\ > org\apache\commons\commons-lang3\3.5\commons-lang3-3.5. > jar;C:\Users\shaof\.m2\repository\com\fasterxml\ > jackson\core\jackson-databind\2.6.5\jackson-databind-2.6.5. > jar;C:\Users\shaof\.m2\repository\com\google\guava\ > guava\14.0.1\guava-14.0.1.jar > [INFO] > [INFO] --- maven-remote-resources-plugin:1.5:process (default) @ > spark-network-common_2.11 --- > [INFO] > [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ > spark-network-common_2.11 --- > [INFO] Using 'UTF-8' encoding to copy filtered resources. > [INFO] skip non existing resourceDirectory E:\spark\fromweb\spark-branch- > 2.1\common\network-common\src\main\resources > [INFO] Copying 3 resources > [INFO] > [INFO] --- scala-maven-plugin:3.2.2:compile (scala-compile-first) @ > spark-network-common_2.11 --- <====stop here for more than 30 > minutes. > > ================================ > > I stopped it and retried again. It stopped at the same point. > > Would you like help me please?Or tell me which log file I can check to > find the reason. > > My OS is WIN10, SPARK code is 2.1. > Maven is 3.5.0. > jdk is 1.8. > Compile command is "mvn -Phadoop-2.7 -Dhadoop.version=2.7.0 -DskipTests > clean package" > > > Thanks > Fei Shao >
