Hi thanks! mvn dependency:tree
[INFO] Scanning for projects... Downloading: https://repo1.maven.org/maven2/org/apache/apache/14/apache-14.pom [ERROR] [ERROR] Some problems were encountered while processing the POMs: [FATAL] Non-resolvable parent POM for org.apache.spark:spark-parent_2.11:2.0.0: Could not transfer artifact org.apache:apache:pom:14 from/to central (https://repo1.maven.org/maven2): sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target and 'parent.relativePath' points at wrong local POM @ line 22, column 11 @ [ERROR] The build could not read 1 project -> [Help 1] [ERROR] [ERROR] The project org.apache.spark:spark-parent_2.11:2.0.0 (/edh_all_sources/edh_2.6.0/spark-2.0.0/pom.xml) has 1 error [ERROR] Non-resolvable parent POM for org.apache.spark:spark-parent_2.11:2.0.0: Could not transfer artifact org.apache:apache:pom:14 from/to central (https://repo1.maven.org/maven2): sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target and 'parent.relativePath' points at wrong local POM @ line 22, column 11 -> [Help 2] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/ProjectBuildingException [ERROR] [Help 2] http://cwiki.apache.org/confluence/display/MAVEN/UnresolvableModelException On Fri, Jul 29, 2016 at 1:34 PM, Dong Meng <mengdong0...@gmail.com> wrote: > Before build, first do a "mvn dependency:tree" to make sure the > dependency is right > > On Thu, Jul 28, 2016 at 10:18 PM, Ascot Moss <ascot.m...@gmail.com> wrote: > >> Thanks for your reply. >> >> Is there a way to find the correct Hadoop profile name? >> >> On Fri, Jul 29, 2016 at 7:06 AM, Sean Owen <so...@cloudera.com> wrote: >> >>> You have at least two problems here: wrong Hadoop profile name, and >>> some kind of firewall interrupting access to the Maven repo. It's not >>> related to Spark. >>> >>> On Thu, Jul 28, 2016 at 4:04 PM, Ascot Moss <ascot.m...@gmail.com> >>> wrote: >>> > Hi, >>> > >>> > I tried to build spark, >>> > >>> > (try 1) >>> > mvn -Pyarn -Phadoop-2.7.0 -Dscala-2.11 -Dhadoop.version=2.7.0 -Phive >>> > -Phive-thriftserver -DskipTests clean package >>> > >>> > [INFO] Spark Project Parent POM ........................... FAILURE [ >>> 0.658 >>> > s] >>> > >>> > [INFO] Spark Project Tags ................................. SKIPPED >>> > >>> > [INFO] Spark Project Sketch ............................... SKIPPED >>> > >>> > [INFO] Spark Project Networking ........................... SKIPPED >>> > >>> > [INFO] Spark Project Shuffle Streaming Service ............ SKIPPED >>> > >>> > [INFO] Spark Project Unsafe ............................... SKIPPED >>> > >>> > [INFO] Spark Project Launcher ............................. SKIPPED >>> > >>> > [INFO] Spark Project Core ................................. SKIPPED >>> > >>> > [INFO] Spark Project GraphX ............................... SKIPPED >>> > >>> > [INFO] Spark Project Streaming ............................ SKIPPED >>> > >>> > [INFO] Spark Project Catalyst ............................. SKIPPED >>> > >>> > [INFO] Spark Project SQL .................................. SKIPPED >>> > >>> > [INFO] Spark Project ML Local Library ..................... SKIPPED >>> > >>> > [INFO] Spark Project ML Library ........................... SKIPPED >>> > >>> > [INFO] Spark Project Tools ................................ SKIPPED >>> > >>> > [INFO] Spark Project Hive ................................. SKIPPED >>> > >>> > [INFO] Spark Project REPL ................................. SKIPPED >>> > >>> > [INFO] Spark Project YARN Shuffle Service ................. SKIPPED >>> > >>> > [INFO] Spark Project YARN ................................. SKIPPED >>> > >>> > [INFO] Spark Project Hive Thrift Server ................... SKIPPED >>> > >>> > [INFO] Spark Project Assembly ............................. SKIPPED >>> > >>> > [INFO] Spark Project External Flume Sink .................. SKIPPED >>> > >>> > [INFO] Spark Project External Flume ....................... SKIPPED >>> > >>> > [INFO] Spark Project External Flume Assembly .............. SKIPPED >>> > >>> > [INFO] Spark Integration for Kafka 0.8 .................... SKIPPED >>> > >>> > [INFO] Spark Project Examples ............................. SKIPPED >>> > >>> > [INFO] Spark Project External Kafka Assembly .............. SKIPPED >>> > >>> > [INFO] Spark Integration for Kafka 0.10 ................... SKIPPED >>> > >>> > [INFO] Spark Integration for Kafka 0.10 Assembly .......... SKIPPED >>> > >>> > [INFO] Spark Project Java 8 Tests ......................... SKIPPED >>> > >>> > [INFO] >>> > >>> ------------------------------------------------------------------------ >>> > >>> > [INFO] BUILD FAILURE >>> > >>> > [INFO] >>> > >>> ------------------------------------------------------------------------ >>> > >>> > [INFO] Total time: 1.090 s >>> > >>> > [INFO] Finished at: 2016-07-29T07:01:57+08:00 >>> > >>> > [INFO] Final Memory: 30M/605M >>> > >>> > [INFO] >>> > >>> ------------------------------------------------------------------------ >>> > >>> > [WARNING] The requested profile "hadoop-2.7.0" could not be activated >>> > because it does not exist. >>> > >>> > [ERROR] Plugin org.apache.maven.plugins:maven-site-plugin:3.3 or one >>> of its >>> > dependencies could not be resolved: Failed to read artifact descriptor >>> for >>> > org.apache.maven.plugins:maven-site-plugin:jar:3.3: Could not transfer >>> > artifact org.apache.maven.plugins:maven-site-plugin:pom:3.3 from/to >>> central >>> > (https://repo1.maven.org/maven2): >>> sun.security.validator.ValidatorException: >>> > PKIX path building failed: >>> > sun.security.provider.certpath.SunCertPathBuilderException: unable to >>> find >>> > valid certification path to requested target -> [Help 1] >>> > >>> > [ERROR] >>> > >>> > [ERROR] To see the full stack trace of the errors, re-run Maven with >>> the -e >>> > switch. >>> > >>> > [ERROR] Re-run Maven using the -X switch to enable full debug logging. >>> > >>> > [ERROR] >>> > >>> > [ERROR] For more information about the errors and possible solutions, >>> please >>> > read the following articles: >>> > >>> > [ERROR] [Help 1] >>> > >>> http://cwiki.apache.org/confluence/display/MAVEN/PluginResolutionException >>> > >>> > >>> > (try 2) >>> > >>> > ./build/mvn -DskipTests clean package >>> > >>> > [INFO] >>> > >>> ------------------------------------------------------------------------ >>> > >>> > [INFO] Reactor Summary: >>> > >>> > [INFO] >>> > >>> > [INFO] Spark Project Parent POM ........................... FAILURE [ >>> 0.653 >>> > s] >>> > >>> > [INFO] Spark Project Tags ................................. SKIPPED >>> > >>> > [INFO] Spark Project Sketch ............................... SKIPPED >>> > >>> > [INFO] Spark Project Networking ........................... SKIPPED >>> > >>> > [INFO] Spark Project Shuffle Streaming Service ............ SKIPPED >>> > >>> > [INFO] Spark Project Unsafe ............................... SKIPPED >>> > >>> > [INFO] Spark Project Launcher ............................. SKIPPED >>> > >>> > [INFO] Spark Project Core ................................. SKIPPED >>> > >>> > [INFO] Spark Project GraphX ............................... SKIPPED >>> > >>> > [INFO] Spark Project Streaming ............................ SKIPPED >>> > >>> > [INFO] Spark Project Catalyst ............................. SKIPPED >>> > >>> > [INFO] Spark Project SQL .................................. SKIPPED >>> > >>> > [INFO] Spark Project ML Local Library ..................... SKIPPED >>> > >>> > [INFO] Spark Project ML Library ........................... SKIPPED >>> > >>> > [INFO] Spark Project Tools ................................ SKIPPED >>> > >>> > [INFO] Spark Project Hive ................................. SKIPPED >>> > >>> > [INFO] Spark Project REPL ................................. SKIPPED >>> > >>> > [INFO] Spark Project Assembly ............................. SKIPPED >>> > >>> > [INFO] Spark Project External Flume Sink .................. SKIPPED >>> > >>> > [INFO] Spark Project External Flume ....................... SKIPPED >>> > >>> > [INFO] Spark Project External Flume Assembly .............. SKIPPED >>> > >>> > [INFO] Spark Integration for Kafka 0.8 .................... SKIPPED >>> > >>> > [INFO] Spark Project Examples ............................. SKIPPED >>> > >>> > [INFO] Spark Project External Kafka Assembly .............. SKIPPED >>> > >>> > [INFO] Spark Integration for Kafka 0.10 ................... SKIPPED >>> > >>> > [INFO] Spark Integration for Kafka 0.10 Assembly .......... SKIPPED >>> > >>> > [INFO] Spark Project Java 8 Tests ......................... SKIPPED >>> > >>> > [INFO] >>> > >>> ------------------------------------------------------------------------ >>> > >>> > [INFO] BUILD FAILURE >>> > >>> > [INFO] >>> > >>> ------------------------------------------------------------------------ >>> > >>> > [INFO] Total time: 1.067 s >>> > >>> > [INFO] Finished at: 2016-07-29T07:02:52+08:00 >>> > >>> > [INFO] Final Memory: 29M/605M >>> > >>> > [INFO] >>> > >>> ------------------------------------------------------------------------ >>> > >>> > [ERROR] Plugin org.apache.maven.plugins:maven-site-plugin:3.3 or one >>> of its >>> > dependencies could not be resolved: Failed to read artifact descriptor >>> for >>> > org.apache.maven.plugins:maven-site-plugin:jar:3.3: Could not transfer >>> > artifact org.apache.maven.plugins:maven-site-plugin:pom:3.3 from/to >>> central >>> > (https://repo1.maven.org/maven2): >>> sun.security.validator.ValidatorException: >>> > PKIX path building failed: >>> > sun.security.provider.certpath.SunCertPathBuilderException: unable to >>> find >>> > valid certification path to requested target -> [Help 1] >>> > >>> > [ERROR] >>> > >>> > [ERROR] To see the full stack trace of the errors, re-run Maven with >>> the -e >>> > switch. >>> > >>> > [ERROR] Re-run Maven using the -X switch to enable full debug logging. >>> > >>> > [ERROR] >>> > >>> > [ERROR] For more information about the errors and possible solutions, >>> please >>> > read the following articles: >>> > >>> > [ERROR] [Help 1] >>> > >>> http://cwiki.apache.org/confluence/display/MAVEN/PluginResolutionException >>> > >>> > >>> > Any idea? What would be the build command for 2.0 now? >>> > >>> > >>> > Regards >>> > >>> > >>> > >>> > >>> >> >> >
