Re: Spark 2.0 Build Failed
I think my maven is broken, I used another node in the cluster to compile 2.0.0 and got "successful" [INFO] [INFO] --- maven-source-plugin:2.4:jar-no-fork (create-source-jar) @ java8-tests_2.11 --- [INFO] [INFO] --- maven-source-plugin:2.4:test-jar-no-fork (create-source-jar) @ java8-tests_2.11 --- [INFO] [INFO] Reactor Summary: [INFO] [INFO] Spark Project Parent POM ... SUCCESS [ 1.972 s] [INFO] Spark Project Tags . SUCCESS [ 3.280 s] [INFO] Spark Project Sketch ... SUCCESS [ 5.449 s] [INFO] Spark Project Networking ... SUCCESS [ 5.197 s] [INFO] Spark Project Shuffle Streaming Service SUCCESS [ 3.816 s] [INFO] Spark Project Unsafe ... SUCCESS [ 8.275 s] [INFO] Spark Project Launcher . SUCCESS [ 5.229 s] [INFO] Spark Project Core . SUCCESS [01:41 min] [INFO] Spark Project GraphX ... SUCCESS [ 25.111 s] [INFO] Spark Project Streaming SUCCESS [ 54.290 s] [INFO] Spark Project Catalyst . SUCCESS [01:15 min] [INFO] Spark Project SQL .. SUCCESS [01:55 min] [INFO] Spark Project ML Local Library . SUCCESS [ 16.132 s] [INFO] Spark Project ML Library ... SUCCESS [01:32 min] [INFO] Spark Project Tools SUCCESS [ 5.136 s] [INFO] Spark Project Hive . SUCCESS [ 53.472 s] [INFO] Spark Project REPL . SUCCESS [ 11.716 s] [INFO] Spark Project YARN Shuffle Service . SUCCESS [ 4.102 s] [INFO] Spark Project YARN . SUCCESS [ 26.685 s] [INFO] Spark Project Hive Thrift Server ... SUCCESS [ 23.611 s] [INFO] Spark Project Assembly . SUCCESS [ 1.342 s] [INFO] Spark Project External Flume Sink .. SUCCESS [ 9.630 s] [INFO] Spark Project External Flume ... SUCCESS [ 15.323 s] [INFO] Spark Project External Flume Assembly .. SUCCESS [ 1.434 s] [INFO] Spark Integration for Kafka 0.8 SUCCESS [ 20.958 s] [INFO] Spark Project Examples . SUCCESS [ 22.080 s] [INFO] Spark Project External Kafka Assembly .. SUCCESS [ 2.421 s] [INFO] Spark Integration for Kafka 0.10 ... SUCCESS [ 16.255 s] [INFO] Spark Integration for Kafka 0.10 Assembly .. SUCCESS [ 2.578 s] [INFO] Spark Project Java 8 Tests . SUCCESS [ 5.573 s] [INFO] [INFO] BUILD SUCCESS [INFO] [INFO] Total time: 12:16 min [INFO] Finished at: 2016-07-29T15:58:41+08:00 [INFO] Final Memory: 127M/4210M [INFO] I tried to reinstall my maven 3.3.9, deleted .m2, still got following error. [ERROR] Plugin org.scalastyle:scalastyle-maven-plugin:0.8.0 or one of its dependencies could not be resolved: Failed to read artifact descriptor for org.scalastyle:scalastyle-maven-plugin:jar:0.8.0: Could not transfer artifact org.scalastyle:scalastyle-maven-plugin:pom:0.8.0 from/to central ( https://repo1.maven.org/maven2): sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginResolutionException On Fri, Jul 29, 2016 at 1:46 PM, Ascot Moss wrote: > I just run > > wget https://repo1.maven.org/maven2/org/apache/apache/14/apache-14.pom, > can get it without issue. > > On Fri, Jul 29, 2016 at 1:44 PM, Ascot Moss wrote: > >> Hi thanks! >> >> mvn dependency:tree >> >> [INFO] Scanning for projects... >> >> Downloading: >> https://repo1.maven.org/maven2/org/apache/apache/14/apache-14.pom >> >> [ERROR] [ERROR] Some problems were encountered while processing the POMs: >> >> [FATAL] Non-resolvable parent POM for >> org.apache.spark:spark-parent_2.11:2.0.0: Could not transfer artifact >> org.apache:apache:pom:14 from/to central (https://repo1.maven.org/maven2): >> sun.security.validator.ValidatorException: PKIX path building failed: >> sun.security.provider.certpath.SunCertPathBuilderExceptio
Re: Spark 2.0 Build Failed
I just run wget https://repo1.maven.org/maven2/org/apache/apache/14/apache-14.pom, can get it without issue. On Fri, Jul 29, 2016 at 1:44 PM, Ascot Moss wrote: > Hi thanks! > > mvn dependency:tree > > [INFO] Scanning for projects... > > Downloading: > https://repo1.maven.org/maven2/org/apache/apache/14/apache-14.pom > > [ERROR] [ERROR] Some problems were encountered while processing the POMs: > > [FATAL] Non-resolvable parent POM for > org.apache.spark:spark-parent_2.11:2.0.0: Could not transfer artifact > org.apache:apache:pom:14 from/to central (https://repo1.maven.org/maven2): > sun.security.validator.ValidatorException: PKIX path building failed: > sun.security.provider.certpath.SunCertPathBuilderException: unable to find > valid certification path to requested target and 'parent.relativePath' > points at wrong local POM @ line 22, column 11 > > @ > > [ERROR] The build could not read 1 project -> [Help 1] > > [ERROR] > > [ERROR] The project org.apache.spark:spark-parent_2.11:2.0.0 > (/edh_all_sources/edh_2.6.0/spark-2.0.0/pom.xml) has 1 error > > [ERROR] Non-resolvable parent POM for > org.apache.spark:spark-parent_2.11:2.0.0: Could not transfer artifact > org.apache:apache:pom:14 from/to central (https://repo1.maven.org/maven2): > sun.security.validator.ValidatorException: PKIX path building failed: > sun.security.provider.certpath.SunCertPathBuilderException: unable to find > valid certification path to requested target and 'parent.relativePath' > points at wrong local POM @ line 22, column 11 -> [Help 2] > > [ERROR] > > [ERROR] To see the full stack trace of the errors, re-run Maven with the > -e switch. > > [ERROR] Re-run Maven using the -X switch to enable full debug logging. > > [ERROR] > > [ERROR] For more information about the errors and possible solutions, > please read the following articles: > > [ERROR] [Help 1] > http://cwiki.apache.org/confluence/display/MAVEN/ProjectBuildingException > > [ERROR] [Help 2] > http://cwiki.apache.org/confluence/display/MAVEN/UnresolvableModelException > > > > > > > On Fri, Jul 29, 2016 at 1:34 PM, Dong Meng wrote: > >> Before build, first do a "mvn dependency:tree" to make sure the >> dependency is right >> >> On Thu, Jul 28, 2016 at 10:18 PM, Ascot Moss >> wrote: >> >>> Thanks for your reply. >>> >>> Is there a way to find the correct Hadoop profile name? >>> >>> On Fri, Jul 29, 2016 at 7:06 AM, Sean Owen wrote: >>> You have at least two problems here: wrong Hadoop profile name, and some kind of firewall interrupting access to the Maven repo. It's not related to Spark. On Thu, Jul 28, 2016 at 4:04 PM, Ascot Moss wrote: > Hi, > > I tried to build spark, > > (try 1) > mvn -Pyarn -Phadoop-2.7.0 -Dscala-2.11 -Dhadoop.version=2.7.0 -Phive > -Phive-thriftserver -DskipTests clean package > > [INFO] Spark Project Parent POM ... FAILURE [ 0.658 > s] > > [INFO] Spark Project Tags . SKIPPED > > [INFO] Spark Project Sketch ... SKIPPED > > [INFO] Spark Project Networking ... SKIPPED > > [INFO] Spark Project Shuffle Streaming Service SKIPPED > > [INFO] Spark Project Unsafe ... SKIPPED > > [INFO] Spark Project Launcher . SKIPPED > > [INFO] Spark Project Core . SKIPPED > > [INFO] Spark Project GraphX ... SKIPPED > > [INFO] Spark Project Streaming SKIPPED > > [INFO] Spark Project Catalyst . SKIPPED > > [INFO] Spark Project SQL .. SKIPPED > > [INFO] Spark Project ML Local Library . SKIPPED > > [INFO] Spark Project ML Library ... SKIPPED > > [INFO] Spark Project Tools SKIPPED > > [INFO] Spark Project Hive . SKIPPED > > [INFO] Spark Project REPL . SKIPPED > > [INFO] Spark Project YARN Shuffle Service . SKIPPED > > [INFO] Spark Project YARN . SKIPPED > > [INFO] Spark Project Hive Thrift Server ... SKIPPED > > [INFO] Spark Project Assembly . SKIPPED > > [INFO] Spark Project External Flume Sink .. SKIPPED > > [INFO] Spark Project External Flume ... SKIPPED > > [INFO] Spark Project External Flume Assembly .. SKIPPED > > [INFO] Spark Integration for Kafka 0.8 SKIPPED > > [INFO] Spark Project Examples ..
Re: Spark 2.0 Build Failed
Hi thanks! mvn dependency:tree [INFO] Scanning for projects... Downloading: https://repo1.maven.org/maven2/org/apache/apache/14/apache-14.pom [ERROR] [ERROR] Some problems were encountered while processing the POMs: [FATAL] Non-resolvable parent POM for org.apache.spark:spark-parent_2.11:2.0.0: Could not transfer artifact org.apache:apache:pom:14 from/to central (https://repo1.maven.org/maven2): sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target and 'parent.relativePath' points at wrong local POM @ line 22, column 11 @ [ERROR] The build could not read 1 project -> [Help 1] [ERROR] [ERROR] The project org.apache.spark:spark-parent_2.11:2.0.0 (/edh_all_sources/edh_2.6.0/spark-2.0.0/pom.xml) has 1 error [ERROR] Non-resolvable parent POM for org.apache.spark:spark-parent_2.11:2.0.0: Could not transfer artifact org.apache:apache:pom:14 from/to central (https://repo1.maven.org/maven2): sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target and 'parent.relativePath' points at wrong local POM @ line 22, column 11 -> [Help 2] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/ProjectBuildingException [ERROR] [Help 2] http://cwiki.apache.org/confluence/display/MAVEN/UnresolvableModelException On Fri, Jul 29, 2016 at 1:34 PM, Dong Meng wrote: > Before build, first do a "mvn dependency:tree" to make sure the > dependency is right > > On Thu, Jul 28, 2016 at 10:18 PM, Ascot Moss wrote: > >> Thanks for your reply. >> >> Is there a way to find the correct Hadoop profile name? >> >> On Fri, Jul 29, 2016 at 7:06 AM, Sean Owen wrote: >> >>> You have at least two problems here: wrong Hadoop profile name, and >>> some kind of firewall interrupting access to the Maven repo. It's not >>> related to Spark. >>> >>> On Thu, Jul 28, 2016 at 4:04 PM, Ascot Moss >>> wrote: >>> > Hi, >>> > >>> > I tried to build spark, >>> > >>> > (try 1) >>> > mvn -Pyarn -Phadoop-2.7.0 -Dscala-2.11 -Dhadoop.version=2.7.0 -Phive >>> > -Phive-thriftserver -DskipTests clean package >>> > >>> > [INFO] Spark Project Parent POM ... FAILURE [ >>> 0.658 >>> > s] >>> > >>> > [INFO] Spark Project Tags . SKIPPED >>> > >>> > [INFO] Spark Project Sketch ... SKIPPED >>> > >>> > [INFO] Spark Project Networking ... SKIPPED >>> > >>> > [INFO] Spark Project Shuffle Streaming Service SKIPPED >>> > >>> > [INFO] Spark Project Unsafe ... SKIPPED >>> > >>> > [INFO] Spark Project Launcher . SKIPPED >>> > >>> > [INFO] Spark Project Core . SKIPPED >>> > >>> > [INFO] Spark Project GraphX ... SKIPPED >>> > >>> > [INFO] Spark Project Streaming SKIPPED >>> > >>> > [INFO] Spark Project Catalyst . SKIPPED >>> > >>> > [INFO] Spark Project SQL .. SKIPPED >>> > >>> > [INFO] Spark Project ML Local Library . SKIPPED >>> > >>> > [INFO] Spark Project ML Library ... SKIPPED >>> > >>> > [INFO] Spark Project Tools SKIPPED >>> > >>> > [INFO] Spark Project Hive . SKIPPED >>> > >>> > [INFO] Spark Project REPL . SKIPPED >>> > >>> > [INFO] Spark Project YARN Shuffle Service . SKIPPED >>> > >>> > [INFO] Spark Project YARN . SKIPPED >>> > >>> > [INFO] Spark Project Hive Thrift Server ... SKIPPED >>> > >>> > [INFO] Spark Project Assembly . SKIPPED >>> > >>> > [INFO] Spark Project External Flume Sink .. SKIPPED >>> > >>> > [INFO] Spark Project External Flume ... SKIPPED >>> > >>> > [INFO] Spark Project External Flume Assembly .. SKIPPED >>> > >>> > [INFO] Spark Integration for Kafka 0.8 SKIPPED >>> > >>> > [INFO] Spark Project Examples . SKIPPED >>> > >>> > [INFO] Spark Project External Kafka Assembly .. SKIPPED >>> > >>> > [INFO] Spark Integration for Kafka 0.10 ... SKIPPED >>> > >>> > [INFO] Spark Integration for Kafka 0.10 Assembly .. SKIPPED >>> > >>> > [INFO] Spark Project Java 8 Tests . SKIPPED >>> > >>
Re: Spark 2.0 Build Failed
Before build, first do a "mvn dependency:tree" to make sure the dependency is right On Thu, Jul 28, 2016 at 10:18 PM, Ascot Moss wrote: > Thanks for your reply. > > Is there a way to find the correct Hadoop profile name? > > On Fri, Jul 29, 2016 at 7:06 AM, Sean Owen wrote: > >> You have at least two problems here: wrong Hadoop profile name, and >> some kind of firewall interrupting access to the Maven repo. It's not >> related to Spark. >> >> On Thu, Jul 28, 2016 at 4:04 PM, Ascot Moss wrote: >> > Hi, >> > >> > I tried to build spark, >> > >> > (try 1) >> > mvn -Pyarn -Phadoop-2.7.0 -Dscala-2.11 -Dhadoop.version=2.7.0 -Phive >> > -Phive-thriftserver -DskipTests clean package >> > >> > [INFO] Spark Project Parent POM ... FAILURE [ >> 0.658 >> > s] >> > >> > [INFO] Spark Project Tags . SKIPPED >> > >> > [INFO] Spark Project Sketch ... SKIPPED >> > >> > [INFO] Spark Project Networking ... SKIPPED >> > >> > [INFO] Spark Project Shuffle Streaming Service SKIPPED >> > >> > [INFO] Spark Project Unsafe ... SKIPPED >> > >> > [INFO] Spark Project Launcher . SKIPPED >> > >> > [INFO] Spark Project Core . SKIPPED >> > >> > [INFO] Spark Project GraphX ... SKIPPED >> > >> > [INFO] Spark Project Streaming SKIPPED >> > >> > [INFO] Spark Project Catalyst . SKIPPED >> > >> > [INFO] Spark Project SQL .. SKIPPED >> > >> > [INFO] Spark Project ML Local Library . SKIPPED >> > >> > [INFO] Spark Project ML Library ... SKIPPED >> > >> > [INFO] Spark Project Tools SKIPPED >> > >> > [INFO] Spark Project Hive . SKIPPED >> > >> > [INFO] Spark Project REPL . SKIPPED >> > >> > [INFO] Spark Project YARN Shuffle Service . SKIPPED >> > >> > [INFO] Spark Project YARN . SKIPPED >> > >> > [INFO] Spark Project Hive Thrift Server ... SKIPPED >> > >> > [INFO] Spark Project Assembly . SKIPPED >> > >> > [INFO] Spark Project External Flume Sink .. SKIPPED >> > >> > [INFO] Spark Project External Flume ... SKIPPED >> > >> > [INFO] Spark Project External Flume Assembly .. SKIPPED >> > >> > [INFO] Spark Integration for Kafka 0.8 SKIPPED >> > >> > [INFO] Spark Project Examples . SKIPPED >> > >> > [INFO] Spark Project External Kafka Assembly .. SKIPPED >> > >> > [INFO] Spark Integration for Kafka 0.10 ... SKIPPED >> > >> > [INFO] Spark Integration for Kafka 0.10 Assembly .. SKIPPED >> > >> > [INFO] Spark Project Java 8 Tests . SKIPPED >> > >> > [INFO] >> > >> > >> > [INFO] BUILD FAILURE >> > >> > [INFO] >> > >> > >> > [INFO] Total time: 1.090 s >> > >> > [INFO] Finished at: 2016-07-29T07:01:57+08:00 >> > >> > [INFO] Final Memory: 30M/605M >> > >> > [INFO] >> > >> > >> > [WARNING] The requested profile "hadoop-2.7.0" could not be activated >> > because it does not exist. >> > >> > [ERROR] Plugin org.apache.maven.plugins:maven-site-plugin:3.3 or one of >> its >> > dependencies could not be resolved: Failed to read artifact descriptor >> for >> > org.apache.maven.plugins:maven-site-plugin:jar:3.3: Could not transfer >> > artifact org.apache.maven.plugins:maven-site-plugin:pom:3.3 from/to >> central >> > (https://repo1.maven.org/maven2): >> sun.security.validator.ValidatorException: >> > PKIX path building failed: >> > sun.security.provider.certpath.SunCertPathBuilderException: unable to >> find >> > valid certification path to requested target -> [Help 1] >> > >> > [ERROR] >> > >> > [ERROR] To see the full stack trace of the errors, re-run Maven with >> the -e >> > switch. >> > >> > [ERROR] Re-run Maven using the -X switch to enable full debug logging. >> > >> > [ERROR] >> > >> > [ERROR] For more information about the errors and possible solutions, >> please >> > read the following articles: >> > >> > [ERROR] [Help 1] >> > >> http://cwiki.apache.org/confluence/display/MAVEN/PluginResolutionException >> > >> > >> > (try 2) >> > >> > ./build/mvn -DskipTests clean package >> > >> > [INFO] >> > >> > >> > [INFO] Reactor Summary: >> > >> > [INFO] >> > >> > [INFO] Spark Project Parent POM ... FAILURE [ >> 0.653 >> > s] >> > >> > [INFO] Spark Proje
Re: Spark 2.0 Build Failed
Thanks for your reply. Is there a way to find the correct Hadoop profile name? On Fri, Jul 29, 2016 at 7:06 AM, Sean Owen wrote: > You have at least two problems here: wrong Hadoop profile name, and > some kind of firewall interrupting access to the Maven repo. It's not > related to Spark. > > On Thu, Jul 28, 2016 at 4:04 PM, Ascot Moss wrote: > > Hi, > > > > I tried to build spark, > > > > (try 1) > > mvn -Pyarn -Phadoop-2.7.0 -Dscala-2.11 -Dhadoop.version=2.7.0 -Phive > > -Phive-thriftserver -DskipTests clean package > > > > [INFO] Spark Project Parent POM ... FAILURE [ > 0.658 > > s] > > > > [INFO] Spark Project Tags . SKIPPED > > > > [INFO] Spark Project Sketch ... SKIPPED > > > > [INFO] Spark Project Networking ... SKIPPED > > > > [INFO] Spark Project Shuffle Streaming Service SKIPPED > > > > [INFO] Spark Project Unsafe ... SKIPPED > > > > [INFO] Spark Project Launcher . SKIPPED > > > > [INFO] Spark Project Core . SKIPPED > > > > [INFO] Spark Project GraphX ... SKIPPED > > > > [INFO] Spark Project Streaming SKIPPED > > > > [INFO] Spark Project Catalyst . SKIPPED > > > > [INFO] Spark Project SQL .. SKIPPED > > > > [INFO] Spark Project ML Local Library . SKIPPED > > > > [INFO] Spark Project ML Library ... SKIPPED > > > > [INFO] Spark Project Tools SKIPPED > > > > [INFO] Spark Project Hive . SKIPPED > > > > [INFO] Spark Project REPL . SKIPPED > > > > [INFO] Spark Project YARN Shuffle Service . SKIPPED > > > > [INFO] Spark Project YARN . SKIPPED > > > > [INFO] Spark Project Hive Thrift Server ... SKIPPED > > > > [INFO] Spark Project Assembly . SKIPPED > > > > [INFO] Spark Project External Flume Sink .. SKIPPED > > > > [INFO] Spark Project External Flume ... SKIPPED > > > > [INFO] Spark Project External Flume Assembly .. SKIPPED > > > > [INFO] Spark Integration for Kafka 0.8 SKIPPED > > > > [INFO] Spark Project Examples . SKIPPED > > > > [INFO] Spark Project External Kafka Assembly .. SKIPPED > > > > [INFO] Spark Integration for Kafka 0.10 ... SKIPPED > > > > [INFO] Spark Integration for Kafka 0.10 Assembly .. SKIPPED > > > > [INFO] Spark Project Java 8 Tests . SKIPPED > > > > [INFO] > > > > > > [INFO] BUILD FAILURE > > > > [INFO] > > > > > > [INFO] Total time: 1.090 s > > > > [INFO] Finished at: 2016-07-29T07:01:57+08:00 > > > > [INFO] Final Memory: 30M/605M > > > > [INFO] > > > > > > [WARNING] The requested profile "hadoop-2.7.0" could not be activated > > because it does not exist. > > > > [ERROR] Plugin org.apache.maven.plugins:maven-site-plugin:3.3 or one of > its > > dependencies could not be resolved: Failed to read artifact descriptor > for > > org.apache.maven.plugins:maven-site-plugin:jar:3.3: Could not transfer > > artifact org.apache.maven.plugins:maven-site-plugin:pom:3.3 from/to > central > > (https://repo1.maven.org/maven2): > sun.security.validator.ValidatorException: > > PKIX path building failed: > > sun.security.provider.certpath.SunCertPathBuilderException: unable to > find > > valid certification path to requested target -> [Help 1] > > > > [ERROR] > > > > [ERROR] To see the full stack trace of the errors, re-run Maven with the > -e > > switch. > > > > [ERROR] Re-run Maven using the -X switch to enable full debug logging. > > > > [ERROR] > > > > [ERROR] For more information about the errors and possible solutions, > please > > read the following articles: > > > > [ERROR] [Help 1] > > > http://cwiki.apache.org/confluence/display/MAVEN/PluginResolutionException > > > > > > (try 2) > > > > ./build/mvn -DskipTests clean package > > > > [INFO] > > > > > > [INFO] Reactor Summary: > > > > [INFO] > > > > [INFO] Spark Project Parent POM ... FAILURE [ > 0.653 > > s] > > > > [INFO] Spark Project Tags . SKIPPED > > > > [INFO] Spark Project Sketch ... SKIPPED > > > > [INFO] Spark Project Networking ... SKIPPED > > > > [INFO] Spark Project Shuffle Streaming Service SKIPPED > > > > [INFO]
Re: Spark 2.0 Build Failed
You have at least two problems here: wrong Hadoop profile name, and some kind of firewall interrupting access to the Maven repo. It's not related to Spark. On Thu, Jul 28, 2016 at 4:04 PM, Ascot Moss wrote: > Hi, > > I tried to build spark, > > (try 1) > mvn -Pyarn -Phadoop-2.7.0 -Dscala-2.11 -Dhadoop.version=2.7.0 -Phive > -Phive-thriftserver -DskipTests clean package > > [INFO] Spark Project Parent POM ... FAILURE [ 0.658 > s] > > [INFO] Spark Project Tags . SKIPPED > > [INFO] Spark Project Sketch ... SKIPPED > > [INFO] Spark Project Networking ... SKIPPED > > [INFO] Spark Project Shuffle Streaming Service SKIPPED > > [INFO] Spark Project Unsafe ... SKIPPED > > [INFO] Spark Project Launcher . SKIPPED > > [INFO] Spark Project Core . SKIPPED > > [INFO] Spark Project GraphX ... SKIPPED > > [INFO] Spark Project Streaming SKIPPED > > [INFO] Spark Project Catalyst . SKIPPED > > [INFO] Spark Project SQL .. SKIPPED > > [INFO] Spark Project ML Local Library . SKIPPED > > [INFO] Spark Project ML Library ... SKIPPED > > [INFO] Spark Project Tools SKIPPED > > [INFO] Spark Project Hive . SKIPPED > > [INFO] Spark Project REPL . SKIPPED > > [INFO] Spark Project YARN Shuffle Service . SKIPPED > > [INFO] Spark Project YARN . SKIPPED > > [INFO] Spark Project Hive Thrift Server ... SKIPPED > > [INFO] Spark Project Assembly . SKIPPED > > [INFO] Spark Project External Flume Sink .. SKIPPED > > [INFO] Spark Project External Flume ... SKIPPED > > [INFO] Spark Project External Flume Assembly .. SKIPPED > > [INFO] Spark Integration for Kafka 0.8 SKIPPED > > [INFO] Spark Project Examples . SKIPPED > > [INFO] Spark Project External Kafka Assembly .. SKIPPED > > [INFO] Spark Integration for Kafka 0.10 ... SKIPPED > > [INFO] Spark Integration for Kafka 0.10 Assembly .. SKIPPED > > [INFO] Spark Project Java 8 Tests . SKIPPED > > [INFO] > > > [INFO] BUILD FAILURE > > [INFO] > > > [INFO] Total time: 1.090 s > > [INFO] Finished at: 2016-07-29T07:01:57+08:00 > > [INFO] Final Memory: 30M/605M > > [INFO] > > > [WARNING] The requested profile "hadoop-2.7.0" could not be activated > because it does not exist. > > [ERROR] Plugin org.apache.maven.plugins:maven-site-plugin:3.3 or one of its > dependencies could not be resolved: Failed to read artifact descriptor for > org.apache.maven.plugins:maven-site-plugin:jar:3.3: Could not transfer > artifact org.apache.maven.plugins:maven-site-plugin:pom:3.3 from/to central > (https://repo1.maven.org/maven2): sun.security.validator.ValidatorException: > PKIX path building failed: > sun.security.provider.certpath.SunCertPathBuilderException: unable to find > valid certification path to requested target -> [Help 1] > > [ERROR] > > [ERROR] To see the full stack trace of the errors, re-run Maven with the -e > switch. > > [ERROR] Re-run Maven using the -X switch to enable full debug logging. > > [ERROR] > > [ERROR] For more information about the errors and possible solutions, please > read the following articles: > > [ERROR] [Help 1] > http://cwiki.apache.org/confluence/display/MAVEN/PluginResolutionException > > > (try 2) > > ./build/mvn -DskipTests clean package > > [INFO] > > > [INFO] Reactor Summary: > > [INFO] > > [INFO] Spark Project Parent POM ... FAILURE [ 0.653 > s] > > [INFO] Spark Project Tags . SKIPPED > > [INFO] Spark Project Sketch ... SKIPPED > > [INFO] Spark Project Networking ... SKIPPED > > [INFO] Spark Project Shuffle Streaming Service SKIPPED > > [INFO] Spark Project Unsafe ... SKIPPED > > [INFO] Spark Project Launcher . SKIPPED > > [INFO] Spark Project Core . SKIPPED > > [INFO] Spark Project GraphX ... SKIPPED > > [INFO] Spark Project Streaming SKIPPED > > [INFO] Spark Project Catalyst . SKIPPED > > [INFO] S
Spark 2.0 Build Failed
Hi, I tried to build spark, (try 1) mvn -Pyarn *-Phadoop-2.7.0* *-Dscala-2.11* -Dhadoop.version=2.7.0 -Phive -Phive-thriftserver -DskipTests clean package [INFO] Spark Project Parent POM ... FAILURE [ 0.658 s] [INFO] Spark Project Tags . SKIPPED [INFO] Spark Project Sketch ... SKIPPED [INFO] Spark Project Networking ... SKIPPED [INFO] Spark Project Shuffle Streaming Service SKIPPED [INFO] Spark Project Unsafe ... SKIPPED [INFO] Spark Project Launcher . SKIPPED [INFO] Spark Project Core . SKIPPED [INFO] Spark Project GraphX ... SKIPPED [INFO] Spark Project Streaming SKIPPED [INFO] Spark Project Catalyst . SKIPPED [INFO] Spark Project SQL .. SKIPPED [INFO] Spark Project ML Local Library . SKIPPED [INFO] Spark Project ML Library ... SKIPPED [INFO] Spark Project Tools SKIPPED [INFO] Spark Project Hive . SKIPPED [INFO] Spark Project REPL . SKIPPED [INFO] Spark Project YARN Shuffle Service . SKIPPED [INFO] Spark Project YARN . SKIPPED [INFO] Spark Project Hive Thrift Server ... SKIPPED [INFO] Spark Project Assembly . SKIPPED [INFO] Spark Project External Flume Sink .. SKIPPED [INFO] Spark Project External Flume ... SKIPPED [INFO] Spark Project External Flume Assembly .. SKIPPED [INFO] Spark Integration for Kafka 0.8 SKIPPED [INFO] Spark Project Examples . SKIPPED [INFO] Spark Project External Kafka Assembly .. SKIPPED [INFO] Spark Integration for Kafka 0.10 ... SKIPPED [INFO] Spark Integration for Kafka 0.10 Assembly .. SKIPPED [INFO] Spark Project Java 8 Tests . SKIPPED [INFO] [INFO] BUILD FAILURE [INFO] [INFO] Total time: 1.090 s [INFO] Finished at: 2016-07-29T07:01:57+08:00 [INFO] Final Memory: 30M/605M [INFO] [WARNING] The requested profile "hadoop-2.7.0" could not be activated because it does not exist. [ERROR] Plugin org.apache.maven.plugins:maven-site-plugin:3.3 or one of its dependencies could not be resolved: Failed to read artifact descriptor for org.apache.maven.plugins:maven-site-plugin:jar:3.3: Could not transfer artifact org.apache.maven.plugins:maven-site-plugin:pom:3.3 from/to central (https://repo1.maven.org/maven2): sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginResolutionException (try 2) ./build/mvn -DskipTests clean package [INFO] [INFO] Reactor Summary: [INFO] [INFO] Spark Project Parent POM ... FAILURE [ 0.653 s] [INFO] Spark Project Tags . SKIPPED [INFO] Spark Project Sketch ... SKIPPED [INFO] Spark Project Networking ... SKIPPED [INFO] Spark Project Shuffle Streaming Service SKIPPED [INFO] Spark Project Unsafe ... SKIPPED [INFO] Spark Project Launcher . SKIPPED [INFO] Spark Project Core . SKIPPED [INFO] Spark Project GraphX ... SKIPPED [INFO] Spark Project Streaming SKIPPED [INFO] Spark Project Catalyst . SKIPPED [INFO] Spark Project SQL .. SKIPPED [INFO] Spark Project ML Local Library . SKIPPED [INFO] Spark Project ML Library ... SKIPPED [INFO] Spark Project Tools SKIPPED [INFO] Spark Project Hive . SKIPPED [INFO] Spark Project REPL . SKIPPED [INFO] Spark Project Assembly