Re: Spark 2.0 Build Failed

2016-07-29 Thread Ascot Moss
I think my maven is broken, I used another node in the cluster to compile
2.0.0 and got "successful"


[INFO]

[INFO] --- maven-source-plugin:2.4:jar-no-fork (create-source-jar) @
java8-tests_2.11 ---

[INFO]

[INFO] --- maven-source-plugin:2.4:test-jar-no-fork (create-source-jar) @
java8-tests_2.11 ---

[INFO]


[INFO] Reactor Summary:

[INFO]

[INFO] Spark Project Parent POM ... SUCCESS [
1.972 s]

[INFO] Spark Project Tags . SUCCESS [
3.280 s]

[INFO] Spark Project Sketch ... SUCCESS [
5.449 s]

[INFO] Spark Project Networking ... SUCCESS [
5.197 s]

[INFO] Spark Project Shuffle Streaming Service  SUCCESS [
3.816 s]

[INFO] Spark Project Unsafe ... SUCCESS [
8.275 s]

[INFO] Spark Project Launcher . SUCCESS [
5.229 s]

[INFO] Spark Project Core . SUCCESS [01:41
min]

[INFO] Spark Project GraphX ... SUCCESS [
25.111 s]

[INFO] Spark Project Streaming  SUCCESS [
54.290 s]

[INFO] Spark Project Catalyst . SUCCESS [01:15
min]

[INFO] Spark Project SQL .. SUCCESS [01:55
min]

[INFO] Spark Project ML Local Library . SUCCESS [
16.132 s]

[INFO] Spark Project ML Library ... SUCCESS [01:32
min]

[INFO] Spark Project Tools  SUCCESS [
5.136 s]

[INFO] Spark Project Hive . SUCCESS [
53.472 s]

[INFO] Spark Project REPL . SUCCESS [
11.716 s]

[INFO] Spark Project YARN Shuffle Service . SUCCESS [
4.102 s]

[INFO] Spark Project YARN . SUCCESS [
26.685 s]

[INFO] Spark Project Hive Thrift Server ... SUCCESS [
23.611 s]

[INFO] Spark Project Assembly . SUCCESS [
1.342 s]

[INFO] Spark Project External Flume Sink .. SUCCESS [
9.630 s]

[INFO] Spark Project External Flume ... SUCCESS [
15.323 s]

[INFO] Spark Project External Flume Assembly .. SUCCESS [
1.434 s]

[INFO] Spark Integration for Kafka 0.8  SUCCESS [
20.958 s]

[INFO] Spark Project Examples . SUCCESS [
22.080 s]

[INFO] Spark Project External Kafka Assembly .. SUCCESS [
2.421 s]

[INFO] Spark Integration for Kafka 0.10 ... SUCCESS [
16.255 s]

[INFO] Spark Integration for Kafka 0.10 Assembly .. SUCCESS [
2.578 s]

[INFO] Spark Project Java 8 Tests . SUCCESS [
5.573 s]

[INFO]


[INFO] BUILD SUCCESS

[INFO]


[INFO] Total time: 12:16 min

[INFO] Finished at: 2016-07-29T15:58:41+08:00

[INFO] Final Memory: 127M/4210M

[INFO]






I tried to reinstall my maven 3.3.9, deleted .m2, still got following error.

[ERROR] Plugin org.scalastyle:scalastyle-maven-plugin:0.8.0 or one of its
dependencies could not be resolved: Failed to read artifact descriptor for
org.scalastyle:scalastyle-maven-plugin:jar:0.8.0: Could not transfer
artifact org.scalastyle:scalastyle-maven-plugin:pom:0.8.0 from/to central (
https://repo1.maven.org/maven2): sun.security.validator.ValidatorException:
PKIX path building failed:
sun.security.provider.certpath.SunCertPathBuilderException: unable to find
valid certification path to requested target -> [Help 1]

[ERROR]

[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.

[ERROR] Re-run Maven using the -X switch to enable full debug logging.

[ERROR]

[ERROR] For more information about the errors and possible solutions,
please read the following articles:

[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/PluginResolutionException

On Fri, Jul 29, 2016 at 1:46 PM, Ascot Moss  wrote:

> I just run
>
> wget https://repo1.maven.org/maven2/org/apache/apache/14/apache-14.pom,
> can get it without issue.
>
> On Fri, Jul 29, 2016 at 1:44 PM, Ascot Moss  wrote:
>
>> Hi thanks!
>>
>> mvn dependency:tree
>>
>> [INFO] Scanning for projects...
>>
>> Downloading:
>> https://repo1.maven.org/maven2/org/apache/apache/14/apache-14.pom
>>
>> [ERROR] [ERROR] Some problems were encountered while processing the POMs:
>>
>> [FATAL] Non-resolvable parent POM for
>> org.apache.spark:spark-parent_2.11:2.0.0: Could not transfer artifact
>> org.apache:apache:pom:14 from/to central (https://repo1.maven.org/maven2):
>> sun.security.validator.ValidatorException: PKIX path building failed:
>> sun.security.provider.certpath.SunCertPathBuilderExceptio

Re: Spark 2.0 Build Failed

2016-07-28 Thread Ascot Moss
I just run

wget https://repo1.maven.org/maven2/org/apache/apache/14/apache-14.pom, can
get it without issue.

On Fri, Jul 29, 2016 at 1:44 PM, Ascot Moss  wrote:

> Hi thanks!
>
> mvn dependency:tree
>
> [INFO] Scanning for projects...
>
> Downloading:
> https://repo1.maven.org/maven2/org/apache/apache/14/apache-14.pom
>
> [ERROR] [ERROR] Some problems were encountered while processing the POMs:
>
> [FATAL] Non-resolvable parent POM for
> org.apache.spark:spark-parent_2.11:2.0.0: Could not transfer artifact
> org.apache:apache:pom:14 from/to central (https://repo1.maven.org/maven2):
> sun.security.validator.ValidatorException: PKIX path building failed:
> sun.security.provider.certpath.SunCertPathBuilderException: unable to find
> valid certification path to requested target and 'parent.relativePath'
> points at wrong local POM @ line 22, column 11
>
>  @
>
> [ERROR] The build could not read 1 project -> [Help 1]
>
> [ERROR]
>
> [ERROR]   The project org.apache.spark:spark-parent_2.11:2.0.0
> (/edh_all_sources/edh_2.6.0/spark-2.0.0/pom.xml) has 1 error
>
> [ERROR] Non-resolvable parent POM for
> org.apache.spark:spark-parent_2.11:2.0.0: Could not transfer artifact
> org.apache:apache:pom:14 from/to central (https://repo1.maven.org/maven2):
> sun.security.validator.ValidatorException: PKIX path building failed:
> sun.security.provider.certpath.SunCertPathBuilderException: unable to find
> valid certification path to requested target and 'parent.relativePath'
> points at wrong local POM @ line 22, column 11 -> [Help 2]
>
> [ERROR]
>
> [ERROR] To see the full stack trace of the errors, re-run Maven with the
> -e switch.
>
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>
> [ERROR]
>
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
>
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/ProjectBuildingException
>
> [ERROR] [Help 2]
> http://cwiki.apache.org/confluence/display/MAVEN/UnresolvableModelException
>
>
>
>
>
>
> On Fri, Jul 29, 2016 at 1:34 PM, Dong Meng  wrote:
>
>> Before build, first do a "mvn dependency:tree" to make sure the
>> dependency is right
>>
>> On Thu, Jul 28, 2016 at 10:18 PM, Ascot Moss 
>> wrote:
>>
>>> Thanks for your reply.
>>>
>>> Is there a way to find the correct Hadoop profile name?
>>>
>>> On Fri, Jul 29, 2016 at 7:06 AM, Sean Owen  wrote:
>>>
 You have at least two problems here: wrong Hadoop profile name, and
 some kind of firewall interrupting access to the Maven repo. It's not
 related to Spark.

 On Thu, Jul 28, 2016 at 4:04 PM, Ascot Moss 
 wrote:
 > Hi,
 >
 > I tried to build spark,
 >
 > (try 1)
 > mvn -Pyarn -Phadoop-2.7.0 -Dscala-2.11 -Dhadoop.version=2.7.0 -Phive
 > -Phive-thriftserver -DskipTests clean package
 >
 > [INFO] Spark Project Parent POM ... FAILURE
 [  0.658
 > s]
 >
 > [INFO] Spark Project Tags . SKIPPED
 >
 > [INFO] Spark Project Sketch ... SKIPPED
 >
 > [INFO] Spark Project Networking ... SKIPPED
 >
 > [INFO] Spark Project Shuffle Streaming Service  SKIPPED
 >
 > [INFO] Spark Project Unsafe ... SKIPPED
 >
 > [INFO] Spark Project Launcher . SKIPPED
 >
 > [INFO] Spark Project Core . SKIPPED
 >
 > [INFO] Spark Project GraphX ... SKIPPED
 >
 > [INFO] Spark Project Streaming  SKIPPED
 >
 > [INFO] Spark Project Catalyst . SKIPPED
 >
 > [INFO] Spark Project SQL .. SKIPPED
 >
 > [INFO] Spark Project ML Local Library . SKIPPED
 >
 > [INFO] Spark Project ML Library ... SKIPPED
 >
 > [INFO] Spark Project Tools  SKIPPED
 >
 > [INFO] Spark Project Hive . SKIPPED
 >
 > [INFO] Spark Project REPL . SKIPPED
 >
 > [INFO] Spark Project YARN Shuffle Service . SKIPPED
 >
 > [INFO] Spark Project YARN . SKIPPED
 >
 > [INFO] Spark Project Hive Thrift Server ... SKIPPED
 >
 > [INFO] Spark Project Assembly . SKIPPED
 >
 > [INFO] Spark Project External Flume Sink .. SKIPPED
 >
 > [INFO] Spark Project External Flume ... SKIPPED
 >
 > [INFO] Spark Project External Flume Assembly .. SKIPPED
 >
 > [INFO] Spark Integration for Kafka 0.8  SKIPPED
 >
 > [INFO] Spark Project Examples ..

Re: Spark 2.0 Build Failed

2016-07-28 Thread Ascot Moss
Hi thanks!

mvn dependency:tree

[INFO] Scanning for projects...

Downloading:
https://repo1.maven.org/maven2/org/apache/apache/14/apache-14.pom

[ERROR] [ERROR] Some problems were encountered while processing the POMs:

[FATAL] Non-resolvable parent POM for
org.apache.spark:spark-parent_2.11:2.0.0: Could not transfer artifact
org.apache:apache:pom:14 from/to central (https://repo1.maven.org/maven2):
sun.security.validator.ValidatorException: PKIX path building failed:
sun.security.provider.certpath.SunCertPathBuilderException: unable to find
valid certification path to requested target and 'parent.relativePath'
points at wrong local POM @ line 22, column 11

 @

[ERROR] The build could not read 1 project -> [Help 1]

[ERROR]

[ERROR]   The project org.apache.spark:spark-parent_2.11:2.0.0
(/edh_all_sources/edh_2.6.0/spark-2.0.0/pom.xml) has 1 error

[ERROR] Non-resolvable parent POM for
org.apache.spark:spark-parent_2.11:2.0.0: Could not transfer artifact
org.apache:apache:pom:14 from/to central (https://repo1.maven.org/maven2):
sun.security.validator.ValidatorException: PKIX path building failed:
sun.security.provider.certpath.SunCertPathBuilderException: unable to find
valid certification path to requested target and 'parent.relativePath'
points at wrong local POM @ line 22, column 11 -> [Help 2]

[ERROR]

[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.

[ERROR] Re-run Maven using the -X switch to enable full debug logging.

[ERROR]

[ERROR] For more information about the errors and possible solutions,
please read the following articles:

[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/ProjectBuildingException

[ERROR] [Help 2]
http://cwiki.apache.org/confluence/display/MAVEN/UnresolvableModelException






On Fri, Jul 29, 2016 at 1:34 PM, Dong Meng  wrote:

> Before build, first do a "mvn dependency:tree" to make sure the
> dependency is right
>
> On Thu, Jul 28, 2016 at 10:18 PM, Ascot Moss  wrote:
>
>> Thanks for your reply.
>>
>> Is there a way to find the correct Hadoop profile name?
>>
>> On Fri, Jul 29, 2016 at 7:06 AM, Sean Owen  wrote:
>>
>>> You have at least two problems here: wrong Hadoop profile name, and
>>> some kind of firewall interrupting access to the Maven repo. It's not
>>> related to Spark.
>>>
>>> On Thu, Jul 28, 2016 at 4:04 PM, Ascot Moss 
>>> wrote:
>>> > Hi,
>>> >
>>> > I tried to build spark,
>>> >
>>> > (try 1)
>>> > mvn -Pyarn -Phadoop-2.7.0 -Dscala-2.11 -Dhadoop.version=2.7.0 -Phive
>>> > -Phive-thriftserver -DskipTests clean package
>>> >
>>> > [INFO] Spark Project Parent POM ... FAILURE [
>>> 0.658
>>> > s]
>>> >
>>> > [INFO] Spark Project Tags . SKIPPED
>>> >
>>> > [INFO] Spark Project Sketch ... SKIPPED
>>> >
>>> > [INFO] Spark Project Networking ... SKIPPED
>>> >
>>> > [INFO] Spark Project Shuffle Streaming Service  SKIPPED
>>> >
>>> > [INFO] Spark Project Unsafe ... SKIPPED
>>> >
>>> > [INFO] Spark Project Launcher . SKIPPED
>>> >
>>> > [INFO] Spark Project Core . SKIPPED
>>> >
>>> > [INFO] Spark Project GraphX ... SKIPPED
>>> >
>>> > [INFO] Spark Project Streaming  SKIPPED
>>> >
>>> > [INFO] Spark Project Catalyst . SKIPPED
>>> >
>>> > [INFO] Spark Project SQL .. SKIPPED
>>> >
>>> > [INFO] Spark Project ML Local Library . SKIPPED
>>> >
>>> > [INFO] Spark Project ML Library ... SKIPPED
>>> >
>>> > [INFO] Spark Project Tools  SKIPPED
>>> >
>>> > [INFO] Spark Project Hive . SKIPPED
>>> >
>>> > [INFO] Spark Project REPL . SKIPPED
>>> >
>>> > [INFO] Spark Project YARN Shuffle Service . SKIPPED
>>> >
>>> > [INFO] Spark Project YARN . SKIPPED
>>> >
>>> > [INFO] Spark Project Hive Thrift Server ... SKIPPED
>>> >
>>> > [INFO] Spark Project Assembly . SKIPPED
>>> >
>>> > [INFO] Spark Project External Flume Sink .. SKIPPED
>>> >
>>> > [INFO] Spark Project External Flume ... SKIPPED
>>> >
>>> > [INFO] Spark Project External Flume Assembly .. SKIPPED
>>> >
>>> > [INFO] Spark Integration for Kafka 0.8  SKIPPED
>>> >
>>> > [INFO] Spark Project Examples . SKIPPED
>>> >
>>> > [INFO] Spark Project External Kafka Assembly .. SKIPPED
>>> >
>>> > [INFO] Spark Integration for Kafka 0.10 ... SKIPPED
>>> >
>>> > [INFO] Spark Integration for Kafka 0.10 Assembly .. SKIPPED
>>> >
>>> > [INFO] Spark Project Java 8 Tests . SKIPPED
>>> >
>>

Re: Spark 2.0 Build Failed

2016-07-28 Thread Dong Meng
Before build, first do a "mvn dependency:tree" to make sure the dependency
is right

On Thu, Jul 28, 2016 at 10:18 PM, Ascot Moss  wrote:

> Thanks for your reply.
>
> Is there a way to find the correct Hadoop profile name?
>
> On Fri, Jul 29, 2016 at 7:06 AM, Sean Owen  wrote:
>
>> You have at least two problems here: wrong Hadoop profile name, and
>> some kind of firewall interrupting access to the Maven repo. It's not
>> related to Spark.
>>
>> On Thu, Jul 28, 2016 at 4:04 PM, Ascot Moss  wrote:
>> > Hi,
>> >
>> > I tried to build spark,
>> >
>> > (try 1)
>> > mvn -Pyarn -Phadoop-2.7.0 -Dscala-2.11 -Dhadoop.version=2.7.0 -Phive
>> > -Phive-thriftserver -DskipTests clean package
>> >
>> > [INFO] Spark Project Parent POM ... FAILURE [
>> 0.658
>> > s]
>> >
>> > [INFO] Spark Project Tags . SKIPPED
>> >
>> > [INFO] Spark Project Sketch ... SKIPPED
>> >
>> > [INFO] Spark Project Networking ... SKIPPED
>> >
>> > [INFO] Spark Project Shuffle Streaming Service  SKIPPED
>> >
>> > [INFO] Spark Project Unsafe ... SKIPPED
>> >
>> > [INFO] Spark Project Launcher . SKIPPED
>> >
>> > [INFO] Spark Project Core . SKIPPED
>> >
>> > [INFO] Spark Project GraphX ... SKIPPED
>> >
>> > [INFO] Spark Project Streaming  SKIPPED
>> >
>> > [INFO] Spark Project Catalyst . SKIPPED
>> >
>> > [INFO] Spark Project SQL .. SKIPPED
>> >
>> > [INFO] Spark Project ML Local Library . SKIPPED
>> >
>> > [INFO] Spark Project ML Library ... SKIPPED
>> >
>> > [INFO] Spark Project Tools  SKIPPED
>> >
>> > [INFO] Spark Project Hive . SKIPPED
>> >
>> > [INFO] Spark Project REPL . SKIPPED
>> >
>> > [INFO] Spark Project YARN Shuffle Service . SKIPPED
>> >
>> > [INFO] Spark Project YARN . SKIPPED
>> >
>> > [INFO] Spark Project Hive Thrift Server ... SKIPPED
>> >
>> > [INFO] Spark Project Assembly . SKIPPED
>> >
>> > [INFO] Spark Project External Flume Sink .. SKIPPED
>> >
>> > [INFO] Spark Project External Flume ... SKIPPED
>> >
>> > [INFO] Spark Project External Flume Assembly .. SKIPPED
>> >
>> > [INFO] Spark Integration for Kafka 0.8  SKIPPED
>> >
>> > [INFO] Spark Project Examples . SKIPPED
>> >
>> > [INFO] Spark Project External Kafka Assembly .. SKIPPED
>> >
>> > [INFO] Spark Integration for Kafka 0.10 ... SKIPPED
>> >
>> > [INFO] Spark Integration for Kafka 0.10 Assembly .. SKIPPED
>> >
>> > [INFO] Spark Project Java 8 Tests . SKIPPED
>> >
>> > [INFO]
>> > 
>> >
>> > [INFO] BUILD FAILURE
>> >
>> > [INFO]
>> > 
>> >
>> > [INFO] Total time: 1.090 s
>> >
>> > [INFO] Finished at: 2016-07-29T07:01:57+08:00
>> >
>> > [INFO] Final Memory: 30M/605M
>> >
>> > [INFO]
>> > 
>> >
>> > [WARNING] The requested profile "hadoop-2.7.0" could not be activated
>> > because it does not exist.
>> >
>> > [ERROR] Plugin org.apache.maven.plugins:maven-site-plugin:3.3 or one of
>> its
>> > dependencies could not be resolved: Failed to read artifact descriptor
>> for
>> > org.apache.maven.plugins:maven-site-plugin:jar:3.3: Could not transfer
>> > artifact org.apache.maven.plugins:maven-site-plugin:pom:3.3 from/to
>> central
>> > (https://repo1.maven.org/maven2):
>> sun.security.validator.ValidatorException:
>> > PKIX path building failed:
>> > sun.security.provider.certpath.SunCertPathBuilderException: unable to
>> find
>> > valid certification path to requested target -> [Help 1]
>> >
>> > [ERROR]
>> >
>> > [ERROR] To see the full stack trace of the errors, re-run Maven with
>> the -e
>> > switch.
>> >
>> > [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>> >
>> > [ERROR]
>> >
>> > [ERROR] For more information about the errors and possible solutions,
>> please
>> > read the following articles:
>> >
>> > [ERROR] [Help 1]
>> >
>> http://cwiki.apache.org/confluence/display/MAVEN/PluginResolutionException
>> >
>> >
>> > (try 2)
>> >
>> > ./build/mvn -DskipTests clean package
>> >
>> > [INFO]
>> > 
>> >
>> > [INFO] Reactor Summary:
>> >
>> > [INFO]
>> >
>> > [INFO] Spark Project Parent POM ... FAILURE [
>> 0.653
>> > s]
>> >
>> > [INFO] Spark Proje

Re: Spark 2.0 Build Failed

2016-07-28 Thread Ascot Moss
Thanks for your reply.

Is there a way to find the correct Hadoop profile name?

On Fri, Jul 29, 2016 at 7:06 AM, Sean Owen  wrote:

> You have at least two problems here: wrong Hadoop profile name, and
> some kind of firewall interrupting access to the Maven repo. It's not
> related to Spark.
>
> On Thu, Jul 28, 2016 at 4:04 PM, Ascot Moss  wrote:
> > Hi,
> >
> > I tried to build spark,
> >
> > (try 1)
> > mvn -Pyarn -Phadoop-2.7.0 -Dscala-2.11 -Dhadoop.version=2.7.0 -Phive
> > -Phive-thriftserver -DskipTests clean package
> >
> > [INFO] Spark Project Parent POM ... FAILURE [
> 0.658
> > s]
> >
> > [INFO] Spark Project Tags . SKIPPED
> >
> > [INFO] Spark Project Sketch ... SKIPPED
> >
> > [INFO] Spark Project Networking ... SKIPPED
> >
> > [INFO] Spark Project Shuffle Streaming Service  SKIPPED
> >
> > [INFO] Spark Project Unsafe ... SKIPPED
> >
> > [INFO] Spark Project Launcher . SKIPPED
> >
> > [INFO] Spark Project Core . SKIPPED
> >
> > [INFO] Spark Project GraphX ... SKIPPED
> >
> > [INFO] Spark Project Streaming  SKIPPED
> >
> > [INFO] Spark Project Catalyst . SKIPPED
> >
> > [INFO] Spark Project SQL .. SKIPPED
> >
> > [INFO] Spark Project ML Local Library . SKIPPED
> >
> > [INFO] Spark Project ML Library ... SKIPPED
> >
> > [INFO] Spark Project Tools  SKIPPED
> >
> > [INFO] Spark Project Hive . SKIPPED
> >
> > [INFO] Spark Project REPL . SKIPPED
> >
> > [INFO] Spark Project YARN Shuffle Service . SKIPPED
> >
> > [INFO] Spark Project YARN . SKIPPED
> >
> > [INFO] Spark Project Hive Thrift Server ... SKIPPED
> >
> > [INFO] Spark Project Assembly . SKIPPED
> >
> > [INFO] Spark Project External Flume Sink .. SKIPPED
> >
> > [INFO] Spark Project External Flume ... SKIPPED
> >
> > [INFO] Spark Project External Flume Assembly .. SKIPPED
> >
> > [INFO] Spark Integration for Kafka 0.8  SKIPPED
> >
> > [INFO] Spark Project Examples . SKIPPED
> >
> > [INFO] Spark Project External Kafka Assembly .. SKIPPED
> >
> > [INFO] Spark Integration for Kafka 0.10 ... SKIPPED
> >
> > [INFO] Spark Integration for Kafka 0.10 Assembly .. SKIPPED
> >
> > [INFO] Spark Project Java 8 Tests . SKIPPED
> >
> > [INFO]
> > 
> >
> > [INFO] BUILD FAILURE
> >
> > [INFO]
> > 
> >
> > [INFO] Total time: 1.090 s
> >
> > [INFO] Finished at: 2016-07-29T07:01:57+08:00
> >
> > [INFO] Final Memory: 30M/605M
> >
> > [INFO]
> > 
> >
> > [WARNING] The requested profile "hadoop-2.7.0" could not be activated
> > because it does not exist.
> >
> > [ERROR] Plugin org.apache.maven.plugins:maven-site-plugin:3.3 or one of
> its
> > dependencies could not be resolved: Failed to read artifact descriptor
> for
> > org.apache.maven.plugins:maven-site-plugin:jar:3.3: Could not transfer
> > artifact org.apache.maven.plugins:maven-site-plugin:pom:3.3 from/to
> central
> > (https://repo1.maven.org/maven2):
> sun.security.validator.ValidatorException:
> > PKIX path building failed:
> > sun.security.provider.certpath.SunCertPathBuilderException: unable to
> find
> > valid certification path to requested target -> [Help 1]
> >
> > [ERROR]
> >
> > [ERROR] To see the full stack trace of the errors, re-run Maven with the
> -e
> > switch.
> >
> > [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> >
> > [ERROR]
> >
> > [ERROR] For more information about the errors and possible solutions,
> please
> > read the following articles:
> >
> > [ERROR] [Help 1]
> >
> http://cwiki.apache.org/confluence/display/MAVEN/PluginResolutionException
> >
> >
> > (try 2)
> >
> > ./build/mvn -DskipTests clean package
> >
> > [INFO]
> > 
> >
> > [INFO] Reactor Summary:
> >
> > [INFO]
> >
> > [INFO] Spark Project Parent POM ... FAILURE [
> 0.653
> > s]
> >
> > [INFO] Spark Project Tags . SKIPPED
> >
> > [INFO] Spark Project Sketch ... SKIPPED
> >
> > [INFO] Spark Project Networking ... SKIPPED
> >
> > [INFO] Spark Project Shuffle Streaming Service  SKIPPED
> >
> > [INFO]

Re: Spark 2.0 Build Failed

2016-07-28 Thread Sean Owen
You have at least two problems here: wrong Hadoop profile name, and
some kind of firewall interrupting access to the Maven repo. It's not
related to Spark.

On Thu, Jul 28, 2016 at 4:04 PM, Ascot Moss  wrote:
> Hi,
>
> I tried to build spark,
>
> (try 1)
> mvn -Pyarn -Phadoop-2.7.0 -Dscala-2.11 -Dhadoop.version=2.7.0 -Phive
> -Phive-thriftserver -DskipTests clean package
>
> [INFO] Spark Project Parent POM ... FAILURE [  0.658
> s]
>
> [INFO] Spark Project Tags . SKIPPED
>
> [INFO] Spark Project Sketch ... SKIPPED
>
> [INFO] Spark Project Networking ... SKIPPED
>
> [INFO] Spark Project Shuffle Streaming Service  SKIPPED
>
> [INFO] Spark Project Unsafe ... SKIPPED
>
> [INFO] Spark Project Launcher . SKIPPED
>
> [INFO] Spark Project Core . SKIPPED
>
> [INFO] Spark Project GraphX ... SKIPPED
>
> [INFO] Spark Project Streaming  SKIPPED
>
> [INFO] Spark Project Catalyst . SKIPPED
>
> [INFO] Spark Project SQL .. SKIPPED
>
> [INFO] Spark Project ML Local Library . SKIPPED
>
> [INFO] Spark Project ML Library ... SKIPPED
>
> [INFO] Spark Project Tools  SKIPPED
>
> [INFO] Spark Project Hive . SKIPPED
>
> [INFO] Spark Project REPL . SKIPPED
>
> [INFO] Spark Project YARN Shuffle Service . SKIPPED
>
> [INFO] Spark Project YARN . SKIPPED
>
> [INFO] Spark Project Hive Thrift Server ... SKIPPED
>
> [INFO] Spark Project Assembly . SKIPPED
>
> [INFO] Spark Project External Flume Sink .. SKIPPED
>
> [INFO] Spark Project External Flume ... SKIPPED
>
> [INFO] Spark Project External Flume Assembly .. SKIPPED
>
> [INFO] Spark Integration for Kafka 0.8  SKIPPED
>
> [INFO] Spark Project Examples . SKIPPED
>
> [INFO] Spark Project External Kafka Assembly .. SKIPPED
>
> [INFO] Spark Integration for Kafka 0.10 ... SKIPPED
>
> [INFO] Spark Integration for Kafka 0.10 Assembly .. SKIPPED
>
> [INFO] Spark Project Java 8 Tests . SKIPPED
>
> [INFO]
> 
>
> [INFO] BUILD FAILURE
>
> [INFO]
> 
>
> [INFO] Total time: 1.090 s
>
> [INFO] Finished at: 2016-07-29T07:01:57+08:00
>
> [INFO] Final Memory: 30M/605M
>
> [INFO]
> 
>
> [WARNING] The requested profile "hadoop-2.7.0" could not be activated
> because it does not exist.
>
> [ERROR] Plugin org.apache.maven.plugins:maven-site-plugin:3.3 or one of its
> dependencies could not be resolved: Failed to read artifact descriptor for
> org.apache.maven.plugins:maven-site-plugin:jar:3.3: Could not transfer
> artifact org.apache.maven.plugins:maven-site-plugin:pom:3.3 from/to central
> (https://repo1.maven.org/maven2): sun.security.validator.ValidatorException:
> PKIX path building failed:
> sun.security.provider.certpath.SunCertPathBuilderException: unable to find
> valid certification path to requested target -> [Help 1]
>
> [ERROR]
>
> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e
> switch.
>
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>
> [ERROR]
>
> [ERROR] For more information about the errors and possible solutions, please
> read the following articles:
>
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/PluginResolutionException
>
>
> (try 2)
>
> ./build/mvn -DskipTests clean package
>
> [INFO]
> 
>
> [INFO] Reactor Summary:
>
> [INFO]
>
> [INFO] Spark Project Parent POM ... FAILURE [  0.653
> s]
>
> [INFO] Spark Project Tags . SKIPPED
>
> [INFO] Spark Project Sketch ... SKIPPED
>
> [INFO] Spark Project Networking ... SKIPPED
>
> [INFO] Spark Project Shuffle Streaming Service  SKIPPED
>
> [INFO] Spark Project Unsafe ... SKIPPED
>
> [INFO] Spark Project Launcher . SKIPPED
>
> [INFO] Spark Project Core . SKIPPED
>
> [INFO] Spark Project GraphX ... SKIPPED
>
> [INFO] Spark Project Streaming  SKIPPED
>
> [INFO] Spark Project Catalyst . SKIPPED
>
> [INFO] S

Spark 2.0 Build Failed

2016-07-28 Thread Ascot Moss
Hi,

I tried to build spark,

(try 1)
mvn -Pyarn *-Phadoop-2.7.0* *-Dscala-2.11* -Dhadoop.version=2.7.0 -Phive
-Phive-thriftserver -DskipTests clean package

[INFO] Spark Project Parent POM ... FAILURE [
0.658 s]

[INFO] Spark Project Tags . SKIPPED

[INFO] Spark Project Sketch ... SKIPPED

[INFO] Spark Project Networking ... SKIPPED

[INFO] Spark Project Shuffle Streaming Service  SKIPPED

[INFO] Spark Project Unsafe ... SKIPPED

[INFO] Spark Project Launcher . SKIPPED

[INFO] Spark Project Core . SKIPPED

[INFO] Spark Project GraphX ... SKIPPED

[INFO] Spark Project Streaming  SKIPPED

[INFO] Spark Project Catalyst . SKIPPED

[INFO] Spark Project SQL .. SKIPPED

[INFO] Spark Project ML Local Library . SKIPPED

[INFO] Spark Project ML Library ... SKIPPED

[INFO] Spark Project Tools  SKIPPED

[INFO] Spark Project Hive . SKIPPED

[INFO] Spark Project REPL . SKIPPED

[INFO] Spark Project YARN Shuffle Service . SKIPPED

[INFO] Spark Project YARN . SKIPPED

[INFO] Spark Project Hive Thrift Server ... SKIPPED

[INFO] Spark Project Assembly . SKIPPED

[INFO] Spark Project External Flume Sink .. SKIPPED

[INFO] Spark Project External Flume ... SKIPPED

[INFO] Spark Project External Flume Assembly .. SKIPPED

[INFO] Spark Integration for Kafka 0.8  SKIPPED

[INFO] Spark Project Examples . SKIPPED

[INFO] Spark Project External Kafka Assembly .. SKIPPED

[INFO] Spark Integration for Kafka 0.10 ... SKIPPED

[INFO] Spark Integration for Kafka 0.10 Assembly .. SKIPPED

[INFO] Spark Project Java 8 Tests . SKIPPED

[INFO]


[INFO] BUILD FAILURE

[INFO]


[INFO] Total time: 1.090 s

[INFO] Finished at: 2016-07-29T07:01:57+08:00

[INFO] Final Memory: 30M/605M

[INFO]


[WARNING] The requested profile "hadoop-2.7.0" could not be activated
because it does not exist.

[ERROR] Plugin org.apache.maven.plugins:maven-site-plugin:3.3 or one of its
dependencies could not be resolved: Failed to read artifact descriptor for
org.apache.maven.plugins:maven-site-plugin:jar:3.3: Could not transfer
artifact org.apache.maven.plugins:maven-site-plugin:pom:3.3 from/to central
(https://repo1.maven.org/maven2):
sun.security.validator.ValidatorException: PKIX path building failed:
sun.security.provider.certpath.SunCertPathBuilderException: unable to find
valid certification path to requested target -> [Help 1]

[ERROR]

[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.

[ERROR] Re-run Maven using the -X switch to enable full debug logging.

[ERROR]

[ERROR] For more information about the errors and possible solutions,
please read the following articles:

[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/PluginResolutionException


(try 2)

./build/mvn -DskipTests clean package

[INFO]


[INFO] Reactor Summary:

[INFO]

[INFO] Spark Project Parent POM ... FAILURE [
0.653 s]

[INFO] Spark Project Tags . SKIPPED

[INFO] Spark Project Sketch ... SKIPPED

[INFO] Spark Project Networking ... SKIPPED

[INFO] Spark Project Shuffle Streaming Service  SKIPPED

[INFO] Spark Project Unsafe ... SKIPPED

[INFO] Spark Project Launcher . SKIPPED

[INFO] Spark Project Core . SKIPPED

[INFO] Spark Project GraphX ... SKIPPED

[INFO] Spark Project Streaming  SKIPPED

[INFO] Spark Project Catalyst . SKIPPED

[INFO] Spark Project SQL .. SKIPPED

[INFO] Spark Project ML Local Library . SKIPPED

[INFO] Spark Project ML Library ... SKIPPED

[INFO] Spark Project Tools  SKIPPED

[INFO] Spark Project Hive . SKIPPED

[INFO] Spark Project REPL . SKIPPED

[INFO] Spark Project Assembly