Re: how long does it takes for full build ?

2015-04-16 Thread Sree V 
Found it, Ted. Thank 
you.https://amplab.cs.berkeley.edu/jenkins/job/Spark-1.2-Maven-pre-YARN/hadoop.version=2.0.0-mr1-cdh4.1.2,label=centos/354/consoleFull
We locally build with "-DskipTests" and on our jenkins as well.

Thanking you.

With Regards
Sree 


 On Thursday, April 16, 2015 1:04 PM, Ted Yu  wrote:
   

 You can find the command at the beginning of the console output:

[centos] $ 
/home/jenkins/tools/hudson.tasks.Maven_MavenInstallation/Maven_3.0.5/bin/mvn
-DHADOOP_PROFILE=hadoop-2.4 -Dlabel=centos -DskipTests -Phadoop-2.4
-Pyarn -Phive clean package


On Thu, Apr 16, 2015 at 12:42 PM, Sree V  wrote:

> 1.
> 40 min+ to 1hr+, from jenkins.
> I didn't find the commands of the job. Does it require a login ?
>
> Part of the console output:
>
>  > git checkout -f 3ae37b93a7c299bd8b22a36248035bca5de3422f
>  > git rev-list de4fa6b6d12e2bee0307ffba2abfca0c33f15e45 # timeout=10
> Triggering Spark-Master-Maven-pre-YARN ? 2.0.0-mr1-cdh4.1.2,centos 
> 
> Triggering Spark-Master-Maven-pre-YARN ? 1.0.4,centos 
> 
>
> How to find the commands of these 'triggers' ?
> I am interested, whether these named triggers use -DskipTests or not.
>
> 2.
> This page, gives examples all with -DskipTests only.
> http://spark.apache.org/docs/1.2.0/building-spark.html
>
>
> 3.
> For casting VOTE to release 1.2.2-rc1,
> I am running 'mvn clean package' on spark 1.2.2-rc1 with oralce jdk8_40 on
> centos7.
> This is stuck at, from last night. i.e. almost 12 hours.
> ...
> ExternalSorterSuite:
> - empty data stream
> - few elements per partition
> - empty partitions with spilling
> - empty partitions with spilling, bypass merge-sort
>
> Any pointers ?
>
> Thanking you.
>
> With Regards
> Sree
>
>
>
>  On Thursday, April 16, 2015 12:01 PM, Ted Yu 
> wrote:
>
>
> You can get some idea by looking at the builds here:
>
>
> https://amplab.cs.berkeley.edu/jenkins/view/Spark/job/Spark-1.2-Maven-with-YARN/HADOOP_PROFILE=hadoop-2.4,label=centos/
>
> Cheers
>
> On Thu, Apr 16, 2015 at 11:56 AM, Sree V 
> wrote:
>
> Hi Team,
> How long does it takes for a full build 'mvn clean package' on spark
> 1.2.2-rc1 ?
>
>
> Thanking you.
>
> With Regards
> Sree
>
>
>
>
>

Re: how long does it takes for full build ?

2015-04-16 Thread Ted Yu 
You can find the command at the beginning of the console output:

[centos] $ 
/home/jenkins/tools/hudson.tasks.Maven_MavenInstallation/Maven_3.0.5/bin/mvn
-DHADOOP_PROFILE=hadoop-2.4 -Dlabel=centos -DskipTests -Phadoop-2.4
-Pyarn -Phive clean package


On Thu, Apr 16, 2015 at 12:42 PM, Sree V  wrote:

> 1.
> 40 min+ to 1hr+, from jenkins.
> I didn't find the commands of the job. Does it require a login ?
>
> Part of the console output:
>
>  > git checkout -f 3ae37b93a7c299bd8b22a36248035bca5de3422f
>  > git rev-list de4fa6b6d12e2bee0307ffba2abfca0c33f15e45 # timeout=10
> Triggering Spark-Master-Maven-pre-YARN ? 2.0.0-mr1-cdh4.1.2,centos 
> 
> Triggering Spark-Master-Maven-pre-YARN ? 1.0.4,centos 
> 
>
> How to find the commands of these 'triggers' ?
> I am interested, whether these named triggers use -DskipTests or not.
>
> 2.
> This page, gives examples all with -DskipTests only.
> http://spark.apache.org/docs/1.2.0/building-spark.html
>
>
> 3.
> For casting VOTE to release 1.2.2-rc1,
> I am running 'mvn clean package' on spark 1.2.2-rc1 with oralce jdk8_40 on
> centos7.
> This is stuck at, from last night. i.e. almost 12 hours.
> ...
> ExternalSorterSuite:
> - empty data stream
> - few elements per partition
> - empty partitions with spilling
> - empty partitions with spilling, bypass merge-sort
>
> Any pointers ?
>
> Thanking you.
>
> With Regards
> Sree
>
>
>
>   On Thursday, April 16, 2015 12:01 PM, Ted Yu 
> wrote:
>
>
> You can get some idea by looking at the builds here:
>
>
> https://amplab.cs.berkeley.edu/jenkins/view/Spark/job/Spark-1.2-Maven-with-YARN/HADOOP_PROFILE=hadoop-2.4,label=centos/
>
> Cheers
>
> On Thu, Apr 16, 2015 at 11:56 AM, Sree V 
> wrote:
>
> Hi Team,
> How long does it takes for a full build 'mvn clean package' on spark
> 1.2.2-rc1 ?
>
>
> Thanking you.
>
> With Regards
> Sree
>
>
>
>
>

Re: how long does it takes for full build ?

2015-04-16 Thread Sree V 
+ ShaneHi Shane,
Would you address 1. please ? 

Thanking you.

With Regards
Sree 


 On Thursday, April 16, 2015 12:46 PM, Sree V 
 wrote:
   

 1.
40 min+ to 1hr+, from jenkins.I didn't find the commands of the job. Does it 
require a login ?
Part of the console output:
 > git checkout -f 3ae37b93a7c299bd8b22a36248035bca5de3422f
 > git rev-list de4fa6b6d12e2bee0307ffba2abfca0c33f15e45 # timeout=10
Triggering Spark-Master-Maven-pre-YARN ? 2.0.0-mr1-cdh4.1.2,centos
Triggering Spark-Master-Maven-pre-YARN ? 1.0.4,centosHow to find the commands 
of these 'triggers' ?I am interested, whether these named triggers use 
-DskipTests or not.

2.
This page, gives examples all with -DskipTests only.
http://spark.apache.org/docs/1.2.0/building-spark.html

 
3.For casting VOTE to release 1.2.2-rc1,
I am running 'mvn clean package' on spark 1.2.2-rc1 with oralce jdk8_40 on 
centos7.This is stuck at, from last night. i.e. almost 12 hours.
...ExternalSorterSuite:
- empty data stream
- few elements per partition
- empty partitions with spilling
- empty partitions with spilling, bypass merge-sort

Any pointers ?

Thanking you.

With Regards
Sree 


    On Thursday, April 16, 2015 12:01 PM, Ted Yu  wrote:
  

 You can get some idea by looking at the builds here:
https://amplab.cs.berkeley.edu/jenkins/view/Spark/job/Spark-1.2-Maven-with-YARN/HADOOP_PROFILE=hadoop-2.4,label=centos/

Cheers
On Thu, Apr 16, 2015 at 11:56 AM, Sree V  
wrote:

Hi Team,
How long does it takes for a full build 'mvn clean package' on spark 1.2.2-rc1 ?


Thanking you.

With Regards
Sree



 

Re: how long does it takes for full build ?

2015-04-16 Thread Sree V 
1.
40 min+ to 1hr+, from jenkins.I didn't find the commands of the job. Does it 
require a login ?
Part of the console output:
 > git checkout -f 3ae37b93a7c299bd8b22a36248035bca5de3422f
 > git rev-list de4fa6b6d12e2bee0307ffba2abfca0c33f15e45 # timeout=10
Triggering Spark-Master-Maven-pre-YARN ? 2.0.0-mr1-cdh4.1.2,centos
Triggering Spark-Master-Maven-pre-YARN ? 1.0.4,centosHow to find the commands 
of these 'triggers' ?I am interested, whether these named triggers use 
-DskipTests or not.

2.
This page, gives examples all with -DskipTests only.
http://spark.apache.org/docs/1.2.0/building-spark.html

 
3.For casting VOTE to release 1.2.2-rc1,
I am running 'mvn clean package' on spark 1.2.2-rc1 with oralce jdk8_40 on 
centos7.This is stuck at, from last night. i.e. almost 12 hours.
...ExternalSorterSuite:
- empty data stream
- few elements per partition
- empty partitions with spilling
- empty partitions with spilling, bypass merge-sort

Any pointers ?

Thanking you.

With Regards
Sree 


 On Thursday, April 16, 2015 12:01 PM, Ted Yu  wrote:
   

 You can get some idea by looking at the builds here:
https://amplab.cs.berkeley.edu/jenkins/view/Spark/job/Spark-1.2-Maven-with-YARN/HADOOP_PROFILE=hadoop-2.4,label=centos/

Cheers
On Thu, Apr 16, 2015 at 11:56 AM, Sree V  
wrote:

Hi Team,
How long does it takes for a full build 'mvn clean package' on spark 1.2.2-rc1 ?


Thanking you.

With Regards
Sree

Re: how long does it takes for full build ?

2015-04-16 Thread Kushal Datta 
15-20mins.

On Thu, Apr 16, 2015 at 11:56 AM, Sree V 
wrote:

> Hi Team,
> How long does it takes for a full build 'mvn clean package' on spark
> 1.2.2-rc1 ?
>
>
> Thanking you.
>
> With Regards
> Sree

Re: how long does it takes for full build ?

2015-04-16 Thread Ted Yu 
You can get some idea by looking at the builds here:

https://amplab.cs.berkeley.edu/jenkins/view/Spark/job/Spark-1.2-Maven-with-YARN/HADOOP_PROFILE=hadoop-2.4,label=centos/

Cheers

On Thu, Apr 16, 2015 at 11:56 AM, Sree V 
wrote:

> Hi Team,
> How long does it takes for a full build 'mvn clean package' on spark
> 1.2.2-rc1 ?
>
>
> Thanking you.
>
> With Regards
> Sree