Re: Jenkins commands?

2019-02-07 Thread Tom Graves
 Thanks, that is exactly what I was looking for.
Tom
On Wednesday, February 6, 2019, 10:50:14 PM CST, shane knapp 
 wrote:  
 
 the PRB executes the following scripts:./dev/run-tests-jenkins
./build/sbt unsafe/test

SBT QA tests:./dev/run-tests 
maven QA tests:ZINC_PORT=$(python -S -c "import random; print 
random.randrange(3030,4030)")MVN="build/mvn --force -DzincPort=$ZINC_PORT"
$MVN \    -DskipTests \    -P"hadoop-2.7" \    -Pyarn \    -Phive \    
-Phive-thriftserver \    -Pkinesis-asl \    -Pmesos \    clean package$MVN \
    -P"hadoop-2.7" \    -Pyarn \    -Phive \    -Phive-thriftserver \    
-Pkinesis-asl \    -Pmesos \    --fail-at-end \    test 

there some some specific rise/amp-lab variables involved (grep -r AMPLAB 
spark/*) for the build system, but this should cover it.
On Wed, Feb 6, 2019 at 3:55 PM Tom Graves  wrote:

I'm curious if we have it documented anywhere or if there is a good place to 
look, what exact commands Spark runs in the pull request builds and the QA 
builds?  

Thanks,Tom


-- 
Shane Knapp
UC Berkeley EECS Research / RISELab Staff Technical Lead
https://rise.cs.berkeley.edu
  

Re: Jenkins commands?

2019-02-06 Thread shane knapp
the PRB executes the following scripts:
./dev/run-tests-jenkins
./build/sbt unsafe/test

SBT QA tests:
./dev/run-tests

maven QA tests:
ZINC_PORT=$(python -S -c "import random; print random.randrange(3030,4030)")
MVN="build/mvn --force -DzincPort=$ZINC_PORT"
$MVN \
-DskipTests \
-P"hadoop-2.7" \
-Pyarn \
-Phive \
-Phive-thriftserver \
-Pkinesis-asl \
-Pmesos \
clean package
$MVN \
-P"hadoop-2.7" \
-Pyarn \
-Phive \
-Phive-thriftserver \
-Pkinesis-asl \
-Pmesos \
--fail-at-end \
test

there some some specific rise/amp-lab variables involved (grep -r AMPLAB
spark/*) for the build system, but this should cover it.

On Wed, Feb 6, 2019 at 3:55 PM Tom Graves 
wrote:

> I'm curious if we have it documented anywhere or if there is a good place
> to look, what exact commands Spark runs in the pull request builds and the
> QA builds?
>
>
> Thanks,
> Tom
>


-- 
Shane Knapp
UC Berkeley EECS Research / RISELab Staff Technical Lead
https://rise.cs.berkeley.edu


Re: Jenkins commands?

2019-02-06 Thread Xin Lu
It's mostly in this folder: https://github.com/apache/spark/tree/master/dev

Xin

On Wed, Feb 6, 2019 at 3:55 PM Tom Graves 
wrote:

> I'm curious if we have it documented anywhere or if there is a good place
> to look, what exact commands Spark runs in the pull request builds and the
> QA builds?
>
>
> Thanks,
> Tom
>


Jenkins commands?

2019-02-06 Thread Tom Graves
I'm curious if we have it documented anywhere or if there is a good place to 
look, what exact commands Spark runs in the pull request builds and the QA 
builds?  

Thanks,Tom