Re: Jenkins commands?

It's mostly in this folder: https://github.com/apache/spark/tree/master/dev Xin On Wed, Feb 6, 2019 at 3:55 PM Tom Graves wrote: > I'm curious if we have it documented anywhere or if there is a good place > to look, what exact commands Spark runs in the pull request builds and the > QA builds?

Re: Build timed out for `branch-2.3 (hadoop-2.7)`

seems like someone should investigate what caused the build time to go up an hour and if it's expected or not. On Thu, Jan 11, 2018 at 7:37 PM, Dongjoon Hyun wrote: > Hi, All and Shane. > > Can we increase the build time for `branch-2.3` during 2.3 RC period? > > There

Re: spark-tests.appspot status?

Most likely the job that uploads this stuff at databricks is broken. On Thu, Dec 14, 2017 at 12:41 PM, Imran Rashid wrote: > Hi, > > I was trying to look at some flaky tests and old jiras, and noticed that > spark-tests.appspot.com is still live, but hasn't updated with

Re: Jenkins upgrade/Test Parallelization & Containerization

>> *From:* holden.ka...@gmail.com <holden.ka...@gmail.com> on behalf of >> Holden Karau <hol...@pigscanfly.ca> >> *Sent:* Tuesday, November 7, 2017 2:14:18 PM >> *To:* Sean Owen >> *Cc:* Xin Lu; dev@spark.apache.org >> *Subject:* Re: Jenkins upgrade/Test

Re: Spark build is failing in amplab Jenkins

that was dedicated to it. Perhaps that's something that can be replicated for OSS. On Sun, Nov 5, 2017 at 8:45 AM, Xin Lu <x...@salesforce.com> wrote: > So, right now it looks like 2 and 6 are still broken, but 7 has recovered: > > https://amplab.cs.berkeley.edu/jenkins/view/Spark%

Re: Spark build is failing in amplab Jenkins

ot somewhere in the mango > Jenkins build where something is getting installed outside of the conda > environment. I'll be looking into this shortly. > > Regards, > > Frank Austin Nothaft > > On Nov 4, 2017, at 9:25 PM, Xin Lu <x...@salesforce.com> wrote: > >

Re: Spark build is failing in amplab Jenkins

t; fnoth...@eecs.berkeley.edu > 202-340-0466 <(202)%20340-0466> > > On Nov 4, 2017, at 9:15 PM, Xin Lu <x...@salesforce.com> wrote: > > Sorry, mango wasn't added recently, but it looks like after successful > builds of this specific configuration the workers break: > &g

Re: Spark build is failing in amplab Jenkins

it recovers. Xin On Sat, Nov 4, 2017 at 9:09 PM, Xin Lu <x...@salesforce.com> wrote: > It has happened with other workers as well, namely 3 and 4 and then > recovered. Looking at the build history it looks like a project called > mango has been added to this pool of machines rece

Re: Spark build is failing in amplab Jenkins

It has happened with other workers as well, namely 3 and 4 and then recovered. Looking at the build history it looks like a project called mango has been added to this pool of machines recently: https://amplab.cs.berkeley.edu/jenkins/job/mango/ It looks like the slaves start to fail spark pull

Jenkins upgrade/Test Parallelization & Containerization

Hi everyone, I tried sending emails to this list and I'm not sure if it went through so I'm trying again. Anyway, a couple months ago before I left Databricks I was working on a proof of concept that parallelized Spark tests on jenkins. The way it worked was basically it build the spark jars