Hi Xin!
Alyssa and I chatted just now and both reviewed the mango build scripts. We
don’t see anything in the mango build scripts that looks concerning. To give a
bit more context, Mango is a Spark-based application for visualizing genomics
data that is built in Scala, but which has python lang
Hi Xin!
Mango does install python dependencies, but they should all be inside of a
conda environment. My guess is that we've got somewhere in the mango Jenkins
build where something is getting installed outside of the conda environment.
I'll be looking into this shortly.
Regards,
Frank Austin
I'm not entirely sure if it's the cause because I can't see the build
configurations, but just looking at the build logs it looks like they share
a pool and those mango builds run some setup with python.
On Sat, Nov 4, 2017 at 9:19 PM, Frank Austin Nothaft
wrote:
> Hi folks,
>
> Alyssa (cc’ed) a
Hi folks,
Alyssa (cc’ed) and I manage the mango build on the AMPLab Jenkins. I will start
to look into this to see what the connection between the mango builds and the
failing Spark builds are.
Regards,
Frank Austin Nothaft
fnoth...@berkeley.edu
fnoth...@eecs.berkeley.edu
202-340-0466
> On No
Sorry, mango wasn't added recently, but it looks like after successful
builds of this specific configuration the workers break:
https://amplab.cs.berkeley.edu/jenkins/job/mango/HADOOP_VERSION=2.6.0,SCALAVER=2.11,SPARK_VERSION=1.6.1,label=centos/
And then after another configuration runs it recove
It has happened with other workers as well, namely 3 and 4 and then
recovered. Looking at the build history it looks like a project called
mango has been added to this pool of machines recently:
https://amplab.cs.berkeley.edu/jenkins/job/mango/
It looks like the slaves start to fail spark pull re
Hi Everyone,
I've been told, that accessing DataFrame object from UserDefinedFunction is
not possible, but turns out that the code shown below works fine (taken from
StackOverflow). Why is it so? Is it a bug, or is it expected?
Thanks in advance.
case class Target(wordListOne: Seq[String], WordL
+1
2017-11-04 11:00 GMT-07:00 Burak Yavuz :
> +1
>
> On Fri, Nov 3, 2017 at 10:02 PM, vaquar khan
> wrote:
>
>> +1
>>
>> On Fri, Nov 3, 2017 at 8:14 PM, Weichen Xu
>> wrote:
>>
>>> +1.
>>>
>>> On Sat, Nov 4, 2017 at 8:04 AM, Matei Zaharia
>>> wrote:
>>>
+1 from me too.
Matei
>>>
+1
On Fri, Nov 3, 2017 at 10:02 PM, vaquar khan wrote:
> +1
>
> On Fri, Nov 3, 2017 at 8:14 PM, Weichen Xu
> wrote:
>
>> +1.
>>
>> On Sat, Nov 4, 2017 at 8:04 AM, Matei Zaharia
>> wrote:
>>
>>> +1 from me too.
>>>
>>> Matei
>>>
>>> > On Nov 3, 2017, at 4:59 PM, Wenchen Fan wrote:
>>> >
>>> >
I assume it is as it says:
Python versions prior to 2.7 are not supported.
Looks this happens in worker 2, 6 and 7 given my observation.
On 4 Nov 2017 5:15 pm, "Sean Owen" wrote:
Agree, seeing this somewhat regularly on the pull request builder. Do some
machines inadvertently have Python 2.6
Agree, seeing this somewhat regularly on the pull request builder. Do some
machines inadvertently have Python 2.6? some builds succeed, so may just be
one or a few. CC Shane.
On Thu, Nov 2, 2017 at 5:39 PM Pralabh Kumar wrote:
> Hi Dev
>
> Spark build is failing in Jenkins
>
>
> https://amplab.c
11 matches
Mail list logo
