Re: pyspark installation using pip3

2017-08-25 Thread Holden Karau
The reinstall and caching mechanism is managed by pip its self so I'm not super sure what your asking for? On Fri, Aug 25, 2017 at 5:43 PM Wei-Shun Lo wrote: > > Hi Spark dev team, > > I found that the pyspark installation may always download the full package > again and it

pyspark installation using pip3

2017-08-25 Thread Wei-Shun Lo
Hi Spark dev team, I found that the pyspark installation may always download the full package again and it is not quite reasonable move. Please see the screen shot for information. A version-check before reinstall will be better. Please advise, and thanks. ! Best , Ralic

[build system] upcoming downtime for next week

2017-08-25 Thread shane knapp
greetings, denizens of the aether! as you are all probably aware, we've been having a lot of issues w/power in the beautiful little city of berkeley over the summer. next week, we have two sudden and separate maintenances on both power to our building (soda hall), and to the datacenter (IST).

Re: Increase Timeout or optimize Spark UT?

2017-08-25 Thread Dongjoon Hyun
BTW, the situation seems to become worse, now we lost two builds. - https://amplab.cs.berkeley.edu/jenkins/view/Spark%20QA%20Test%20(Dashboard)/job/spark-master-test-sbt-hadoop-2.7/ - https://amplab.cs.berkeley.edu/jenkins/view/Spark%20QA%20Test%20(Dashboard)/job/spark-master-test-sbt-hadoop-2.6/