Re: Increase Timeout or optimize Spark UT?

2017-08-25 Thread Dongjoon Hyun
1 for any efforts to recover Jenkins! >>>> >>>> >>>> >>>> Thank you for the direction. >>>> >>>> >>>> >>>> Bests, >>>> >>>> Dongjoon. >>>> >>>> >>>>

Re: Increase Timeout or optimize Spark UT?

2017-08-24 Thread Maciej Szymkiewicz
; >>> >>> >>> *From: *Reynold Xin <r...@databricks.com> >>> *Date: *Sunday, August 20, 2017 at 5:53 PM >>> *To: *Dong Joon Hyun <dh...@hortonworks.com> >>> *Cc: *"dev@spark.apache.org" <dev@spark.apache.org> >>> *Subject

Re: Increase Timeout or optimize Spark UT?

2017-08-23 Thread Michael Armbrust
joon. >> >> >> >> *From: *Reynold Xin <r...@databricks.com> >> *Date: *Sunday, August 20, 2017 at 5:53 PM >> *To: *Dong Joon Hyun <dh...@hortonworks.com> >> *Cc: *"dev@spark.apache.org" <dev@spark.apache.org> >> *Subject: *R

Re: Increase Timeout or optimize Spark UT?

2017-08-22 Thread Mark Hamstra
ny efforts to recover Jenkins! >>> >>> >>> >>> Thank you for the direction. >>> >>> >>> >>> Bests, >>> >>> Dongjoon. >>> >>> >>> >>> *From: *Reynold Xin <r...@databricks.com&

Re: Increase Timeout or optimize Spark UT?

2017-08-22 Thread Reynold Xin
or the direction. >> >> >> >> Bests, >> >> Dongjoon. >> >> >> >> *From: *Reynold Xin <r...@databricks.com> >> *Date: *Sunday, August 20, 2017 at 5:53 PM >> *To: *Dong Joon Hyun <dh...@hortonworks.com> >> *

Re: Increase Timeout or optimize Spark UT?

2017-08-22 Thread Maciej Szymkiewicz
PM > *To: *Dong Joon Hyun <dh...@hortonworks.com> > *Cc: *"dev@spark.apache.org" <dev@spark.apache.org> > *Subject: *Re: Increase Timeout or optimize Spark UT? > > > > It seems like it's time to look into how to cut down some of the test > runtimes. Test runt

Re: Increase Timeout or optimize Spark UT?

2017-08-20 Thread Dong Joon Hyun
ubject: Re: Increase Timeout or optimize Spark UT? It seems like it's time to look into how to cut down some of the test runtimes. Test runtimes will slowly go up given the way development happens. 3 hr is already a very long time for tests to run. On Sun, Aug 20, 2017 at 5:45 PM, Dong Joon Hyun <

Re: Increase Timeout or optimize Spark UT?

2017-08-20 Thread Reynold Xin
It seems like it's time to look into how to cut down some of the test runtimes. Test runtimes will slowly go up given the way development happens. 3 hr is already a very long time for tests to run. On Sun, Aug 20, 2017 at 5:45 PM, Dong Joon Hyun wrote: > Hi, All. > > > >

Increase Timeout or optimize Spark UT?

2017-08-20 Thread Dong Joon Hyun
Hi, All. Recently, Apache Spark master branch test (SBT with hadoop-2.7 / 2.6) has been hitting the build timeout. Please see the build time trend. https://amplab.cs.berkeley.edu/jenkins/view/Spark%20QA%20Test%20(Dashboard)/job/spark-master-test-sbt-hadoop-2.7/buildTimeTrend All recent 22