Build time limit in PR builder

2020-05-28 Thread Hyukjin Kwon
Hi all, Seems we're hitting the time limit in PR builders (see https://github.com/apache/spark/pull/28627), in particular wen it's Maven build which takes more time compared to SBT in general. Should we maybe increase the PR builder a bit more (10 ~ 20 mins?) to unblock these PRs and focus on

Re: Build time limit in PR builder

2020-05-28 Thread Sean Owen
What else can we do, I suppose? On Thu, May 28, 2020 at 3:13 AM Hyukjin Kwon wrote: > Hi all, > > Seems we're hitting the time limit in PR builders (see > https://github.com/apache/spark/pull/28627), in particular wen it's Maven > build which takes more time compared to SBT in general. > Should

Re: Build time limit in PR builder

2020-05-28 Thread shane knapp ☠
On Thu, May 28, 2020 at 7:16 AM Sean Owen wrote: > What else can we do, I suppose? > > there,s not much else we can do. i'll add 30m to the timeout. shane -- Shane Knapp Computer Guy / Voice of Reason UC Berkeley EECS Research / RISELab Staff Technical Lead https://rise.cs.berkeley.edu

Re: Build time limit in PR builder

2020-05-28 Thread Hyukjin Kwon
I remember we were able to cut down pretty considerably in the past. For example, I investigated ( https://github.com/apache/spark/pull/21822#issuecomment-407295739) and fixed some before at, like https://github.com/apache/spark/pull/23111. Maybe we could skim again to reduce the build/testing

Re: Build time limit in PR builder

2020-05-28 Thread Kousuke Saruta
Thanks all. It's very helpful! - Kousuke On 2020/05/29 3:31, shane knapp ☠ wrote: https://github.com/apache/spark/pull/28666 On Thu, May 28, 2020 at 11:20 AM shane knapp ☠ mailto:skn...@berkeley.edu>> wrote: i'll get a PR put together now. On Thu, May 28, 2020 at 8:26 AM Hyukjin

Re: Build time limit in PR builder

2020-05-28 Thread shane knapp ☠
i'll get a PR put together now. On Thu, May 28, 2020 at 8:26 AM Hyukjin Kwon wrote: > I remember we were able to cut down pretty considerably in the past. For > example, I investigated ( > https://github.com/apache/spark/pull/21822#issuecomment-407295739) > and fixed some before at, like

Re: Build time limit in PR builder

2020-05-28 Thread shane knapp ☠
https://github.com/apache/spark/pull/28666 On Thu, May 28, 2020 at 11:20 AM shane knapp ☠ wrote: > i'll get a PR put together now. > > On Thu, May 28, 2020 at 8:26 AM Hyukjin Kwon wrote: > >> I remember we were able to cut down pretty considerably in the past. For >> example, I investigated (

Re: Build time limit in PR builder

2020-05-28 Thread shane knapp ☠
the timer is set to 500m now in master, 3.0 and 2.4. On Thu, May 28, 2020 at 12:32 PM Kousuke Saruta wrote: > Thanks all. It's very helpful! > > - Kousuke > > On 2020/05/29 3:31, shane knapp ☠ wrote: > > https://github.com/apache/spark/pull/28666 > > On Thu, May 28, 2020 at 11:20 AM shane knapp