Re: [DISCUSS] Enabling all platform builds in CI for all Hadoop PRs

2022-05-18 Thread Ayush Saxena
gt;> *Cc:* Gautham Banasandra ; Hadoop Common < >> common-...@hadoop.apache.org>; Hdfs-dev ; >> yarn-dev ; d...@hadoop.apache.org < >> d...@hadoop.apache.org> >> *Subject:* Re: [DISCUSS] Enabling all platform builds in CI for all >> Hadoop PRs >&

Re: [DISCUSS] Enabling all platform builds in CI for all Hadoop PRs

2022-05-10 Thread Ayush Saxena
Monday, May 9, 2022 7:50 AM >> To: Ayush Saxena >> Cc: Gautham Banasandra ; Hadoop Common >> ; Hdfs-dev ; >> yarn-dev ; d...@hadoop.apache.org >> >> Subject: Re: [DISCUSS] Enabling all platform builds in CI for all Hadoop PRs >> >> how about for

Re: [DISCUSS] Enabling all platform builds in CI for all Hadoop PRs

2022-05-10 Thread Gautham Banasandra
.@hadoop.apache.org> > *Subject:* Re: [DISCUSS] Enabling all platform builds in CI for all > Hadoop PRs > > how about for trunk we -wait for it- declare it java11 only? > > do that and we cut out a lot of the CI build. > > we would have to mandate a test run through branch

Re: [DISCUSS] Enabling all platform builds in CI for all Hadoop PRs

2022-05-09 Thread Steve Loughran
how about for trunk we -wait for it- declare it java11 only? do that and we cut out a lot of the CI build. we would have to mandate a test run through branch-3.3 before any cherrypick there On Sat, 7 May 2022 at 11:19, Ayush Saxena wrote: > Three for trunk: > Java-8 > >

Re: [DISCUSS] Enabling all platform builds in CI for all Hadoop PRs

2022-05-07 Thread Ayush Saxena
Three for trunk: Java-8 https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/ Java-11 https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java11-linux-x86_64/ ARM https://ci-hadoop.apache.org/view/Hadoop/job/hadoop-qbt-linux-ARM-trunk/ -Ayush > > On 07-May-2022, at 11:49 AM,

Re: [DISCUSS] Enabling all platform builds in CI for all Hadoop PRs

2022-05-07 Thread Gautham Banasandra
Hi all, Although validating cross platform builds at pre-commit would be the most effective approach, I understand the huge disadvantage caused by the slowdown. The best way to tackle this would be to enable parallel builds for the different platforms. I had given it a shot about a year ago[1],

Re: [DISCUSS] Enabling all platform builds in CI for all Hadoop PRs

2022-05-06 Thread Ayush Saxena
>From functional point of view it does makes sense to validate all the platforms as part of the builds, but the Pre commits builds taking time is now no longer a small things, In past one year or may be two, we have already increased it more than twice as compared to what it was before, If someone

Re: [DISCUSS] Enabling all platform builds in CI for all Hadoop PRs

2022-05-06 Thread Wei-Chiu Chuang
Running builds for all platforms for each and every PR seems too excessive. How about doing all platform builds in the nightly jobs? On Fri, May 6, 2022 at 8:02 AM Steve Loughran wrote: > I'm not enthusiastic here as it not only makes the builds slower, it > reduces the #of builds we can

Re: [DISCUSS] Enabling all platform builds in CI for all Hadoop PRs

2022-05-06 Thread Steve Loughran
I'm not enthusiastic here as it not only makes the builds slower, it reduces the #of builds we can through a day one thing I am wondering is could we remove java8 support on some branches? make branch 3.3.2.x (i.e the 3.3.3 release) the last java 8 build, and this summers branch-3.3 release

[DISCUSS] Enabling all platform builds in CI for all Hadoop PRs

2022-05-05 Thread Gautham Banasandra
Hi Hadoop devs, Last week, there was a Hadoop build failure on Debian 10 caused by https://github.com/apache/hadoop/pull/3988. In dev-support/jenkins.sh, there's the capability to build and test Hadoop across the supported platforms. Currently, we're limiting this only for those PRs having only