Re: [VOTE] Release Hadoop-3.1.3-RC0

2019-09-19 Thread epa...@apache.org
+1 (binding) Thanks Zhankun for all of your hard work on this release. I downloaded and built the source and ran it on an insecure multi-node pseudo cluster. I performed various YARN manual tests, including creating custom resources, creating queue submission ACLs, and queue refreshes. One

Re: [VOTE] Release Apache Hadoop 2.10.0 (RC1)

2019-10-23 Thread epa...@apache.org
Hi Jonathan, Thanks very much for all of your work on this release. I have a concern about cross-queue (inter-queue) preemption in 2.10. In 2.8, on a 6 node pseudo-cluster, preempting from one queue to meet the needs of another queue seems to work as expected. However, 2.10 in the same pseudo-

Re: [VOTE] Release Apache Hadoop 2.10.0 (RC0)

2019-10-26 Thread epa...@apache.org
I ran a few compatibility tests between 2.10.0 and 3.3.0 (trunk) Unfortunately, I ran into the following problem: Running with 2.10 RM and 3.3.0 (trunk) NM fails attempts with the following error: 2019-10-26 15:44:06,885 WARN [main] org.apache.hadoop.mapred.YarnChild: Exception running child :

Re: [VOTE] Release Apache Hadoop 2.10.0 (RC0)

2019-10-27 Thread epa...@apache.org
mapreduce.application.framework.path to run your MR jobs? If not, this seems like expected behavior if AM and tasks get launched on different NMs with different locally installed hadoop versions? Jonathan Hung On Sat, Oct 26, 2019 at 8:55 AM epa...@apache.org wrote: I ran a few compatibility tests between

Re: [VOTE] Release Apache Hadoop 2.10.0 (RC0)

2019-10-28 Thread epa...@apache.org
Compatibility testing has gone well for me. - In a 4-node cluster, I ran YARN rolling upgrade tests between 2.8.5 and 2.10.0 - In a 4-node cluster, I ran YARN rolling upgrade tests between 2.10.0 and trunk - With one 4-node cluster running 2.10.0 and one 4-node cluster running trunk, I ran a word

Re: [VOTE] Release Apache Hadoop 2.10.0 (RC0)

2019-10-29 Thread epa...@apache.org
d RC0 is HDFS-14667. If RC1 looks good to you then it'd be great to get your testing results on that thread. Jonathan Hung On Mon, Oct 28, 2019 at 1:06 PM epa...@apache.org wrote: > Compatibility testing has gone well for me. > > - In a 4-node cluster, I ran YARN rolling upgrade

Re: [VOTE] Release Apache Hadoop 2.10.0 (RC1)

2019-10-29 Thread epa...@apache.org
Compatibility testing has gone well for me. - In a 4-node cluster, I ran YARN rolling upgrade tests between 2.8.5 and 2.10.0 - In a 4-node cluster, I ran YARN rolling upgrade tests between 2.10.0 and trunk - With one 4-node cluster running 2.10.0 and one 4-node cluster running trunk, I ran a wo

Re: [DISCUSS] Making 2.10 the last minor 2.x release

2019-11-15 Thread epa...@apache.org
Thanks Jonathan for opening the discussion. I am not in favor of this proposal. 2.10 was very recently released, and moving to 2.10 will take some time for the community. It seems premature to make a decision at this point that there will never be a need for a 2.11 release. -Eric On Thursday

Re: [DISCUSS] Making 2.10 the last minor 2.x release

2019-11-19 Thread epa...@apache.org
ly need to, by > recreating branch-2. But this proposal would reduce a lot of confusion IMO. > > Jonathan Hung > > > On Fri, Nov 15, 2019 at 11:41 AM epa...@apache.org > wrote: > > > Thanks Jonathan for opening the discussion. > > > > I am not in favor of

[ANNOUNCE] Jim Brennan is a new Hadoop Committer

2020-08-03 Thread epa...@apache.org
I am pleased to announce that Jim Brennan has accepted the invitation to become a Hadoop committer focusing on the YARN space. Please reach out to Jim and welcome him in his new role. Congratulations, Jim! Well-deserved! -Eric Payne -

Re: [E] Re: the v2 commit algorithm

2020-09-24 Thread epa...@apache.org
Thanks Steve and Jim for bringing this issue to our attention. IIUC, Serial commit takes minutes with mrv1, whereas with mrv2 it is very quick. With this kind of performance difference, is wise to change the default behavior for released versions of Hadoop? Should this be limited to trunk? Than

Re: [ANNOUNCE] Hui Fei is a new Apache Hadoop Committer

2020-09-24 Thread epa...@apache.org
Congratulations Hui Fei! On Wednesday, September 23, 2020, 1:07:11 PM CDT, Wei-Chiu Chuang wrote: I am pleased to announce that Hui Fei has accepted the invitation to become a Hadoop committer. He started contributing to the project in October 2016. Over the past 4 years he has contributed a l

Re: [DISCUSS] check style changes

2021-05-15 Thread epa...@apache.org
I would be fine with a discussion and vote on relaxing some checkstyle restrictions. Regarding line length, my personal preference is to leave it at 80, but 80 is arbitrary and I would not oppose 100 if that's what people want. Another one that I think should be relaxed is the limit on number o

Re: [VOTE] Hadoop 3.1.x EOL

2021-06-07 Thread epa...@apache.org
+1 (binding) -Eric On Thursday, June 3, 2021, 1:14:51 AM CDT, Akira Ajisaka wrote: Dear Hadoop developers, Given the feedback from the discussion thread [1], I'd like to start an official vote thread for the community to vote and start the 3.1 EOL process. What this entails: (1) an o

Re: [VOTE] Release Apache Hadoop 3.3.1 RC3

2021-06-11 Thread epa...@apache.org
+1 (binding) Eric On Tuesday, June 1, 2021, 5:29:49 AM CDT, Wei-Chiu Chuang wrote: Hi community, This is the release candidate RC3 of Apache Hadoop 3.3.1 line. All blocker issues have been resolved [1] again. There are 2 additional issues resolved for RC3: * Revert "MAPREDUCE-7303. Fi