[ANNOUNCE] New Hadoop Committer - Haiyang Hu

2024-04-21 Thread Xiaoqiao He
I am pleased to announce that Haiyang Hu has been elected as a committer on the Apache Hadoop project. We appreciate all of Haiyang's work, and look forward to her/his continued contributions. Congratulations and Welcome, Haiyang! Best Regards, - He Xiaoqiao (On behalf of the Apache Hadoop PMC)

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

2024-03-14 Thread Xiaoqiao He
ot 2739952 Sep 19 13:09 >> /usr/lib/aarch64-linux-gnu/libcrypto.so.1.1 >> -rw-r--r-- 1 root root 4466856 Oct 27 13:40 >> /usr/lib/aarch64-linux-gnu/libcrypto.so.3 >> >> Anyone got any insights on how I should set up this (debian-based) OS >> here? >> I

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

2024-03-11 Thread Xiaoqiao He
ified they are good. > > > > Oh, and I've also got my raspberry p5 doing the download of the arm > > stuff for its checknative; not expecting problems. > > > > So: i've got some stuff still ongoing, but the core changes to packaging > > are in and the rest I'm

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

2024-03-11 Thread Xiaoqiao He
fixed in HADOOP-19057 > <https://issues.apache.org/jira/browse/HADOOP-19057>. > > -- > *From:* slfan1989 > *Sent:* Monday, March 4, 2024 10:07:05 PM > *To:* Hadoop Common; Hdfs-dev; yarn-dev; mapreduce-dev; < > priv...@hadoop.apache.org>

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

2024-03-06 Thread Xiaoqiao He
cc @Chao Sun @zhang...@apache.org @Ayush Saxena Would you mind helping to check the upstream systems(Spark, HBase, Hive) dependency with the new hadoop release version if necessary? Thanks. Best Regards, - He Xiaoqiao On Thu, Mar 7, 2024 at 10:23 AM Xiaoqiao He wrote: > Shilun, Tha

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

2024-03-06 Thread Xiaoqiao He
Shilun, Thanks for your great work. I am checking but not finished yet. Will confirm once done. Best Regards, - He Xiaoqiao On Thu, Mar 7, 2024 at 7:23 AM slfan1989 wrote: > @Xiaoqiao He @Ayush Saxena > @Steve > Loughran @Mukund Madhav Thakur > @Takanobu > Asanuma @M

Re: [VOTE] Release Apache Hadoop Thirdparty 1.2.0 (RC1)

2024-02-05 Thread Xiaoqiao He
cc @PJ Fanning @Ayush Saxena @Steve Loughran @Takanobu Asanuma @Shuyan Zhang @inigo...@apache.org On Mon, Feb 5, 2024 at 11:30 AM Xiaoqiao He wrote: > +1(binding). > > I checked the following items: > - [X] Download links are valid. > - [X] Checksums and PGP signatures ar

Re: [VOTE] Release Apache Hadoop Thirdparty 1.2.0 (RC1)

2024-02-04 Thread Xiaoqiao He
at 10:29 PM slfan1989 wrote: > Hi folks, > > Xiaoqiao He and I have put together a release candidate (RC1) for Hadoop > Thirdparty 1.2.0. > > The RC is available at: > https://dist.apache.org/repos/dist/dev/hadoop/hadoop-thirdparty-1.2.0-RC1 > > The RC tag is > ht

Re: [VOTE] Release Apache Hadoop Thirdparty 1.2.0 RC0

2024-02-01 Thread Xiaoqiao He
ds, > Shilun Fan. > > On Tue, Jan 30, 2024 at 6:20 PM Xiaoqiao He wrote: > > > Thanks Shilun for driving it and making it happen. > > > > +1(binding). > > > > [x] Checksums and PGP signatures are valid. > > [x] LICENSE files exist. > > [x] NOTICE

Re: [VOTE] Release Apache Hadoop Thirdparty 1.2.0 RC0

2024-01-30 Thread Xiaoqiao He
wrote: > Hi folks, > > Xiaoqiao He and I have put together a release candidate (RC0) for Hadoop > Thirdparty 1.2.0. > > The RC is available at: > https://dist.apache.org/repos/dist/dev/hadoop/hadoop-thirdparty-1.2.0-RC0 > > The RC tag is > https://github.com/apache/

Re: [INFO] Hadoop-3.4 Release Update

2024-01-24 Thread Xiaoqiao He
; On Mon, 22 Jan 2024 at 11:50 AM, slfan1989 wrote: > > > >> Thank you very much for specifying the frozen time for the > >> Branch-3.4.0. @Xiaoqiao > >> He > >> > >> If there is a need to backport any PRs to branch-3.4/branch-3.4.0, > please &

Re: [INFO] Hadoop-3.4 Release Update

2024-01-21 Thread Xiaoqiao He
gt; > Best > > On Mon, Jan 22, 2024 at 10:38 AM Xiaoqiao He > wrote: > >> Thanks all for your input. Connected to Shilun offline yesterday, and he >> will >> update or recover the fix version tag before 3.4.0-RC1. >> >> Best Regards, >> - He Xiao

Re: [INFO] Hadoop-3.4 Release Update

2024-01-21 Thread Xiaoqiao He
se versions have been released, > remove > > > the 3.4.0 entry from the fix version. > > > > > > 3. For JIRA issues with target version set to 3.4.0, fix version set to > > > 3.4.0, and status set to > > > RESOLVED, if Affects Ve

[INFO] Hadoop-3.4 Release Update

2024-01-18 Thread Xiaoqiao He
Hi All, Branch trunk has been set to 3.5.0-SNAPSHOT and branch-3.4 is created[1]. Please set the proper fix version while committing jira, 3.5.0 should be priority. If there is any blocker/critical please also backport to branch-3.4 or sync to me or RM Shilun Fan. Shilun will start 3.4.0 RC1

Re: [VOTE] Release Apache Hadoop 3.4.0 RC0

2024-01-16 Thread Xiaoqiao He
Hi Shilun, Thanks for your great work! Compare branch-3.4 and branch-3.4.0, I found that commit [1] is only checked in branch-3.4.0 but not branch-3.4. Please double check if we need to backport branch-3.4. Moreover, before 3.4.0 release we should cherry-pick from trunk to branch-3.4 first if

Re: [DISCUSS] Release Hadoop 3.4.0

2024-01-03 Thread Xiaoqiao He
> > I think the release discussion can be in public ML? Good idea. cc common-dev/hdfs-dev/yarn-dev/mapreduce-dev ML. Best Regards, - He Xiaoqiao On Tue, Jan 2, 2024 at 6:18 AM Ayush Saxena wrote: > +1 from me as well. > > We should definitely attempt to upgrade the thirdparty version for >

Re: [VOTE] Hadoop 3.2.x EOL

2023-12-21 Thread Xiaoqiao He
Hi All, JIRA/WIKI/Website has been updated. Release line 3.2 is EOL now. Thanks all. Best Regards, - He Xiaoqiao On Tue, Dec 19, 2023 at 11:58 AM Xiaoqiao He wrote: > This vote passed with 10 +1. I'll update the JIRA, WIKI and website for a > while. > > Thanks all for your p

Re: [VOTE] Hadoop 3.2.x EOL

2023-12-18 Thread Xiaoqiao He
t; On Wed, Dec 6, 2023 at 8:39 AM Akira Ajisaka wrote: >> > >> > +1 >> > >> > >> > >> > On Wed, Dec 6, 2023 at 1:10 PM Xiaoqiao He wrote: >> > >> > > Dear Hadoop devs, >> > > >> > > Given the feedb

[VOTE] Hadoop 3.2.x EOL

2023-12-05 Thread Xiaoqiao He
Dear Hadoop devs, Given the feedback from the discussion thread [1], I'd like to start an official thread for the community to vote on release line 3.2 EOL. It will include, a. An official announcement informs no further regular Hadoop 3.2.x releases. b. Issues which target 3.2.5 will not be

Re: [DISCUSS] Make some release lines EOL

2023-12-05 Thread Xiaoqiao He
here's a clear story: we have a > > new 3.4.x line stabilising, if you want something already stable move > onto > > 3.3.x if you hadn't already > > > > > > > > > > > > On Mon, 4 Dec 2023 at 12:39, Xiaoqiao He wrote: > > > > > Hi folk

Re: [DISCUSS] Make some release lines EOL

2023-12-04 Thread Xiaoqiao He
> > -Ayush > > On Mon, 4 Dec 2023 at 18:09, Xiaoqiao He wrote: > > > > Hi folks, > > > > There are many discussions about which release lines should we still > > consider actively > > maintained in history. I want to launch this topic again, and

[DISCUSS] Make some release lines EOL

2023-12-04 Thread Xiaoqiao He
Hi folks, There are many discussions about which release lines should we still consider actively maintained in history. I want to launch this topic again, and try to get a consensus. >From download page[1] and active branches page[2], we have the following release lines: Hadoop 3.3 Release

Re: [DISCUSS] Hadoop 3.4.0 release

2023-12-03 Thread Xiaoqiao He
Thanks Ahmar for starting this thread. Strong +1 to have 3.4.0 from trunk rather than from 3.3.*. We should keep release line clear, and it's not standard operation to cut a branch from another line. Let's move the trunk to 3.5.0-SNAPSHOT when we come to an agreement at this thread. About this

[ANNOUNCE] New Hadoop PMC Member - Shilun Fan

2023-10-31 Thread Xiaoqiao He
On behalf of the Apache Hadoop PMC, I am pleased to announce that Shilun Fan(slfan1989) has accepted the PMC's invitation to become PMC member on the project. We appreciate all of Shilun's generous contributions thus far and look forward to his continued involvement. Congratulations and welcome,

[ANNOUNCE] New Hadoop Committer - Shuyan Zhang

2023-09-26 Thread Xiaoqiao He
I am pleased to announce that Shuyan Zhang has been elected as a committer on the Apache Hadoop project. We appreciate all of Shuyan's work, and look forward to her/his continued contributions. Congratulations and Welcome, Shuyan! Best Regards, - He Xiaoqiao (On behalf of the Apache Hadoop PMC)

Re: [VOTE] Release Apache Hadoop 3.3.6 RC1

2023-06-23 Thread Xiaoqiao He
+1(binding) * Verified signature and checksum of all source tarballs. * Built source code on Ubuntu and OpenJDK 11 by `mvn clean package -DskipTests -Pnative -Pdist -Dtar`. * Setup pseudo cluster with HDFS and YARN. * Run simple FsShell - mkdir/put/get/mv/rm and check the result. * Run example mr

Re: [VOTE] Release Apache Hadoop 3.3.6 RC1

2023-06-21 Thread Xiaoqiao He
Addendum: A. Build the release from sources using: `mvn clean install package -DskipTests=true -Dmaven.javadoc.skip=true` B. It works well when using the same command to build from the source branch trunk. On Wed, Jun 21, 2023 at 8:44 PM Xiaoqiao He wrote: > Hi, > > I met a fatal e

Re: [VOTE] Release Apache Hadoop 3.3.6 RC1

2023-06-21 Thread Xiaoqiao He
Hi, I met a fatal error when building from source on local Mac OSX. It could reproduce stably. Not sure if it is related to my local environment. Try to dig it, but not any conclusion right now. Will feedback once find reasons. Appendix system environment, some more stack information refer to

Re: [VOTE] Release Apache Hadoop 3.3.6 RC0

2023-06-17 Thread Xiaoqiao He
Thanks Wei-Chiu for driving this release. The next RC will be prepared, right? If true, I would like to try and vote on the next RC. Just notice that some JIRAs are not included and need to revert some PRs to pass HBase verification which are mentioned above. Best Regards, - He Xiaoqiao On Fri,

[jira] [Resolved] (YARN-11489) Fix memory leak of DelegationTokenRenewer futures in DelegationTokenRenewerPoolTracker

2023-05-14 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/YARN-11489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved YARN-11489. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Fix memory l

Re: [DISCUSS] Hadoop 3.3.6 release planning

2023-05-04 Thread Xiaoqiao He
Thanks Wei-Chiu for driving this release. Cherry-pick YARN-11482 to branch-3.3 and mark 3.3.6 as the fixed version. so far only 8 jiras were resolved in the branch-3.3 line. If we should consider both 3.3.6 and 3.3.9 (which is from release-3.3.5 discuss)[1] for this release line? I try to query

[jira] [Resolved] (YARN-11482) Fix bug of DRF comparision DominantResourceFairnessComparator2 in fair scheduler

2023-04-28 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/YARN-11482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved YARN-11482. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Fix bug of

[jira] [Created] (YARN-11482) Fix bug of DRF comparision DominantResourceFairnessComparator2 in fair scheduler

2023-04-27 Thread Xiaoqiao He (Jira)
Xiaoqiao He created YARN-11482: -- Summary: Fix bug of DRF comparision DominantResourceFairnessComparator2 in fair scheduler Key: YARN-11482 URL: https://issues.apache.org/jira/browse/YARN-11482 Project

Re: [VOTE] Release Apache Hadoop 3.3.5 (RC3)

2023-03-20 Thread Xiaoqiao He
+1 * Verified signature and checksum of the source tarball. * Built the source code on Ubuntu and OpenJDK 11 by `mvn clean package -DskipTests -Pnative -Pdist -Dtar`. * Setup pseudo cluster with HDFS and YARN. * Run simple FsShell - mkdir/put/get/mv/rm (include EC) and check the result. * Run

Re: [VOTE] Release Apache Hadoop 3.3.3 (RC1)

2022-05-15 Thread Xiaoqiao He
+1(binding) * Verified signature and checksum of the source tarball. * Built the source code on Ubuntu and OpenJDK 11 by `mvn clean package -DskipTests -Pnative -Pdist -Dtar`. * Setup pseudo cluster with HDFS and YARN. * Run simple FsShell - mkdir/put/get/mv/rm and check the result. * Run example

Re: [DISCUSS] Hadoop 2.10.2 release

2022-05-11 Thread Xiaoqiao He
Thanks Masatake and Akira for bringing this release up. +1 for 2.10.2 release. Sorry for the late response. Regards, - He Xiaoqiao On Mon, Mar 14, 2022 at 1:17 PM Akira Ajisaka wrote: > > Thank you Masatake. > > +1 to release 2.10.2. > > On Fri, Mar 4, 2022 at 6:52 PM Masatake Iwasaki >

Re: [VOTE] Release Apache Hadoop 3.2.3 - RC1

2022-03-20 Thread Xiaoqiao He
+1(binding) * Verified signature and checksum of the source tarball. * Built the source code on Ubuntu and OpenJDK 11 by `mvn clean package -DskipTests -Pnative -Pdist -Dtar`. * Setup pseudo cluster with HDFS and YARN. * Run simple FsShell - mkdir/put/get/mv/rm and check the result. * Run example

Re: Hadoop-3.2.3 Release Update

2022-03-11 Thread Xiaoqiao He
just for reload4j migration if we > need. > https://issues.apache.org/jira/browse/HADOOP-18088 > > Thanks, > Masatake Iwasaki > > On 2022/03/10 12:23, Xiaoqiao He wrote: > > Thanks Masatake for reaching out. > > > > Not sure if Brahma has bandwidth to pu

Re: Hadoop-3.2.3 Release Update

2022-03-09 Thread Xiaoqiao He
t; > >>> I am evaluating the CVE’s which needs to go for this release.. > >>> > >>> Will update soon!! > >>> > >>> > >>> On Tue, 5 Oct 2021 at 1:46 PM, Akira Ajisaka > >> wrote: > >>> > >>>> Hi Brahm

Re: [ANNOUNCE] New Hadoop PMC Sun Chao

2022-03-08 Thread Xiaoqiao He
Congratulations, Sun Chao! Best Regards, - He Xiaoqiao On Wed, Mar 9, 2022 at 1:06 PM tom lee wrote: > Congratulations, Sun! > > Wei-Chiu Chuang 于2022年3月9日周三 11:47写道: > > > On behalf of the Apache Hadoop PMC, I am pleased to announce that Sun > > Chao(sunchao) has accepted the PMC's

Re: [ANNOUNCE] Apache Hadoop 3.3.2 release

2022-03-06 Thread Xiaoqiao He
t and 3.3.2 showed up in the list under the > > "Documentation" tab. > > > > In https://hadoop.apache.org, under the "Documentation" tab, the > > "Latest" and "Stable" are already updated to 3.3.2, but somehow the > > announcement is not

Re: [ANNOUNCE] Apache Hadoop 3.3.2 release

2022-03-05 Thread Xiaoqiao He
release, and everyone in > the > > Apache Hadoop community! This release is a direct result of your great > > contributions. > > > > Many thanks to everyone who helped in this release process! > > > > Many thanks to Viraj Jasani, Michael Stack, Masatake Iwasaki, Xiaoqiao > He, > > Mukund Madhav Thakur, Wei-Chiu Chuang, Steve Loughran, Akira Ajisaka and > > other folks who helped for this release process. > > > > Best Regards, > > Chao > > >

Re: [VOTE] Release Apache Hadoop 3.3.2 - RC5

2022-02-23 Thread Xiaoqiao He
+1(binding) * Built on CentOS 8 and OpenJDK 8 by `mvn clean package -DskipTests -Pnative -Pdist -Dtar` from source. * Verified signature and checksums. * Setup pseudo cluster with HDFS and YARN. * Run simple FsShell - mkdir/put/get/mv/rm. * Submit example mr applications and check the result - Pi

Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4

2022-02-21 Thread Xiaoqiao He
Thanks Chao for your great work and thanks Viraj's careful checks here. After checking to build from source and setting up a pseudo cluster based on the RC4, it seems that it is almost ready for release-3.3.2 beside update changelog, right? Please feel free to share information if you meet any

Re: Hadoop-3.2.3 Release Update

2021-09-22 Thread Xiaoqiao He
fine. FYI. Regards, - He Xiaoqiao On Thu, Sep 16, 2021 at 10:52 PM Brahma Reddy Battula wrote: > Please go ahead. Let me know any help required on review. > > On Tue, Sep 14, 2021 at 6:57 PM Xiaoqiao He wrote: > >> Hi Brahma, >> >> I plan to involve HDFS-14997 an

Re: Hadoop-3.2.3 Release Update

2021-09-14 Thread Xiaoqiao He
. Best Regards, - He Xiaoqiao On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He wrote: > Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3. FYI. > > On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula > wrote: > >> Hi All, >> >> Waiting for the fol

Re: Hadoop-3.2.3 Release Update

2021-09-14 Thread Xiaoqiao He
>>> In these patches, how about backporting the following issues to > >> >>> branch-3.2 and branch-3.2.3? > >> >>> - HADOOP-14922 > >> >>> - HADOOP-15939 > >> >>> - HADOOP-17569 > >> >>> > >> &

Re: [DISCUSS] Hadoop 3.3.2 release?

2021-09-08 Thread Xiaoqiao He
+1, Thanks Chao for bringing this up. - He Xiaoqiao On Thu, Sep 9, 2021 at 8:32 AM tom lee wrote: > +1 (non-binding) > > Ayush Saxena 于2021年9月9日周四 上午1:12写道: > > > +1, > > Thanx Chao for volunteering!!! > > > > > On 07-Sep-2021, at 10:36 PM, Chao Sun wrote: > > > > > > Hi all, > > > > > > It

Re: Hadoop-3.2.3 Release Update

2021-08-10 Thread Xiaoqiao He
Thanks Brahma for initiating this and making hadoop-3.2.3 release happen. I would like to validate the HBase project (both the latest release and trunk branch). Chao Sun will validate the Spark Project (Got in touch with Chao already). once RC is out. Thanks and Regards, - He Xiaoqiao On Tue,

Re: [DISCUSS] Hadoop 3.2.3 release

2021-07-28 Thread Xiaoqiao He
cc @dev mail-list. On Wed, Jul 28, 2021 at 5:11 PM Xiaoqiao He wrote: > Hi Brahma, > > I just created version 3.2.4, and changed all unresolved issues (target > version/s: 3.2.3) to 3.2.4 after checking both of them are not blocker > issues. Dashboard[1] is clean now. >

Re: [DISCUSS] Hadoop 3.2.3 release

2021-07-25 Thread Xiaoqiao He
Thanks Brahma for volunteering and driving this release plan. I just created a dashboard for 3.2.3 release[1]. I would like to support for this release line if need. (cc Brahma) Thanks. Regards, - He Xiaoqiao [1] https://issues.apache.org/jira/secure/Dashboard.jspa?selectPageId=12336167 On

Re: [VOTE] Release Apache Hadoop 3.3.1 RC3

2021-06-15 Thread Xiaoqiao He
+0. - Built successfully from tag release-3.3.1-RC3 on Ubuntu 20.04 - Verified signature and checksum - Deployed pseudo-distributed cluster with 3 nodes - Ran basic HDFS shell commands and sample MR Jobs, it worked well. - Browsed NN/DN/RM/NM UI. *YARN UI2 DOES NOT work from my side.* NOTE:

Re: [VOTE] Hadoop 3.1.x EOL

2021-06-03 Thread Xiaoqiao He
+1 On Thu, Jun 3, 2021 at 4:18 PM Bharat Viswanadham wrote: > +1 > > Thanks, > Bharat > > > On Thu, Jun 3, 2021 at 1:00 PM Viraj Jasani wrote: > > > +1 (non-binding) > > > > On Thu, 3 Jun 2021 at 12:21 PM, Wei-Chiu Chuang > > wrote: > > > > > +1 > > > > > > On Thu, Jun 3, 2021 at 2:14 PM

Re: [VOTE] Release Apache Hadoop Thirdparty 1.1.1 RC0

2021-05-27 Thread Xiaoqiao He
p in > the thirdparty 1 1 1. > > On Fri, May 28, 2021 at 11:23 AM Xiaoqiao He > wrote: > >> +1 >> >> - Verified checksums and signatures. >> - Checked CHANGELOG / RELEASE NOTES. >> - Built from source with jdk1.8.0_202. >> - Built Hadoop trunk with

Re: [VOTE] Release Apache Hadoop Thirdparty 1.1.1 RC0

2021-05-27 Thread Xiaoqiao He
+1 - Verified checksums and signatures. - Checked CHANGELOG / RELEASE NOTES. - Built from source with jdk1.8.0_202. - Built Hadoop trunk with hadoop-thirdparty 1.1.1 and checked with pseudo distribution hadoop cluster deployment. Thanks Wei-Chiu for your work on this. I am confused about the

Re: [DISCUSS] which release lines should we still consider actively maintained?

2021-05-23 Thread Xiaoqiao He
Thanks Sean and Akira for discussion here. > As you commented, the confluence wiki pages for Hadoop releases were out of date. Updated [1]. Just update Roadmap[1] for 3.2.2 and updated/added issues collections for 3.2.3[2] which will be useful if you are interested in becoming a release manager

Re: [DISCUSS] Change project style guidelines to allow line length 100

2021-05-19 Thread Xiaoqiao He
+1 for <= 100 chars long per line length. On Thu, May 20, 2021 at 10:28 AM Masatake Iwasaki < iwasak...@oss.nttdata.co.jp> wrote: > I'm +1 too. > I feel 80 characters limit tends to degrade readability by introducing > useless line breaks. > > > >

Re: [VOTE] hadoop-thirdparty 1.1.0-RC0

2021-05-16 Thread Xiaoqiao He
+1 - Verified checksums and signatures. - Checked CHANGELOG / RELEASE NOTES. - Built from source with jdk1.8.0_202. - Built Hadoop trunk with hadoop-thirdparty 1.1.0 and checked with pseudo distribution hadoop cluster deployment. Thanks, - He Xiaoqiao On Fri, May 14, 2021 at 6:16 PM Viraj

[ANNOUNCE] Apache Hadoop 3.2.2 release

2021-01-15 Thread Xiaoqiao He
Hi All, It gives me great pleasure to announce that the Apache Hadoop community has voted to release Apache Hadoop 3.2.2. Apache Hadoop 3.2.2 includes 516 fixes since the previous Hadoop 3.2.1 release. * For major changes included in Hadoop 3.2.2, please refer to Hadoop 3.2.2 main page [1]. *

Re: [VOTE] Release Apache Hadoop 3.2.2 - RC5

2021-01-08 Thread Xiaoqiao He
Hi folks, The vote[1] passed with 4 binging +1's and 4 non-binding +1's.[2] Thanks all for pushing this. I'm going to publish the release. binding +1's: - Akira Ajisaka - Wei-Chiu Chuang - Masatake Iwasaki - Sunil Govindan non-binding +1's: - Xiaoqiao He - Hui Fei - Lisheng Sun - Chao Sun

Re: [E] Re: [VOTE] Release Apache Hadoop 3.2.2 - RC4

2021-01-03 Thread Xiaoqiao He
l, - He Xiaoqiao [1] https://lists.apache.org/thread.html/r6c2817770e99362da79ebfaa0b6a774c5fca0f31e0dcc24df398eda0%40%3Chdfs-dev.hadoop.apache.org%3E On Thu, Dec 24, 2020 at 11:30 AM Xiaoqiao He wrote: > Thanks Sunil, it makes sense to me. Will backport and prepare another RC > shortly. > > - He Xiaoqiao > &

Re: [E] Re: [VOTE] Release Apache Hadoop 3.2.2 - RC4

2020-12-23 Thread Xiaoqiao He
> I feel that we can call a new RC as YARN-10540 is backported already. > > Thanks > Sunil > > On Wed, Dec 23, 2020 at 3:54 PM Xiaoqiao He wrote: > > > Thanks Jim, Eric and Sunil, > > > > I tried to backport YARN-10540 to branch-3.2.2 at local and check yarn >

Re: [E] Re: [VOTE] Release Apache Hadoop 3.2.2 - RC4

2020-12-23 Thread Xiaoqiao He
tps-3A__issues.apache.org_jira_browse_YARN-2D10450=DwIBaQ=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY=7Imi06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg=QEHMGtEbBz5Gn7mW4UsGlc-wNZ8ugZwiFQBy2pTx-Fw= >> > > >. >> > > > In the trunk, I

Re: [VOTE] Release Apache Hadoop 3.2.2 - RC4

2020-12-19 Thread Xiaoqiao He
browse/HADOOP-15930>. >> >> Thanks >> Sunil >> >> On Sat, Dec 19, 2020 at 10:16 AM Sunil Govindan >> wrote: >> >>> Hi Xiaoqiao and Wei-chiu >>> >>> I am a bit confused after seeing both *.sha512 and *.md5 files in the >

[VOTE] Release Apache Hadoop 3.2.2 - RC4

2020-12-09 Thread Xiaoqiao He
Hi folks, The release candidate (RC4) for Hadoop-3.2.2 is available now. There are 10 commits[1] differences between RC4 and RC3[2]. The RC4 is available at: http://people.apache.org/~hexiaoqiao/hadoop-3.2.2-RC4 The RC4 tag in github is here:

Re: [VOTE] Release Apache Hadoop 3.2.2 - RC3

2020-12-07 Thread Xiaoqiao He
0 at 9:09 AM Chao Sun wrote: > > > > > > Thanks Xiaoqiao. I just committed the fix to branch-3.2 (and will port > it > > > to other branches as well later). Could you cherry-pick it to > branch-3.2.2 > > > and start another RC? really appre

Re: [VOTE] Release Apache Hadoop 3.2.2 - RC3

2020-12-02 Thread Xiaoqiao He
e notice. > > Best, > Chao > > On Mon, Nov 30, 2020 at 7:37 AM Xiaoqiao He wrote: > >> Hi folks, >> >> The release candidate (RC3) for Hadoop-3.2.2 is available now. >> There are 22 commits[1] differences between RC3 and RC2[2]. >> >> The RC3 i

[VOTE] Release Apache Hadoop 3.2.2 - RC3

2020-11-30 Thread Xiaoqiao He
Hi folks, The release candidate (RC3) for Hadoop-3.2.2 is available now. There are 22 commits[1] differences between RC3 and RC2[2]. The RC3 is available at: http://people.apache.org/~hexiaoqiao/hadoop-3.2.2-RC3 The RC3 tag in github is here:

Re: [VOTE] Release Apache Hadoop 3.2.2 - RC2

2020-11-14 Thread Xiaoqiao He
nd the webUI etc. Everything >>> looks fine. The only strange thing, was on the Namenode webUI under the >>> overview section - the "unknown" is a little strange, but I am not sure >>> what is usually in there: >>> >>> Version: 3.2.2, rUnknown &

[VOTE] Release Apache Hadoop 3.2.2 - RC2

2020-11-07 Thread Xiaoqiao He
Hi folks, The release candidate (RC2) for Hadoop-3.2.2 is available now. There are two commits[1] differences between RC2 and RC1[2](Thanks Akira Ajisaka for the report.): * revert HADOOP-17306. * include HDFS-15643. The RC2 is available at: http://people.apache.org/~hexiaoqiao/hadoop-3.2.2-RC2

Re: [VOTE] Release Apache Hadoop 3.2.2 - RC1

2020-11-05 Thread Xiaoqiao He
saw that the revert of HADOOP-17306 is now pushed to > the 3.2.2 branch as well. > > Let's do one more RC. Thanks @Xiaoqiao He for > helping. > > Thanks > Sunil > > On Fri, Nov 6, 2020 at 6:58 AM Akira Ajisaka wrote: > >> -1 >> >> - YARN resource loc

[VOTE] Release Apache Hadoop 3.2.2 - RC1

2020-11-03 Thread Xiaoqiao He
Hi folks, I have put together a release candidate (RC1) for Hadoop-3.2.2. It contains *473[1]* fixed jira issues since 3.2.1 release which also include many features and improvements(Please reference the full set of release notes). The RC is available at:

Re: [E] Re: Hadoop 3.2.2 Release Code Freeze Plan

2020-10-17 Thread Xiaoqiao He
it in 3.2.2. It's a blocking issue though, so I think it'd be > unfortunate if we missed this chance to include it in a 3.2.x maintenance > release. (Same for YARN-8992, which is a related JIRA.) > > Best, > Steve > > On Sat, Oct 17, 2020 at 12:25 PM Xiaoqiao He > wrote: &

Re: [E] Re: Hadoop 3.2.2 Release Code Freeze Plan

2020-10-17 Thread Xiaoqiao He
, Oct 16, 2020 at 6:43 AM Sunil Govindan wrote: >> >>> Looks good to me. >>> >>> Thanks Xiaoquio. >>> >>> + Sunil >>> >>> On Fri, Oct 16, 2020 at 12:36 PM Xiaoqiao He >>> wrote: >>> >>> > Thanks S

Re: Hadoop 3.2.2 Release Code Freeze Plan

2020-10-16 Thread Xiaoqiao He
/branch-3.2 On Fri, Oct 16, 2020 at 12:03 PM Sunil Govindan wrote: > Thank you > > Did we also cut the branch already ? > > Sunil > > On Fri, 16 Oct 2020 at 9:14 AM, Xiaoqiao He wrote: > >> Hi All, >> >> All issues targeted to 3.2.2 have been resolved from no

Re: Hadoop 3.2.2 Release Code Freeze Plan

2020-10-15 Thread Xiaoqiao He
Xiaoqiao He wrote: > Thanks to Wei-Chiu for your reminder, the dashboard and filters have been > updated. It is visible to the public now. > > Thanks, Regards. > > [1] > https://issues.apache.org/jira/secure/Dashboard.jspa?selectPageId=12335948 > > > On Fri, Oct 2, 2

Re: Hadoop 3.2.2 Release Code Freeze Plan

2020-10-02 Thread Xiaoqiao He
; Glad to see this is moving along. I noticed your dashboard has private > filters and therefore the results are not visible publicly. > > On Tue, Sep 29, 2020 at 10:02 PM Xiaoqiao He > wrote: > > > Hi All, > > > > Plan to code frozen for Hadoop-3.2.2 relea

Hadoop 3.2.2 Release Code Freeze Plan

2020-09-29 Thread Xiaoqiao He
Hi All, Plan to code frozen for Hadoop-3.2.2 release at 2020/10/15. From now on, most of the issues have been resolved. And there are two JIRA still open which target to 3.2.2 traced by [1]. * https://issues.apache.org/jira/browse/YARN-10244 * https://issues.apache.org/jira/browse/HADOOP-17287

Re: [ANNOUNCE] Hui Fei is a new Apache Hadoop Committer

2020-09-24 Thread Xiaoqiao He
Congrats! Best Regards, He Xiaoqiao On Thu, Sep 24, 2020 at 10:03 AM Sammi Chen wrote: > Congratulations to Hui ! > > On Thu, Sep 24, 2020 at 2:07 AM Wei-Chiu Chuang > wrote: > > > I am pleased to announce that Hui Fei has accepted the invitation to > become > > a Hadoop committer. > > > > He

Re: [ANNOUNCE] Lisheng Sun is a new Apache Hadoop Committer

2020-09-23 Thread Xiaoqiao He
Congrats! Best Regards, He Xiaoqiao On Thu, Sep 24, 2020 at 9:08 AM Guanghao Zhang wrote: > Congratulations, Lisheng! >

Re: [DISCUSS] Hadoop 3.2.2 release

2020-09-06 Thread Xiaoqiao He
iao, > > Thanks for volunteering. > I could help to guide you through the process. > > Thanks, > Sunil > > On Thu, Sep 3, 2020 at 9:09 AM Xiaoqiao He wrote: > >> Thanks Wei-Chiu for initiating this. >> >> It's been nearly a year since Hadoop-3.2.1 released(201

Re: [DISCUSS] Hadoop 3.2.2 release

2020-09-02 Thread Xiaoqiao He
Thanks Wei-Chiu for initiating this. It's been nearly a year since Hadoop-3.2.1 released(2019 Sep 22). We have several important fixes landed in branch-3.2 (around 37 blockers/critical issues)[1]. There are also 3 blockers/critical pending issues and 3 other pending issues on 3.2.2[2]. I am

Re: [VOTE] End of Life Hadoop 2.9

2020-08-31 Thread Xiaoqiao He
+1 On Tue, Sep 1, 2020 at 10:14 AM Ayush Saxena wrote: > +1 > > -Ayush > > > On 01-Sep-2020, at 7:23 AM, Akira Ajisaka wrote: > > > > +1 > > > > -Akira > > > >> On Tue, Sep 1, 2020 at 4:09 AM Wei-Chiu Chuang > wrote: > >> > >> Dear fellow Hadoop developers, > >> > >> Given the overwhelming

Re: [DISCUSS] fate of branch-2.9

2020-08-27 Thread Xiaoqiao He
+1 for putting 2.9 release lines to EOL. Thanks, Hexiaoqiao On Thu, Aug 27, 2020 at 3:14 PM Mingliang Liu wrote: > +1 for putting 2.9 lines to EOL. > > Let's focus on 2.10 releases for Hadoop 2. Also is there any plan for > 2.10.1? It has been 11 months since 2.10 first release. > > Thanks, >

Re: [VOTE] Release Apache Hadoop 3.3.0 - RC0

2020-07-13 Thread Xiaoqiao He
t; Thanks for bringing this to my attention. > > It's too rare to occur this scenario and a couple of releases went after > HDFS-4882(broken jira). > > So,You think it's fine to include in the next release? Or if you still > insist we can go for another RC... > > > On Mon,

Re: [VOTE] Release Apache Hadoop 3.3.0 - RC0

2020-07-13 Thread Xiaoqiao He
Thanks Brahma Reddy Battula for your great work here. Stephen fixed lease leak in namenode, and it is ready now: https://issues.apache.org/jira/browse/HDFS-14498. I think this affects 3.3.0-RC0. Would you check this? Sorry for reporting it so late. On Mon, Jul 13, 2020 at 2:53 PM Takanobu Asanuma

Re: [ANNOUNCE] New Apache Hadoop Committer - He Xiaoqiao

2020-06-12 Thread Xiaoqiao He
Thanks all! So glad to join the Hadoop committer family. Will continue to make contributions to the projects. Best Regards, He Xiaoqiao On Fri, Jun 12, 2020 at 3:04 PM Wangda Tan wrote: > Congrats! > > Best, > Wangda Tan > > On Thu, Jun 11, 2020 at 5:55 PM Tao Yang > wrote: > > >

Re: Client Caller Context Through Router(RBF)

2020-05-05 Thread Xiaoqiao He
Hi Ayush, Thank you for summary and re-launching this discussion. Both of JIRA's links are very helpful for pushing it forward. I would like to underline that this is a serious issue and very hope that we could get the solution here. As far as know, there are many users who deploy RBF meet this

Re: [Hadoop-3.3 Release update]- branch-3.3 has created

2020-04-11 Thread Xiaoqiao He
Hi Brahma, Thanks for your great works here. About HDFS-12862 , I try to raise another JIRA (HDFS-15272) to track backport branch-3.1, close this one to decouple release progress. Thanks, Hexiaoqiao On Sun, Apr 12, 2020 at 2:49 AM Brahma Reddy

Re: [ANNOUNCE] New Apache Hadoop Committer - Stephen O'Donnell

2020-03-05 Thread Xiaoqiao He
Congratulations Stephen! - Hexiaoqiao On Thu, Mar 5, 2020 at 11:08 AM Masatake Iwasaki < iwasak...@oss.nttdata.co.jp> wrote: > Congratulations! > > Masatake Iwasaki > > > On 2020/03/04 5:11, Wei-Chiu Chuang wrote: > > In bcc: general@ > > > > It's my pleasure to announce that Stephen O'Donnell

Re: [DISCUSS] Prefer Github PR Integration over patch in JIRA

2019-07-23 Thread Xiaoqiao He
Thanks Wei-Chiu for starting this discussion. +1 (non-binding) for turning code review to GitHub PR and keep other comments/discussions on JIRA. 1. In my experience, JIRA is better at tracking and recording information. 2. It is confused that no guide (`How to contribute`) about submit PR to JIRA

Re: Aug Hadoop Community Meetup in China

2019-07-20 Thread Xiaoqiao He
Thanks Junping for organizing the event. Looking forward to the coming meetup. BTW, It is hoped to keep running regular Hadoop Contributors Meetups in China. On Fri, Jul 19, 2019 at 12:35 AM Wanqiang Ji wrote: > Thanks for organize this event! > I always looking forward to meet folks in the