Re: Apache Hadoop 2.9.1 Release Plan
Hi Sammi, Thank you for driving 2.9.1 release. I've committed HDFS-13427 (only documentation bug fix) to branch-2.9.1. Sorry for doing this without reading this thread. Regards, Akira On 2018/04/07 4:12, Wei-Chiu Chuang wrote: Done. Both HDFS-11915 and HDFS-13364 are in branch-2.9 and branch-2.9.1. Thank you Sammi for driving 2.9.1 release On Fri, Apr 6, 2018 at 10:14 AM, Wei-Chiu Chuang wrote: 1. Looks like: 2. HDFS-13347 <https://issues.apache.org/jira/browse/HDFS-13347> breaks compilation, which is later fixed byHDFS-13364 <https://issues.apache.org/jira/browse/HDFS-13364>. But HDFS-13364 is only available in 2.9.2 (branch-2.9) Before I cherrypick HDFS-11915, I will cherry pick HDFS-13364 first into branch-2.9.1. On Fri, Apr 6, 2018 at 9:46 AM, Chen, Sammi wrote: Hi Wei-Chiu, HDFS-11915 improves the data reliability when there is power failure. I'm happy to include it in 2.9.1 release. Would you help to cherry-pick it to both branch-2.9 and branch-2.9.1? Thanks, Sammi -Original Message- From: Wei-Chiu Chuang [mailto:weic...@cloudera.com] Sent: Thursday, April 5, 2018 1:30 AM To: Chen, Sammi Cc: hdfs-dev ; mapreduce-...@hadoop.apache.or g; common-...@hadoop.apache.org; yarn-dev@hadoop.apache.org Subject: Re: Apache Hadoop 2.9.1 Release Plan Sorry Sammi I was late to this thread. Please considering incorporating HDFS-11915. Sync rbw dir on the first hsync() to avoid file lost on power failure. I thought it was already in 2.9.1 but turns out it didn't land. The cherry pick to branch-2.9 is conflict free. On Mon, Apr 2, 2018 at 4:34 AM, Chen, Sammi wrote: Hi All, Today I have created branch-2.9.1 from branch-2.9 and started creating the RC0 based on branch-2.9.1. But due to the corporate network conditions and my not full privileges on Hadoop, it will take a while for RC0 to come out. If you have anything want to commit to branch-2.9.1, please let me know. Also I will update fix version of all 2.9.1 JIRAs and moved all unresolved JIRA with target version = 2.9.1 to 2.9.2. Bests, Sammi Chen -Original Message- From: Chen, Sammi [mailto:sammi.c...@intel.com] Sent: Friday, March 30, 2018 3:55 PM To: hdfs-dev ; mapreduce-...@hadoop.apache.org; common-...@hadoop.apache.org; yarn-dev@hadoop.apache.org Subject: Apache Hadoop 2.9.1 Release Plan Hi All, We have 47 changes on 2.9 branch since last release on Nov. 2017. There are 7 blockers, 5 critical issues and rest are normal bug fixes and feature improvements. Here are current tasks targeting for 2.9.1. No critical and blockers so far. https://issues.apache.org/jira/issues/?jql=%22Target+ Version%2Fs%22+%3D+2.9.1+AND+%28project+%3D+hadoop+OR+ project+%3D+%22Hadoop+HDFS%22+OR+project+%3D+%22Hadoop+YARN% 22+OR+project+%3D+%22Hadoop+Map%2FReduce%22+OR+project+% 3D+%22Hadoop+Common%22%29+AND+status+%21%3D+resolved+ORDER+ BY+priority+DESC I plan to cut the 2.9.1 branch today, and try to deliver the RC0 ASAP. Please let me know if you have any objections or suggestions. Bests, Sammi - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org -- A very happy Clouderan -- A very happy Clouderan - To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org
Re: Apache Hadoop 2.9.1 Release Plan
Done. Both HDFS-11915 and HDFS-13364 are in branch-2.9 and branch-2.9.1. Thank you Sammi for driving 2.9.1 release On Fri, Apr 6, 2018 at 10:14 AM, Wei-Chiu Chuang wrote: > >1. > Looks like: >2. HDFS-13347 <https://issues.apache.org/jira/browse/HDFS-13347> breaks >compilation, which is later fixed byHDFS-13364 ><https://issues.apache.org/jira/browse/HDFS-13364>. But HDFS-13364 is >only available in 2.9.2 (branch-2.9) > > > > > >Before I cherrypick HDFS-11915, I will cherry pick HDFS-13364 first >into branch-2.9.1. > > > On Fri, Apr 6, 2018 at 9:46 AM, Chen, Sammi wrote: > >> Hi Wei-Chiu, >> >> HDFS-11915 improves the data reliability when there is power failure. >> I'm happy to include it in 2.9.1 release. >> >> Would you help to cherry-pick it to both branch-2.9 and branch-2.9.1? >> >> >> Thanks, >> Sammi >> >> -Original Message- >> From: Wei-Chiu Chuang [mailto:weic...@cloudera.com] >> Sent: Thursday, April 5, 2018 1:30 AM >> To: Chen, Sammi >> Cc: hdfs-dev ; mapreduce-...@hadoop.apache.or >> g; common-...@hadoop.apache.org; yarn-dev@hadoop.apache.org >> Subject: Re: Apache Hadoop 2.9.1 Release Plan >> >> Sorry Sammi I was late to this thread. >> Please considering incorporating HDFS-11915. Sync rbw dir on the first >> hsync() to avoid file lost on power failure. >> I thought it was already in 2.9.1 but turns out it didn't land. The >> cherry pick to branch-2.9 is conflict free. >> >> On Mon, Apr 2, 2018 at 4:34 AM, Chen, Sammi wrote: >> >> > Hi All, >> > >> > Today I have created branch-2.9.1 from branch-2.9 and started creating >> the >> > RC0 based on branch-2.9.1. But due to the corporate network >> conditions >> > and my not full privileges on Hadoop, it will take a while for RC0 to >> > come out. >> > >> > If you have anything want to commit to branch-2.9.1, please let me >> know. >> > >> > Also I will update fix version of all 2.9.1 JIRAs and moved all >> > unresolved JIRA with target version = 2.9.1 to 2.9.2. >> > >> > >> > >> > Bests, >> > Sammi Chen >> > >> > -Original Message- >> > From: Chen, Sammi [mailto:sammi.c...@intel.com] >> > Sent: Friday, March 30, 2018 3:55 PM >> > To: hdfs-dev ; >> > mapreduce-...@hadoop.apache.org; common-...@hadoop.apache.org; >> > yarn-dev@hadoop.apache.org >> > Subject: Apache Hadoop 2.9.1 Release Plan >> > >> > Hi All, >> > >> > We have 47 changes on 2.9 branch since last release on Nov. 2017. >> There >> > are 7 blockers, 5 critical issues and rest are normal bug fixes and >> > feature improvements. >> > >> > >> > >> > >> > >> > Here are current tasks targeting for 2.9.1. No critical and blockers >> > so far. >> > >> > https://issues.apache.org/jira/issues/?jql=%22Target+ >> > Version%2Fs%22+%3D+2.9.1+AND+%28project+%3D+hadoop+OR+ >> > project+%3D+%22Hadoop+HDFS%22+OR+project+%3D+%22Hadoop+YARN% >> > 22+OR+project+%3D+%22Hadoop+Map%2FReduce%22+OR+project+% >> > 3D+%22Hadoop+Common%22%29+AND+status+%21%3D+resolved+ORDER+ >> > BY+priority+DESC >> > >> > >> > I plan to cut the 2.9.1 branch today, and try to deliver the RC0 ASAP. >> > Please let me know if you have any objections or suggestions. >> > >> > >> > >> > >> > >> > >> > Bests, >> > >> > Sammi >> > >> > >> > >> > >> > - >> > To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org >> > For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org >> > >> > >> >> >> -- >> A very happy Clouderan >> > > > > -- > A very happy Clouderan > -- A very happy Hadoop contributor
Re: Apache Hadoop 2.9.1 Release Plan
1. Looks like: 2. HDFS-13347 <https://issues.apache.org/jira/browse/HDFS-13347> breaks compilation, which is later fixed byHDFS-13364 <https://issues.apache.org/jira/browse/HDFS-13364>. But HDFS-13364 is only available in 2.9.2 (branch-2.9) Before I cherrypick HDFS-11915, I will cherry pick HDFS-13364 first into branch-2.9.1. On Fri, Apr 6, 2018 at 9:46 AM, Chen, Sammi wrote: > Hi Wei-Chiu, > > HDFS-11915 improves the data reliability when there is power failure. I'm > happy to include it in 2.9.1 release. > > Would you help to cherry-pick it to both branch-2.9 and branch-2.9.1? > > > Thanks, > Sammi > > -Original Message- > From: Wei-Chiu Chuang [mailto:weic...@cloudera.com] > Sent: Thursday, April 5, 2018 1:30 AM > To: Chen, Sammi > Cc: hdfs-dev ; mapreduce-...@hadoop.apache.org; > common-...@hadoop.apache.org; yarn-dev@hadoop.apache.org > Subject: Re: Apache Hadoop 2.9.1 Release Plan > > Sorry Sammi I was late to this thread. > Please considering incorporating HDFS-11915. Sync rbw dir on the first > hsync() to avoid file lost on power failure. > I thought it was already in 2.9.1 but turns out it didn't land. The cherry > pick to branch-2.9 is conflict free. > > On Mon, Apr 2, 2018 at 4:34 AM, Chen, Sammi wrote: > > > Hi All, > > > > Today I have created branch-2.9.1 from branch-2.9 and started creating > the > > RC0 based on branch-2.9.1. But due to the corporate network conditions > > and my not full privileges on Hadoop, it will take a while for RC0 to > > come out. > > > > If you have anything want to commit to branch-2.9.1, please let me know. > > > > Also I will update fix version of all 2.9.1 JIRAs and moved all > > unresolved JIRA with target version = 2.9.1 to 2.9.2. > > > > > > > > Bests, > > Sammi Chen > > > > -Original Message- > > From: Chen, Sammi [mailto:sammi.c...@intel.com] > > Sent: Friday, March 30, 2018 3:55 PM > > To: hdfs-dev ; > > mapreduce-...@hadoop.apache.org; common-...@hadoop.apache.org; > > yarn-dev@hadoop.apache.org > > Subject: Apache Hadoop 2.9.1 Release Plan > > > > Hi All, > > > > We have 47 changes on 2.9 branch since last release on Nov. 2017. There > > are 7 blockers, 5 critical issues and rest are normal bug fixes and > > feature improvements. > > > > > > > > > > > > Here are current tasks targeting for 2.9.1. No critical and blockers > > so far. > > > > https://issues.apache.org/jira/issues/?jql=%22Target+ > > Version%2Fs%22+%3D+2.9.1+AND+%28project+%3D+hadoop+OR+ > > project+%3D+%22Hadoop+HDFS%22+OR+project+%3D+%22Hadoop+YARN% > > 22+OR+project+%3D+%22Hadoop+Map%2FReduce%22+OR+project+% > > 3D+%22Hadoop+Common%22%29+AND+status+%21%3D+resolved+ORDER+ > > BY+priority+DESC > > > > > > I plan to cut the 2.9.1 branch today, and try to deliver the RC0 ASAP. > > Please let me know if you have any objections or suggestions. > > > > > > > > > > > > > > Bests, > > > > Sammi > > > > > > > > > > - > > To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org > > For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org > > > > > > > -- > A very happy Clouderan > -- A very happy Clouderan
RE: Apache Hadoop 2.9.1 Release Plan
Hi Wei-Chiu, HDFS-11915 improves the data reliability when there is power failure. I'm happy to include it in 2.9.1 release. Would you help to cherry-pick it to both branch-2.9 and branch-2.9.1? Thanks, Sammi -Original Message- From: Wei-Chiu Chuang [mailto:weic...@cloudera.com] Sent: Thursday, April 5, 2018 1:30 AM To: Chen, Sammi Cc: hdfs-dev ; mapreduce-...@hadoop.apache.org; common-...@hadoop.apache.org; yarn-dev@hadoop.apache.org Subject: Re: Apache Hadoop 2.9.1 Release Plan Sorry Sammi I was late to this thread. Please considering incorporating HDFS-11915. Sync rbw dir on the first hsync() to avoid file lost on power failure. I thought it was already in 2.9.1 but turns out it didn't land. The cherry pick to branch-2.9 is conflict free. On Mon, Apr 2, 2018 at 4:34 AM, Chen, Sammi wrote: > Hi All, > > Today I have created branch-2.9.1 from branch-2.9 and started creating the > RC0 based on branch-2.9.1. But due to the corporate network conditions > and my not full privileges on Hadoop, it will take a while for RC0 to > come out. > > If you have anything want to commit to branch-2.9.1, please let me know. > > Also I will update fix version of all 2.9.1 JIRAs and moved all > unresolved JIRA with target version = 2.9.1 to 2.9.2. > > > > Bests, > Sammi Chen > > -Original Message- > From: Chen, Sammi [mailto:sammi.c...@intel.com] > Sent: Friday, March 30, 2018 3:55 PM > To: hdfs-dev ; > mapreduce-...@hadoop.apache.org; common-...@hadoop.apache.org; > yarn-dev@hadoop.apache.org > Subject: Apache Hadoop 2.9.1 Release Plan > > Hi All, > > We have 47 changes on 2.9 branch since last release on Nov. 2017. There > are 7 blockers, 5 critical issues and rest are normal bug fixes and > feature improvements. > > > > > > Here are current tasks targeting for 2.9.1. No critical and blockers > so far. > > https://issues.apache.org/jira/issues/?jql=%22Target+ > Version%2Fs%22+%3D+2.9.1+AND+%28project+%3D+hadoop+OR+ > project+%3D+%22Hadoop+HDFS%22+OR+project+%3D+%22Hadoop+YARN% > 22+OR+project+%3D+%22Hadoop+Map%2FReduce%22+OR+project+% > 3D+%22Hadoop+Common%22%29+AND+status+%21%3D+resolved+ORDER+ > BY+priority+DESC > > > I plan to cut the 2.9.1 branch today, and try to deliver the RC0 ASAP. > Please let me know if you have any objections or suggestions. > > > > > > > Bests, > > Sammi > > > > > - > To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org > For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org > > -- A very happy Clouderan
Re: Apache Hadoop 2.9.1 Release Plan
Sorry Sammi I was late to this thread. Please considering incorporating HDFS-11915. Sync rbw dir on the first hsync() to avoid file lost on power failure. I thought it was already in 2.9.1 but turns out it didn't land. The cherry pick to branch-2.9 is conflict free. On Mon, Apr 2, 2018 at 4:34 AM, Chen, Sammi wrote: > Hi All, > > Today I have created branch-2.9.1 from branch-2.9 and started creating the > RC0 based on branch-2.9.1. But due to the corporate network conditions > and my not full privileges on Hadoop, it will take a while for RC0 to > come out. > > If you have anything want to commit to branch-2.9.1, please let me know. > > Also I will update fix version of all 2.9.1 JIRAs and moved all > unresolved JIRA with target version = 2.9.1 to 2.9.2. > > > > Bests, > Sammi Chen > > -Original Message- > From: Chen, Sammi [mailto:sammi.c...@intel.com] > Sent: Friday, March 30, 2018 3:55 PM > To: hdfs-dev ; mapreduce-...@hadoop.apache.org; > common-...@hadoop.apache.org; yarn-dev@hadoop.apache.org > Subject: Apache Hadoop 2.9.1 Release Plan > > Hi All, > > We have 47 changes on 2.9 branch since last release on Nov. 2017. There > are 7 blockers, 5 critical issues and rest are normal bug fixes and feature > improvements. > > > > > > Here are current tasks targeting for 2.9.1. No critical and blockers so > far. > > https://issues.apache.org/jira/issues/?jql=%22Target+ > Version%2Fs%22+%3D+2.9.1+AND+%28project+%3D+hadoop+OR+ > project+%3D+%22Hadoop+HDFS%22+OR+project+%3D+%22Hadoop+YARN% > 22+OR+project+%3D+%22Hadoop+Map%2FReduce%22+OR+project+% > 3D+%22Hadoop+Common%22%29+AND+status+%21%3D+resolved+ORDER+ > BY+priority+DESC > > > I plan to cut the 2.9.1 branch today, and try to deliver the RC0 ASAP. > Please let me know if you have any objections or suggestions. > > > > > > > Bests, > > Sammi > > > > > - > To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org > For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org > > -- A very happy Clouderan
RE: Apache Hadoop 2.9.1 Release Plan
Hi All, Today I have created branch-2.9.1 from branch-2.9 and started creating the RC0 based on branch-2.9.1. But due to the corporate network conditions and my not full privileges on Hadoop, it will take a while for RC0 to come out. If you have anything want to commit to branch-2.9.1, please let me know. Also I will update fix version of all 2.9.1 JIRAs and moved all unresolved JIRA with target version = 2.9.1 to 2.9.2. Bests, Sammi Chen -Original Message- From: Chen, Sammi [mailto:sammi.c...@intel.com] Sent: Friday, March 30, 2018 3:55 PM To: hdfs-dev ; mapreduce-...@hadoop.apache.org; common-...@hadoop.apache.org; yarn-dev@hadoop.apache.org Subject: Apache Hadoop 2.9.1 Release Plan Hi All, We have 47 changes on 2.9 branch since last release on Nov. 2017. There are 7 blockers, 5 critical issues and rest are normal bug fixes and feature improvements. Here are current tasks targeting for 2.9.1. No critical and blockers so far. https://issues.apache.org/jira/issues/?jql=%22Target+Version%2Fs%22+%3D+2.9.1+AND+%28project+%3D+hadoop+OR+project+%3D+%22Hadoop+HDFS%22+OR+project+%3D+%22Hadoop+YARN%22+OR+project+%3D+%22Hadoop+Map%2FReduce%22+OR+project+%3D+%22Hadoop+Common%22%29+AND+status+%21%3D+resolved+ORDER+BY+priority+DESC I plan to cut the 2.9.1 branch today, and try to deliver the RC0 ASAP. Please let me know if you have any objections or suggestions. Bests, Sammi - To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org
RE: Apache Hadoop 2.9.1 Release Plan
Thanks Arun for the reminder. Here is the 2.9.1 monitor list, https://issues.apache.org/jira/secure/IssueNavigator.jspa?reset=true&jqlQuery=%22Target+Version%2Fs%22+%3D+2.9.1+AND+%28project+%3D+hadoop+OR+project+%3D+%22Hadoop+HDFS%22+OR+project+%3D+%22Hadoop+YARN%22+OR+project+%3D+%22Hadoop+Map%2FReduce%22+OR+project+%3D+%22Hadoop+Common%22%29+AND+status+%21%3D+resolved+ORDER+BY+priority+DESC Bests, Sammi -Original Message- From: Arun Suresh [mailto:arun.sur...@gmail.com] Sent: Thursday, January 11, 2018 2:14 AM To: Chen, Sammi Cc: Hadoop Common ; mapreduce-...@hadoop.apache.org; yarn-dev@hadoop.apache.org; Hdfs-dev Subject: Re: Apache Hadoop 2.9.1 Release Plan Hey Sammi, Looks like your filter is private. Cheers -Arun On Wed, Jan 10, 2018 at 12:28 AM, Chen, Sammi wrote: > Hi All, > > > > We have successfully released Apache Hadoop 2.9.0 in Nov. 2017 [1] > with 30 new features, 407 improvements, 790 bug fixes new fixed issues since > 2.8.2. To further improve the quality and stability of the release, we > plan to start the 2.9.1 release work. > > > > The priority of 2.9.1 will be fixing blockers, critical bugs, bug fixes > and improvements. So far, I don't see any pending blockers and critical > bugs on 2.9.1[2]. > > > > We plan to cut the branch-2.9.1 on March 1st, and targeting for March > 9th release. > > > > For all coming commits to land on branch-2.9, please mark the fix > version as 2.9.1. > > > > Please feel free to let me know if you have any thoughts or comments > on the plan. > > > > > > [1] http://hadoop.apache.org/docs/r2.9.0/ > > [2] https://issues.apache.org/jira/issues/?filter=12342845 > > > > > > Bests, > > Sammi Chen > > - > > To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org hdfs-dev-unsubscr...@hadoop.apache.org> > > For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org hdfs-dev-h...@hadoop.apache.org> > > - To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org
Re: Apache Hadoop 2.9.1 Release Plan
Hey Sammi, Looks like your filter is private. Cheers -Arun On Wed, Jan 10, 2018 at 12:28 AM, Chen, Sammi wrote: > Hi All, > > > > We have successfully released Apache Hadoop 2.9.0 in Nov. 2017 [1] with 30 > new features, 407 improvements, 790 bug fixes new fixed issues since > 2.8.2. To further improve the quality and stability of the release, we > plan to start the 2.9.1 release work. > > > > The priority of 2.9.1 will be fixing blockers, critical bugs, bug fixes > and improvements. So far, I don't see any pending blockers and critical > bugs on 2.9.1[2]. > > > > We plan to cut the branch-2.9.1 on March 1st, and targeting for March 9th > release. > > > > For all coming commits to land on branch-2.9, please mark the fix version > as 2.9.1. > > > > Please feel free to let me know if you have any thoughts or comments on > the plan. > > > > > > [1] http://hadoop.apache.org/docs/r2.9.0/ > > [2] https://issues.apache.org/jira/issues/?filter=12342845 > > > > > > Bests, > > Sammi Chen > > - > > To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org hdfs-dev-unsubscr...@hadoop.apache.org> > > For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org hdfs-dev-h...@hadoop.apache.org> > >