Re: the v2 commit algorithm

2020-09-24 Thread Steve Loughran
On Wed, 23 Sep 2020 at 20:07, Igor Dvorzhak wrote: > What will be the solution for object stores to have fast and correct > commit algorithms? > https://github.com/steveloughran/zero-rename-committer/releases/tag/tag_draft_006 There's a plugin point for you to add an explicit committer for gcs:

Re: [E] Re: the v2 commit algorithm

2020-09-24 Thread Steve Loughran
On Wed, 23 Sep 2020 at 20:16, Jim Brennan wrote: > I replied in the Jira. The speed up provided by the v2 commit algorithm > is very important to us at Verizon Media (Yahoo). Please do not remove it. > I referred to this comment from Jason Lowe on the original Jira: > > https://issues.apache.o

Re: [ANNOUNCE] Hui Fei is a new Apache Hadoop Committer

2020-09-24 Thread Surendra Singh Lilhore
Congratulations! -Surendra On Thu, 24 Sep, 2020, 12:22 pm Xiaoqiao He, wrote: > Congrats! > > Best Regards, > He Xiaoqiao > > On Thu, Sep 24, 2020 at 10:03 AM Sammi Chen wrote: > > > Congratulations to Hui ! > > > > On Thu, Sep 24, 2020 at 2:07 AM Wei-Chiu Chuang > > wrote: > > > > > I am pl

Re: [ANNOUNCE] Hui Fei is a new Apache Hadoop Committer

2020-09-24 Thread Adam Antal
Congratulations! Regards, Adam On Thu, Sep 24, 2020 at 3:22 PM Surendra Singh Lilhore < surendralilh...@apache.org> wrote: > Congratulations! > > > -Surendra > > On Thu, 24 Sep, 2020, 12:22 pm Xiaoqiao He, wrote: > > > Congrats! > > > > Best Regards, > > He Xiaoqiao > > > > On Thu, Sep 24, 2020

Re: [ANNOUNCE] Lisheng Sun is a new Apache Hadoop Committer

2020-09-24 Thread Adam Antal
Congratulations! Regards, Adam On Thu, Sep 24, 2020 at 1:32 PM Rudolf Reti wrote: > Congrats! :) > > On Thu, Sep 24, 2020 at 9:48 AM runlin zhang wrote: > > > Congratulations Lisheng ! > > > > > 在 2020年9月24日,上午2:00,Wei-Chiu Chuang 写道: > > > > > > I am pleased to announce that Lisheng Sun has

Apache Hadoop qbt Report: branch-2.10+JDK7 on Linux/x86_64

2020-09-24 Thread Apache Jenkins Server
For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/66/ No changes -1 overall The following subsystems voted -1: asflicense hadolint jshint pathlen unit xml The following subsystems voted -1 but were configured to be filtered/ignored: c

Re: [E] Re: the v2 commit algorithm

2020-09-24 Thread epa...@apache.org
Thanks Steve and Jim for bringing this issue to our attention. IIUC, Serial commit takes minutes with mrv1, whereas with mrv2 it is very quick. With this kind of performance difference, is wise to change the default behavior for released versions of Hadoop? Should this be limited to trunk? Than

Re: [ANNOUNCE] Hui Fei is a new Apache Hadoop Committer

2020-09-24 Thread epa...@apache.org
Congratulations Hui Fei! On Wednesday, September 23, 2020, 1:07:11 PM CDT, Wei-Chiu Chuang wrote: I am pleased to announce that Hui Fei has accepted the invitation to become a Hadoop committer. He started contributing to the project in October 2016. Over the past 4 years he has contributed a l

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86_64

2020-09-24 Thread Apache Jenkins Server
For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/275/ [Sep 23, 2020 5:50:28 AM] (noreply) YARN-6754. Fair scheduler docs should explain meaning of weight=0 for a queue. (#2300) [Sep 23, 2020 3:42:56 PM] (Adam Antal) YARN-10443. Document options of logs

Re: [ANNOUNCE] Lisheng Sun is a new Apache Hadoop Committer

2020-09-24 Thread Xun Liu
Lisheng, Congratulations! On Thu, Sep 24, 2020 at 9:59 PM Adam Antal wrote: > Congratulations! > > Regards, > Adam > > On Thu, Sep 24, 2020 at 1:32 PM Rudolf Reti > wrote: > > > Congrats! :) > > > > On Thu, Sep 24, 2020 at 9:48 AM runlin zhang > wrote: > > > > > Congratulations Lisheng ! > >