Re: [ANNOUNCE] New HBase committer Chia-Ping Tsai

[Yu Li]

Congratulations and welcome!

Best Regards,
Yu

On 18 March 2017 at 12:31, Chia-Ping Tsai  wrote:

> thank you for inviting me here!
>
> On 2017-03-18 06:30 (+0800), Anoop John  wrote:
> > On behalf of the Apache HBase PMC, I am pleased to announce that
> Chia-Ping Tsai
> > has accepted the PMC's invitation to become a committer on the project.
> We
> > appreciate all of his contributions thus far and look forward
> > to his continued involvement.
> >
> > Congratulation and welcome Chia-Ping Tsai!
> >
> > -Anoop-
> >
>

Re: [ANNOUNCE] New HBase committer Chia-Ping Tsai

[Jerry He]

Congrats and welcome, Chia-Ping!


Jerry

On Fri, Mar 17, 2017 at 9:31 PM, Chia-Ping Tsai  wrote:

> thank you for inviting me here!
>
> On 2017-03-18 06:30 (+0800), Anoop John  wrote:
> > On behalf of the Apache HBase PMC, I am pleased to announce that
> Chia-Ping Tsai
> > has accepted the PMC's invitation to become a committer on the project.
> We
> > appreciate all of his contributions thus far and look forward
> > to his continued involvement.
> >
> > Congratulation and welcome Chia-Ping Tsai!
> >
> > -Anoop-
> >
>

Re: [ANNOUNCE] New HBase committer Chia-Ping Tsai

[Chia-Ping Tsai]

thank you for inviting me here!

On 2017-03-18 06:30 (+0800), Anoop John  wrote: 
> On behalf of the Apache HBase PMC, I am pleased to announce that Chia-Ping 
> Tsai
> has accepted the PMC's invitation to become a committer on the project. We
> appreciate all of his contributions thus far and look forward
> to his continued involvement.
> 
> Congratulation and welcome Chia-Ping Tsai!
> 
> -Anoop-
> 

[jira] [Created] (HBASE-17803) PE always re-creates table when we specify the split policy

[Chia-Ping Tsai (JIRA)]

Chia-Ping Tsai created HBASE-17803:
--

 Summary: PE always re-creates table when we specify the split 
policy
 Key: HBASE-17803
 URL: https://issues.apache.org/jira/browse/HBASE-17803
 Project: HBase
  Issue Type: Bug
Affects Versions: 2.0.0, 1.4.0
Reporter: Chia-Ping Tsai
Assignee: Chia-Ping Tsai
Priority: Minor
 Fix For: 2.0.0, 1.4.0


I find this bug when i run the tests for HBASE-17623
The critical code is shown below.

{noformat}
if ((exists && opts.presplitRegions != DEFAULT_OPTS.presplitRegions)
  || (!isReadCmd && desc != null && desc.getRegionSplitPolicyClassName() != 
opts.splitPolicy)
  || (!isReadCmd && desc != null && desc.getRegionReplication() != 
opts.replicas)) {
{noformat}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Resolved] (HBASE-17754) [C++] RawAsyncTable

[Enis Soztutar (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HBASE-17754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Enis Soztutar resolved HBASE-17754.
---
   Resolution: Fixed
 Hadoop Flags: Reviewed
Fix Version/s: HBASE-14850

Pushed to branch. 

> [C++] RawAsyncTable
> ---
>
> Key: HBASE-17754
> URL: https://issues.apache.org/jira/browse/HBASE-17754
> Project: HBase
>  Issue Type: Sub-task
>Reporter: Enis Soztutar
>Assignee: Enis Soztutar
> Fix For: HBASE-14850
>
> Attachments: hbase-17754_v0.patch, hbase-17754_v1.patch, 
> hbase-17754-v2.patch, hbase-17754-v3.patch, hbase-17754-v4.patch
>
>
> We need RawAsyncTable to connect {{table.h}} to the async retrying callers. 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Re: ANNOUNCE: Good news!!!! Two new PMC and a new Committer!

[Yi Liang]

Congratulations,  Jerry and Josh Elser

Best,
Yi

On Fri, Mar 17, 2017 at 4:10 PM, Mikhail Antonov  wrote:

> Congratulations and welcome!!
>
> -Mikhail
>
> On Fri, Mar 17, 2017 at 2:07 PM, Enis Söztutar  wrote:
>
> > Congrats, and warm welcome.
> >
> > Enis
> >
> > On Fri, Mar 17, 2017 at 1:23 PM, Stephen Jiang 
> > wrote:
> >
> > > Congratulations! Looking forward to working with all 3 of you and make
> > > HBase better!
> > >
> > > -Stephen
> > >
> > > On Fri, Mar 17, 2017 at 12:51 PM, Anoop John 
> > > wrote:
> > >
> > > > Congrats all..Well deserving...
> > > >
> > > > -Anoop-
> > > >
> > > > On Sat, Mar 18, 2017 at 12:04 AM, Umesh Agashe  >
> > > > wrote:
> > > > > Congratulations to all of you!
> > > > >
> > > > > Umesh
> > > > >
> > > > >
> > > > > On Fri, Mar 17, 2017 at 9:55 AM, Esteban Gutierrez <
> > > este...@cloudera.com
> > > > >
> > > > > wrote:
> > > > >
> > > > >> Amazing! Congratulations to all of you guys!
> > > > >>
> > > > >> esteban.
> > > > >>
> > > > >> --
> > > > >> Cloudera, Inc.
> > > > >>
> > > > >>
> > > > >> On Fri, Mar 17, 2017 at 8:58 AM, Andrew Purtell <
> > > > andrew.purt...@gmail.com>
> > > > >> wrote:
> > > > >>
> > > > >> > Congratulations and welcome, all!
> > > > >> >
> > > > >> > > On Mar 17, 2017, at 6:04 AM, Jonathan Hsieh  >
> > > > wrote:
> > > > >> > >
> > > > >> > > Yay!
> > > > >> > >
> > > > >> > >> On Thu, Mar 16, 2017 at 10:37 PM, Stack 
> > > wrote:
> > > > >> > >>
> > > > >> > >> Josh Elser and Jing Chen (Jerry) have both been added to the
> > > HBase
> > > > >> PMC.
> > > > >> > >> These lads have been stellar helping the project along; Jerry
> > > for a
> > > > >> good
> > > > >> > >> few years now and Josh, though less time served, has made up
> > for
> > > > the
> > > > >> > lack
> > > > >> > >> with style. It makes sense that they be made PMCers!
> > > > >> > >>
> > > > >> > >> Let me take this opportunity while I have your attention to
> > also
> > > > >> welcome
> > > > >> > >> Eshcar Hillel as a Committer on Apache HBase. We are very
> glad
> > to
> > > > have
> > > > >> > her
> > > > >> > >> on-board. She's a brainbox who has been working on the
> inmemory
> > > > >> > compaction
> > > > >> > >> project among other things and is without fear when it comes
> to
> > > > >> taking a
> > > > >> > >> deep dive into crud!
> > > > >> > >>
> > > > >> > >> Welcome aboard Josh, Jing Chen He, and Eshcar!
> > > > >> > >>
> > > > >> > >> St.Ack
> > > > >> > >>
> > > > >> > >
> > > > >> > >
> > > > >> > >
> > > > >> > > --
> > > > >> > > // Jonathan Hsieh (shay)
> > > > >> > > // HBase Tech Lead, Software Engineer, Cloudera
> > > > >> > > // j...@cloudera.com // @jmhsieh
> > > > >> >
> > > > >>
> > > >
> > >
> >
>

Re: About adding methods to an interface which is part of our public API in minor release

[Stack]

I added a proposed wording for refguide in client binary compat section in
refguide [1]

Issue is HBASE-17802.  +1 if you good w/ it (or improvements also welcome).

Thanks,
St.Ack

1.
https://issues.apache.org/jira/secure/attachment/12859376/HBASE-17802.master.001.patch


On Thu, Mar 16, 2017 at 10:32 PM, Yu Li  wrote:

> +1 on allow adding methods to interfaces in minor release, especially
> before 2.0 is out, I don't think a minor release is that "minor" (smile).
>
> Regarding refguide, shall we also remind user to check the "incompatible"
> changes in release note before upgrading for minor version?
>
> Best Regards,
> Yu
>
> On 17 March 2017 at 08:50, Andrew Purtell  wrote:
>
> > This sounds like a good result to me.
> > We've sometimes provided BaseXXX implementations of interfaces for Java
> <=
> > 7 but haven't been consistent. Would be good to do better.
> >
> > On Thu, Mar 16, 2017 at 2:18 PM, Stack  wrote:
> >
> > > On Thu, Mar 16, 2017 at 11:02 AM, Josh Elser 
> wrote:
> > >
> > > > +1 to the JDK8 default implementation approach. I'd say this would be
> > > good
> > > > to push forward for the future.
> > > >
> > > > For 1.x, I see no reason why we couldn't provide concrete
> > implementations
> > > > as a stop-gap. Identifying and creating those classes is probably the
> > > > biggest barrier :). I don't think anything really stops us from doing
> > > this
> > > > now...
> > > >
> > > >
> > > I can change the wording to say we will make a best effort at
> providing a
> > > default implementation but allow that it may not be always possible.
> > >
> > > St.Ack
> > >
> > >
> > >
> > >
> > > >
> > > > James Taylor wrote:
> > > >
> > > >> How about the idea of HBase having base implementations for common
> > > >> interfaces? That would often help applications built on top of HBase
> > to
> > > >> maintain backward compatibility from release to release.
> > > >>
> > > >> On Wed, Mar 15, 2017 at 10:38 PM Stack  wrote:
> > > >>
> > > >> On Wed, Mar 15, 2017 at 10:28 PM, Duo Zhang
> > > wrote:
> > > >>>
> > > >>> There are some comments in https://issues.apache.org/
> > >  jira/browse/HBASE-17584
> > >  .
> > > 
> > >  In HBASE-17584, we want to remove Scan.getScanMetrics and move the
> > >  method
> > >  to ResultScanner  which is an interface and part of our public
> API.
> > > 
> > >  In our refguide, it is clear that we can do this for a major
> > release.
> > >  And for patch release, it is also clear that we are not allowed to
> > do
> > > 
> > > >>> this.
> > > >>>
> > >  New APIs introduced in a patch version will only be added in a
> > source
> > >  compatible way [1 >]:
> > > i.e.
> > >  code that implements public APIs will continue to compile.
> > > 
> > > 
> > >  But for minor release, it is a liitle inexplicit.
> > > 
> > >  A minor upgrade requires no application/client code modification.
> > >  Ideally
> > >  it would be a drop-in replacement but client code, coprocessors,
> > >  filters,
> > >  etc might have to be recompiled if new jars are used.
> > > 
> > >  If no client code modification is required, then we are not
> allowed
> > to
> > > 
> > > >>> add
> > > >>>
> > >  methods to interface as it will cause compliation error if user
> > > extends
> > > 
> > > >>> the
> > > >>>
> > >  interface as on branch-1, we still need to support JDK7 which does
> > not
> > >  support default method. But I think this will make minor release
> > > almost
> > > 
> > > >>> the
> > > >>>
> > >  same with patch release? And another point is that, for most
> users,
> > > they
> > >  only use the interface and do not implement it, so adding methods
> > will
> > > 
> > > >>> not
> > > >>>
> > >  break their code.
> > > 
> > >  So here we want to see what the community think of whether we
> should
> > > 
> > > >>> allow
> > > >>>
> > >  adding methods to interface in minor release. Any comments are
> > > welcomed.
> > > 
> > > 
> > >  I'd suggest we add to the refguide a clarification that allows
> > > addition
> > > >>> of
> > > >>> new methods to Interfaces in minor releases. Here is a suggested
> > > >>> addition:
> > > >>>
> > > >>> "For a minor release, IF YOU HAVE IMPLEMENTED AN INTERFACE, you may
> > > have
> > > >>> to
> > > >>> recompile. We reserve the right to add new methods to existing
> > > Interfaces
> > > >>> on minor updates (this will be less of an issue in hbase-2.0.0
> which
> > > >>> requires JDK8; JDK8 allows specification of 'default'
> implementations
> > > of
> > > >>> Interface methods)"
> > > >>>
> > > >>> I could add a further qualifier only applies to hbase-1.4.0 and
> > beyond?
> > > >>>
> > > >>> St.Ack
> > > >>>
> > > >>>
> > > >>>
> > > >>> Thanks.

Re: [ANNOUNCE] New HBase committer Chia-Ping Tsai

[Andrew Purtell]

Congratulations and welcome, Chia-Ping!

On Fri, Mar 17, 2017 at 3:30 PM, Anoop John  wrote:

> On behalf of the Apache HBase PMC, I am pleased to announce that Chia-Ping
> Tsai
> has accepted the PMC's invitation to become a committer on the project. We
> appreciate all of his contributions thus far and look forward
> to his continued involvement.
>
> Congratulation and welcome Chia-Ping Tsai!
>
> -Anoop-
>



-- 
Best regards,

   - Andy

If you are given a choice, you believe you have acted freely. - Raymond
Teller (via Peter Watts)

[jira] [Created] (HBASE-17802) Add note that minor versions can add methods to Interfaces

[stack (JIRA)]

stack created HBASE-17802:
-

 Summary: Add note that minor versions can add methods to Interfaces
 Key: HBASE-17802
 URL: https://issues.apache.org/jira/browse/HBASE-17802
 Project: HBase
  Issue Type: Task
  Components: documentation
Reporter: stack
Assignee: stack


Clarify that adding methods to Interfaces in minor releases is allowed and that 
we'll always try to do it in a backward compatible way.

Here is discussion from the list:

http://search-hadoop.com/m/HBase/YGbbQfpjp1kozD7?subj=About+adding+methods+to+an+interface+which+is+part+of+our+public+API+in+minor+release



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Re: [ANNOUNCE] New HBase committer Chia-Ping Tsai

[Ted Yu]

Congratulations !

On Fri, Mar 17, 2017 at 3:30 PM, Anoop John  wrote:

> On behalf of the Apache HBase PMC, I am pleased to announce that Chia-Ping
> Tsai
> has accepted the PMC's invitation to become a committer on the project. We
> appreciate all of his contributions thus far and look forward
> to his continued involvement.
>
> Congratulation and welcome Chia-Ping Tsai!
>
> -Anoop-
>

Re: [ANNOUNCE] New HBase committer Chia-Ping Tsai

[Stack]

Welcome aboard Chia-Ping Tsai!
St.Ack

On Fri, Mar 17, 2017 at 3:30 PM, Anoop John  wrote:

> On behalf of the Apache HBase PMC, I am pleased to announce that Chia-Ping
> Tsai
> has accepted the PMC's invitation to become a committer on the project. We
> appreciate all of his contributions thus far and look forward
> to his continued involvement.
>
> Congratulation and welcome Chia-Ping Tsai!
>
> -Anoop-
>

[ANNOUNCE] New HBase committer Chia-Ping Tsai

[Anoop John]

On behalf of the Apache HBase PMC, I am pleased to announce that Chia-Ping Tsai
has accepted the PMC's invitation to become a committer on the project. We
appreciate all of his contributions thus far and look forward
to his continued involvement.

Congratulation and welcome Chia-Ping Tsai!

-Anoop-

Re: ANNOUNCE: Good news!!!! Two new PMC and a new Committer!

[Mikhail Antonov]

Congratulations and welcome!!

-Mikhail

On Fri, Mar 17, 2017 at 2:07 PM, Enis Söztutar  wrote:

> Congrats, and warm welcome.
>
> Enis
>
> On Fri, Mar 17, 2017 at 1:23 PM, Stephen Jiang 
> wrote:
>
> > Congratulations! Looking forward to working with all 3 of you and make
> > HBase better!
> >
> > -Stephen
> >
> > On Fri, Mar 17, 2017 at 12:51 PM, Anoop John 
> > wrote:
> >
> > > Congrats all..Well deserving...
> > >
> > > -Anoop-
> > >
> > > On Sat, Mar 18, 2017 at 12:04 AM, Umesh Agashe 
> > > wrote:
> > > > Congratulations to all of you!
> > > >
> > > > Umesh
> > > >
> > > >
> > > > On Fri, Mar 17, 2017 at 9:55 AM, Esteban Gutierrez <
> > este...@cloudera.com
> > > >
> > > > wrote:
> > > >
> > > >> Amazing! Congratulations to all of you guys!
> > > >>
> > > >> esteban.
> > > >>
> > > >> --
> > > >> Cloudera, Inc.
> > > >>
> > > >>
> > > >> On Fri, Mar 17, 2017 at 8:58 AM, Andrew Purtell <
> > > andrew.purt...@gmail.com>
> > > >> wrote:
> > > >>
> > > >> > Congratulations and welcome, all!
> > > >> >
> > > >> > > On Mar 17, 2017, at 6:04 AM, Jonathan Hsieh 
> > > wrote:
> > > >> > >
> > > >> > > Yay!
> > > >> > >
> > > >> > >> On Thu, Mar 16, 2017 at 10:37 PM, Stack 
> > wrote:
> > > >> > >>
> > > >> > >> Josh Elser and Jing Chen (Jerry) have both been added to the
> > HBase
> > > >> PMC.
> > > >> > >> These lads have been stellar helping the project along; Jerry
> > for a
> > > >> good
> > > >> > >> few years now and Josh, though less time served, has made up
> for
> > > the
> > > >> > lack
> > > >> > >> with style. It makes sense that they be made PMCers!
> > > >> > >>
> > > >> > >> Let me take this opportunity while I have your attention to
> also
> > > >> welcome
> > > >> > >> Eshcar Hillel as a Committer on Apache HBase. We are very glad
> to
> > > have
> > > >> > her
> > > >> > >> on-board. She's a brainbox who has been working on the inmemory
> > > >> > compaction
> > > >> > >> project among other things and is without fear when it comes to
> > > >> taking a
> > > >> > >> deep dive into crud!
> > > >> > >>
> > > >> > >> Welcome aboard Josh, Jing Chen He, and Eshcar!
> > > >> > >>
> > > >> > >> St.Ack
> > > >> > >>
> > > >> > >
> > > >> > >
> > > >> > >
> > > >> > > --
> > > >> > > // Jonathan Hsieh (shay)
> > > >> > > // HBase Tech Lead, Software Engineer, Cloudera
> > > >> > > // j...@cloudera.com // @jmhsieh
> > > >> >
> > > >>
> > >
> >
>

[jira] [Resolved] (HBASE-17758) [RSGROUP] Add shell command to move servers and tables at the same time

[Ted Yu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HBASE-17758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ted Yu resolved HBASE-17758.

Resolution: Fixed

> [RSGROUP] Add shell command to move servers and tables at the same time
> ---
>
> Key: HBASE-17758
> URL: https://issues.apache.org/jira/browse/HBASE-17758
> Project: HBase
>  Issue Type: New Feature
>  Components: rsgroup
>Affects Versions: 2.0.0
>Reporter: Guangxu Cheng
>Assignee: Guangxu Cheng
> Fix For: 2.0.0
>
> Attachments: HBASE-17758-v1.patch, HBASE-17758-v2.patch, 
> HBASE-17758-v3.patch, HBASE-17758-v4.patch, HBASE-17758-v5.patch
>
>
> Currently add a new group perform the following steps:
> {code:javascript}
> hbase(main):001:0> add_rsgroup 'mygroup'
> Took 0.3840 seconds
> hbase(main):002:0> move_servers_rsgroup 
> 'mygroup',['hbase-rs-01:16030','hbase-rs-02:16030']
> Took 3.5040 seconds
> hbase(main):003:0> move_tables_rsgroup 'mygroup',['example']
> Took 0.2710 seconds
> {code}
> 1. move_servers_rsgroup will unassign all regions on hbase-rs-01 and 
> hbase-rs-02
> 2. move_tables_rsgroup will also reassign all the regions of the table 
> example.
> This will lead to a large number of regions to migrate and affect the data 
> locality.
> However, some regions of the table that are distributed on hbase-rs-01 and 
> hbase-rs-02, do not need to be moved.
> So,we need a new shell command *move_servers_tables_rsgroup* which minimizes 
> the number of regions needed to move.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Re: ANNOUNCE: Good news!!!! Two new PMC and a new Committer!

[Enis Söztutar]

Congrats, and warm welcome.

Enis

On Fri, Mar 17, 2017 at 1:23 PM, Stephen Jiang 
wrote:

> Congratulations! Looking forward to working with all 3 of you and make
> HBase better!
>
> -Stephen
>
> On Fri, Mar 17, 2017 at 12:51 PM, Anoop John 
> wrote:
>
> > Congrats all..Well deserving...
> >
> > -Anoop-
> >
> > On Sat, Mar 18, 2017 at 12:04 AM, Umesh Agashe 
> > wrote:
> > > Congratulations to all of you!
> > >
> > > Umesh
> > >
> > >
> > > On Fri, Mar 17, 2017 at 9:55 AM, Esteban Gutierrez <
> este...@cloudera.com
> > >
> > > wrote:
> > >
> > >> Amazing! Congratulations to all of you guys!
> > >>
> > >> esteban.
> > >>
> > >> --
> > >> Cloudera, Inc.
> > >>
> > >>
> > >> On Fri, Mar 17, 2017 at 8:58 AM, Andrew Purtell <
> > andrew.purt...@gmail.com>
> > >> wrote:
> > >>
> > >> > Congratulations and welcome, all!
> > >> >
> > >> > > On Mar 17, 2017, at 6:04 AM, Jonathan Hsieh 
> > wrote:
> > >> > >
> > >> > > Yay!
> > >> > >
> > >> > >> On Thu, Mar 16, 2017 at 10:37 PM, Stack 
> wrote:
> > >> > >>
> > >> > >> Josh Elser and Jing Chen (Jerry) have both been added to the
> HBase
> > >> PMC.
> > >> > >> These lads have been stellar helping the project along; Jerry
> for a
> > >> good
> > >> > >> few years now and Josh, though less time served, has made up for
> > the
> > >> > lack
> > >> > >> with style. It makes sense that they be made PMCers!
> > >> > >>
> > >> > >> Let me take this opportunity while I have your attention to also
> > >> welcome
> > >> > >> Eshcar Hillel as a Committer on Apache HBase. We are very glad to
> > have
> > >> > her
> > >> > >> on-board. She's a brainbox who has been working on the inmemory
> > >> > compaction
> > >> > >> project among other things and is without fear when it comes to
> > >> taking a
> > >> > >> deep dive into crud!
> > >> > >>
> > >> > >> Welcome aboard Josh, Jing Chen He, and Eshcar!
> > >> > >>
> > >> > >> St.Ack
> > >> > >>
> > >> > >
> > >> > >
> > >> > >
> > >> > > --
> > >> > > // Jonathan Hsieh (shay)
> > >> > > // HBase Tech Lead, Software Engineer, Cloudera
> > >> > > // j...@cloudera.com // @jmhsieh
> > >> >
> > >>
> >
>

Re: ANNOUNCE: Good news!!!! Two new PMC and a new Committer!

[Stephen Jiang]

Congratulations! Looking forward to working with all 3 of you and make
HBase better!

-Stephen

On Fri, Mar 17, 2017 at 12:51 PM, Anoop John  wrote:

> Congrats all..Well deserving...
>
> -Anoop-
>
> On Sat, Mar 18, 2017 at 12:04 AM, Umesh Agashe 
> wrote:
> > Congratulations to all of you!
> >
> > Umesh
> >
> >
> > On Fri, Mar 17, 2017 at 9:55 AM, Esteban Gutierrez  >
> > wrote:
> >
> >> Amazing! Congratulations to all of you guys!
> >>
> >> esteban.
> >>
> >> --
> >> Cloudera, Inc.
> >>
> >>
> >> On Fri, Mar 17, 2017 at 8:58 AM, Andrew Purtell <
> andrew.purt...@gmail.com>
> >> wrote:
> >>
> >> > Congratulations and welcome, all!
> >> >
> >> > > On Mar 17, 2017, at 6:04 AM, Jonathan Hsieh 
> wrote:
> >> > >
> >> > > Yay!
> >> > >
> >> > >> On Thu, Mar 16, 2017 at 10:37 PM, Stack  wrote:
> >> > >>
> >> > >> Josh Elser and Jing Chen (Jerry) have both been added to the HBase
> >> PMC.
> >> > >> These lads have been stellar helping the project along; Jerry for a
> >> good
> >> > >> few years now and Josh, though less time served, has made up for
> the
> >> > lack
> >> > >> with style. It makes sense that they be made PMCers!
> >> > >>
> >> > >> Let me take this opportunity while I have your attention to also
> >> welcome
> >> > >> Eshcar Hillel as a Committer on Apache HBase. We are very glad to
> have
> >> > her
> >> > >> on-board. She's a brainbox who has been working on the inmemory
> >> > compaction
> >> > >> project among other things and is without fear when it comes to
> >> taking a
> >> > >> deep dive into crud!
> >> > >>
> >> > >> Welcome aboard Josh, Jing Chen He, and Eshcar!
> >> > >>
> >> > >> St.Ack
> >> > >>
> >> > >
> >> > >
> >> > >
> >> > > --
> >> > > // Jonathan Hsieh (shay)
> >> > > // HBase Tech Lead, Software Engineer, Cloudera
> >> > > // j...@cloudera.com // @jmhsieh
> >> >
> >>
>

Re: ANNOUNCE: Good news!!!! Two new PMC and a new Committer!

[Anoop John]

Congrats all..Well deserving...

-Anoop-

On Sat, Mar 18, 2017 at 12:04 AM, Umesh Agashe  wrote:
> Congratulations to all of you!
>
> Umesh
>
>
> On Fri, Mar 17, 2017 at 9:55 AM, Esteban Gutierrez 
> wrote:
>
>> Amazing! Congratulations to all of you guys!
>>
>> esteban.
>>
>> --
>> Cloudera, Inc.
>>
>>
>> On Fri, Mar 17, 2017 at 8:58 AM, Andrew Purtell 
>> wrote:
>>
>> > Congratulations and welcome, all!
>> >
>> > > On Mar 17, 2017, at 6:04 AM, Jonathan Hsieh  wrote:
>> > >
>> > > Yay!
>> > >
>> > >> On Thu, Mar 16, 2017 at 10:37 PM, Stack  wrote:
>> > >>
>> > >> Josh Elser and Jing Chen (Jerry) have both been added to the HBase
>> PMC.
>> > >> These lads have been stellar helping the project along; Jerry for a
>> good
>> > >> few years now and Josh, though less time served, has made up for the
>> > lack
>> > >> with style. It makes sense that they be made PMCers!
>> > >>
>> > >> Let me take this opportunity while I have your attention to also
>> welcome
>> > >> Eshcar Hillel as a Committer on Apache HBase. We are very glad to have
>> > her
>> > >> on-board. She's a brainbox who has been working on the inmemory
>> > compaction
>> > >> project among other things and is without fear when it comes to
>> taking a
>> > >> deep dive into crud!
>> > >>
>> > >> Welcome aboard Josh, Jing Chen He, and Eshcar!
>> > >>
>> > >> St.Ack
>> > >>
>> > >
>> > >
>> > >
>> > > --
>> > > // Jonathan Hsieh (shay)
>> > > // HBase Tech Lead, Software Engineer, Cloudera
>> > > // j...@cloudera.com // @jmhsieh
>> >
>>

[jira] [Created] (HBASE-17801) Assigning dead region causing FAILED_OPEN permanent RIT that needs manual resolve

[Stephen Yuan Jiang (JIRA)]

Stephen Yuan Jiang created HBASE-17801:
--

 Summary: Assigning dead region causing FAILED_OPEN permanent RIT 
that needs manual resolve 
 Key: HBASE-17801
 URL: https://issues.apache.org/jira/browse/HBASE-17801
 Project: HBase
  Issue Type: Bug
  Components: Region Assignment
Affects Versions: 1.1.2
Reporter: Stephen Yuan Jiang
Assignee: Stephen Yuan Jiang
Priority: Critical


In Apache 1.x, there is a Assignment Manager bug when SSH and drop table 
happens at the same time.  Here is the sequence:

(1). The Region Server hosting the target region is dead, SSH (server shutdown 
handler) offlined all regions hosted by the RS: 
{noformat}
2017-02-20 20:39:25,022 ERROR org.apache.hadoop.hbase.master.MasterRpcServices: 
Region server rs01.foo.com,60020,1486760911253 reported a fatal error:
ABORTING region server rs01.foo.com,60020,1486760911253: 
regionserver:60020-0x55a076071923f5f, 
quorum=zk01.foo.com:2181,zk02.foo.com:2181,zk3.foo.com:2181, baseZNode=/hbase 
regionserver:60020-0x1234567890abcdf received expired from ZooKeeper, aborting
Cause:
org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = 
Session expired
at 
org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.connectionEvent(ZooKeeperWatcher.java:613)
at 
org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.process(ZooKeeperWatcher.java:524)
at 
org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:534)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510)
2017-02-20 20:42:43,775 INFO 
org.apache.hadoop.hbase.master.handler.ServerShutdownHandler: Splitting logs 
for rs01.foo.com,60020,1486760911253 before assignment; region count=999
2017-02-20 20:43:31,784 INFO org.apache.hadoop.hbase.master.RegionStates: 
Transition {783a4814b862a6e23a3265a874c3048b state=OPEN, ts=1487568368296, 
server=rs01.foo.com,60020,1486760911253} to {783a4814b862a6e23a3265a874c3048b 
state=OFFLINE, ts=1487648611784, server=rs01.foo.com,60020,1486760911253}
{noformat}

(2). Now SSH goes through each region and check whether it should be 
re-assigned (at this time, SSH do check whether a table is disabled/deleted).  
If a region needs to be re-assigned, it would put into a list.  Since at this 
time, the troubled region is still on the table that is enabled, it will be in 
the list.

{noformat}
2017-02-20 20:43:31,795 INFO 
org.apache.hadoop.hbase.master.handler.ServerShutdownHandler: Reassigning 999 
region(s) that rs01.foo.com,60020,1486760911253 was carrying (and 0 regions(s) 
that were opening on this server)
{noformat}

(3). Now, disable and delete table come in and also try to offline the region; 
since the region is already offlined, the deleted table just removes the region 
from meta and in-memory.
{noformat}
2017-02-20 20:43:32,429 INFO org.apache.hadoop.hbase.master.HMaster: 
Client=b_kylin/null disable t1
2017-02-20 20:43:34,275 INFO 
org.apache.hadoop.hbase.zookeeper.ZKTableStateManager: Moving table t1 state 
from DISABLING to DISABLED
2017-02-20 20:43:34,276 INFO 
org.apache.hadoop.hbase.master.procedure.DisableTableProcedure: Disabled table, 
t1, is completed.
2017-02-20 20:43:35,624 INFO org.apache.hadoop.hbase.master.HMaster: 
Client=b_kylin/null delete t1
2017-02-20 20:43:36,011 INFO org.apache.hadoop.hbase.MetaTableAccessor: Deleted 
[{ENCODED => fbf9fda1381636aa5b3cd6e3fe0f6c1e, NAME => 
't1,,1487568367030.fbf9fda1381636aa5b3cd6e3fe0f6c1e.', STARTKEY => '', ENDKEY 
=> '\x00\x01'}, {ENCODED => 783a4814b862a6e23a3265a874c3048b, NAME => 
't1,\x00\x01,1487568367030.783a4814b862a6e23a3265a874c3048b.', STARTKEY => 
'\x00\x01', ENDKEY => ''}]
{noformat}

(4). However, SSH calls Assignment Manager to reassign the dead region (note 
that the dead region is in the re-assign list SSH collected and we don't 
re-check again)
{noformat}

2017-02-20 20:43:52,725 WARN org.apache.hadoop.hbase.master.AssignmentManager: 
Assigning but not in region states: {ENCODED => 
783a4814b862a6e23a3265a874c3048b, NAME => 
't1,\x00\x01,1487568367030.783a4814b862a6e23a3265a874c3048b.', STARTKEY => 
'\x00\x01', ENDKEY => ''}

{noformat}

(5).  In the region server that the dead region tries to land, because the 
table is dropped, we could not open region and now the dead region is in 
FAILED_OPEN, which is in permanent RIT state. 

{noformat}
2017-02-20 20:43:52,861 INFO 
org.apache.hadoop.hbase.regionserver.RSRpcServices: Open 
t1,\x00\x01,1487568367030.783a4814b862a6e23a3265a874c3048b.
2017-02-20 20:43:52,865 ERROR 
org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler: Failed open of 
region=t1,\x00\x01,1487568367030.783a4814b862a6e23a3265a874c3048b., starting to 
roll back the global memstore size.
java.lang.IllegalStateException: Could not instantiate a region instance.
at 

Re: [VOTE] Backup/Restore feature for HBase 2.0, vote closing 3/11/2017

[Vladimir Rodionov]

OK,

The VOTE is CLOSED successfully with 3 +1s (Enis, Ted, Josh) and the patch
will be committed to the master. All the remaining work will continue
against the master code.

Thanks, everyone

-Vlad

On Thu, Mar 16, 2017 at 10:13 PM, Stack  wrote:

> On Thu, Mar 16, 2017 at 10:01 AM, Vladimir Rodionov <
> vladrodio...@gmail.com>
> wrote:
>
> > v61 is against current master.
> >
> >
> It was what I thought. I got confused by the hijacker.
> St.Ack
>
>
>
> > On Thu, Mar 16, 2017 at 7:18 AM, Stack  wrote:
> >
> > > On Wed, Mar 15, 2017 at 11:38 PM, Vladimir Rodionov <
> > > vladrodio...@gmail.com>
> > > wrote:
> > >
> > > > >> I thought I was reviewing a patch that was against master
> > > >
> > > > Yes, it was against master. We used to develop in HBASE-7912 branch,
> > but
> > > it
> > > > was abandoned 6-8 mo ago.
> > > > This is why the only way to merge backup is to apply v61 directly to
> > > master
> > > > branch.
> > > >
> > > >
> > > If you are saying that v61 is against a master of 6-8 months ago, then
> > I'd
> > > think this VOTE is premature. Don't you have a mountain of rebasing to
> do
> > > before you can put your patch up for a vote?
> > >
> > > St.Ack
> > >
> > >
> > >
> > > > -Vlad
> > > >
> > > >
> > > > On Wed, Mar 15, 2017 at 9:17 PM, Stack  wrote:
> > > >
> > > > > On Wed, Mar 15, 2017 at 5:51 PM, Ted Yu 
> wrote:
> > > > >
> > > > > > Thanks for the vote, Josh.
> > > > > >
> > > > > > So far there have been 3 +1's (Enis', mine and Josh's)
> > > > > >
> > > > > > Should we start another thread on the procedure of merging or use
> > > this
> > > > > > thread ?
> > > > > > Background:
> > > > > > HBASE-7912 branch is way out of date.
> > > > > > Latest rounds of mega patch were based on then-current master
> > branch.
> > > > > >
> > > > > >
> > > > > 1. Vlad is running this VOTE, not you.
> > > > > 2. Don't you need 3 PMC votes to merge? I count 2.
> > > > > 3. You almost derailed the merge with your earlier interjection
> > rushing
> > > > to
> > > > > take us in the wrong direction; you'd think you'd learn from your
> > past
> > > > > experience but here you are again w/ haste and rash summary.
> > > > > 4. This vote has been awkward. Josh's note is considered and
> careful.
> > > > You'd
> > > > > think it could hang out there a while to see if draws a response
> > rather
> > > > > than rush to close.
> > > > >
> > > > > I thought I was reviewing a patch that was against master, not some
> > > > version
> > > > > of master from eons ago. Thats a problem. When was the last rebase?
> > > > >
> > > > > St.Ack
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > > Thanks
> > > > > >
> > > > > > On Wed, Mar 15, 2017 at 4:22 PM, Josh Elser 
> > > wrote:
> > > > > >
> > > > > > > Spent the day playing around with this on 6 nodes.
> > > > > > >
> > > > > > > I've found some rough edges: some known (the docs blocker Vlad
> > > > pointed
> > > > > > > out) and some that I think are unknown (tooling is rough --
> > > partially
> > > > > > from
> > > > > > > wrong help messages and, I think, changes in design like
> > > > > Master-submitted
> > > > > > > MR jobs).
> > > > > > >
> > > > > > > But, Stack's assessment (and Andrew's reminder) that further
> > > tweaking
> > > > > > > would just throw us back into another review cycle is a real
> > > concern.
> > > > > > It's
> > > > > > > unfortunate that this feature has lingered so long aside of
> > master
> > > to
> > > > > get
> > > > > > > to this point, but I don't see any realistic resolution to this
> > > > problem
> > > > > > > than a merge. In the future, this is something we'll have to
> try
> > > > harder
> > > > > > to
> > > > > > > avoid letting happen (looking in the mirror with quota work...)
> > > > > > >
> > > > > > > Thankfully, I can help out with development/review on the
> > > outstanding
> > > > > > > blockers (notably, the two I pruned from Vlad's original of
> five
> > --
> > > > the
> > > > > > > other three still seem to be improvements). In addition to
> these
> > > > > > blockers,
> > > > > > > I believe the documentation *must* be updated before a release
> to
> > > > note
> > > > > > that
> > > > > > > this feature is still growing -- it does not feel like a
> quality
> > > > > feature
> > > > > > > that I've come to expect from this community. This isn't a
> knock
> > on
> > > > > Vlad
> > > > > > > and company; this is a hard problem and one that I could not
> have
> > > > done
> > > > > > > better given time constraints, but it is also one that users
> will
> > > > > demand
> > > > > > > simplicity and the utmost correctness around. To this end, I
> will
> > > > also
> > > > > > try
> > > > > > > to help out to smooth out these issues in the following 2.x
> > > release.
> > > > > > >
> > > > > > > So, this leaves me to say: +1 to merge with the caveat that the
> > > docs
> > > > > are
> > > > > > > updated to make 

Re: ANNOUNCE: Good news!!!! Two new PMC and a new Committer!

[Umesh Agashe]

Congratulations to all of you!

Umesh


On Fri, Mar 17, 2017 at 9:55 AM, Esteban Gutierrez 
wrote:

> Amazing! Congratulations to all of you guys!
>
> esteban.
>
> --
> Cloudera, Inc.
>
>
> On Fri, Mar 17, 2017 at 8:58 AM, Andrew Purtell 
> wrote:
>
> > Congratulations and welcome, all!
> >
> > > On Mar 17, 2017, at 6:04 AM, Jonathan Hsieh  wrote:
> > >
> > > Yay!
> > >
> > >> On Thu, Mar 16, 2017 at 10:37 PM, Stack  wrote:
> > >>
> > >> Josh Elser and Jing Chen (Jerry) have both been added to the HBase
> PMC.
> > >> These lads have been stellar helping the project along; Jerry for a
> good
> > >> few years now and Josh, though less time served, has made up for the
> > lack
> > >> with style. It makes sense that they be made PMCers!
> > >>
> > >> Let me take this opportunity while I have your attention to also
> welcome
> > >> Eshcar Hillel as a Committer on Apache HBase. We are very glad to have
> > her
> > >> on-board. She's a brainbox who has been working on the inmemory
> > compaction
> > >> project among other things and is without fear when it comes to
> taking a
> > >> deep dive into crud!
> > >>
> > >> Welcome aboard Josh, Jing Chen He, and Eshcar!
> > >>
> > >> St.Ack
> > >>
> > >
> > >
> > >
> > > --
> > > // Jonathan Hsieh (shay)
> > > // HBase Tech Lead, Software Engineer, Cloudera
> > > // j...@cloudera.com // @jmhsieh
> >
>

[jira] [Created] (HBASE-17800) [C++] handle exceptions in client RPC

[Xiaobing Zhou (JIRA)]

Xiaobing Zhou created HBASE-17800:
-

 Summary: [C++] handle exceptions in client RPC
 Key: HBASE-17800
 URL: https://issues.apache.org/jira/browse/HBASE-17800
 Project: HBase
  Issue Type: Sub-task
Reporter: Xiaobing Zhou
Assignee: Xiaobing Zhou


Exceptions are ignored in current client RPC. They should be handled properly 
to be consumed by RPC retry or propagated up to APIs.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Created] (HBASE-17799) HBCK region boundaries check can return false negatives when IOExceptions are thrown

[Esteban Gutierrez (JIRA)]

Esteban Gutierrez created HBASE-17799:
-

 Summary: HBCK region boundaries check can return false negatives 
when IOExceptions are thrown
 Key: HBASE-17799
 URL: https://issues.apache.org/jira/browse/HBASE-17799
 Project: HBase
  Issue Type: Bug
  Components: hbck
Affects Versions: 2.0.0, 1.4.0, 1.3.1, 1.2.5
Reporter: Esteban Gutierrez
Assignee: Esteban Gutierrez


When enabled, HBaseFsck#checkRegionBoundaries will crawl all HFiles across all 
namespaces and tables when {{-boundaries}} is specified. However if an 
IOException is thrown by accessing a corrupt HFile, an un-handled HLink or by 
any other reason, we will only log the exception and stop crawling the HFiles 
and potentially reporting the wrong result.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Re: FastDiffDeltaEncoder improvements

[Stack]

On Mon, Sep 12, 2016 at 12:46 AM, Дмитрий  wrote:

> Hi all,
>
> I would like to discuss available implementations of data block encoding
> in HBase and how we can improve them.
>

(Sorry, missed the first posting)

Killer w/ encoders/decoders is allocation of a block to encode/decode into.
If encoding/decoding could be inlined, that'd help loads.

Other possible improvements would be keeping the encoding as you traversed
hbase; i.e. keeping content encoded while in case; being able to merge sort
encoded blocks or pick a Cell out of an encoded block w/o first having to
undo it all.

Have you done any profiling of codecs to see where we are slow?


The most interesting for me is FastDiffDeltaEncoder because it encodes not
> only keys but also anothers fields
> like timestamp, type, keyLen, etc. Also it removes duplicated values and
> it is the most controversial feature
> as for me. Look at following image:
>
> [IMG]http://i68.tinypic.com/8z2wzn.png[/IMG]
>
>
The image does not work for me. Does it work for you?



> This is an example of small table with row keys: Row-1, Row-2, Row-3 and
> columns Column-A, Column-B, Column-C.
> DataBlockEncoder encodes cells ordered by keys. Each key consists of
> RowKey, Family and Qualifier. That's why
> we will encode cells in order which is displayed by blue line in the image.
>
> FastDiffDeltaEncoder calculates difference between two serial cells. In
> this way duplicated values in Column-A
> will not be removed. The only case when it works it is in single column
> tables.
>
> So, my suggestion is to detect duplicates in columns, not only in
> neighboring cells. Also I've heard an idea
> not just to remove duplicated values, but to calculate prefix difference
> between them, like for keys.
>
>
You've had a look at hbase-prefix-tree, an old contribution that
unfortunately has seen little use. It slowed writing significantly but made
for nice improvements at read time. There is some overlap between what you
are thinking and the work done there.


> To implement this we have to keep previous value for each column. The most
> efficient way in my opinion is to
> keep them in HashMap using ByteArrayWrapper for keys. Size of this map
> will be the same as count of unique
> columns in the encoding block.
>
>
So, what would you write out? Blocks that had this Map appended as metadata
or would this metadata be on the file itself?



> It looks very easy to implement this but I guess there must be some hidden
> obstacles, because this has not
> implemented yet.
>
> What do you think about the idea? Is there more efficient way (by
> CPU/Memory) to keep previous values?
> Should I try to implement prefix delta encoding for values?
>
>
Any improvements to be had encoding/decoding would be much appreciated.

You have a dataset you can play with? A profiling workbench?

Thank you for asking,
St.Ack





> -- реклама ---
> Огромный выбор и скидки на телевизоры на Palladium.ua!
> http://goo.gl/HBFW3x

Re: ANNOUNCE: Good news!!!! Two new PMC and a new Committer!

[Esteban Gutierrez]

Amazing! Congratulations to all of you guys!

esteban.

--
Cloudera, Inc.


On Fri, Mar 17, 2017 at 8:58 AM, Andrew Purtell 
wrote:

> Congratulations and welcome, all!
>
> > On Mar 17, 2017, at 6:04 AM, Jonathan Hsieh  wrote:
> >
> > Yay!
> >
> >> On Thu, Mar 16, 2017 at 10:37 PM, Stack  wrote:
> >>
> >> Josh Elser and Jing Chen (Jerry) have both been added to the HBase PMC.
> >> These lads have been stellar helping the project along; Jerry for a good
> >> few years now and Josh, though less time served, has made up for the
> lack
> >> with style. It makes sense that they be made PMCers!
> >>
> >> Let me take this opportunity while I have your attention to also welcome
> >> Eshcar Hillel as a Committer on Apache HBase. We are very glad to have
> her
> >> on-board. She's a brainbox who has been working on the inmemory
> compaction
> >> project among other things and is without fear when it comes to taking a
> >> deep dive into crud!
> >>
> >> Welcome aboard Josh, Jing Chen He, and Eshcar!
> >>
> >> St.Ack
> >>
> >
> >
> >
> > --
> > // Jonathan Hsieh (shay)
> > // HBase Tech Lead, Software Engineer, Cloudera
> > // j...@cloudera.com // @jmhsieh
>

Re: ANNOUNCE: Good news!!!! Two new PMC and a new Committer!

[Andrew Purtell]

Congratulations and welcome, all! 

> On Mar 17, 2017, at 6:04 AM, Jonathan Hsieh  wrote:
> 
> Yay!
> 
>> On Thu, Mar 16, 2017 at 10:37 PM, Stack  wrote:
>> 
>> Josh Elser and Jing Chen (Jerry) have both been added to the HBase PMC.
>> These lads have been stellar helping the project along; Jerry for a good
>> few years now and Josh, though less time served, has made up for the lack
>> with style. It makes sense that they be made PMCers!
>> 
>> Let me take this opportunity while I have your attention to also welcome
>> Eshcar Hillel as a Committer on Apache HBase. We are very glad to have her
>> on-board. She's a brainbox who has been working on the inmemory compaction
>> project among other things and is without fear when it comes to taking a
>> deep dive into crud!
>> 
>> Welcome aboard Josh, Jing Chen He, and Eshcar!
>> 
>> St.Ack
>> 
> 
> 
> 
> -- 
> // Jonathan Hsieh (shay)
> // HBase Tech Lead, Software Engineer, Cloudera
> // j...@cloudera.com // @jmhsieh

Successful: HBase Generate Website

[Apache Jenkins Server]

Build status: Successful

If successful, the website and docs have been generated. To update the live 
site, follow the instructions below. If failed, skip to the bottom of this 
email.

Use the following commands to download the patch and apply it to a clean branch 
based on origin/asf-site. If you prefer to keep the hbase-site repo around 
permanently, you can skip the clone step.

  git clone https://git-wip-us.apache.org/repos/asf/hbase-site.git

  cd hbase-site
  wget -O- 
https://builds.apache.org/job/hbase_generate_website/518/artifact/website.patch.zip
 | funzip > 0ed50f42e71599a86738643822e1ec4f2e432026.patch
  git fetch
  git checkout -b asf-site-0ed50f42e71599a86738643822e1ec4f2e432026 
origin/asf-site
  git am --whitespace=fix 0ed50f42e71599a86738643822e1ec4f2e432026.patch

At this point, you can preview the changes by opening index.html or any of the 
other HTML pages in your local 
asf-site-0ed50f42e71599a86738643822e1ec4f2e432026 branch.

There are lots of spurious changes, such as timestamps and CSS styles in 
tables, so a generic git diff is not very useful. To see a list of files that 
have been added, deleted, renamed, changed type, or are otherwise interesting, 
use the following command:

  git diff --name-status --diff-filter=ADCRTXUB origin/asf-site

To see only files that had 100 or more lines changed:

  git diff --stat origin/asf-site | grep -E '[1-9][0-9]{2,}'

When you are satisfied, publish your changes to origin/asf-site using these 
commands:

  git commit --allow-empty -m "Empty commit" # to work around a current ASF 
INFRA bug
  git push origin asf-site-0ed50f42e71599a86738643822e1ec4f2e432026:asf-site
  git checkout asf-site
  git branch -D asf-site-0ed50f42e71599a86738643822e1ec4f2e432026

Changes take a couple of minutes to be propagated. You can verify whether they 
have been propagated by looking at the Last Published date at the bottom of 
http://hbase.apache.org/. It should match the date in the index.html on the 
asf-site branch in Git.

As a courtesy- reply-all to this email to let other committers know you pushed 
the site.



If failed, see https://builds.apache.org/job/hbase_generate_website/518/console

Re: ANNOUNCE: Good news!!!! Two new PMC and a new Committer!

[Jonathan Hsieh]

Yay!

On Thu, Mar 16, 2017 at 10:37 PM, Stack  wrote:

> Josh Elser and Jing Chen (Jerry) have both been added to the HBase PMC.
> These lads have been stellar helping the project along; Jerry for a good
> few years now and Josh, though less time served, has made up for the lack
> with style. It makes sense that they be made PMCers!
>
> Let me take this opportunity while I have your attention to also welcome
> Eshcar Hillel as a Committer on Apache HBase. We are very glad to have her
> on-board. She's a brainbox who has been working on the inmemory compaction
> project among other things and is without fear when it comes to taking a
> deep dive into crud!
>
> Welcome aboard Josh, Jing Chen He, and Eshcar!
>
> St.Ack
>



-- 
// Jonathan Hsieh (shay)
// HBase Tech Lead, Software Engineer, Cloudera
// j...@cloudera.com // @jmhsieh

[jira] [Created] (HBASE-17798) RpcServer.Listener.Reader can abort due to CancelledKeyException

[Guangxu Cheng (JIRA)]

Guangxu Cheng created HBASE-17798:
-

 Summary: RpcServer.Listener.Reader can abort due to 
CancelledKeyException
 Key: HBASE-17798
 URL: https://issues.apache.org/jira/browse/HBASE-17798
 Project: HBase
  Issue Type: Bug
Affects Versions: 0.98.24, 1.2.4, 1.3.0, 2.0.0
Reporter: Guangxu Cheng


In our production cluster(0.98), some of the requests were unacceptable because 
RpcServer.Listener.Reader were aborted.
getReader() will return the next reader to deal with request.
The implementation of getReader() as below：
{code:title=RpcServer.java|borderStyle=solid}
// The method that will return the next reader to work with
// Simplistic implementation of round robin for now
Reader getReader() {
  currentReader = (currentReader + 1) % readers.length;
  return readers[currentReader];
}
{code}
If one of the readers abort, then it will lead to fall on the reader's request 
will never be dealt with.
Why does RpcServer.Listener.Reader abort?We add the debug log to get it.
After a while, we got the following exception:
{code}
2017-03-10 08:05:13,247 ERROR [RpcServer.reader=3,port=60020] ipc.RpcServer: 
RpcServer.listener,port=60020: unexpectedly error in Reader(Throwable)
java.nio.channels.CancelledKeyException
at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
at sun.nio.ch.SelectionKeyImpl.readyOps(SelectionKeyImpl.java:87)
at java.nio.channels.SelectionKey.isReadable(SelectionKey.java:289)
at 
org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:592)
at 
org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:566)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
{code}

So, when deal with the request in reader, we should handle CanceledKeyException.

--
versions 1.x and 2.0 will log and retrun when dealing with the 
InterruptedException in Reader#doRunLoop after HBASE-10521. It will lead to the 
same problem.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Re: ANNOUNCE: Good news!!!! Two new PMC and a new Committer!

[Jingcheng Du]

Congratulations to you all!

2017-03-17 17:02 GMT+08:00 Ted Yu :

> Congratulations!
>
> > On Mar 17, 2017, at 12:24 AM, Guanghao Zhang  wrote:
> >
> > Congratulations!
> >
> > 2017-03-17 14:49 GMT+08:00 ashish singhi :
> >
> >> Many congratulations, Josh, Jing Chen He and Eshcar !!!
> >>
> >> -Original Message-
> >> From: saint@gmail.com [mailto:saint@gmail.com] On Behalf Of
> Stack
> >> Sent: 17 March 2017 11:07
> >> To: HBase Dev List 
> >> Subject: ANNOUNCE: Good news Two new PMC and a new Committer!
> >>
> >> Josh Elser and Jing Chen (Jerry) have both been added to the HBase PMC.
> >> These lads have been stellar helping the project along; Jerry for a good
> >> few years now and Josh, though less time served, has made up for the
> lack
> >> with style. It makes sense that they be made PMCers!
> >>
> >> Let me take this opportunity while I have your attention to also welcome
> >> Eshcar Hillel as a Committer on Apache HBase. We are very glad to have
> her
> >> on-board. She's a brainbox who has been working on the inmemory
> compaction
> >> project among other things and is without fear when it comes to taking a
> >> deep dive into crud!
> >>
> >> Welcome aboard Josh, Jing Chen He, and Eshcar!
> >>
> >> St.Ack
> >>
>

[jira] [Reopened] (HBASE-17758) [RSGROUP] Add shell command to move servers and tables at the same time

[Chia-Ping Tsai (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HBASE-17758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Chia-Ping Tsai reopened HBASE-17758:


move_servers_tables_rsgroup.rb disappeared
[~apurtell] Would you please check it? Thanks.

> [RSGROUP] Add shell command to move servers and tables at the same time
> ---
>
> Key: HBASE-17758
> URL: https://issues.apache.org/jira/browse/HBASE-17758
> Project: HBase
>  Issue Type: New Feature
>  Components: rsgroup
>Affects Versions: 2.0.0
>Reporter: Guangxu Cheng
>Assignee: Guangxu Cheng
> Fix For: 2.0.0
>
> Attachments: HBASE-17758-v1.patch, HBASE-17758-v2.patch, 
> HBASE-17758-v3.patch, HBASE-17758-v4.patch, HBASE-17758-v5.patch
>
>
> Currently add a new group perform the following steps:
> {code:javascript}
> hbase(main):001:0> add_rsgroup 'mygroup'
> Took 0.3840 seconds
> hbase(main):002:0> move_servers_rsgroup 
> 'mygroup',['hbase-rs-01:16030','hbase-rs-02:16030']
> Took 3.5040 seconds
> hbase(main):003:0> move_tables_rsgroup 'mygroup',['example']
> Took 0.2710 seconds
> {code}
> 1. move_servers_rsgroup will unassign all regions on hbase-rs-01 and 
> hbase-rs-02
> 2. move_tables_rsgroup will also reassign all the regions of the table 
> example.
> This will lead to a large number of regions to migrate and affect the data 
> locality.
> However, some regions of the table that are distributed on hbase-rs-01 and 
> hbase-rs-02, do not need to be moved.
> So,we need a new shell command *move_servers_tables_rsgroup* which minimizes 
> the number of regions needed to move.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Re: ANNOUNCE: Good news!!!! Two new PMC and a new Committer!

[Phil Yang]

Congratulations!

Thanks,
Phil


2017-03-17 15:53 GMT+08:00 ramkrishna vasudevan <
ramkrishna.s.vasude...@gmail.com>:

> Congratulations to all of you!! Welcome on board !!!
>
> Regards
> Ram
>
> On Fri, Mar 17, 2017 at 1:00 PM, Yu Li  wrote:
>
> > Congratulations Josh, Jerry and Eshcar! Another female committer, bravo!!
> >
> > Best Regards,
> > Yu
> >
> > On 17 March 2017 at 15:24, Guanghao Zhang  wrote:
> >
> > > Congratulations!
> > >
> > > 2017-03-17 14:49 GMT+08:00 ashish singhi :
> > >
> > > > Many congratulations, Josh, Jing Chen He and Eshcar !!!
> > > >
> > > > -Original Message-
> > > > From: saint@gmail.com [mailto:saint@gmail.com] On Behalf Of
> > > Stack
> > > > Sent: 17 March 2017 11:07
> > > > To: HBase Dev List 
> > > > Subject: ANNOUNCE: Good news Two new PMC and a new Committer!
> > > >
> > > > Josh Elser and Jing Chen (Jerry) have both been added to the HBase
> PMC.
> > > > These lads have been stellar helping the project along; Jerry for a
> > good
> > > > few years now and Josh, though less time served, has made up for the
> > lack
> > > > with style. It makes sense that they be made PMCers!
> > > >
> > > > Let me take this opportunity while I have your attention to also
> > welcome
> > > > Eshcar Hillel as a Committer on Apache HBase. We are very glad to
> have
> > > her
> > > > on-board. She's a brainbox who has been working on the inmemory
> > > compaction
> > > > project among other things and is without fear when it comes to
> taking
> > a
> > > > deep dive into crud!
> > > >
> > > > Welcome aboard Josh, Jing Chen He, and Eshcar!
> > > >
> > > > St.Ack
> > > >
> > >
> >
>

Re: FastDiffDeltaEncoder improvements

[Dmitriy A.]

Any ideas?



-
Sincerely,
Dmitriy
--
View this message in context: 
http://apache-hbase.679495.n3.nabble.com/FastDiffDeltaEncoder-improvements-tp4082599p4086891.html
Sent from the HBase Developer mailing list archive at Nabble.com.

Re: ANNOUNCE: Good news!!!! Two new PMC and a new Committer!

[ramkrishna vasudevan]

Congratulations to all of you!! Welcome on board !!!

Regards
Ram

On Fri, Mar 17, 2017 at 1:00 PM, Yu Li  wrote:

> Congratulations Josh, Jerry and Eshcar! Another female committer, bravo!!
>
> Best Regards,
> Yu
>
> On 17 March 2017 at 15:24, Guanghao Zhang  wrote:
>
> > Congratulations!
> >
> > 2017-03-17 14:49 GMT+08:00 ashish singhi :
> >
> > > Many congratulations, Josh, Jing Chen He and Eshcar !!!
> > >
> > > -Original Message-
> > > From: saint@gmail.com [mailto:saint@gmail.com] On Behalf Of
> > Stack
> > > Sent: 17 March 2017 11:07
> > > To: HBase Dev List 
> > > Subject: ANNOUNCE: Good news Two new PMC and a new Committer!
> > >
> > > Josh Elser and Jing Chen (Jerry) have both been added to the HBase PMC.
> > > These lads have been stellar helping the project along; Jerry for a
> good
> > > few years now and Josh, though less time served, has made up for the
> lack
> > > with style. It makes sense that they be made PMCers!
> > >
> > > Let me take this opportunity while I have your attention to also
> welcome
> > > Eshcar Hillel as a Committer on Apache HBase. We are very glad to have
> > her
> > > on-board. She's a brainbox who has been working on the inmemory
> > compaction
> > > project among other things and is without fear when it comes to taking
> a
> > > deep dive into crud!
> > >
> > > Welcome aboard Josh, Jing Chen He, and Eshcar!
> > >
> > > St.Ack
> > >
> >
>

[jira] [Created] (HBASE-17796) Minor improvements on the javadoc and naming for rpc client implementation

[Duo Zhang (JIRA)]

Duo Zhang created HBASE-17796:
-

 Summary: Minor improvements on the javadoc and naming for rpc 
client implementation
 Key: HBASE-17796
 URL: https://issues.apache.org/jira/browse/HBASE-17796
 Project: HBase
  Issue Type: Improvement
Affects Versions: 2.0.0, 1.4.0
Reporter: Duo Zhang
 Fix For: 2.0.0, 1.4.0


Address the comments here

https://reviews.apache.org/r/57459/



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Re: ANNOUNCE: Good news!!!! Two new PMC and a new Committer!

[Duo Zhang]

Congratulations!

2017-03-17 13:37 GMT+08:00 Stack :

> Josh Elser and Jing Chen (Jerry) have both been added to the HBase PMC.
> These lads have been stellar helping the project along; Jerry for a good
> few years now and Josh, though less time served, has made up for the lack
> with style. It makes sense that they be made PMCers!
>
> Let me take this opportunity while I have your attention to also welcome
> Eshcar Hillel as a Committer on Apache HBase. We are very glad to have her
> on-board. She's a brainbox who has been working on the inmemory compaction
> project among other things and is without fear when it comes to taking a
> deep dive into crud!
>
> Welcome aboard Josh, Jing Chen He, and Eshcar!
>
> St.Ack
>

Re: ANNOUNCE: Good news!!!! Two new PMC and a new Committer!

[Yu Li]

Congratulations Josh, Jerry and Eshcar! Another female committer, bravo!!

Best Regards,
Yu

On 17 March 2017 at 15:24, Guanghao Zhang  wrote:

> Congratulations!
>
> 2017-03-17 14:49 GMT+08:00 ashish singhi :
>
> > Many congratulations, Josh, Jing Chen He and Eshcar !!!
> >
> > -Original Message-
> > From: saint@gmail.com [mailto:saint@gmail.com] On Behalf Of
> Stack
> > Sent: 17 March 2017 11:07
> > To: HBase Dev List 
> > Subject: ANNOUNCE: Good news Two new PMC and a new Committer!
> >
> > Josh Elser and Jing Chen (Jerry) have both been added to the HBase PMC.
> > These lads have been stellar helping the project along; Jerry for a good
> > few years now and Josh, though less time served, has made up for the lack
> > with style. It makes sense that they be made PMCers!
> >
> > Let me take this opportunity while I have your attention to also welcome
> > Eshcar Hillel as a Committer on Apache HBase. We are very glad to have
> her
> > on-board. She's a brainbox who has been working on the inmemory
> compaction
> > project among other things and is without fear when it comes to taking a
> > deep dive into crud!
> >
> > Welcome aboard Josh, Jing Chen He, and Eshcar!
> >
> > St.Ack
> >
>

Re: ANNOUNCE: Good news!!!! Two new PMC and a new Committer!

[Guanghao Zhang]

Congratulations!

2017-03-17 14:49 GMT+08:00 ashish singhi :

> Many congratulations, Josh, Jing Chen He and Eshcar !!!
>
> -Original Message-
> From: saint@gmail.com [mailto:saint@gmail.com] On Behalf Of Stack
> Sent: 17 March 2017 11:07
> To: HBase Dev List 
> Subject: ANNOUNCE: Good news Two new PMC and a new Committer!
>
> Josh Elser and Jing Chen (Jerry) have both been added to the HBase PMC.
> These lads have been stellar helping the project along; Jerry for a good
> few years now and Josh, though less time served, has made up for the lack
> with style. It makes sense that they be made PMCers!
>
> Let me take this opportunity while I have your attention to also welcome
> Eshcar Hillel as a Committer on Apache HBase. We are very glad to have her
> on-board. She's a brainbox who has been working on the inmemory compaction
> project among other things and is without fear when it comes to taking a
> deep dive into crud!
>
> Welcome aboard Josh, Jing Chen He, and Eshcar!
>
> St.Ack
>

RE: ANNOUNCE: Good news!!!! Two new PMC and a new Committer!

[ashish singhi]

Many congratulations, Josh, Jing Chen He and Eshcar !!!

-Original Message-
From: saint@gmail.com [mailto:saint@gmail.com] On Behalf Of Stack
Sent: 17 March 2017 11:07
To: HBase Dev List 
Subject: ANNOUNCE: Good news Two new PMC and a new Committer!

Josh Elser and Jing Chen (Jerry) have both been added to the HBase PMC.
These lads have been stellar helping the project along; Jerry for a good few 
years now and Josh, though less time served, has made up for the lack with 
style. It makes sense that they be made PMCers!

Let me take this opportunity while I have your attention to also welcome Eshcar 
Hillel as a Committer on Apache HBase. We are very glad to have her on-board. 
She's a brainbox who has been working on the inmemory compaction project among 
other things and is without fear when it comes to taking a deep dive into crud!

Welcome aboard Josh, Jing Chen He, and Eshcar!

St.Ack

[jira] [Created] (HBASE-17795) Async ReplicationEndpoint

[Phil Yang (JIRA)]

Phil Yang created HBASE-17795:
-

 Summary: Async ReplicationEndpoint
 Key: HBASE-17795
 URL: https://issues.apache.org/jira/browse/HBASE-17795
 Project: HBase
  Issue Type: Sub-task
  Components: Replication
Reporter: Phil Yang
Assignee: Phil Yang
 Fix For: 2.0.0


We need change ReplicationEndpoint to async so we can push same entries to 
different peers at a same time.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

ANNOUNCE: Good news!!!! Two new PMC and a new Committer!

[Stack]

Josh Elser and Jing Chen (Jerry) have both been added to the HBase PMC.
These lads have been stellar helping the project along; Jerry for a good
few years now and Josh, though less time served, has made up for the lack
with style. It makes sense that they be made PMCers!

Let me take this opportunity while I have your attention to also welcome
Eshcar Hillel as a Committer on Apache HBase. We are very glad to have her
on-board. She's a brainbox who has been working on the inmemory compaction
project among other things and is without fear when it comes to taking a
deep dive into crud!

Welcome aboard Josh, Jing Chen He, and Eshcar!

St.Ack