RE: [ANNOUNCE] Please welcome Francis Liu to the HBase PMC

[Pankaj kr]

Congratulations Francis..!! 


Regards,
Pankaj

-Original Message-
From: Andrew Purtell [mailto:apurt...@apache.org] 
Sent: Thursday, April 12, 2018 4:04 AM
To: dev
Subject: [ANNOUNCE] Please welcome Francis Liu to the HBase PMC

On behalf of the Apache HBase PMC I am pleased to announce that Francis Liu has 
accepted our invitation to become a PMC member on the Apache HBase project. We 
appreciate Francis stepping up to take more responsibility in the HBase 
project. He has been an active contributor to HBase for many years and recently 
took over responsibilities as branch RM for branch-1.3.

Please join me in welcoming Francis to the HBase PMC!

--
Best regards,
Andrew

[jira] [Created] (HBASE-20393) Operational documents for synchromous replication.

[Zheng Hu (JIRA)]

Zheng Hu created HBASE-20393:


 Summary: Operational documents for synchromous replication. 
 Key: HBASE-20393
 URL: https://issues.apache.org/jira/browse/HBASE-20393
 Project: HBase
  Issue Type: Sub-task
Reporter: Zheng Hu
Assignee: Zheng Hu






--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Re: [ANNOUNCE] Please welcome Francis Liu to the HBase PMC

[OpenInx]

Congratulations Francis!

On Thu, Apr 12, 2018 at 9:31 AM, Guanghao Zhang  wrote:

> Congratulations!
>
> 2018-04-12 5:49 GMT+08:00 Sean Busbey :
>
> > Congrats Francis!
> >
> > On Wed, Apr 11, 2018 at 3:03 PM, Andrew Purtell 
> > wrote:
> > > On behalf of the Apache HBase PMC I am pleased to announce that Francis
> > > Liu has accepted our invitation to become a PMC member on the Apache
> > > HBase project. We appreciate Francis stepping up to take more
> > > responsibility in the HBase project. He has been an active contributor
> to
> > > HBase for many years and recently took over responsibilities as branch
> RM
> > > for branch-1.3.
> > >
> > > Please join me in welcoming Francis to the HBase PMC!
> > >
> > > --
> > > Best regards,
> > > Andrew
> >
>



-- 
==
Openinx  blog : http://openinx.github.io

TO BE A GREAT HACKER !
==

Re: [ANNOUNCE] Please welcome Francis Liu to the HBase PMC

[Guanghao Zhang]

Congratulations!

2018-04-12 5:49 GMT+08:00 Sean Busbey :

> Congrats Francis!
>
> On Wed, Apr 11, 2018 at 3:03 PM, Andrew Purtell 
> wrote:
> > On behalf of the Apache HBase PMC I am pleased to announce that Francis
> > Liu has accepted our invitation to become a PMC member on the Apache
> > HBase project. We appreciate Francis stepping up to take more
> > responsibility in the HBase project. He has been an active contributor to
> > HBase for many years and recently took over responsibilities as branch RM
> > for branch-1.3.
> >
> > Please join me in welcoming Francis to the HBase PMC!
> >
> > --
> > Best regards,
> > Andrew
>

[jira] [Created] (HBASE-20392) Automated Installation of HBase (and Hadoop) on a distributed cluster environment

[Sakthi (JIRA)]

Sakthi created HBASE-20392:
--

 Summary: Automated Installation of HBase (and Hadoop) on a 
distributed cluster environment
 Key: HBASE-20392
 URL: https://issues.apache.org/jira/browse/HBASE-20392
 Project: HBase
  Issue Type: Task
  Components: hbase
Reporter: Sakthi
Assignee: Sakthi


The process of HBase (and Hadoop) installation on a distributed cluster could 
be automated to enable the deployment with lesser manual labor.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Re: [ANNOUNCE] Please welcome Francis Liu to the HBase PMC

[Sean Busbey]

Congrats Francis!

On Wed, Apr 11, 2018 at 3:03 PM, Andrew Purtell  wrote:
> On behalf of the Apache HBase PMC I am pleased to announce that Francis
> Liu has accepted our invitation to become a PMC member on the Apache
> HBase project. We appreciate Francis stepping up to take more
> responsibility in the HBase project. He has been an active contributor to
> HBase for many years and recently took over responsibilities as branch RM
> for branch-1.3.
>
> Please join me in welcoming Francis to the HBase PMC!
>
> --
> Best regards,
> Andrew

[jira] [Created] (HBASE-20391) close out stale or finished PRs on github

[Sean Busbey (JIRA)]

Sean Busbey created HBASE-20391:
---

 Summary: close out stale or finished PRs on github
 Key: HBASE-20391
 URL: https://issues.apache.org/jira/browse/HBASE-20391
 Project: HBase
  Issue Type: Task
  Components: community
Reporter: Sean Busbey
Assignee: Sean Busbey


Time to do another round of closing PRs via empty commit.

* [#51|https://github.com/apache/hbase/pull/51] - > 1 month since notification
* [#52|https://github.com/apache/hbase/pull/52] - > 1 month since notification
* [#61|https://github.com/apache/hbase/pull/61] - HBASE-18928 has already closed
* [#62|https://github.com/apache/hbase/pull/62] - HBASE-18929 has already closed
* [#64|https://github.com/apache/hbase/pull/64] -HBASE-18901 has already closed
* [#67|https://github.com/apache/hbase/pull/67] - HBASE-19386 has already closed
* [#68|https://github.com/apache/hbase/pull/68] - HBASE-19387 has already closed





--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Re: [ANNOUNCE] Please welcome Francis Liu to the HBase PMC

[Gary Helmling]

Congrats and welcome, Francis!

On Wed, Apr 11, 2018 at 1:13 PM Ted Yu  wrote:

> Congratulations, Francis !
>
> On Wed, Apr 11, 2018 at 1:03 PM, Andrew Purtell 
> wrote:
>
> > On behalf of the Apache HBase PMC I am pleased to announce that Francis
> > Liu has accepted our invitation to become a PMC member on the Apache
> > HBase project. We appreciate Francis stepping up to take more
> > responsibility in the HBase project. He has been an active contributor to
> > HBase for many years and recently took over responsibilities as branch RM
> > for branch-1.3.
> >
> > Please join me in welcoming Francis to the HBase PMC!
> >
> > --
> > Best regards,
> > Andrew
> >
>

Re: [ANNOUNCE] Please welcome Francis Liu to the HBase PMC

[Ted Yu]

Congratulations, Francis !

On Wed, Apr 11, 2018 at 1:03 PM, Andrew Purtell  wrote:

> On behalf of the Apache HBase PMC I am pleased to announce that Francis
> Liu has accepted our invitation to become a PMC member on the Apache
> HBase project. We appreciate Francis stepping up to take more
> responsibility in the HBase project. He has been an active contributor to
> HBase for many years and recently took over responsibilities as branch RM
> for branch-1.3.
>
> Please join me in welcoming Francis to the HBase PMC!
>
> --
> Best regards,
> Andrew
>

[ANNOUNCE] Please welcome Francis Liu to the HBase PMC

[Andrew Purtell]

On behalf of the Apache HBase PMC I am pleased to announce that Francis
Liu has accepted our invitation to become a PMC member on the Apache
HBase project. We appreciate Francis stepping up to take more
responsibility in the HBase project. He has been an active contributor to
HBase for many years and recently took over responsibilities as branch RM
for branch-1.3.

Please join me in welcoming Francis to the HBase PMC!

-- 
Best regards,
Andrew

[jira] [Created] (HBASE-20390) IMC Default Parameters for 2.0.0

[Eshcar Hillel (JIRA)]

Eshcar Hillel created HBASE-20390:
-

 Summary: IMC Default Parameters for 2.0.0
 Key: HBASE-20390
 URL: https://issues.apache.org/jira/browse/HBASE-20390
 Project: HBase
  Issue Type: Task
Reporter: Eshcar Hillel


Setting new default parameters for in-memory compaction based on performance 
tests done in HBASE-20188 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Resolved] (HBASE-20248) [ITBLL] UNREFERENCED rows

[stack (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HBASE-20248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

stack resolved HBASE-20248.
---
Resolution: Cannot Reproduce

> [ITBLL] UNREFERENCED rows
> -
>
> Key: HBASE-20248
> URL: https://issues.apache.org/jira/browse/HBASE-20248
> Project: HBase
>  Issue Type: Sub-task
>  Components: dataloss
>Affects Versions: 2.0.0
>Reporter: stack
>Assignee: stack
>Priority: Blocker
> Fix For: 2.0.0
>
>
> From parent, saw unreferenced rows in a run yesterday against tip of 
> branch-2. Saw similar in a run from a week or so ago.
> Enabling DEBUG and rerunning to see if I can get to root of dataloss. See 
> https://docs.google.com/document/d/14Tvu5yWYNBDFkh8xCqLkU9tlyNWhJv3GjDGOkqZU1eE/edit#
>  for old debugging trickery.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Re: HBase Developer - Questions

[Josh Elser]

(-to dev, +bcc dev, +to user)

Hi Stefano,

Moving your question over to the user@ mailing list as it's not so much 
about development of HBase, instead development when using HBase.


Q1: what do you mean by the "latest field"? Are you talking about the 
latest version of a Cell for a column (which is row + cf/cq)?


When you write a new cell without explicitly setting a timestamp, it 
will use the current time from that RegionServer which is effectively 
making it the "latest".


Q2: Not sure here :)

On 4/10/18 9:33 AM, Stefano Manca wrote:

Dear,

My name is Stefano, I am a young software developer.
In these months I am using HBase as database in a Hadoop cluster, to write
data from Apache Spark with scala language.
May I ask you any question for specific information?

*Q1*: there is a way to insert/update a specific cell as latest field into
the same record?

Example:
ROW COLUMN+CELL
row1  column=CF1:QUAL1, timestamp=1523350296746, value=0.0
row1  column=CF1:QUAL2, timestamp=1523350296746, value=test
row1  column=CF1:QUAL3, timestamp=1523350296746, value=2700
row1  *column=CF2:QUAL4, timestamp=1523350296746, value=01218*
row1  column=CF2:QUAL5, timestamp=1523350296746, value=example

I would like to be sure that the value of the key QUAL4 will be insert as
last field, respect to the other values of the same rowkey (row1).

*Q2*: What is the best way to write in bulk with Spark 2.2? Is the
HBaseContext class available to use the bulkload with Hfiles?


Thank you very much in advance.

Best regards,



*__Stefano Manca*

*Phone: +39 349216059*
*E-mail: ste.manc...@gmail.com *

[jira] [Created] (HBASE-20389) Move website building flags into a profile

[Sean Busbey (JIRA)]

Sean Busbey created HBASE-20389:
---

 Summary: Move website building flags into a profile
 Key: HBASE-20389
 URL: https://issues.apache.org/jira/browse/HBASE-20389
 Project: HBase
  Issue Type: Improvement
  Components: build, website
Reporter: Sean Busbey


we have some "magic" in our website building right now. The script that's used 
bout our automated website build + publish mechanism manually sets a bunch of 
stuff on the maven command line.

It'd be better to reflect those settings in a maven profile, so that folks are 
less likely to be surprised e.g. when trying to debug a failure in the {{site}} 
goal happens.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (HBASE-20388) nightly tests running on a feature branch should only comment on that feature branch's jira

[Sean Busbey (JIRA)]

Sean Busbey created HBASE-20388:
---

 Summary: nightly tests running on a feature branch should only 
comment on that feature branch's jira
 Key: HBASE-20388
 URL: https://issues.apache.org/jira/browse/HBASE-20388
 Project: HBase
  Issue Type: Improvement
  Components: community, test
Reporter: Sean Busbey


It would help improve our signal-to-noise ratio from nightly tests if feature 
branch runs stopped commenting on all the jiras that got covered by a rebase / 
merge.

should be straight forward to have the commenting bit check the current branch 
against our feature branch naming convention.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Resolved] (HBASE-20385) Purge md5-making from our little make_rc.sh script

[stack (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HBASE-20385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

stack resolved HBASE-20385.
---
   Resolution: Fixed
 Assignee: stack
Fix Version/s: 2.0.0

Pushed to branch-1.4+ (didn't apply to 1.3..)

> Purge md5-making from our little make_rc.sh script
> --
>
> Key: HBASE-20385
> URL: https://issues.apache.org/jira/browse/HBASE-20385
> Project: HBase
>  Issue Type: Bug
>Reporter: stack
>Assignee: stack
>Priority: Minor
> Fix For: 2.0.0
>
> Attachments: HBASE-20385.master.001.patch
>
>
> Don't generate md5s anymore. New Apache release policy via Apache 
> Infrastructure asks that we not provide md5 as md5 is 'broken for many 
> purposes; we should movea awy from it.' Remove the md5' making from our 
> make-rc.sh script.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (HBASE-20387) Fold flaky test finding into nightly job

[Sean Busbey (JIRA)]

Sean Busbey created HBASE-20387:
---

 Summary: Fold flaky test finding into nightly job
 Key: HBASE-20387
 URL: https://issues.apache.org/jira/browse/HBASE-20387
 Project: HBase
  Issue Type: Improvement
  Components: test
Reporter: Sean Busbey


We need a flaky list per-branch, since what does/does not work reliably on 
master isn't really relevant to our older maintenance release lines.

We should just make the invocation a step in the current per-branch nightly 
jobs, prior to when we need the list in the stages that run unit tests. We can 
publish it in the nightly job as well so that precommit can still get it. (and 
can fetch it per-branch if needed)



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Resolved] (HBASE-20384) [AMv2] Logging format improvements; use encoded name rather than full region name marking transitions

[stack (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HBASE-20384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

stack resolved HBASE-20384.
---
   Resolution: Fixed
 Assignee: stack
 Hadoop Flags: Reviewed
Fix Version/s: 2.0.0

Pushed to branch-2.0+. Thanks [~balazs.meszaros]

> [AMv2] Logging format improvements; use encoded name rather than full region 
> name marking  transitions
> --
>
> Key: HBASE-20384
> URL: https://issues.apache.org/jira/browse/HBASE-20384
> Project: HBase
>  Issue Type: Bug
>Reporter: stack
>Assignee: stack
>Priority: Minor
> Fix For: 2.0.0
>
> Attachments: HBASE-20384.branch-2.0.001.patch
>
>
> We use encoded name near everywhere. Makes logging regular-looking at least 
> and eases tracing. In a few places we still do full region name. Let me fix 
> (ran into it trying to debug...)



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Resolved] (HBASE-20228) [Umbrella] Verify 1.2.7 shell works against 2.0.0 server

[Peter Somogyi (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HBASE-20228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Peter Somogyi resolved HBASE-20228.
---
Resolution: Fixed

All subtasks done. Resolving.

> [Umbrella] Verify 1.2.7 shell works against 2.0.0 server
> 
>
> Key: HBASE-20228
> URL: https://issues.apache.org/jira/browse/HBASE-20228
> Project: HBase
>  Issue Type: Test
>  Components: shell
>Affects Versions: 2.0.0-beta-2
>Reporter: Peter Somogyi
>Assignee: Peter Somogyi
>Priority: Blocker
> Fix For: 2.0.0
>
>
> Run 1.2.7 shell commands against 2.0.0 hbase and document which commands do 
> not work.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Re: [DISCUSS] RowCounter duplication

[Sean Busbey]

So long as we're still supporting integration with the Apache Hadoop
MapReduce project including versions that have both the old and new
api, I think we need to support both.

On Wed, Apr 11, 2018 at 7:15 AM, Peter Somogyi  wrote:
> Thanks for bringing this up Chia-Ping Tsai. Yes, the question can be more
> general whether we need to support the old API.
>
> On Tue, Apr 10, 2018 at 7:49 PM, Chia-Ping Tsai  wrote:
>
>> There are other tools having two versions - o.a.h.h.mapreduce and
>> o.a.h.h.mapred
>> It seems to me the question is "should hbase support old MR APIs ?' Given
>> that hadoop 3.0 doesn't mark old MR APIs deprecated, we should keep them in
>> hbase? Or we can deprecate them in hbase-2+ in order to remove them in the
>> future?
>>
>> On 2018/04/10 16:02:07, Peter Somogyi  wrote:
>> > Hi,
>> >
>> > Currently we have 2 RowCounter tools in our
>> > repository: o.a.h.h.mapreduce.RowCounter and o.a.h.h.mapred.RowCounter.
>> > None of them is marked as deprecated but mapred.RowCounter was deprecated
>> > in pre-HBase 1 releases and the annotation was eventually removed
>> > in HBASE-11178.
>> >
>> > Do we still want to or need to keep both versions? The mapred tool is not
>> > documented in refguide and the command's usage is minimal. The
>> > mapreduce.RowCounter tool also has more features.
>> >
>> > Thanks,
>> > Peter
>> >
>>

[jira] [Resolved] (HBASE-20381) precommit failing w/rat on shadedjars plugin

[Sean Busbey (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HBASE-20381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sean Busbey resolved HBASE-20381.
-
Resolution: Cannot Reproduce
  Assignee: (was: Sean Busbey)

okay I updated the default parameter for the precommit job. closing this out 
for now.

> precommit failing w/rat on shadedjars plugin
> 
>
> Key: HBASE-20381
> URL: https://issues.apache.org/jira/browse/HBASE-20381
> Project: HBase
>  Issue Type: Bug
>  Components: test
>Reporter: Sean Busbey
>Priority: Blocker
>
> see HBASE-20219 and related builds.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Re: [DISCUSS] RowCounter duplication

[Peter Somogyi]

Thanks for bringing this up Chia-Ping Tsai. Yes, the question can be more
general whether we need to support the old API.

On Tue, Apr 10, 2018 at 7:49 PM, Chia-Ping Tsai  wrote:

> There are other tools having two versions - o.a.h.h.mapreduce and
> o.a.h.h.mapred
> It seems to me the question is "should hbase support old MR APIs ?' Given
> that hadoop 3.0 doesn't mark old MR APIs deprecated, we should keep them in
> hbase? Or we can deprecate them in hbase-2+ in order to remove them in the
> future?
>
> On 2018/04/10 16:02:07, Peter Somogyi  wrote:
> > Hi,
> >
> > Currently we have 2 RowCounter tools in our
> > repository: o.a.h.h.mapreduce.RowCounter and o.a.h.h.mapred.RowCounter.
> > None of them is marked as deprecated but mapred.RowCounter was deprecated
> > in pre-HBase 1 releases and the annotation was eventually removed
> > in HBASE-11178.
> >
> > Do we still want to or need to keep both versions? The mapred tool is not
> > documented in refguide and the command's usage is minimal. The
> > mapreduce.RowCounter tool also has more features.
> >
> > Thanks,
> > Peter
> >
>

[jira] [Created] (HBASE-20386) [DOC] Align WALPlayer help text and refguide

[Balazs Meszaros (JIRA)]

Balazs Meszaros created HBASE-20386:
---

 Summary: [DOC] Align WALPlayer help text and refguide
 Key: HBASE-20386
 URL: https://issues.apache.org/jira/browse/HBASE-20386
 Project: HBase
  Issue Type: Task
  Components: documentation
Affects Versions: 2.0.0
Reporter: Balazs Meszaros
Assignee: Balazs Meszaros






--
This message was sent by Atlassian JIRA
(v7.6.3#76005)