[jira] [Resolved] (HBASE-17203) unable to see the namespaces and tables when grant read-only privleges

[Ashish Singhi (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HBASE-17203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ashish Singhi resolved HBASE-17203.
---
Resolution: Invalid

This is correct.
To see to namespaces a user needs to have Admin privilege.
Please check https://hbase.apache.org/book.html#appendix_acl_matrix

> unable to see the namespaces and tables when grant read-only privleges
> --
>
> Key: HBASE-17203
> URL: https://issues.apache.org/jira/browse/HBASE-17203
> Project: HBase
>  Issue Type: Task
>  Components: hbase, shell
>Affects Versions: 1.0.0
>Reporter: sandeep vura
>
> Hi,
> i have created namespaces and given grant  read-only privileges. When i run 
> "list_namespace" on hbase shell i am unable to see the namespaces and also 
> the tables.
> But namespaces and tables are able to see in HUE --> HBase browser.
> Executed commands:
> create_namespace 'q1'
> grant '@hadooptest','R','@q1'
> Please advise.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Resolved] (HBASE-17202) Master takes a long time to initialize

[Yu Li (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HBASE-17202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yu Li resolved HBASE-17202.
---
Resolution: Duplicate

Duplicate with HBASE-16570, please refer to the [addendum patch 
v7|https://issues.apache.org/jira/secure/attachment/12837729/HBASE-16570_addnum_v7.patch]
 and 
[comment|https://issues.apache.org/jira/browse/HBASE-16570?focusedCommentId=15649981=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15649981]
 there for more details.

> Master takes a long time to initialize
> --
>
> Key: HBASE-17202
> URL: https://issues.apache.org/jira/browse/HBASE-17202
> Project: HBase
>  Issue Type: Improvement
>  Components: Balancer, master
>Reporter: Ashu Pachauri
>Assignee: Ashu Pachauri
>
> On master failover or a full cluster restart, we create the 
> RegionLocationFinder cache by calculating block locations for every region; 
> this cache is used by the balancer for calculating region locality. This 
> greatly increases the time it takes for the assignment manager to start and 
> affects region availability in scenarios of full cluster restart.
> We should initialize assignment manager with the bare minimum information and 
> asynchronously load the block location cache.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HBASE-17203) unable to see the namespaces and tables when grant read-only privleges

[sandeep vura (JIRA)]

sandeep vura created HBASE-17203:


 Summary: unable to see the namespaces and tables when grant 
read-only privleges
 Key: HBASE-17203
 URL: https://issues.apache.org/jira/browse/HBASE-17203
 Project: HBase
  Issue Type: Task
  Components: hbase, shell
Affects Versions: 1.0.0
Reporter: sandeep vura


Hi,

i have created namespaces and given grant  read-only privileges. When i run 
"list_namespace" on hbase shell i am unable to see the namespaces and also the 
tables.

But namespaces and tables are able to see in HUE --> HBase browser.

Executed commands:

create_namespace 'q1'
grant '@hadooptest','R','@q1'

Please advise.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Reopened] (HBASE-17197) hfile does not work in 2.0

[stack (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HBASE-17197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

stack reopened HBASE-17197:
---

Reopening. Having to add the -f is a PITA.

> hfile does not work in 2.0
> --
>
> Key: HBASE-17197
> URL: https://issues.apache.org/jira/browse/HBASE-17197
> Project: HBase
>  Issue Type: Bug
>  Components: HFile
>Affects Versions: 2.0.0
>Reporter: huaxiang sun
>Assignee: huaxiang sun
>
> I tried to use hfile in master branch, it does not print out kv pairs or meta 
> as it is supposed to be.
> {code}
> hsun-MBP:hbase-2.0.0-SNAPSHOT hsun$ hbase hfile 
> file:///Users/hsun/work/local-hbase-cluster/data/data/default/t1/755b5d7a44148492b7138c79c5e4f39f/f1/
> 53e9f9bc328f468b87831221de3a0c74  bdc6e1c4eea246a99e989e02d554cb03  
> bf9275ac418d4d458904d81137e82683  
> hsun-MBP:hbase-2.0.0-SNAPSHOT hsun$ hbase hfile 
> file:///Users/hsun/work/local-hbase-cluster/data/data/default/t1/755b5d7a44148492b7138c79c5e4f39f/f1/bf9275ac418d4d458904d81137e82683
>  -m
> 2016-11-29 12:25:22,019 WARN  [main] util.NativeCodeLoader: Unable to load 
> native-hadoop library for your platform... using builtin-java classes where 
> applicable
> hsun-MBP:hbase-2.0.0-SNAPSHOT hsun$ hbase hfile 
> file:///Users/hsun/work/local-hbase-cluster/data/data/default/t1/755b5d7a44148492b7138c79c5e4f39f/f1/bf9275ac418d4d458904d81137e82683
>  -p
> 2016-11-29 12:25:27,333 WARN  [main] util.NativeCodeLoader: Unable to load 
> native-hadoop library for your platform... using builtin-java classes where 
> applicable
> Scanned kv count -> 0
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: [ANNOUNCE] New HBase committer Phil Yang

[Phil Yang]

Thanks all.
It is a great honor to be a committer and I will try my best to contribute
more to HBase.

Thanks,
Phil


2016-11-30 1:07 GMT+08:00 Stack :

> Welcome Phil!
> St.Ack
>
> On Tue, Nov 29, 2016 at 1:49 AM, Duo Zhang  wrote:
>
> > On behalf of the Apache HBase PMC, I am pleased to announce that Phil
> Yang
> > has accepted the PMC's invitation to become a committer on the project.
> We
> > appreciate all of Phil's generous contributions thus far and look forward
> > to his continued involvement.
> >
> > Congratulations and welcome, Phil!
> >
>

Re: [ANNOUNCE] New HBase committer Lijin Bin

[Enis Söztutar]

Welcome!

Enis.

On Tue, Nov 29, 2016 at 5:36 PM, Heng Chen  wrote:

> Congratulations!!
>
> 2016-11-30 6:42 GMT+08:00 Andrew Purtell :
> > Congratulations and welcome, Lijin!
> >
> > On Tue, Nov 29, 2016 at 1:48 AM, Duo Zhang  wrote:
> >
> >> On behalf of the Apache HBase PMC, I am pleased to announce that Lijin
> >> Bin(binlijin) has accepted the PMC's invitation to become a committer on
> >> the project. We appreciate all of Lijin's generous contributions thus
> far
> >> and look forward to his continued involvement.
> >>
> >> Congratulations and welcome, Lijin!
> >>
> >
> >
> >
> > --
> > Best regards,
> >
> >- Andy
> >
> > Problems worthy of attack prove their worth by hitting back. - Piet Hein
> > (via Tom White)
>

[jira] [Created] (HBASE-17202) Master takes a long time to initialize

[Ashu Pachauri (JIRA)]

Ashu Pachauri created HBASE-17202:
-

 Summary: Master takes a long time to initialize
 Key: HBASE-17202
 URL: https://issues.apache.org/jira/browse/HBASE-17202
 Project: HBase
  Issue Type: Improvement
  Components: Balancer, master
Reporter: Ashu Pachauri
Assignee: Ashu Pachauri


On master failover or a full cluster restart, we create the 
RegionLocationFinder cache by calculating block locations for every region used 
by the balancer. This greatly increases the time it takes for the assignment 
manager to start and affects region availability in scenarios of full cluster 
restart.

We should initialize assignment manager with the bare minimum information and 
asynchronously load the block location cache.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

答复: [ANNOUNCE] New HBase committer Phil Yang

[Honghua Feng 冯宏华]

Congratulations!

发件人: Guanghao Zhang 
发送时间: 2016年11月29日 18:59
收件人: dev@hbase.apache.org
主题: Re: [ANNOUNCE] New HBase committer Phil Yang

Congratulations!

2016-11-29 17:49 GMT+08:00 Duo Zhang :

> On behalf of the Apache HBase PMC, I am pleased to announce that Phil Yang
> has accepted the PMC's invitation to become a committer on the project. We
> appreciate all of Phil's generous contributions thus far and look forward
> to his continued involvement.
>
> Congratulations and welcome, Phil!
>

Re: [ANNOUNCE] New HBase committer Lijin Bin

[Heng Chen]

Congratulations!!

2016-11-30 6:42 GMT+08:00 Andrew Purtell :
> Congratulations and welcome, Lijin!
>
> On Tue, Nov 29, 2016 at 1:48 AM, Duo Zhang  wrote:
>
>> On behalf of the Apache HBase PMC, I am pleased to announce that Lijin
>> Bin(binlijin) has accepted the PMC's invitation to become a committer on
>> the project. We appreciate all of Lijin's generous contributions thus far
>> and look forward to his continued involvement.
>>
>> Congratulations and welcome, Lijin!
>>
>
>
>
> --
> Best regards,
>
>- Andy
>
> Problems worthy of attack prove their worth by hitting back. - Piet Hein
> (via Tom White)

[jira] [Resolved] (HBASE-16295) InvalidFamilyOperationException while deleting a column family in shell

[Ashu Pachauri (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HBASE-16295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ashu Pachauri resolved HBASE-16295.
---
Resolution: Cannot Reproduce

> InvalidFamilyOperationException while deleting a column family in shell
> ---
>
> Key: HBASE-16295
> URL: https://issues.apache.org/jira/browse/HBASE-16295
> Project: HBase
>  Issue Type: Bug
>  Components: master, shell
>Affects Versions: 1.2.0
>Reporter: Ashu Pachauri
>Assignee: Ashu Pachauri
>Priority: Minor
>
> The column family exists and is actually deleted, the regions are also 
> reopened. But, the following exception is thrown in the shell:
> {code}
> alter 't1', 'delete' => 'cf'
> ERROR: org.apache.hadoop.hbase.InvalidFamilyOperationException: Family 'cf' 
> does not exist, so it cannot be deleted
>   at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
>   at 
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
>   at 
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
>   at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
>   at 
> org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106)
>   at 
> org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:95)
>   at 
> org.apache.hadoop.hbase.util.ForeignExceptionUtil.toIOException(ForeignExceptionUtil.java:45)
>   at 
> org.apache.hadoop.hbase.procedure2.RemoteProcedureException.fromProto(RemoteProcedureException.java:114)
>   at 
> org.apache.hadoop.hbase.master.procedure.ProcedureSyncWait.waitForProcedureToComplete(ProcedureSyncWait.java:85)
>   at 
> org.apache.hadoop.hbase.master.HMaster.deleteColumn(HMaster.java:1916)
>   at 
> org.apache.hadoop.hbase.master.MasterRpcServices.deleteColumn(MasterRpcServices.java:474)
>   at 
> org.apache.hadoop.hbase.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java:55658)
>   at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2170)
>   at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:109)
>   at 
> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:137)
>   at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:112)
>   at java.lang.Thread.run(Thread.java:745)
> Caused by: 
> org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hbase.InvalidFamilyOperationException):
>  Family 'cf' does not exist, so it cannot be deleted
>   at 
> org.apache.hadoop.hbase.master.procedure.DeleteColumnFamilyProcedure.prepareDelete(DeleteColumnFamilyProcedure.java:281)
>   at 
> org.apache.hadoop.hbase.master.procedure.DeleteColumnFamilyProcedure.executeFromState(DeleteColumnFamilyProcedure.java:93)
>   at 
> org.apache.hadoop.hbase.master.procedure.DeleteColumnFamilyProcedure.executeFromState(DeleteColumnFamilyProcedure.java:48)
>   at 
> org.apache.hadoop.hbase.procedure2.StateMachineProcedure.execute(StateMachineProcedure.java:119)
>   at 
> org.apache.hadoop.hbase.procedure2.Procedure.doExecute(Procedure.java:465)
>   at 
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1061)
>   at 
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execLoop(ProcedureExecutor.java:856)
>   at 
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execLoop(ProcedureExecutor.java:809)
>   at 
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$400(ProcedureExecutor.java:75)
>   at 
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor$2.run(ProcedureExecutor.java:495)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HBASE-17200) Document an interesting implication of HBASE-15212

[Andrew Purtell (JIRA)]

Andrew Purtell created HBASE-17200:
--

 Summary: Document an interesting implication of HBASE-15212
 Key: HBASE-17200
 URL: https://issues.apache.org/jira/browse/HBASE-17200
 Project: HBase
  Issue Type: Bug
  Components: documentation, Operability, Replication
Reporter: Andrew Purtell
Priority: Minor


We had a Phoenix client application unfortunately batching up 1000 rows at a 
time. Phoenix bundles mutations up only considering the row count not byte 
count (see PHOENIX-541) so this lead to some *single WALEdits* in excess of 600 
MB. A cluster without max RPC size enforcement accepted them. (That may be 
something we should fix - WALEdits that large are crazy.) Then replication 
workers attempting to ship the monster edits from this cluster to a remote 
cluster recently upgraded with RPC size enforcement active would see all their 
RPC attempts rejected, because the default limit is 256 MB. 

This is an edge case but I can see it happening in practice and taking users by 
surprise, most likely when replicating between mixed versions. We should 
document this in the troubleshooting section. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HBASE-17199) Back-port HBASE-17151 to HBASE-7912 branch

[Vladimir Rodionov (JIRA)]

Vladimir Rodionov created HBASE-17199:
-

 Summary: Back-port HBASE-17151 to HBASE-7912 branch
 Key: HBASE-17199
 URL: https://issues.apache.org/jira/browse/HBASE-17199
 Project: HBase
  Issue Type: Task
Reporter: Vladimir Rodionov
Assignee: Vladimir Rodionov






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Resolved] (HBASE-17196) deleted mob cell can come back after major compaction and minor mob compaction

[huaxiang sun (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HBASE-17196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

huaxiang sun resolved HBASE-17196.
--
Resolution: Invalid

As explained in the comments.

> deleted mob cell can come back after major compaction and minor mob compaction
> --
>
> Key: HBASE-17196
> URL: https://issues.apache.org/jira/browse/HBASE-17196
> Project: HBase
>  Issue Type: Bug
>  Components: mob
>Affects Versions: 2.0.0
>Reporter: huaxiang sun
>Assignee: huaxiang sun
>
> In the following case, the deleted mob cell can come back.
> {code}
> 1) hbase(main):001:0> create 't1', {NAME => 'f1', IS_MOB => true, 
> MOB_THRESHOLD => 10}
> 2) hbase(main):002:0> put 't1', 'r1', 'f1:q1', ''
> 3) hbase(main):003:0> flush 't1'
> 4) hbase(main):004:0> deleteall 't1', 'r1'
> 5) hbase(main):005:0> scan 't1'
> ROW COLUMN+CELL   
>   
>   
> 0 row(s)
> 6) hbase(main):006:0> flush 't1'
> 7) hbase(main):007:0> major_compact 't1'
> After that, go to mobdir, remove the _del file, this is to simulate the case 
> that  mob minor compaction does not the _del file. Right now, the cell in 
> normal region is gone after the major compaction.
> 8) hbase(main):008:0> put 't1', 'r2', 'f1:q1', ''
>   
> 
> 9) hbase(main):009:0> flush 't1'
> 10) hbase(main):010:0> scan 't1'
> ROW COLUMN+CELL   
>   
>   
>  r2 column=f1:q1, 
> timestamp=1480451201393, value=   
>   
> 1 row(s)
> 11) hbase(main):011:0> compact 't1', 'f1', 'MOB'
> 12) hbase(main):012:0> scan 't1'
> ROW COLUMN+CELL   
>   
>   
>  r1 column=f1:q1, 
> timestamp=1480450987725, value=   
>   
>  r2 column=f1:q1, 
> timestamp=1480451201393, value=   
>   
> 2 row(s)
> The deleted "r1" comes back. The reason is that mob minor compaction does not 
> include _del files so it generates references for the deleted cell.
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: [ANNOUNCE] New HBase committer Lijin Bin

[Andrew Purtell]

Congratulations and welcome, Lijin!

On Tue, Nov 29, 2016 at 1:48 AM, Duo Zhang  wrote:

> On behalf of the Apache HBase PMC, I am pleased to announce that Lijin
> Bin(binlijin) has accepted the PMC's invitation to become a committer on
> the project. We appreciate all of Lijin's generous contributions thus far
> and look forward to his continued involvement.
>
> Congratulations and welcome, Lijin!
>



-- 
Best regards,

   - Andy

Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)

[jira] [Resolved] (HBASE-17197) hfile does not work in 2.0

[huaxiang sun (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HBASE-17197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

huaxiang sun resolved HBASE-17197.
--
Resolution: Invalid

Missing -f for the file, do not know why I forgot that.

> hfile does not work in 2.0
> --
>
> Key: HBASE-17197
> URL: https://issues.apache.org/jira/browse/HBASE-17197
> Project: HBase
>  Issue Type: Bug
>  Components: HFile
>Affects Versions: 2.0.0
>Reporter: huaxiang sun
>Assignee: huaxiang sun
>
> I tried to use hfile in master branch, it does not print out kv pairs or meta 
> as it is supposed to be.
> {code}
> hsun-MBP:hbase-2.0.0-SNAPSHOT hsun$ hbase hfile 
> file:///Users/hsun/work/local-hbase-cluster/data/data/default/t1/755b5d7a44148492b7138c79c5e4f39f/f1/
> 53e9f9bc328f468b87831221de3a0c74  bdc6e1c4eea246a99e989e02d554cb03  
> bf9275ac418d4d458904d81137e82683  
> hsun-MBP:hbase-2.0.0-SNAPSHOT hsun$ hbase hfile 
> file:///Users/hsun/work/local-hbase-cluster/data/data/default/t1/755b5d7a44148492b7138c79c5e4f39f/f1/bf9275ac418d4d458904d81137e82683
>  -m
> 2016-11-29 12:25:22,019 WARN  [main] util.NativeCodeLoader: Unable to load 
> native-hadoop library for your platform... using builtin-java classes where 
> applicable
> hsun-MBP:hbase-2.0.0-SNAPSHOT hsun$ hbase hfile 
> file:///Users/hsun/work/local-hbase-cluster/data/data/default/t1/755b5d7a44148492b7138c79c5e4f39f/f1/bf9275ac418d4d458904d81137e82683
>  -p
> 2016-11-29 12:25:27,333 WARN  [main] util.NativeCodeLoader: Unable to load 
> native-hadoop library for your platform... using builtin-java classes where 
> applicable
> Scanned kv count -> 0
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HBASE-17198) FN updates during region merge (follow up to Procedure v2 merge)

[Thiruvel Thirumoolan (JIRA)]

Thiruvel Thirumoolan created HBASE-17198:


 Summary: FN updates during region merge (follow up to Procedure v2 
merge)
 Key: HBASE-17198
 URL: https://issues.apache.org/jira/browse/HBASE-17198
 Project: HBase
  Issue Type: Sub-task
Reporter: Thiruvel Thirumoolan
Assignee: Thiruvel Thirumoolan


As mentioned in https://reviews.apache.org/r/53242/ (HBASE-16941), since the 
procedure v2 merge changes are in development, there is a follow up 
optimization/cleanup that can be done for favored nodes during merge. This jira 
will be taken up once HBASE-16119 is complete.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HBASE-17197) hfile does not work in 2.0

[huaxiang sun (JIRA)]

huaxiang sun created HBASE-17197:


 Summary: hfile does not work in 2.0
 Key: HBASE-17197
 URL: https://issues.apache.org/jira/browse/HBASE-17197
 Project: HBase
  Issue Type: Bug
  Components: HFile
Affects Versions: 2.0.0
Reporter: huaxiang sun
Assignee: huaxiang sun


I tried to use hfile in master branch, it does not print out kv pairs or meta 
as it is supposed to be.
{code}
hsun-MBP:hbase-2.0.0-SNAPSHOT hsun$ hbase hfile 
file:///Users/hsun/work/local-hbase-cluster/data/data/default/t1/755b5d7a44148492b7138c79c5e4f39f/f1/
53e9f9bc328f468b87831221de3a0c74  bdc6e1c4eea246a99e989e02d554cb03  
bf9275ac418d4d458904d81137e82683  
hsun-MBP:hbase-2.0.0-SNAPSHOT hsun$ hbase hfile 
file:///Users/hsun/work/local-hbase-cluster/data/data/default/t1/755b5d7a44148492b7138c79c5e4f39f/f1/bf9275ac418d4d458904d81137e82683
 -m
2016-11-29 12:25:22,019 WARN  [main] util.NativeCodeLoader: Unable to load 
native-hadoop library for your platform... using builtin-java classes where 
applicable
hsun-MBP:hbase-2.0.0-SNAPSHOT hsun$ hbase hfile 
file:///Users/hsun/work/local-hbase-cluster/data/data/default/t1/755b5d7a44148492b7138c79c5e4f39f/f1/bf9275ac418d4d458904d81137e82683
 -p
2016-11-29 12:25:27,333 WARN  [main] util.NativeCodeLoader: Unable to load 
native-hadoop library for your platform... using builtin-java classes where 
applicable
Scanned kv count -> 0
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HBASE-17196) deleted mob cell can come back after major compaction and minor mob compaction

[huaxiang sun (JIRA)]

huaxiang sun created HBASE-17196:


 Summary: deleted mob cell can come back after major compaction and 
minor mob compaction
 Key: HBASE-17196
 URL: https://issues.apache.org/jira/browse/HBASE-17196
 Project: HBase
  Issue Type: Bug
  Components: mob
Affects Versions: 2.0.0
Reporter: huaxiang sun
Assignee: huaxiang sun


In the following case, the deleted mob cell can come back.

{code}
1) hbase(main):001:0> create 't1', {NAME => 'f1', IS_MOB => true, MOB_THRESHOLD 
=> 10}

2) hbase(main):002:0> put 't1', 'r1', 'f1:q1', ''

3) hbase(main):003:0> flush 't1'

4) hbase(main):004:0> deleteall 't1', 'r1'

5) hbase(main):005:0> scan 't1'
ROW COLUMN+CELL 

  
0 row(s)

6) hbase(main):006:0> flush 't1'

7) hbase(main):007:0> major_compact 't1'

After that, go to mobdir, remove the _del file, this is to simulate the case 
that  mob minor compaction does not the _del file. Right now, the cell in 
normal region is gone after the major compaction.

8) hbase(main):008:0> put 't1', 'r2', 'f1:q1', ''

  
9) hbase(main):009:0> flush 't1'

10) hbase(main):010:0> scan 't1'
ROW COLUMN+CELL 

  
 r2 column=f1:q1, 
timestamp=1480451201393, value= 

1 row(s)

11) hbase(main):011:0> compact 't1', 'f1', 'MOB'

12) hbase(main):012:0> scan 't1'
ROW COLUMN+CELL 

  
 r1 column=f1:q1, 
timestamp=1480450987725, value= 

 r2 column=f1:q1, 
timestamp=1480451201393, value= 

2 row(s)

The deleted "r1" comes back. The reason is that mob minor compaction does not 
include _del files so it generates references for the deleted cell.
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: [ANNOUNCE] New HBase committer Phil Yang

[Apekshit Sharma]

Congratulations Phil!

On Tue, Nov 29, 2016 at 10:36 AM, Jerry He  wrote:

> Congratulations and welcome, Phil.
>
> On Tue, Nov 29, 2016 at 9:35 AM, Huaxiang Sun  wrote:
>
> > Congratulations, Phil!
> >
> > > On Nov 29, 2016, at 5:29 AM, Yu Li  wrote:
> > >
> > > Congrats and welcome Phil!
> > >
> > > Best Regards,
> > > Yu
> > >
> > > On 29 November 2016 at 19:01, Anoop John 
> wrote:
> > >
> > >> Congrats and welcome Phil...  Looking forward for many more
> > >> contributions from u.
> > >>
> > >> -Anoop-
> > >>
> > >> On Tue, Nov 29, 2016 at 4:30 PM, Anoop John 
> > wrote:
> > >>> Congrats and welcome Binlijin.
> > >>>
> > >>> -Anoop-
> > >>>
> > >>> On Tue, Nov 29, 2016 at 4:29 PM, Guanghao Zhang 
> > >> wrote:
> >  Congratulations!
> > 
> >  2016-11-29 17:49 GMT+08:00 Duo Zhang :
> > 
> > > On behalf of the Apache HBase PMC, I am pleased to announce that
> Phil
> > >> Yang
> > > has accepted the PMC's invitation to become a committer on the
> > >> project. We
> > > appreciate all of Phil's generous contributions thus far and look
> > >> forward
> > > to his continued involvement.
> > >
> > > Congratulations and welcome, Phil!
> > >
> > >>
> >
> >
>



-- 

-- Appy

Re: [ANNOUNCE] New HBase committer Lijin Bin

[Apekshit Sharma]

Congratulations Lijin.

On Tue, Nov 29, 2016 at 10:35 AM, Jerry He  wrote:

> *Congratulations, *宾莉金!
>
> On Tue, Nov 29, 2016 at 9:34 AM, Huaxiang Sun  wrote:
>
> >
> > Congratulations, Lijin!
> >
> > > On Nov 29, 2016, at 5:15 AM, 宾莉金 or binlijin 
> wrote:
> > >
> > > Thanks everyone. :)
> > >
> > > Looking forward to keep doing cool stuff with you guys.
> > >
> > > 2016-11-29 19:01 GMT+08:00 ramkrishna vasudevan <
> > > ramkrishna.s.vasude...@gmail.com>:
> > >
> > >> Congratulations !! All the best !!!
> > >>
> > >> On Tue, Nov 29, 2016 at 4:29 PM, Guanghao Zhang 
> > >> wrote:
> > >>
> > >>> Congratulations!
> > >>>
> > >>> 2016-11-29 17:48 GMT+08:00 Duo Zhang :
> > >>>
> >  On behalf of the Apache HBase PMC, I am pleased to announce that
> Lijin
> >  Bin(binlijin) has accepted the PMC's invitation to become a
> committer
> > >> on
> >  the project. We appreciate all of Lijin's generous contributions
> thus
> > >> far
> >  and look forward to his continued involvement.
> > 
> >  Congratulations and welcome, Lijin!
> > 
> > >>>
> > >>
> > >
> > >
> > >
> > > --
> > > *Best Regards,*
> > > lijin bin
> >
> >
>



-- 

-- Appy

Re: [ANNOUNCE] New HBase committer Phil Yang

[Jerry He]

Congratulations and welcome, Phil.

On Tue, Nov 29, 2016 at 9:35 AM, Huaxiang Sun  wrote:

> Congratulations, Phil!
>
> > On Nov 29, 2016, at 5:29 AM, Yu Li  wrote:
> >
> > Congrats and welcome Phil!
> >
> > Best Regards,
> > Yu
> >
> > On 29 November 2016 at 19:01, Anoop John  wrote:
> >
> >> Congrats and welcome Phil...  Looking forward for many more
> >> contributions from u.
> >>
> >> -Anoop-
> >>
> >> On Tue, Nov 29, 2016 at 4:30 PM, Anoop John 
> wrote:
> >>> Congrats and welcome Binlijin.
> >>>
> >>> -Anoop-
> >>>
> >>> On Tue, Nov 29, 2016 at 4:29 PM, Guanghao Zhang 
> >> wrote:
>  Congratulations!
> 
>  2016-11-29 17:49 GMT+08:00 Duo Zhang :
> 
> > On behalf of the Apache HBase PMC, I am pleased to announce that Phil
> >> Yang
> > has accepted the PMC's invitation to become a committer on the
> >> project. We
> > appreciate all of Phil's generous contributions thus far and look
> >> forward
> > to his continued involvement.
> >
> > Congratulations and welcome, Phil!
> >
> >>
>
>

Re: [ANNOUNCE] New HBase committer Lijin Bin

[Jerry He]

*Congratulations, *宾莉金!

On Tue, Nov 29, 2016 at 9:34 AM, Huaxiang Sun  wrote:

>
> Congratulations, Lijin!
>
> > On Nov 29, 2016, at 5:15 AM, 宾莉金 or binlijin  wrote:
> >
> > Thanks everyone. :)
> >
> > Looking forward to keep doing cool stuff with you guys.
> >
> > 2016-11-29 19:01 GMT+08:00 ramkrishna vasudevan <
> > ramkrishna.s.vasude...@gmail.com>:
> >
> >> Congratulations !! All the best !!!
> >>
> >> On Tue, Nov 29, 2016 at 4:29 PM, Guanghao Zhang 
> >> wrote:
> >>
> >>> Congratulations!
> >>>
> >>> 2016-11-29 17:48 GMT+08:00 Duo Zhang :
> >>>
>  On behalf of the Apache HBase PMC, I am pleased to announce that Lijin
>  Bin(binlijin) has accepted the PMC's invitation to become a committer
> >> on
>  the project. We appreciate all of Lijin's generous contributions thus
> >> far
>  and look forward to his continued involvement.
> 
>  Congratulations and welcome, Lijin!
> 
> >>>
> >>
> >
> >
> >
> > --
> > *Best Regards,*
> > lijin bin
>
>

[jira] [Created] (HBASE-17195) Split/Merge - Update of FN info along with regionState change

[Thiruvel Thirumoolan (JIRA)]

Thiruvel Thirumoolan created HBASE-17195:


 Summary: Split/Merge - Update of FN info along with regionState 
change
 Key: HBASE-17195
 URL: https://issues.apache.org/jira/browse/HBASE-17195
 Project: HBase
  Issue Type: Sub-task
Reporter: Thiruvel Thirumoolan
Assignee: Thiruvel Thirumoolan
Priority: Minor


Follow up optimization to HBASE-16941 to reduce the number of edits to meta 
during a split/merge. Once balancer changes are in (where lot of updates 
happen) will consolidate FN updates to META and see if it can be done better.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: [ANNOUNCE] New HBase committer Phil Yang

[Huaxiang Sun]

Congratulations, Phil!

> On Nov 29, 2016, at 5:29 AM, Yu Li  wrote:
> 
> Congrats and welcome Phil!
> 
> Best Regards,
> Yu
> 
> On 29 November 2016 at 19:01, Anoop John  wrote:
> 
>> Congrats and welcome Phil...  Looking forward for many more
>> contributions from u.
>> 
>> -Anoop-
>> 
>> On Tue, Nov 29, 2016 at 4:30 PM, Anoop John  wrote:
>>> Congrats and welcome Binlijin.
>>> 
>>> -Anoop-
>>> 
>>> On Tue, Nov 29, 2016 at 4:29 PM, Guanghao Zhang 
>> wrote:
 Congratulations!
 
 2016-11-29 17:49 GMT+08:00 Duo Zhang :
 
> On behalf of the Apache HBase PMC, I am pleased to announce that Phil
>> Yang
> has accepted the PMC's invitation to become a committer on the
>> project. We
> appreciate all of Phil's generous contributions thus far and look
>> forward
> to his continued involvement.
> 
> Congratulations and welcome, Phil!
> 
>> 

Re: [ANNOUNCE] New HBase committer Lijin Bin

[Huaxiang Sun]

Congratulations, Lijin!

> On Nov 29, 2016, at 5:15 AM, 宾莉金 or binlijin  wrote:
> 
> Thanks everyone. :)
> 
> Looking forward to keep doing cool stuff with you guys.
> 
> 2016-11-29 19:01 GMT+08:00 ramkrishna vasudevan <
> ramkrishna.s.vasude...@gmail.com>:
> 
>> Congratulations !! All the best !!!
>> 
>> On Tue, Nov 29, 2016 at 4:29 PM, Guanghao Zhang 
>> wrote:
>> 
>>> Congratulations!
>>> 
>>> 2016-11-29 17:48 GMT+08:00 Duo Zhang :
>>> 
 On behalf of the Apache HBase PMC, I am pleased to announce that Lijin
 Bin(binlijin) has accepted the PMC's invitation to become a committer
>> on
 the project. We appreciate all of Lijin's generous contributions thus
>> far
 and look forward to his continued involvement.
 
 Congratulations and welcome, Lijin!
 
>>> 
>> 
> 
> 
> 
> -- 
> *Best Regards,*
> lijin bin

Re: [ANNOUNCE] New HBase committer Phil Yang

[Esteban Gutierrez]

Congratulations, Phil!


--
Cloudera, Inc.


On Tue, Nov 29, 2016 at 9:07 AM, Stack  wrote:

> Welcome Phil!
> St.Ack
>
> On Tue, Nov 29, 2016 at 1:49 AM, Duo Zhang  wrote:
>
> > On behalf of the Apache HBase PMC, I am pleased to announce that Phil
> Yang
> > has accepted the PMC's invitation to become a committer on the project.
> We
> > appreciate all of Phil's generous contributions thus far and look forward
> > to his continued involvement.
> >
> > Congratulations and welcome, Phil!
> >
>

Re: [ANNOUNCE] New HBase committer Lijin Bin

[Esteban Gutierrez]

Congratulations and welcome, Lijin!

--
Cloudera, Inc.


On Tue, Nov 29, 2016 at 5:32 AM, Yu Li  wrote:

> Congratulations and welcome Lijin!
>
> Best Regards,
> Yu
>
> On 29 November 2016 at 17:48, Duo Zhang  wrote:
>
> > On behalf of the Apache HBase PMC, I am pleased to announce that Lijin
> > Bin(binlijin) has accepted the PMC's invitation to become a committer on
> > the project. We appreciate all of Lijin's generous contributions thus far
> > and look forward to his continued involvement.
> >
> > Congratulations and welcome, Lijin!
> >
>

Re: [ANNOUNCE] New HBase committer Lijin Bin

[Stack]

Welcome Lijin!

On Tue, Nov 29, 2016 at 1:48 AM, Duo Zhang  wrote:

> On behalf of the Apache HBase PMC, I am pleased to announce that Lijin
> Bin(binlijin) has accepted the PMC's invitation to become a committer on
> the project. We appreciate all of Lijin's generous contributions thus far
> and look forward to his continued involvement.
>
> Congratulations and welcome, Lijin!
>

Re: [ANNOUNCE] New HBase committer Phil Yang

[Stack]

Welcome Phil!
St.Ack

On Tue, Nov 29, 2016 at 1:49 AM, Duo Zhang  wrote:

> On behalf of the Apache HBase PMC, I am pleased to announce that Phil Yang
> has accepted the PMC's invitation to become a committer on the project. We
> appreciate all of Phil's generous contributions thus far and look forward
> to his continued involvement.
>
> Congratulations and welcome, Phil!
>

[jira] [Resolved] (HBASE-17012) Handle Offheap cells in CompressedKvEncoder

[ramkrishna.s.vasudevan (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HBASE-17012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ramkrishna.s.vasudevan resolved HBASE-17012.

  Resolution: Fixed
Hadoop Flags: Reviewed

> Handle Offheap cells in CompressedKvEncoder
> ---
>
> Key: HBASE-17012
> URL: https://issues.apache.org/jira/browse/HBASE-17012
> Project: HBase
>  Issue Type: Sub-task
>  Components: regionserver
>Affects Versions: 2.0.0
>Reporter: Anoop Sam John
>Assignee: ramkrishna.s.vasudevan
> Fix For: 2.0.0
>
> Attachments: HBASE-17012_1.patch, HBASE-17012_2.patch, 
> HBASE-17012_3.patch, HBASE-17012_4.patch, HBASE-17012_5.patch, 
> HBASE-17012_6.patch
>
>
> When we deal with off heap cells we will end up copying Cell components on 
> heap
> {code}
> public void write(Cell cell) throws IOException {
> .
>   write(cell.getRowArray(), cell.getRowOffset(), cell.getRowLength(), 
> compression.rowDict);
>   write(cell.getFamilyArray(), cell.getFamilyOffset(), 
> cell.getFamilyLength(),
>   compression.familyDict);
>   write(cell.getQualifierArray(), cell.getQualifierOffset(), 
> cell.getQualifierLength(),
>   compression.qualifierDict);
> ..
>   out.write(cell.getValueArray(), cell.getValueOffset(), 
> cell.getValueLength());
> ...
> {code}
> We need to avoid this.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: [ANNOUNCE] New HBase committer Lijin Bin

[Ted Yu]

Congratulations, Lijin. 

On Tuesday, November 29, 2016 3:01 AM, Anoop John  
wrote:
 

 Congrats and welcome Binlijin.

-Anoop-

On Tue, Nov 29, 2016 at 3:18 PM, Duo Zhang  wrote:
> On behalf of the Apache HBase PMC, I am pleased to announce that Lijin
> Bin(binlijin) has accepted the PMC's invitation to become a committer on
> the project. We appreciate all of Lijin's generous contributions thus far
> and look forward to his continued involvement.
>
> Congratulations and welcome, Lijin!


   

Re: [ANNOUNCE] New HBase committer Phil Yang

[Ted Yu]

Congratulations, Phil. 

On Tuesday, November 29, 2016 1:49 AM, Duo Zhang  
wrote:
 

 On behalf of the Apache HBase PMC, I am pleased to announce that Phil Yang
has accepted the PMC's invitation to become a committer on the project. We
appreciate all of Phil's generous contributions thus far and look forward
to his continued involvement.

Congratulations and welcome, Phil!


   

Successful: HBase Generate Website

[Apache Jenkins Server]

Build status: Successful

If successful, the website and docs have been generated. To update the live 
site, follow the instructions below. If failed, skip to the bottom of this 
email.

Use the following commands to download the patch and apply it to a clean branch 
based on origin/asf-site. If you prefer to keep the hbase-site repo around 
permanently, you can skip the clone step.

  git clone https://git-wip-us.apache.org/repos/asf/hbase-site.git

  cd hbase-site
  wget -O- 
https://builds.apache.org/job/hbase_generate_website/421/artifact/website.patch.zip
 | funzip > e5dad24a9cb35d831a0ee1cf0eeb14b3719ab7ef.patch
  git fetch
  git checkout -b asf-site-e5dad24a9cb35d831a0ee1cf0eeb14b3719ab7ef 
origin/asf-site
  git am --whitespace=fix e5dad24a9cb35d831a0ee1cf0eeb14b3719ab7ef.patch

At this point, you can preview the changes by opening index.html or any of the 
other HTML pages in your local 
asf-site-e5dad24a9cb35d831a0ee1cf0eeb14b3719ab7ef branch.

There are lots of spurious changes, such as timestamps and CSS styles in 
tables, so a generic git diff is not very useful. To see a list of files that 
have been added, deleted, renamed, changed type, or are otherwise interesting, 
use the following command:

  git diff --name-status --diff-filter=ADCRTXUB origin/asf-site

To see only files that had 100 or more lines changed:

  git diff --stat origin/asf-site | grep -E '[1-9][0-9]{2,}'

When you are satisfied, publish your changes to origin/asf-site using these 
commands:

  git commit --allow-empty -m "Empty commit" # to work around a current ASF 
INFRA bug
  git push origin asf-site-e5dad24a9cb35d831a0ee1cf0eeb14b3719ab7ef:asf-site
  git checkout asf-site
  git branch -D asf-site-e5dad24a9cb35d831a0ee1cf0eeb14b3719ab7ef

Changes take a couple of minutes to be propagated. You can verify whether they 
have been propagated by looking at the Last Published date at the bottom of 
http://hbase.apache.org/. It should match the date in the index.html on the 
asf-site branch in Git.

As a courtesy- reply-all to this email to let other committers know you pushed 
the site.



If failed, see https://builds.apache.org/job/hbase_generate_website/421/console

Re: Aborted: HBase Generate Website

[Sean Busbey]

this was me stopping the run so that today's could include HBASE-17192.

On Tue, Nov 29, 2016 at 8:54 AM, Apache Jenkins Server
 wrote:
> Build status: Aborted
>
> If successful, the website and docs have been generated. To update the live 
> site, follow the instructions below. If failed, skip to the bottom of this 
> email.
>
> Use the following commands to download the patch and apply it to a clean 
> branch based on origin/asf-site. If you prefer to keep the hbase-site repo 
> around permanently, you can skip the clone step.
>
>   git clone https://git-wip-us.apache.org/repos/asf/hbase-site.git
>
>   cd hbase-site
>   wget -O- 
> https://builds.apache.org/job/hbase_generate_website/420/artifact/website.patch.zip
>  | funzip > ${GIT_SHA}.patch
>   git fetch
>   git checkout -b asf-site-${GIT_SHA} origin/asf-site
>   git am --whitespace=fix $GIT_SHA.patch
>
> At this point, you can preview the changes by opening index.html or any of 
> the other HTML pages in your local asf-site-${GIT_SHA} branch.
>
> There are lots of spurious changes, such as timestamps and CSS styles in 
> tables, so a generic git diff is not very useful. To see a list of files that 
> have been added, deleted, renamed, changed type, or are otherwise 
> interesting, use the following command:
>
>   git diff --name-status --diff-filter=ADCRTXUB origin/asf-site
>
> To see only files that had 100 or more lines changed:
>
>   git diff --stat origin/asf-site | grep -E '[1-9][0-9]{2,}'
>
> When you are satisfied, publish your changes to origin/asf-site using these 
> commands:
>
>   git commit --allow-empty -m "Empty commit" # to work around a current ASF 
> INFRA bug
>   git push origin asf-site-${GIT_SHA}:asf-site
>   git checkout asf-site
>   git branch -D asf-site-${GIT_SHA}
>
> Changes take a couple of minutes to be propagated. You can verify whether 
> they have been propagated by looking at the Last Published date at the bottom 
> of http://hbase.apache.org/. It should match the date in the index.html on 
> the asf-site branch in Git.
>
> As a courtesy- reply-all to this email to let other committers know you 
> pushed the site.
>
>
>
> If failed, see 
> https://builds.apache.org/job/hbase_generate_website/420/console

Aborted: HBase Generate Website

[Apache Jenkins Server]

Build status: Aborted

If successful, the website and docs have been generated. To update the live 
site, follow the instructions below. If failed, skip to the bottom of this 
email.

Use the following commands to download the patch and apply it to a clean branch 
based on origin/asf-site. If you prefer to keep the hbase-site repo around 
permanently, you can skip the clone step.

  git clone https://git-wip-us.apache.org/repos/asf/hbase-site.git

  cd hbase-site
  wget -O- 
https://builds.apache.org/job/hbase_generate_website/420/artifact/website.patch.zip
 | funzip > ${GIT_SHA}.patch
  git fetch
  git checkout -b asf-site-${GIT_SHA} origin/asf-site
  git am --whitespace=fix $GIT_SHA.patch

At this point, you can preview the changes by opening index.html or any of the 
other HTML pages in your local asf-site-${GIT_SHA} branch.

There are lots of spurious changes, such as timestamps and CSS styles in 
tables, so a generic git diff is not very useful. To see a list of files that 
have been added, deleted, renamed, changed type, or are otherwise interesting, 
use the following command:

  git diff --name-status --diff-filter=ADCRTXUB origin/asf-site

To see only files that had 100 or more lines changed:

  git diff --stat origin/asf-site | grep -E '[1-9][0-9]{2,}'

When you are satisfied, publish your changes to origin/asf-site using these 
commands:

  git commit --allow-empty -m "Empty commit" # to work around a current ASF 
INFRA bug
  git push origin asf-site-${GIT_SHA}:asf-site
  git checkout asf-site
  git branch -D asf-site-${GIT_SHA}

Changes take a couple of minutes to be propagated. You can verify whether they 
have been propagated by looking at the Last Published date at the bottom of 
http://hbase.apache.org/. It should match the date in the index.html on the 
asf-site branch in Git.

As a courtesy- reply-all to this email to let other committers know you pushed 
the site.



If failed, see https://builds.apache.org/job/hbase_generate_website/420/console

Re: [ANNOUNCE] New HBase committer Phil Yang

[Anoop John]

Congrats and welcome Binlijin.

-Anoop-

On Tue, Nov 29, 2016 at 4:29 PM, Guanghao Zhang  wrote:
> Congratulations!
>
> 2016-11-29 17:49 GMT+08:00 Duo Zhang :
>
>> On behalf of the Apache HBase PMC, I am pleased to announce that Phil Yang
>> has accepted the PMC's invitation to become a committer on the project. We
>> appreciate all of Phil's generous contributions thus far and look forward
>> to his continued involvement.
>>
>> Congratulations and welcome, Phil!
>>

Re: [ANNOUNCE] New HBase committer Phil Yang

[Anoop John]

Congrats and welcome Phil...  Looking forward for many more
contributions from u.

-Anoop-

On Tue, Nov 29, 2016 at 4:30 PM, Anoop John  wrote:
> Congrats and welcome Binlijin.
>
> -Anoop-
>
> On Tue, Nov 29, 2016 at 4:29 PM, Guanghao Zhang  wrote:
>> Congratulations!
>>
>> 2016-11-29 17:49 GMT+08:00 Duo Zhang :
>>
>>> On behalf of the Apache HBase PMC, I am pleased to announce that Phil Yang
>>> has accepted the PMC's invitation to become a committer on the project. We
>>> appreciate all of Phil's generous contributions thus far and look forward
>>> to his continued involvement.
>>>
>>> Congratulations and welcome, Phil!
>>>

Re: [ANNOUNCE] New HBase committer Lijin Bin

[Anoop John]

Congrats and welcome Binlijin.

-Anoop-

On Tue, Nov 29, 2016 at 3:18 PM, Duo Zhang  wrote:
> On behalf of the Apache HBase PMC, I am pleased to announce that Lijin
> Bin(binlijin) has accepted the PMC's invitation to become a committer on
> the project. We appreciate all of Lijin's generous contributions thus far
> and look forward to his continued involvement.
>
> Congratulations and welcome, Lijin!

Re: [ANNOUNCE] New HBase committer Lijin Bin

[ramkrishna vasudevan]

Congratulations !! All the best !!!

On Tue, Nov 29, 2016 at 4:29 PM, Guanghao Zhang  wrote:

> Congratulations!
>
> 2016-11-29 17:48 GMT+08:00 Duo Zhang :
>
> > On behalf of the Apache HBase PMC, I am pleased to announce that Lijin
> > Bin(binlijin) has accepted the PMC's invitation to become a committer on
> > the project. We appreciate all of Lijin's generous contributions thus far
> > and look forward to his continued involvement.
> >
> > Congratulations and welcome, Lijin!
> >
>

Re: [ANNOUNCE] New HBase committer Phil Yang

[ramkrishna vasudevan]

Congratulations !! All the best !!!

On Tue, Nov 29, 2016 at 4:29 PM, Guanghao Zhang  wrote:

> Congratulations!
>
> 2016-11-29 17:49 GMT+08:00 Duo Zhang :
>
> > On behalf of the Apache HBase PMC, I am pleased to announce that Phil
> Yang
> > has accepted the PMC's invitation to become a committer on the project.
> We
> > appreciate all of Phil's generous contributions thus far and look forward
> > to his continued involvement.
> >
> > Congratulations and welcome, Phil!
> >
>

Re: [ANNOUNCE] New HBase committer Lijin Bin

[Guanghao Zhang]

Congratulations!

2016-11-29 17:48 GMT+08:00 Duo Zhang :

> On behalf of the Apache HBase PMC, I am pleased to announce that Lijin
> Bin(binlijin) has accepted the PMC's invitation to become a committer on
> the project. We appreciate all of Lijin's generous contributions thus far
> and look forward to his continued involvement.
>
> Congratulations and welcome, Lijin!
>

Re: [ANNOUNCE] New HBase committer Phil Yang

[Guanghao Zhang]

Congratulations!

2016-11-29 17:49 GMT+08:00 Duo Zhang :

> On behalf of the Apache HBase PMC, I am pleased to announce that Phil Yang
> has accepted the PMC's invitation to become a committer on the project. We
> appreciate all of Phil's generous contributions thus far and look forward
> to his continued involvement.
>
> Congratulations and welcome, Phil!
>

[jira] [Created] (HBASE-17193) Add Metrics for offheap memstore flushes

[ramkrishna.s.vasudevan (JIRA)]

ramkrishna.s.vasudevan created HBASE-17193:
--

 Summary: Add Metrics for offheap memstore flushes
 Key: HBASE-17193
 URL: https://issues.apache.org/jira/browse/HBASE-17193
 Project: HBase
  Issue Type: Sub-task
Affects Versions: 2.0.0
Reporter: ramkrishna.s.vasudevan
Assignee: ramkrishna.s.vasudevan
Priority: Minor


Like we have MetricsHeapMemoryManager - we need to add 
MetricsOffheapMemoryManager if we need to have metrics for offheap flushes.  I 
think this may even warrant a OffheapMemoryManager. Will raise a task for that 
later after discussion.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: Still Failing: HBase Generate Website

[Sean Busbey]

patch is up on:

https://issues.apache.org/jira/browse/HBASE-17192

On Tue, Nov 29, 2016 at 3:37 AM, Sean Busbey  wrote:
> I have figured out the problem. jira in a few.
>
> On Tue, Nov 29, 2016 at 3:23 AM, Sean Busbey  wrote:
>> git bisect led me to the commit immediately after our last known good
>> job. Reverting that commit didn't fix things. Attempting a new build
>> from the same commit used in our last known good job also failed with
>> the current error.
>>
>> I'm checking on some other leads and will follow up tomorrow.
>>
>> On Mon, Nov 28, 2016 at 4:03 PM, Sean Busbey  wrote:
>>> no idea. it's not often I see new cryptic maven errors. :/
>>>
>>> anyone have time to do a git bisect? about a week of changes shouldn't
>>> take too long.
>>>
>>> On Mon, Nov 28, 2016 at 10:01 AM, Dima Spivak  wrote:
 Anyone know what's up here? I don't see any obvious breaking changes, but
 mvn site fails in parent module with:

 
 [ERROR] Failed to execute goal
 org.apache.maven.plugins:maven-site-plugin:3.4:site (default-site) on
 project hbase: Execution default-site of goal
 org.apache.maven.plugins:maven-site-plugin:3.4:site failed: For artifact
 {null:null:null:jar}: The groupId cannot be empty. -> [Help 1]
 [ERROR]

 On Mon, Nov 28, 2016 at 6:34 AM Apache Jenkins Server <
 jenk...@builds.apache.org> wrote:

> Build status: Still Failing
>
> If successful, the website and docs have been generated. To update the
> live site, follow the instructions below. If failed, skip to the bottom of
> this email.
>
> Use the following commands to download the patch and apply it to a clean
> branch based on origin/asf-site. If you prefer to keep the hbase-site repo
> around permanently, you can skip the clone step.
>
>   git clone https://git-wip-us.apache.org/repos/asf/hbase-site.git
>
>   cd hbase-site
>   wget -O-
> https://builds.apache.org/job/hbase_generate_website/419/artifact/website.patch.zip
> | funzip > ${GIT_SHA}.patch
>   git fetch
>   git checkout -b asf-site-${GIT_SHA} origin/asf-site
>   git am --whitespace=fix $GIT_SHA.patch
>
> At this point, you can preview the changes by opening index.html or any of
> the other HTML pages in your local asf-site-${GIT_SHA} branch.
>
> There are lots of spurious changes, such as timestamps and CSS styles in
> tables, so a generic git diff is not very useful. To see a list of files
> that have been added, deleted, renamed, changed type, or are otherwise
> interesting, use the following command:
>
>   git diff --name-status --diff-filter=ADCRTXUB origin/asf-site
>
> To see only files that had 100 or more lines changed:
>
>   git diff --stat origin/asf-site | grep -E '[1-9][0-9]{2,}'
>
> When you are satisfied, publish your changes to origin/asf-site using
> these commands:
>
>   git commit --allow-empty -m "Empty commit" # to work around a current
> ASF INFRA bug
>   git push origin asf-site-${GIT_SHA}:asf-site
>   git checkout asf-site
>   git branch -D asf-site-${GIT_SHA}
>
> Changes take a couple of minutes to be propagated. You can verify whether
> they have been propagated by looking at the Last Published date at the
> bottom of http://hbase.apache.org/. It should match the date in the
> index.html on the asf-site branch in Git.
>
> As a courtesy- reply-all to this email to let other committers know you
> pushed the site.
>
>
>
> If failed, see
> https://builds.apache.org/job/hbase_generate_website/419/console
>>>
>>>
>>>
>>> --
>>> busbey

[jira] [Created] (HBASE-17192) remove use of scala-tools.org from pom

[Sean Busbey (JIRA)]

Sean Busbey created HBASE-17192:
---

 Summary: remove use of scala-tools.org from pom
 Key: HBASE-17192
 URL: https://issues.apache.org/jira/browse/HBASE-17192
 Project: HBase
  Issue Type: Bug
  Components: spark, website
Affects Versions: 2.0.0
Reporter: Sean Busbey
Assignee: Sean Busbey
Priority: Blocker
 Fix For: 2.0.0


our pom makes use of scala-tools.org for a repository. That domain currently 
issues redirects for all URLs; for maven coordinates those redirects lead to 
'not found' and the 'permantenly moved' HTML gets saved. this corrupts the 
local maven repository in a way that cause the mvn:site goal to give an opaque 
error:

{code}
[INFO] 
[INFO] BUILD FAILURE
[INFO] 
[INFO] Total time: 01:46 min
[INFO] Finished at: 2016-11-28T14:17:10+00:00
[INFO] Final Memory: 292M/6583M
[INFO] 
[ERROR] Failed to execute goal 
org.apache.maven.plugins:maven-site-plugin:3.4:site (default-site) on project 
hbase: Execution default-site of goal 
org.apache.maven.plugins:maven-site-plugin:3.4:site failed: For artifact 
{null:null:null:jar}: The groupId cannot be empty. -> [Help 1]
[ERROR] 
{code}

Rerunning in debug mode with {{mvn -X}} gives no additional useful information.

All artifacts from scala-tools.org are now found in maven central.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[ANNOUNCE] New HBase committer Phil Yang

[Duo Zhang]

On behalf of the Apache HBase PMC, I am pleased to announce that Phil Yang
has accepted the PMC's invitation to become a committer on the project. We
appreciate all of Phil's generous contributions thus far and look forward
to his continued involvement.

Congratulations and welcome, Phil!

[ANNOUNCE] New HBase committer Lijin Bin

[Duo Zhang]

On behalf of the Apache HBase PMC, I am pleased to announce that Lijin
Bin(binlijin) has accepted the PMC's invitation to become a committer on
the project. We appreciate all of Lijin's generous contributions thus far
and look forward to his continued involvement.

Congratulations and welcome, Lijin!

Re: Still Failing: HBase Generate Website

[Sean Busbey]

I have figured out the problem. jira in a few.

On Tue, Nov 29, 2016 at 3:23 AM, Sean Busbey  wrote:
> git bisect led me to the commit immediately after our last known good
> job. Reverting that commit didn't fix things. Attempting a new build
> from the same commit used in our last known good job also failed with
> the current error.
>
> I'm checking on some other leads and will follow up tomorrow.
>
> On Mon, Nov 28, 2016 at 4:03 PM, Sean Busbey  wrote:
>> no idea. it's not often I see new cryptic maven errors. :/
>>
>> anyone have time to do a git bisect? about a week of changes shouldn't
>> take too long.
>>
>> On Mon, Nov 28, 2016 at 10:01 AM, Dima Spivak  wrote:
>>> Anyone know what's up here? I don't see any obvious breaking changes, but
>>> mvn site fails in parent module with:
>>>
>>> 
>>> [ERROR] Failed to execute goal
>>> org.apache.maven.plugins:maven-site-plugin:3.4:site (default-site) on
>>> project hbase: Execution default-site of goal
>>> org.apache.maven.plugins:maven-site-plugin:3.4:site failed: For artifact
>>> {null:null:null:jar}: The groupId cannot be empty. -> [Help 1]
>>> [ERROR]
>>>
>>> On Mon, Nov 28, 2016 at 6:34 AM Apache Jenkins Server <
>>> jenk...@builds.apache.org> wrote:
>>>
 Build status: Still Failing

 If successful, the website and docs have been generated. To update the
 live site, follow the instructions below. If failed, skip to the bottom of
 this email.

 Use the following commands to download the patch and apply it to a clean
 branch based on origin/asf-site. If you prefer to keep the hbase-site repo
 around permanently, you can skip the clone step.

   git clone https://git-wip-us.apache.org/repos/asf/hbase-site.git

   cd hbase-site
   wget -O-
 https://builds.apache.org/job/hbase_generate_website/419/artifact/website.patch.zip
 | funzip > ${GIT_SHA}.patch
   git fetch
   git checkout -b asf-site-${GIT_SHA} origin/asf-site
   git am --whitespace=fix $GIT_SHA.patch

 At this point, you can preview the changes by opening index.html or any of
 the other HTML pages in your local asf-site-${GIT_SHA} branch.

 There are lots of spurious changes, such as timestamps and CSS styles in
 tables, so a generic git diff is not very useful. To see a list of files
 that have been added, deleted, renamed, changed type, or are otherwise
 interesting, use the following command:

   git diff --name-status --diff-filter=ADCRTXUB origin/asf-site

 To see only files that had 100 or more lines changed:

   git diff --stat origin/asf-site | grep -E '[1-9][0-9]{2,}'

 When you are satisfied, publish your changes to origin/asf-site using
 these commands:

   git commit --allow-empty -m "Empty commit" # to work around a current
 ASF INFRA bug
   git push origin asf-site-${GIT_SHA}:asf-site
   git checkout asf-site
   git branch -D asf-site-${GIT_SHA}

 Changes take a couple of minutes to be propagated. You can verify whether
 they have been propagated by looking at the Last Published date at the
 bottom of http://hbase.apache.org/. It should match the date in the
 index.html on the asf-site branch in Git.

 As a courtesy- reply-all to this email to let other committers know you
 pushed the site.



 If failed, see
 https://builds.apache.org/job/hbase_generate_website/419/console
>>
>>
>>
>> --
>> busbey

Re: Still Failing: HBase Generate Website

[Sean Busbey]

git bisect led me to the commit immediately after our last known good
job. Reverting that commit didn't fix things. Attempting a new build
from the same commit used in our last known good job also failed with
the current error.

I'm checking on some other leads and will follow up tomorrow.

On Mon, Nov 28, 2016 at 4:03 PM, Sean Busbey  wrote:
> no idea. it's not often I see new cryptic maven errors. :/
>
> anyone have time to do a git bisect? about a week of changes shouldn't
> take too long.
>
> On Mon, Nov 28, 2016 at 10:01 AM, Dima Spivak  wrote:
>> Anyone know what's up here? I don't see any obvious breaking changes, but
>> mvn site fails in parent module with:
>>
>> 
>> [ERROR] Failed to execute goal
>> org.apache.maven.plugins:maven-site-plugin:3.4:site (default-site) on
>> project hbase: Execution default-site of goal
>> org.apache.maven.plugins:maven-site-plugin:3.4:site failed: For artifact
>> {null:null:null:jar}: The groupId cannot be empty. -> [Help 1]
>> [ERROR]
>>
>> On Mon, Nov 28, 2016 at 6:34 AM Apache Jenkins Server <
>> jenk...@builds.apache.org> wrote:
>>
>>> Build status: Still Failing
>>>
>>> If successful, the website and docs have been generated. To update the
>>> live site, follow the instructions below. If failed, skip to the bottom of
>>> this email.
>>>
>>> Use the following commands to download the patch and apply it to a clean
>>> branch based on origin/asf-site. If you prefer to keep the hbase-site repo
>>> around permanently, you can skip the clone step.
>>>
>>>   git clone https://git-wip-us.apache.org/repos/asf/hbase-site.git
>>>
>>>   cd hbase-site
>>>   wget -O-
>>> https://builds.apache.org/job/hbase_generate_website/419/artifact/website.patch.zip
>>> | funzip > ${GIT_SHA}.patch
>>>   git fetch
>>>   git checkout -b asf-site-${GIT_SHA} origin/asf-site
>>>   git am --whitespace=fix $GIT_SHA.patch
>>>
>>> At this point, you can preview the changes by opening index.html or any of
>>> the other HTML pages in your local asf-site-${GIT_SHA} branch.
>>>
>>> There are lots of spurious changes, such as timestamps and CSS styles in
>>> tables, so a generic git diff is not very useful. To see a list of files
>>> that have been added, deleted, renamed, changed type, or are otherwise
>>> interesting, use the following command:
>>>
>>>   git diff --name-status --diff-filter=ADCRTXUB origin/asf-site
>>>
>>> To see only files that had 100 or more lines changed:
>>>
>>>   git diff --stat origin/asf-site | grep -E '[1-9][0-9]{2,}'
>>>
>>> When you are satisfied, publish your changes to origin/asf-site using
>>> these commands:
>>>
>>>   git commit --allow-empty -m "Empty commit" # to work around a current
>>> ASF INFRA bug
>>>   git push origin asf-site-${GIT_SHA}:asf-site
>>>   git checkout asf-site
>>>   git branch -D asf-site-${GIT_SHA}
>>>
>>> Changes take a couple of minutes to be propagated. You can verify whether
>>> they have been propagated by looking at the Last Published date at the
>>> bottom of http://hbase.apache.org/. It should match the date in the
>>> index.html on the asf-site branch in Git.
>>>
>>> As a courtesy- reply-all to this email to let other committers know you
>>> pushed the site.
>>>
>>>
>>>
>>> If failed, see
>>> https://builds.apache.org/job/hbase_generate_website/419/console
>
>
>
> --
> busbey