[jira] [Created] (HBASE-21814) Remove the TODO in AccessControlLists#addUserPermission

[Guanghao Zhang (JIRA)]

Guanghao Zhang created HBASE-21814:
--

 Summary: Remove the TODO in AccessControlLists#addUserPermission
 Key: HBASE-21814
 URL: https://issues.apache.org/jira/browse/HBASE-21814
 Project: HBase
  Issue Type: Bug
Reporter: Guanghao Zhang


The TODO was added by me. Because this method happens within the RS. But after 
HBASE-21739, grant/revoke will execute by master. So this is not a problem now.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (HBASE-21813) ServerNotRunningYet exception should include machine-readable server name

[Sergey Shelukhin (JIRA)]

Sergey Shelukhin created HBASE-21813:


 Summary: ServerNotRunningYet exception should include 
machine-readable server name
 Key: HBASE-21813
 URL: https://issues.apache.org/jira/browse/HBASE-21813
 Project: HBase
  Issue Type: Improvement
Reporter: Sergey Shelukhin


As far as I see, this exception is thrown before the start code of the 
destination can be verified from the request on RS side; the code that handles 
it (e.g. retries from open region procedure) use it to retry later on the same 
server. 
However, if the start code of the server that is not running is different from 
the intended start code of the operations those retries are a waste of time.
The exception should include a server name with a start code (which it already 
includes as part of the message in some cases), so that the caller could check 
that.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (HBASE-21812) Address ruby static analysis for shell module [2nd pass]

[Sakthi (JIRA)]

Sakthi created HBASE-21812:
--

 Summary: Address ruby static analysis for shell module [2nd pass]
 Key: HBASE-21812
 URL: https://issues.apache.org/jira/browse/HBASE-21812
 Project: HBase
  Issue Type: Improvement
Reporter: Sakthi
Assignee: Sakthi


HBASE-18239 did a pass. I think we can go for another round. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (HBASE-21811) region can be opened on two servers due to race condition with procedures and server reports

[Sergey Shelukhin (JIRA)]

Sergey Shelukhin created HBASE-21811:


 Summary: region can be opened on two servers due to race condition 
with procedures and server reports
 Key: HBASE-21811
 URL: https://issues.apache.org/jira/browse/HBASE-21811
 Project: HBase
  Issue Type: Bug
Affects Versions: 3.0.0
Reporter: Sergey Shelukhin



Looks like the region server responses are being processed incorrectly in 
places allowing te region to be opened on two servers.
* The region server report handling in procedures should check which server is 
reporting.
* Also although I didn't check (and it isn't implicated in this bug), RS must 
check in OPEN that it's actually the correct RS master sent open to (w.r.t. 
start timestamp)

This was previosuly "mitigated" by master killing the RS with incorrect 
reports, but due to race conditions with reports and assignment the report was 
replaced with a warning, so now this condition persists.
Regardless, the kill approach is not a good fix because there's still a window 
when a region can be opened on two servers.


A region is being opened by server_48c. The server dies, and we process the 
retry correctly (retry=3 because 2 previous similar open failures were 
processed correctly).
We start opening it on server_1aa now.
{noformat}
2019-01-28 18:12:09,862 INFO  [KeepAlivePEWorker-104] 
assignment.RegionStateStore: pid=4915 updating hbase:meta 
row=8be2a423b16471b9417f0f7de04281c6, regionState=ABNORMALLY_CLOSED
2019-01-28 18:12:09,862 INFO  [KeepAlivePEWorker-104] 
procedure.ServerCrashProcedure: pid=11944, state=RUNNABLE:SERVER_CRASH_ASSIGN, 
hasLock=true; ServerCrashProcedure server=server_48c,17020,1548726406632, 
splitWal=true, meta=false found RIT pid=4915, ppid=7, 
state=WAITING:REGION_STATE_TRANSITION_CONFIRM_OPENED, hasLock=true; 
TransitRegionStateProcedure table=table, 
region=8be2a423b16471b9417f0f7de04281c6, ASSIGN; rit=OPENING, 
location=server_48c,17020,1548726406632, table=table, 
region=8be2a423b16471b9417f0f7de04281c6

2019-01-28 18:12:10,778 INFO  [KeepAlivePEWorker-80] 
assignment.TransitRegionStateProcedure: Retry=3 of max=2147483647; pid=4915, 
ppid=7, state=RUNNABLE:REGION_STATE_TRANSITION_CONFIRM_OPENED, hasLock=true; 
TransitRegionStateProcedure table=table, 
region=8be2a423b16471b9417f0f7de04281c6, ASSIGN; rit=ABNORMALLY_CLOSED, 
location=null
...
2019-01-28 18:12:10,902 INFO  [KeepAlivePEWorker-80] 
assignment.TransitRegionStateProcedure: Starting pid=4915, ppid=7, 
state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, hasLock=true; 
TransitRegionStateProcedure table=table, 
region=8be2a423b16471b9417f0f7de04281c6, ASSIGN; rit=ABNORMALLY_CLOSED, 
location=null; forceNewPlan=true, retain=false
2019-01-28 18:12:11,114 INFO  [PEWorker-7] assignment.RegionStateStore: 
pid=4915 updating hbase:meta row=8be2a423b16471b9417f0f7de04281c6, 
regionState=OPENING, regionLocation=server_1aa,17020,1548727658713
{noformat}
However, we get the remote procedure failure from 48c after we've already 
started that.
It actually tried to open on the restarted RS, which makes me wonder if this is 
safe also w.r.t. other races - what if RS already initialized and didn't error 
out?
Need to check if we verify the start code expected by master on RS when opening.
{noformat}
2019-01-28 18:12:12,179 WARN  [RSProcedureDispatcher-pool4-t362] 
assignment.RegionRemoteProcedureBase: The remote operation pid=11050, 
ppid=4915, state=SUCCESS, hasLock=false; 
org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure for region 
{ENCODED => 8be2a423b16471b9417f0f7de04281c6 ... to server 
server_48c,17020,1548726406632 failed
org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: 
org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server 
server_48c,17020,1548727752747 is not running yet
{noformat}
Without any other reason (at least logged), the RIT immediately retries again 
and chooses a new candidate.
{noformat}
2019-01-28 18:12:12,289 INFO  [KeepAlivePEWorker-100] 
assignment.TransitRegionStateProcedure: Retry=4 of max=2147483647; pid=4915, 
ppid=7, state=RUNNABLE:REGION_STATE_TRANSITION_CONFIRM_OPENED, hasLock=true; 
TransitRegionStateProcedure table=table, 
region=8be2a423b16471b9417f0f7de04281c6, ASSIGN; rit=OPENING, 
location=server_1aa,17020,1548727658713
...
2019-01-28 18:12:12,668 INFO  [PEWorker-9] assignment.RegionStateStore: 
pid=4915 updating hbase:meta row=8be2a423b16471b9417f0f7de04281c6, 
regionState=OPENING, regionLocation=server_fd3,17020,1548727536972
{noformat}
It then retries again and goes to the new 48c, but that's unrelated.
{noformat}
2019-01-28 18:26:29,480 INFO  [KeepAlivePEWorker-154] 
assignment.RegionStateStore: pid=4915 updating hbase:meta 
row=8be2a423b16471b9417f0f7de04281c6, regionState=OPENING, 
regionLocation=server_48c,17020,1548727752747
{noformat}
What does happen though is that 1aa, that never responded when the RIT 
erroneously 

Re: Requesting access to hbase slack channel

[Josh Elser]

Robert, William, and 车 珣 all have been invited.

On 1/30/19 12:58 AM, 车 珣 wrote:



Could you please invite me: singleon...@gmail.com . Thank you~
On 01/30/2019 13:25，William 
Shen wrote：
Can you please invite me as well? Thank you.

On Sat, Jan 19, 2019 at 7:50 AM Robert Yokota  wrote:

Me too please :) rayok...@gmail.com

On Fri, Jan 18, 2019 at 2:06 AM Peter Somogyi  wrote:

Sent.

On Fri, Jan 18, 2019 at 7:48 AM Abhishek Gupta 
wrote:

Hi,

I would like an invitation too abhila...@gmail.com

Thanks

On Fri, Jan 18, 2019 at 11:38 AM Manjeet Singh <
manjeet.chand...@gmail.com

wrote:

Done

On Fri, 18 Jan 2019, 11:24 Buchi Reddy Busi Reddy <
mailtobu...@gmail.com
wrote:

Can you also invite mailtobu...@gmail.com please?

On Thu, Jan 17, 2019 at 8:34 PM Manjeet Singh <
manjeet.chand...@gmail.com>
wrote:

Seems someone else already did it

Manjeet

On Wed, 16 Jan 2019, 17:33 Nihal Jain 
wrote:

Hi Team,

I was wondering if I could get access to the HBase user
slack
channel

https://eur04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fapache-hbase.slack.comdata=02%7C01%7C%7Cc2b9d9be2f9f498e25a208d686734bcb%7C84df9e7fe9f640afb435%7C1%7C0%7C636844227076460951sdata=XJDTTVDIXh3k0mnUt4cSTvM0uCmScUAPUZSfzxAi4eM%3Dreserved=0

It says here <
https://eur04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fissues.apache.org%2Fjira%2Fbrowse%2FHBASE-16413data=02%7C01%7C%7Cc2b9d9be2f9f498e25a208d686734bcb%7C84df9e7fe9f640afb435%7C1%7C0%7C636844227076460951sdata=MStwCobJY76EyALeoOClqPI%2FjkRrjp93qgjEEKYPAQA%3Dreserved=0>
that I
should email you guys  :)

Thanks,
Madhur Pant

[jira] [Created] (HBASE-21810) bulkload support set hfile compression on client

[Yechao Chen (JIRA)]

Yechao Chen created HBASE-21810:
---

 Summary: bulkload  support set hfile compression on client 
 Key: HBASE-21810
 URL: https://issues.apache.org/jira/browse/HBASE-21810
 Project: HBase
  Issue Type: Improvement
Reporter: Yechao Chen
Assignee: Yechao Chen






--
This message was sent by Atlassian JIRA
(v7.6.3#76005)