[jira] [Commented] (HBASE-18810) TestClientScannerRPCTimeout failing in branch-1 / branch-1.4
[
https://issues.apache.org/jira/browse/HBASE-18810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169167#comment-16169167
]
Chia-Ping Tsai commented on HBASE-18810:
I have attached the patch in HBASE-18415. [~apurtell] Please take a look if you
have free time. Thanks.
> TestClientScannerRPCTimeout failing in branch-1 / branch-1.4
>
>
> Key: HBASE-18810
> URL: https://issues.apache.org/jira/browse/HBASE-18810
> Project: HBase
> Issue Type: Bug
>Reporter: Andrew Purtell
>Assignee: Andrew Purtell
> Fix For: 1.4.0, 1.5.0
>
>
> TestClientScannerRPCTimeout is failing in branch-1 / branch-1.4, but it's a
> setup problem involving CreateTableProcedure. Fails for me the first time in
> both Linux and MacOS dev environments.
> Bisect says this is the cause, been there for a while
> {noformat}
> commit af359d03b5e2cc798cee8ba52d2a9fcbb1022104
> Author: Stephen Yuan Jiang
> Date: Tue Jul 18 06:58:29 2017 -0700
> HBASE-16488 Starting namespace and quota services in master startup
> asynchronizely (Stephen Yuan Jiang)
> {noformat}
> and sure enough, if I revert HBASE-16488 from branch-1 / branch-1.4 then the
> test passes again.
> {noformat}
> Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 7.211 sec <<<
> FAILURE! - in org.apache.hadoop.hbase.client.TestClientScannerRPCTimeout
> testScannerNextRPCTimesout(org.apache.hadoop.hbase.client.TestClientScannerRPCTimeout)
> Time elapsed: 6.248 sec <<< ERROR!
> org.apache.hadoop.hbase.TableExistsException: testScannerNextRPCTimesout
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> Method)
> at
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
> at
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
> at
> org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106)
> at
> org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:95)
> at
> org.apache.hadoop.hbase.util.ForeignExceptionUtil.toIOException(ForeignExceptionUtil.java:45)
> at
> org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.convertResult(HBaseAdmin.java:4774)
> at
> org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.waitProcedureResult(HBaseAdmin.java:4732)
> at
> org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.get(HBaseAdmin.java:4665)
> at
> org.apache.hadoop.hbase.client.HBaseAdmin.createTable(HBaseAdmin.java:679)
> at
> org.apache.hadoop.hbase.HBaseTestingUtility.createTable(HBaseTestingUtility.java:1500)
> at
> org.apache.hadoop.hbase.HBaseTestingUtility.createTable(HBaseTestingUtility.java:1547)
> at
> org.apache.hadoop.hbase.HBaseTestingUtility.createTable(HBaseTestingUtility.java:1438)
> at
> org.apache.hadoop.hbase.HBaseTestingUtility.createTable(HBaseTestingUtility.java:1414)
> at
> org.apache.hadoop.hbase.HBaseTestingUtility.createTable(HBaseTestingUtility.java:1370)
> at
> org.apache.hadoop.hbase.client.TestClientScannerRPCTimeout.testScannerNextRPCTimesout(TestClientScannerRPCTimeout.java:87)
> Caused by: org.apache.hadoop.ipc.RemoteException: testScannerNextRPCTimesout
> at
> org.apache.hadoop.hbase.master.procedure.CreateTableProcedure.prepareCreate(CreateTableProcedure.java:286)
> at
> org.apache.hadoop.hbase.master.procedure.CreateTableProcedure.executeFromState(CreateTableProcedure.java:107)
> at
> org.apache.hadoop.hbase.master.procedure.CreateTableProcedure.executeFromState(CreateTableProcedure.java:59)
> at
> org.apache.hadoop.hbase.procedure2.StateMachineProcedure.execute(StateMachineProcedure.java:139)
> at
> org.apache.hadoop.hbase.procedure2.Procedure.doExecute(Procedure.java:506)
> at
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1152)
> at
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execLoop(ProcedureExecutor.java:940)
> at
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execLoop(ProcedureExecutor.java:893)
> at
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$400(ProcedureExecutor.java:76)
> at
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor$2.run(ProcedureExecutor.java:478)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (HBASE-18810) TestClientScannerRPCTimeout failing in branch-1 / branch-1.4
[
https://issues.apache.org/jira/browse/HBASE-18810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167374#comment-16167374
]
Chia-Ping Tsai commented on HBASE-18810:
The error is due to the retry mechanism. If the first quest is timeout, the
client will retry with different group/nonce. And then, the
TableExistsException occurs if the second request is executed after first
request has be finished. This bug can be reproduced by making
MasterObserver#postCreateTable() sleep.
> TestClientScannerRPCTimeout failing in branch-1 / branch-1.4
>
>
> Key: HBASE-18810
> URL: https://issues.apache.org/jira/browse/HBASE-18810
> Project: HBase
> Issue Type: Bug
>Reporter: Andrew Purtell
>Assignee: Andrew Purtell
> Fix For: 1.4.0, 1.5.0
>
>
> TestClientScannerRPCTimeout is failing in branch-1 / branch-1.4, but it's a
> setup problem involving CreateTableProcedure. Fails for me the first time in
> both Linux and MacOS dev environments.
> Bisect says this is the cause, been there for a while
> {noformat}
> commit af359d03b5e2cc798cee8ba52d2a9fcbb1022104
> Author: Stephen Yuan Jiang
> Date: Tue Jul 18 06:58:29 2017 -0700
> HBASE-16488 Starting namespace and quota services in master startup
> asynchronizely (Stephen Yuan Jiang)
> {noformat}
> and sure enough, if I revert HBASE-16488 from branch-1 / branch-1.4 then the
> test passes again.
> {noformat}
> Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 7.211 sec <<<
> FAILURE! - in org.apache.hadoop.hbase.client.TestClientScannerRPCTimeout
> testScannerNextRPCTimesout(org.apache.hadoop.hbase.client.TestClientScannerRPCTimeout)
> Time elapsed: 6.248 sec <<< ERROR!
> org.apache.hadoop.hbase.TableExistsException: testScannerNextRPCTimesout
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> Method)
> at
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
> at
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
> at
> org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106)
> at
> org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:95)
> at
> org.apache.hadoop.hbase.util.ForeignExceptionUtil.toIOException(ForeignExceptionUtil.java:45)
> at
> org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.convertResult(HBaseAdmin.java:4774)
> at
> org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.waitProcedureResult(HBaseAdmin.java:4732)
> at
> org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.get(HBaseAdmin.java:4665)
> at
> org.apache.hadoop.hbase.client.HBaseAdmin.createTable(HBaseAdmin.java:679)
> at
> org.apache.hadoop.hbase.HBaseTestingUtility.createTable(HBaseTestingUtility.java:1500)
> at
> org.apache.hadoop.hbase.HBaseTestingUtility.createTable(HBaseTestingUtility.java:1547)
> at
> org.apache.hadoop.hbase.HBaseTestingUtility.createTable(HBaseTestingUtility.java:1438)
> at
> org.apache.hadoop.hbase.HBaseTestingUtility.createTable(HBaseTestingUtility.java:1414)
> at
> org.apache.hadoop.hbase.HBaseTestingUtility.createTable(HBaseTestingUtility.java:1370)
> at
> org.apache.hadoop.hbase.client.TestClientScannerRPCTimeout.testScannerNextRPCTimesout(TestClientScannerRPCTimeout.java:87)
> Caused by: org.apache.hadoop.ipc.RemoteException: testScannerNextRPCTimesout
> at
> org.apache.hadoop.hbase.master.procedure.CreateTableProcedure.prepareCreate(CreateTableProcedure.java:286)
> at
> org.apache.hadoop.hbase.master.procedure.CreateTableProcedure.executeFromState(CreateTableProcedure.java:107)
> at
> org.apache.hadoop.hbase.master.procedure.CreateTableProcedure.executeFromState(CreateTableProcedure.java:59)
> at
> org.apache.hadoop.hbase.procedure2.StateMachineProcedure.execute(StateMachineProcedure.java:139)
> at
> org.apache.hadoop.hbase.procedure2.Procedure.doExecute(Procedure.java:506)
> at
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1152)
> at
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execLoop(ProcedureExecutor.java:940)
> at
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execLoop(ProcedureExecutor.java:893)
> at
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$400(ProcedureExecutor.java:76)
> at
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor$2.run(ProcedureExecutor.java:478)
> {noformat}
--
This message was sent by
[jira] [Commented] (HBASE-18810) TestClientScannerRPCTimeout failing in branch-1 / branch-1.4
[
https://issues.apache.org/jira/browse/HBASE-18810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16165244#comment-16165244
]
Andrew Purtell commented on HBASE-18810:
I'm checking for impact of the revert on other tests, but I plan to revert.
> TestClientScannerRPCTimeout failing in branch-1 / branch-1.4
>
>
> Key: HBASE-18810
> URL: https://issues.apache.org/jira/browse/HBASE-18810
> Project: HBase
> Issue Type: Bug
>Reporter: Andrew Purtell
>
> TestClientScannerRPCTimeout is failing in branch-1 / branch-1.4, but it's a
> setup problem involving CreateTableProcedure. Fails for me the first time in
> both Linux and MacOS dev environments.
> Bisect says this is the cause, been there for a while
> {noformat}
> commit af359d03b5e2cc798cee8ba52d2a9fcbb1022104
> Author: Stephen Yuan Jiang
> Date: Tue Jul 18 06:58:29 2017 -0700
> HBASE-16488 Starting namespace and quota services in master startup
> asynchronizely (Stephen Yuan Jiang)
> {noformat}
> and sure enough, if I revert HBASE-16488 from branch-1 / branch-1.4 then the
> test passes again.
> {noformat}
> Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 7.211 sec <<<
> FAILURE! - in org.apache.hadoop.hbase.client.TestClientScannerRPCTimeout
> testScannerNextRPCTimesout(org.apache.hadoop.hbase.client.TestClientScannerRPCTimeout)
> Time elapsed: 6.248 sec <<< ERROR!
> org.apache.hadoop.hbase.TableExistsException: testScannerNextRPCTimesout
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> Method)
> at
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
> at
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
> at
> org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106)
> at
> org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:95)
> at
> org.apache.hadoop.hbase.util.ForeignExceptionUtil.toIOException(ForeignExceptionUtil.java:45)
> at
> org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.convertResult(HBaseAdmin.java:4774)
> at
> org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.waitProcedureResult(HBaseAdmin.java:4732)
> at
> org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.get(HBaseAdmin.java:4665)
> at
> org.apache.hadoop.hbase.client.HBaseAdmin.createTable(HBaseAdmin.java:679)
> at
> org.apache.hadoop.hbase.HBaseTestingUtility.createTable(HBaseTestingUtility.java:1500)
> at
> org.apache.hadoop.hbase.HBaseTestingUtility.createTable(HBaseTestingUtility.java:1547)
> at
> org.apache.hadoop.hbase.HBaseTestingUtility.createTable(HBaseTestingUtility.java:1438)
> at
> org.apache.hadoop.hbase.HBaseTestingUtility.createTable(HBaseTestingUtility.java:1414)
> at
> org.apache.hadoop.hbase.HBaseTestingUtility.createTable(HBaseTestingUtility.java:1370)
> at
> org.apache.hadoop.hbase.client.TestClientScannerRPCTimeout.testScannerNextRPCTimesout(TestClientScannerRPCTimeout.java:87)
> Caused by: org.apache.hadoop.ipc.RemoteException: testScannerNextRPCTimesout
> at
> org.apache.hadoop.hbase.master.procedure.CreateTableProcedure.prepareCreate(CreateTableProcedure.java:286)
> at
> org.apache.hadoop.hbase.master.procedure.CreateTableProcedure.executeFromState(CreateTableProcedure.java:107)
> at
> org.apache.hadoop.hbase.master.procedure.CreateTableProcedure.executeFromState(CreateTableProcedure.java:59)
> at
> org.apache.hadoop.hbase.procedure2.StateMachineProcedure.execute(StateMachineProcedure.java:139)
> at
> org.apache.hadoop.hbase.procedure2.Procedure.doExecute(Procedure.java:506)
> at
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1152)
> at
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execLoop(ProcedureExecutor.java:940)
> at
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execLoop(ProcedureExecutor.java:893)
> at
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$400(ProcedureExecutor.java:76)
> at
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor$2.run(ProcedureExecutor.java:478)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (HBASE-18810) TestClientScannerRPCTimeout failing in branch-1 / branch-1.4
[
https://issues.apache.org/jira/browse/HBASE-18810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16165230#comment-16165230
]
Andrew Purtell commented on HBASE-18810:
Oddly a bisect traces this failure to HBASE-16488, and if I revert that commit
from branch-1 / branch-1.4, then the test passes again. I find that HBASE-16488
is still in PA state even though the change was committed at least to
implicated branches, so I am inclined to revert the change given that
irregularity.
> TestClientScannerRPCTimeout failing in branch-1 / branch-1.4
>
>
> Key: HBASE-18810
> URL: https://issues.apache.org/jira/browse/HBASE-18810
> Project: HBase
> Issue Type: Bug
>Reporter: Andrew Purtell
>
> TestClientScannerRPCTimeout is failing in branch-1 / branch-1.4, but it's a
> setup problem involving CreateTableProcedure. Fails for me the first time in
> both Linux and MacOS dev environments.
> Bisect says this is the cause, been there for a while
> {noformat}
> commit af359d03b5e2cc798cee8ba52d2a9fcbb1022104
> Author: Stephen Yuan Jiang
> Date: Tue Jul 18 06:58:29 2017 -0700
> HBASE-16488 Starting namespace and quota services in master startup
> asynchronizely (Stephen Yuan Jiang)
> {noformat}
> and sure enough, if I revert HBASE-16488 from branch-1 / branch-1.4 then the
> test passes again.
> {noformat}
> Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 7.211 sec <<<
> FAILURE! - in org.apache.hadoop.hbase.client.TestClientScannerRPCTimeout
> testScannerNextRPCTimesout(org.apache.hadoop.hbase.client.TestClientScannerRPCTimeout)
> Time elapsed: 6.248 sec <<< ERROR!
> org.apache.hadoop.hbase.TableExistsException: testScannerNextRPCTimesout
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> Method)
> at
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
> at
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
> at
> org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106)
> at
> org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:95)
> at
> org.apache.hadoop.hbase.util.ForeignExceptionUtil.toIOException(ForeignExceptionUtil.java:45)
> at
> org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.convertResult(HBaseAdmin.java:4774)
> at
> org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.waitProcedureResult(HBaseAdmin.java:4732)
> at
> org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.get(HBaseAdmin.java:4665)
> at
> org.apache.hadoop.hbase.client.HBaseAdmin.createTable(HBaseAdmin.java:679)
> at
> org.apache.hadoop.hbase.HBaseTestingUtility.createTable(HBaseTestingUtility.java:1500)
> at
> org.apache.hadoop.hbase.HBaseTestingUtility.createTable(HBaseTestingUtility.java:1547)
> at
> org.apache.hadoop.hbase.HBaseTestingUtility.createTable(HBaseTestingUtility.java:1438)
> at
> org.apache.hadoop.hbase.HBaseTestingUtility.createTable(HBaseTestingUtility.java:1414)
> at
> org.apache.hadoop.hbase.HBaseTestingUtility.createTable(HBaseTestingUtility.java:1370)
> at
> org.apache.hadoop.hbase.client.TestClientScannerRPCTimeout.testScannerNextRPCTimesout(TestClientScannerRPCTimeout.java:87)
> Caused by: org.apache.hadoop.ipc.RemoteException: testScannerNextRPCTimesout
> at
> org.apache.hadoop.hbase.master.procedure.CreateTableProcedure.prepareCreate(CreateTableProcedure.java:286)
> at
> org.apache.hadoop.hbase.master.procedure.CreateTableProcedure.executeFromState(CreateTableProcedure.java:107)
> at
> org.apache.hadoop.hbase.master.procedure.CreateTableProcedure.executeFromState(CreateTableProcedure.java:59)
> at
> org.apache.hadoop.hbase.procedure2.StateMachineProcedure.execute(StateMachineProcedure.java:139)
> at
> org.apache.hadoop.hbase.procedure2.Procedure.doExecute(Procedure.java:506)
> at
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1152)
> at
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execLoop(ProcedureExecutor.java:940)
> at
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execLoop(ProcedureExecutor.java:893)
> at
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$400(ProcedureExecutor.java:76)
> at
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor$2.run(ProcedureExecutor.java:478)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
