[jira] [Updated] (HBASE-17055) Disabling table not getting enabled after clean cluster restart.

2018-02-28 Thread Francis Liu (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HBASE-17055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Francis Liu updated HBASE-17055:

Fix Version/s: (was: 1.3.2)
   1.3.3

> Disabling table not getting enabled after clean cluster restart.
> 
>
> Key: HBASE-17055
> URL: https://issues.apache.org/jira/browse/HBASE-17055
> Project: HBase
>  Issue Type: Bug
>  Components: Region Assignment
>Affects Versions: 1.3.0
>Reporter: Y. SREENIVASULU REDDY
>Assignee: Stephen Yuan Jiang
>Priority: Major
> Fix For: 1.3.3
>
>
> scenario:
> 1. Disable the table, while disabling the table is in progress.
> 2. Restart whole HBase service.
> 3. Then enable the table.
> the above operation leads to RIT continously.
> pls find the below logs for understanding.
> while disabling the table whole hbase service went down.
> the following is the master logs
> {noformat}
> 2016-11-09 19:32:55,102 INFO  
> [RpcServer.FifoWFPBQ.default.handler=49,queue=4,port=16000] master.HMaster: 
> Client=seenu//host-1 disable testTable
> 2016-11-09 19:32:55,257 DEBUG 
> [RpcServer.FifoWFPBQ.default.handler=49,queue=4,port=16000] 
> procedure2.ProcedureExecutor: Procedure DisableTableProcedure 
> (table=testTable) id=8 owner=seenu state=RUNNABLE:DISABLE_TABLE_PREPARE added 
> to the store.
> 2016-11-09 19:32:55,264 DEBUG [ProcedureExecutor-5] 
> lock.ZKInterProcessLockBase: Acquired a lock for 
> /hbase/table-lock/testTable/write-master:165
> 2016-11-09 19:32:55,285 DEBUG 
> [RpcServer.FifoWFPBQ.default.handler=49,queue=4,port=16000] 
> master.MasterRpcServices: Checking to see if procedure is done procId=8
> 2016-11-09 19:32:55,386 DEBUG 
> [RpcServer.FifoWFPBQ.default.handler=49,queue=4,port=16000] 
> master.MasterRpcServices: Checking to see if procedure is done procId=8
> 2016-11-09 19:32:55,513 INFO  [ProcedureExecutor-5] 
> zookeeper.ZKTableStateManager: Moving table testTable state from DISABLING to 
> DISABLING
> 2016-11-09 19:32:55,587 DEBUG 
> [RpcServer.FifoWFPBQ.default.handler=49,queue=4,port=16000] 
> master.MasterRpcServices: Checking to see if procedure is done procId=8
> 2016-11-09 19:32:55,628 INFO  [ProcedureExecutor-5] 
> procedure.DisableTableProcedure: Offlining 1 regions.
> .
> .
> .
> .
> .
> .
> .
> .
> 2016-11-09 19:33:02,871 INFO  [AM.ZK.Worker-pool2-t7] master.RegionStates: 
> Offlined 1890fa9c085dcc2ee0602f4bab069d10 from host-1,16040,1478690163056
> Wed Nov  9 19:33:02 CST 2016 Terminating master
> {noformat}
> here we need to observe
> {color:red} Offlined 1890fa9c085dcc2ee0602f4bab069d10 from 
> host-1,16040,1478690163056 {color}
> then hmaster went down, all regionServers also made down.
> After hmaster and regionserver are restarted
> executed enable Table operation on the table.
> {panel:title=HMaster 
> Logs|borderStyle=dashed|borderColor=#ccc|titleBGColor=#F7D6C1|bgColor=#CE}
> {noformat}
> 2016-11-09 19:49:57,059 INFO  
> [RpcServer.FifoWFPBQ.default.handler=49,queue=4,port=16000] master.HMaster: 
> Client=seenu//host-1 enable testTable
> 2016-11-09 19:49:57,325 DEBUG 
> [RpcServer.FifoWFPBQ.default.handler=49,queue=4,port=16000] 
> procedure2.ProcedureExecutor: Procedure EnableTableProcedure 
> (table=testTable) id=9 owner=seenu state=RUNNABLE:ENABLE_TABLE_PREPARE added 
> to the store.
> 2016-11-09 19:49:57,333 DEBUG [ProcedureExecutor-2] 
> lock.ZKInterProcessLockBase: Acquired a lock for 
> /hbase/table-lock/testTable/write-master:168
> 2016-11-09 19:49:57,335 DEBUG [hconnection-0x745317ee-shared--pool3-t11] 
> ipc.RpcClientImpl: Use SIMPLE authentication for service ClientService, 
> sasl=false
> 2016-11-09 19:49:57,335 DEBUG [hconnection-0x745317ee-shared--pool3-t11] 
> ipc.RpcClientImpl: Connecting to host-1:16040
> 2016-11-09 19:49:57,347 DEBUG 
> [RpcServer.FifoWFPBQ.default.handler=49,queue=4,port=16000] 
> master.MasterRpcServices: Checking to see if procedure is done procId=9
> 2016-11-09 19:49:57,449 DEBUG 
> [RpcServer.FifoWFPBQ.default.handler=49,queue=4,port=16000] 
> master.MasterRpcServices: Checking to see if procedure is done procId=9
> 2016-11-09 19:49:57,579 INFO  [ProcedureExecutor-2] 
> procedure.EnableTableProcedure: Attempting to enable the table testTable
> 2016-11-09 19:49:57,580 INFO  [ProcedureExecutor-2] 
> zookeeper.ZKTableStateManager: Moving table testTable state from DISABLED to 
> ENABLING
> 2016-11-09 19:49:57,655 DEBUG 
> [RpcServer.FifoWFPBQ.default.handler=49,queue=4,port=16000] 
> master.MasterRpcServices: Checking to see if procedure is done procId=9
> 2016-11-09 19:49:57,707 INFO  [ProcedureExecutor-2] 
> procedure.EnableTableProcedure: Table 'testTable' has 1 regions, of which 1 
> are offline.
> 2016-11-09 19:49:57,707 INFO  [ProcedureExecutor-2] 
> procedure.EnableTableProcedure:

[jira] [Updated] (HBASE-17055) Disabling table not getting enabled after clean cluster restart.

2017-04-05 Thread Mikhail Antonov (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HBASE-17055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mikhail Antonov updated HBASE-17055:

Fix Version/s: (was: 1.3.0)
   1.3.2

> Disabling table not getting enabled after clean cluster restart.
> 
>
> Key: HBASE-17055
> URL: https://issues.apache.org/jira/browse/HBASE-17055
> Project: HBase
>  Issue Type: Bug
>  Components: Region Assignment
>Affects Versions: 1.3.0
>Reporter: Y. SREENIVASULU REDDY
>Assignee: Stephen Yuan Jiang
> Fix For: 1.3.2
>
>
> scenario:
> 1. Disable the table, while disabling the table is in progress.
> 2. Restart whole HBase service.
> 3. Then enable the table.
> the above operation leads to RIT continously.
> pls find the below logs for understanding.
> while disabling the table whole hbase service went down.
> the following is the master logs
> {noformat}
> 2016-11-09 19:32:55,102 INFO  
> [RpcServer.FifoWFPBQ.default.handler=49,queue=4,port=16000] master.HMaster: 
> Client=seenu//host-1 disable testTable
> 2016-11-09 19:32:55,257 DEBUG 
> [RpcServer.FifoWFPBQ.default.handler=49,queue=4,port=16000] 
> procedure2.ProcedureExecutor: Procedure DisableTableProcedure 
> (table=testTable) id=8 owner=seenu state=RUNNABLE:DISABLE_TABLE_PREPARE added 
> to the store.
> 2016-11-09 19:32:55,264 DEBUG [ProcedureExecutor-5] 
> lock.ZKInterProcessLockBase: Acquired a lock for 
> /hbase/table-lock/testTable/write-master:165
> 2016-11-09 19:32:55,285 DEBUG 
> [RpcServer.FifoWFPBQ.default.handler=49,queue=4,port=16000] 
> master.MasterRpcServices: Checking to see if procedure is done procId=8
> 2016-11-09 19:32:55,386 DEBUG 
> [RpcServer.FifoWFPBQ.default.handler=49,queue=4,port=16000] 
> master.MasterRpcServices: Checking to see if procedure is done procId=8
> 2016-11-09 19:32:55,513 INFO  [ProcedureExecutor-5] 
> zookeeper.ZKTableStateManager: Moving table testTable state from DISABLING to 
> DISABLING
> 2016-11-09 19:32:55,587 DEBUG 
> [RpcServer.FifoWFPBQ.default.handler=49,queue=4,port=16000] 
> master.MasterRpcServices: Checking to see if procedure is done procId=8
> 2016-11-09 19:32:55,628 INFO  [ProcedureExecutor-5] 
> procedure.DisableTableProcedure: Offlining 1 regions.
> .
> .
> .
> .
> .
> .
> .
> .
> 2016-11-09 19:33:02,871 INFO  [AM.ZK.Worker-pool2-t7] master.RegionStates: 
> Offlined 1890fa9c085dcc2ee0602f4bab069d10 from host-1,16040,1478690163056
> Wed Nov  9 19:33:02 CST 2016 Terminating master
> {noformat}
> here we need to observe
> {color:red} Offlined 1890fa9c085dcc2ee0602f4bab069d10 from 
> host-1,16040,1478690163056 {color}
> then hmaster went down, all regionServers also made down.
> After hmaster and regionserver are restarted
> executed enable Table operation on the table.
> {panel:title=HMaster 
> Logs|borderStyle=dashed|borderColor=#ccc|titleBGColor=#F7D6C1|bgColor=#CE}
> {noformat}
> 2016-11-09 19:49:57,059 INFO  
> [RpcServer.FifoWFPBQ.default.handler=49,queue=4,port=16000] master.HMaster: 
> Client=seenu//host-1 enable testTable
> 2016-11-09 19:49:57,325 DEBUG 
> [RpcServer.FifoWFPBQ.default.handler=49,queue=4,port=16000] 
> procedure2.ProcedureExecutor: Procedure EnableTableProcedure 
> (table=testTable) id=9 owner=seenu state=RUNNABLE:ENABLE_TABLE_PREPARE added 
> to the store.
> 2016-11-09 19:49:57,333 DEBUG [ProcedureExecutor-2] 
> lock.ZKInterProcessLockBase: Acquired a lock for 
> /hbase/table-lock/testTable/write-master:168
> 2016-11-09 19:49:57,335 DEBUG [hconnection-0x745317ee-shared--pool3-t11] 
> ipc.RpcClientImpl: Use SIMPLE authentication for service ClientService, 
> sasl=false
> 2016-11-09 19:49:57,335 DEBUG [hconnection-0x745317ee-shared--pool3-t11] 
> ipc.RpcClientImpl: Connecting to host-1:16040
> 2016-11-09 19:49:57,347 DEBUG 
> [RpcServer.FifoWFPBQ.default.handler=49,queue=4,port=16000] 
> master.MasterRpcServices: Checking to see if procedure is done procId=9
> 2016-11-09 19:49:57,449 DEBUG 
> [RpcServer.FifoWFPBQ.default.handler=49,queue=4,port=16000] 
> master.MasterRpcServices: Checking to see if procedure is done procId=9
> 2016-11-09 19:49:57,579 INFO  [ProcedureExecutor-2] 
> procedure.EnableTableProcedure: Attempting to enable the table testTable
> 2016-11-09 19:49:57,580 INFO  [ProcedureExecutor-2] 
> zookeeper.ZKTableStateManager: Moving table testTable state from DISABLED to 
> ENABLING
> 2016-11-09 19:49:57,655 DEBUG 
> [RpcServer.FifoWFPBQ.default.handler=49,queue=4,port=16000] 
> master.MasterRpcServices: Checking to see if procedure is done procId=9
> 2016-11-09 19:49:57,707 INFO  [ProcedureExecutor-2] 
> procedure.EnableTableProcedure: Table 'testTable' has 1 regions, of which 1 
> are offline.
> 2016-11-09 19:49:57,707 INFO  [ProcedureExecutor-2] 
> procedure.EnableTableProcedure: Bulk assigning 1

[jira] [Updated] (HBASE-17055) Disabling table not getting enabled after clean cluster restart.

2016-11-09 Thread Y. SREENIVASULU REDDY (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HBASE-17055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Y. SREENIVASULU REDDY updated HBASE-17055:
--
Summary: Disabling table not getting enabled after clean cluster restart.  
(was: HMaster refering old RS for enabling the table. in HBase service restart 
case while disabling the table.)

> Disabling table not getting enabled after clean cluster restart.
> 
>
> Key: HBASE-17055
> URL: https://issues.apache.org/jira/browse/HBASE-17055
> Project: HBase
>  Issue Type: Bug
>  Components: Region Assignment
>Affects Versions: 1.3.0
>Reporter: Y. SREENIVASULU REDDY
> Fix For: 1.3.0
>
>
> scenario:
> 1. Disable the table, while disabling the table is in progress.
> 2. Restart whole HBase service.
> 3. Then enable the table.
> the above operation leads to RIT continously.
> pls find the below logs for understanding.
> while disabling the table whole hbase service went down.
> the following is the master logs
> {noformat}
> 2016-11-09 19:32:55,102 INFO  
> [RpcServer.FifoWFPBQ.default.handler=49,queue=4,port=16000] master.HMaster: 
> Client=seenu//host-1 disable testTable
> 2016-11-09 19:32:55,257 DEBUG 
> [RpcServer.FifoWFPBQ.default.handler=49,queue=4,port=16000] 
> procedure2.ProcedureExecutor: Procedure DisableTableProcedure 
> (table=testTable) id=8 owner=seenu state=RUNNABLE:DISABLE_TABLE_PREPARE added 
> to the store.
> 2016-11-09 19:32:55,264 DEBUG [ProcedureExecutor-5] 
> lock.ZKInterProcessLockBase: Acquired a lock for 
> /hbase/table-lock/testTable/write-master:165
> 2016-11-09 19:32:55,285 DEBUG 
> [RpcServer.FifoWFPBQ.default.handler=49,queue=4,port=16000] 
> master.MasterRpcServices: Checking to see if procedure is done procId=8
> 2016-11-09 19:32:55,386 DEBUG 
> [RpcServer.FifoWFPBQ.default.handler=49,queue=4,port=16000] 
> master.MasterRpcServices: Checking to see if procedure is done procId=8
> 2016-11-09 19:32:55,513 INFO  [ProcedureExecutor-5] 
> zookeeper.ZKTableStateManager: Moving table testTable state from DISABLING to 
> DISABLING
> 2016-11-09 19:32:55,587 DEBUG 
> [RpcServer.FifoWFPBQ.default.handler=49,queue=4,port=16000] 
> master.MasterRpcServices: Checking to see if procedure is done procId=8
> 2016-11-09 19:32:55,628 INFO  [ProcedureExecutor-5] 
> procedure.DisableTableProcedure: Offlining 1 regions.
> .
> .
> .
> .
> .
> .
> .
> .
> 2016-11-09 19:33:02,871 INFO  [AM.ZK.Worker-pool2-t7] master.RegionStates: 
> Offlined 1890fa9c085dcc2ee0602f4bab069d10 from host-1,16040,1478690163056
> Wed Nov  9 19:33:02 CST 2016 Terminating master
> {noformat}
> here we need to observe
> {color:red} Offlined 1890fa9c085dcc2ee0602f4bab069d10 from 
> host-1,16040,1478690163056 {color}
> then hmaster went down, all regionServers also made down.
> After hmaster and regionserver are restarted
> executed enable Table operation on the table.
> {panel:title=HMaster 
> Logs|borderStyle=dashed|borderColor=#ccc|titleBGColor=#F7D6C1|bgColor=#CE}
> {noformat}
> 2016-11-09 19:49:57,059 INFO  
> [RpcServer.FifoWFPBQ.default.handler=49,queue=4,port=16000] master.HMaster: 
> Client=seenu//host-1 enable testTable
> 2016-11-09 19:49:57,325 DEBUG 
> [RpcServer.FifoWFPBQ.default.handler=49,queue=4,port=16000] 
> procedure2.ProcedureExecutor: Procedure EnableTableProcedure 
> (table=testTable) id=9 owner=seenu state=RUNNABLE:ENABLE_TABLE_PREPARE added 
> to the store.
> 2016-11-09 19:49:57,333 DEBUG [ProcedureExecutor-2] 
> lock.ZKInterProcessLockBase: Acquired a lock for 
> /hbase/table-lock/testTable/write-master:168
> 2016-11-09 19:49:57,335 DEBUG [hconnection-0x745317ee-shared--pool3-t11] 
> ipc.RpcClientImpl: Use SIMPLE authentication for service ClientService, 
> sasl=false
> 2016-11-09 19:49:57,335 DEBUG [hconnection-0x745317ee-shared--pool3-t11] 
> ipc.RpcClientImpl: Connecting to host-1:16040
> 2016-11-09 19:49:57,347 DEBUG 
> [RpcServer.FifoWFPBQ.default.handler=49,queue=4,port=16000] 
> master.MasterRpcServices: Checking to see if procedure is done procId=9
> 2016-11-09 19:49:57,449 DEBUG 
> [RpcServer.FifoWFPBQ.default.handler=49,queue=4,port=16000] 
> master.MasterRpcServices: Checking to see if procedure is done procId=9
> 2016-11-09 19:49:57,579 INFO  [ProcedureExecutor-2] 
> procedure.EnableTableProcedure: Attempting to enable the table testTable
> 2016-11-09 19:49:57,580 INFO  [ProcedureExecutor-2] 
> zookeeper.ZKTableStateManager: Moving table testTable state from DISABLED to 
> ENABLING
> 2016-11-09 19:49:57,655 DEBUG 
> [RpcServer.FifoWFPBQ.default.handler=49,queue=4,port=16000] 
> master.MasterRpcServices: Checking to see if procedure is done procId=9
> 2016-11-09 19:49:57,707 INFO  [ProcedureExecutor-2] 
> procedure.EnableTableProcedure: Table 'testTable' has 1 regions, of which 1 
> are offline.
>