[
https://issues.apache.org/jira/browse/HBASE-948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yossi Ittach updated HBASE-948:
-------------------------------
Description:
Using Hadoop 0.18.1 and HBase 0.18 . HBase region server crashed after
"FATAL org.apache.hadoop.hbase.HRegionServer: unable to report to master for X
milliseconds - aborting server "
Shut down HBase , shut down Hadoop , restart Hadoop , restart HBase .
Disable table 'resources'. Trying to drop 'resources' results in
org.apache.hadoop.hbase.TableNotDisabledException
{code}
HBase Shell; enter 'help<RETURN>' for list of supported commands.
Version: 0.18.0, r697626, Sun Sep 21 16:00:50 PDT 2008
hbase(main):001:0> disable 'resources' <---------------------------------
08/10/22 13:46:05 DEBUG client.HConnectionManager$TableServers: Found ROOT
REGION => {NAME => '-ROOT-,,0', STARTKEY => '', ENDKEY => '', ENCODED =>
70236052, TABLE => {{NAME => '-ROOT-', IS_ROOT => 'true', IS_META => 'true',
FAMILIES => [{NAME => 'info', BLOOMFILTER => 'false', IN_MEMORY => 'false',
LENGTH => '2147483647', BLOCKCACHE => 'false', VERSIONS => '1', TTL => '-1',
COMPRESSION => 'NONE'}]}}
08/10/22 13:46:05 DEBUG client.HConnectionManager$TableServers: Cache hit in
table locations for row <> and tableName .META.: location server
192.168.30.129:60020, location region name .META.,,1
08/10/22 13:46:05 INFO client.HBaseAdmin: Disabled resources
0 row(s) in 0.3830 seconds
hbase(main):002:0> drop 'resources' <--------------------------------------
08/10/22 13:46:19 DEBUG client.HConnectionManager$TableServers: Cache hit in
table locations for row <> and tableName .META.: location server
192.168.30.129:60020, location region name .META.,,1
NativeException: org.apache.hadoop.hbase.TableNotDisabledException:
org.apache.hadoop.hbase.TableNotDisabledException: resources
at
org.apache.hadoop.hbase.master.TableDelete.processScanItem(TableDelete.java:50)
at
org.apache.hadoop.hbase.master.TableOperation$ProcessTableOperation.call(TableOperation.java:105)
at
org.apache.hadoop.hbase.master.TableOperation$ProcessTableOperation.call(TableOperation.java:70)
at
org.apache.hadoop.hbase.master.RetryableMetaOperation.doWithRetries(RetryableMetaOperation.java:61)
at
org.apache.hadoop.hbase.master.TableOperation.process(TableOperation.java:143)
at org.apache.hadoop.hbase.master.HMaster.deleteTable(HMaster.java:641)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:585)
at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:554)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:888)
from sun/reflect/NativeConstructorAccessorImpl.java:-2:in `newInstance0'
from sun/reflect/NativeConstructorAccessorImpl.java:39:in `newInstance'
from sun/reflect/DelegatingConstructorAccessorImpl.java:27:in
`newInstance'
from java/lang/reflect/Constructor.java:494:in `newInstance'
from org/apache/hadoop/hbase/RemoteExceptionHandler.java:82:in
`decodeRemoteException'
from org/apache/hadoop/hbase/client/HBaseAdmin.java:212:in `deleteTable'
from org/apache/hadoop/hbase/client/HBaseAdmin.java:194:in `deleteTable'
from sun/reflect/NativeMethodAccessorImpl.java:-2:in `invoke0'
from sun/reflect/NativeMethodAccessorImpl.java:39:in `invoke'
from sun/reflect/DelegatingMethodAccessorImpl.java:25:in `invoke'
from java/lang/reflect/Method.java:585:in `invoke'
from org/jruby/javasupport/JavaMethod.java:250:in
`invokeWithExceptionHandling'
from org/jruby/javasupport/JavaMethod.java:219:in `invoke'
from org/jruby/javasupport/JavaClass.java:416:in `execute'
from org/jruby/internal/runtime/methods/SimpleCallbackMethod.java:67:in
`call'
from org/jruby/internal/runtime/methods/DynamicMethod.java:78:in `call'
... 126 levels...
from
ruby.usr.apps.hbase.hbase_minus_0_dot_18_dot_0.bin.hirbInvokermethod__23$RUBY$startOpt:-1:in
`call'
from org/jruby/internal/runtime/methods/DynamicMethod.java:74:in `call'
from org/jruby/internal/runtime/methods/CompiledMethod.java:48:in `call'
from org/jruby/runtime/CallSite.java:123:in `cacheAndCall'
from org/jruby/runtime/CallSite.java:298:in `call'
from
ruby/usr/apps/hbase/hbase_minus_0_dot_18_dot_0/bin//usr/apps/hbase/hbase-0.18.0/bin/../bin/hirb.rb:351:in
`__file__'
from
ruby/usr/apps/hbase/hbase_minus_0_dot_18_dot_0/bin//usr/apps/hbase/hbase-0.18.0/bin/../bin/hirb.rb:-1:in
`__file__'
from
ruby/usr/apps/hbase/hbase_minus_0_dot_18_dot_0/bin//usr/apps/hbase/hbase-0.18.0/bin/../bin/hirb.rb:-1:in
`load'
from org/jruby/Ruby.java:512:in `runScript'
from org/jruby/Ruby.java:432:in `runNormally'
from org/jruby/Ruby.java:312:in `runFromMain'
from org/jruby/Main.java:144:in `run'
from org/jruby/Main.java:89:in `run'
from org/jruby/Main.java:80:in `main'
from /usr/apps/hbase/hbase-0.18.0/bin/../bin/hirb.rb:232:in `drop'
{code}
was:
Using Hadoop 0.18.1 and HBase 0.18 . HBase region server crashed after
"FATAL org.apache.hadoop.hbase.HRegionServer: unable to report to master for X
milliseconds - aborting server "
Shut down HBase , shut down Hadoop , restart Hadoop , restart HBase .
Disable table 'resources'. Trying to drop 'resources' results in
org.apache.hadoop.hbase.TableNotDisabledException
{format}
{code}
HBase Shell; enter 'help<RETURN>' for list of supported commands.
Version: 0.18.0, r697626, Sun Sep 21 16:00:50 PDT 2008
hbase(main):001:0> disable 'resources' <---------------------------------
08/10/22 13:46:05 DEBUG client.HConnectionManager$TableServers: Found ROOT
REGION => {NAME => '-ROOT-,,0', STARTKEY => '', ENDKEY => '', ENCODED =>
70236052, TABLE => {{NAME => '-ROOT-', IS_ROOT => 'true', IS_META => 'true',
FAMILIES => [{NAME => 'info', BLOOMFILTER => 'false', IN_MEMORY => 'false',
LENGTH => '2147483647', BLOCKCACHE => 'false', VERSIONS => '1', TTL => '-1',
COMPRESSION => 'NONE'}]}}
08/10/22 13:46:05 DEBUG client.HConnectionManager$TableServers: Cache hit in
table locations for row <> and tableName .META.: location server
192.168.30.129:60020, location region name .META.,,1
08/10/22 13:46:05 INFO client.HBaseAdmin: Disabled resources
0 row(s) in 0.3830 seconds
hbase(main):002:0> drop 'resources' <--------------------------------------
08/10/22 13:46:19 DEBUG client.HConnectionManager$TableServers: Cache hit in
table locations for row <> and tableName .META.: location server
192.168.30.129:60020, location region name .META.,,1
NativeException: org.apache.hadoop.hbase.TableNotDisabledException:
org.apache.hadoop.hbase.TableNotDisabledException: resources
at
org.apache.hadoop.hbase.master.TableDelete.processScanItem(TableDelete.java:50)
at
org.apache.hadoop.hbase.master.TableOperation$ProcessTableOperation.call(TableOperation.java:105)
at
org.apache.hadoop.hbase.master.TableOperation$ProcessTableOperation.call(TableOperation.java:70)
at
org.apache.hadoop.hbase.master.RetryableMetaOperation.doWithRetries(RetryableMetaOperation.java:61)
at
org.apache.hadoop.hbase.master.TableOperation.process(TableOperation.java:143)
at org.apache.hadoop.hbase.master.HMaster.deleteTable(HMaster.java:641)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:585)
at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:554)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:888)
from sun/reflect/NativeConstructorAccessorImpl.java:-2:in `newInstance0'
from sun/reflect/NativeConstructorAccessorImpl.java:39:in `newInstance'
from sun/reflect/DelegatingConstructorAccessorImpl.java:27:in
`newInstance'
from java/lang/reflect/Constructor.java:494:in `newInstance'
from org/apache/hadoop/hbase/RemoteExceptionHandler.java:82:in
`decodeRemoteException'
from org/apache/hadoop/hbase/client/HBaseAdmin.java:212:in `deleteTable'
from org/apache/hadoop/hbase/client/HBaseAdmin.java:194:in `deleteTable'
from sun/reflect/NativeMethodAccessorImpl.java:-2:in `invoke0'
from sun/reflect/NativeMethodAccessorImpl.java:39:in `invoke'
from sun/reflect/DelegatingMethodAccessorImpl.java:25:in `invoke'
from java/lang/reflect/Method.java:585:in `invoke'
from org/jruby/javasupport/JavaMethod.java:250:in
`invokeWithExceptionHandling'
from org/jruby/javasupport/JavaMethod.java:219:in `invoke'
from org/jruby/javasupport/JavaClass.java:416:in `execute'
from org/jruby/internal/runtime/methods/SimpleCallbackMethod.java:67:in
`call'
from org/jruby/internal/runtime/methods/DynamicMethod.java:78:in `call'
... 126 levels...
from
ruby.usr.apps.hbase.hbase_minus_0_dot_18_dot_0.bin.hirbInvokermethod__23$RUBY$startOpt:-1:in
`call'
from org/jruby/internal/runtime/methods/DynamicMethod.java:74:in `call'
from org/jruby/internal/runtime/methods/CompiledMethod.java:48:in `call'
from org/jruby/runtime/CallSite.java:123:in `cacheAndCall'
from org/jruby/runtime/CallSite.java:298:in `call'
from
ruby/usr/apps/hbase/hbase_minus_0_dot_18_dot_0/bin//usr/apps/hbase/hbase-0.18.0/bin/../bin/hirb.rb:351:in
`__file__'
from
ruby/usr/apps/hbase/hbase_minus_0_dot_18_dot_0/bin//usr/apps/hbase/hbase-0.18.0/bin/../bin/hirb.rb:-1:in
`__file__'
from
ruby/usr/apps/hbase/hbase_minus_0_dot_18_dot_0/bin//usr/apps/hbase/hbase-0.18.0/bin/../bin/hirb.rb:-1:in
`load'
from org/jruby/Ruby.java:512:in `runScript'
from org/jruby/Ruby.java:432:in `runNormally'
from org/jruby/Ruby.java:312:in `runFromMain'
from org/jruby/Main.java:144:in `run'
from org/jruby/Main.java:89:in `run'
from org/jruby/Main.java:80:in `main'
from /usr/apps/hbase/hbase-0.18.0/bin/../bin/hirb.rb:232:in `drop'
{code}
{format}
> "Table no disabled " after table is disabled
> --------------------------------------------
>
> Key: HBASE-948
> URL: https://issues.apache.org/jira/browse/HBASE-948
> Project: Hadoop HBase
> Issue Type: Bug
> Components: build
> Affects Versions: 0.18.0
> Environment: Linux CentOS
> Reporter: Yossi Ittach
>
> Using Hadoop 0.18.1 and HBase 0.18 . HBase region server crashed after
> "FATAL org.apache.hadoop.hbase.HRegionServer: unable to report to master for
> X milliseconds - aborting server "
> Shut down HBase , shut down Hadoop , restart Hadoop , restart HBase .
> Disable table 'resources'. Trying to drop 'resources' results in
> org.apache.hadoop.hbase.TableNotDisabledException
> {code}
> HBase Shell; enter 'help<RETURN>' for list of supported commands.
> Version: 0.18.0, r697626, Sun Sep 21 16:00:50 PDT 2008
> hbase(main):001:0> disable 'resources' <---------------------------------
> 08/10/22 13:46:05 DEBUG client.HConnectionManager$TableServers: Found ROOT
> REGION => {NAME => '-ROOT-,,0', STARTKEY => '', ENDKEY => '', ENCODED =>
> 70236052, TABLE => {{NAME => '-ROOT-', IS_ROOT => 'true', IS_META => 'true',
> FAMILIES => [{NAME => 'info', BLOOMFILTER => 'false', IN_MEMORY => 'false',
> LENGTH => '2147483647', BLOCKCACHE => 'false', VERSIONS => '1', TTL => '-1',
> COMPRESSION => 'NONE'}]}}
> 08/10/22 13:46:05 DEBUG client.HConnectionManager$TableServers: Cache hit in
> table locations for row <> and tableName .META.: location server
> 192.168.30.129:60020, location region name .META.,,1
> 08/10/22 13:46:05 INFO client.HBaseAdmin: Disabled resources
> 0 row(s) in 0.3830 seconds
> hbase(main):002:0> drop 'resources' <--------------------------------------
> 08/10/22 13:46:19 DEBUG client.HConnectionManager$TableServers: Cache hit in
> table locations for row <> and tableName .META.: location server
> 192.168.30.129:60020, location region name .META.,,1
> NativeException: org.apache.hadoop.hbase.TableNotDisabledException:
> org.apache.hadoop.hbase.TableNotDisabledException: resources
> at
> org.apache.hadoop.hbase.master.TableDelete.processScanItem(TableDelete.java:50)
> at
> org.apache.hadoop.hbase.master.TableOperation$ProcessTableOperation.call(TableOperation.java:105)
> at
> org.apache.hadoop.hbase.master.TableOperation$ProcessTableOperation.call(TableOperation.java:70)
> at
> org.apache.hadoop.hbase.master.RetryableMetaOperation.doWithRetries(RetryableMetaOperation.java:61)
> at
> org.apache.hadoop.hbase.master.TableOperation.process(TableOperation.java:143)
> at
> org.apache.hadoop.hbase.master.HMaster.deleteTable(HMaster.java:641)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:585)
> at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:554)
> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:888)
> from sun/reflect/NativeConstructorAccessorImpl.java:-2:in
> `newInstance0'
> from sun/reflect/NativeConstructorAccessorImpl.java:39:in
> `newInstance'
> from sun/reflect/DelegatingConstructorAccessorImpl.java:27:in
> `newInstance'
> from java/lang/reflect/Constructor.java:494:in `newInstance'
> from org/apache/hadoop/hbase/RemoteExceptionHandler.java:82:in
> `decodeRemoteException'
> from org/apache/hadoop/hbase/client/HBaseAdmin.java:212:in
> `deleteTable'
> from org/apache/hadoop/hbase/client/HBaseAdmin.java:194:in
> `deleteTable'
> from sun/reflect/NativeMethodAccessorImpl.java:-2:in `invoke0'
> from sun/reflect/NativeMethodAccessorImpl.java:39:in `invoke'
> from sun/reflect/DelegatingMethodAccessorImpl.java:25:in `invoke'
> from java/lang/reflect/Method.java:585:in `invoke'
> from org/jruby/javasupport/JavaMethod.java:250:in
> `invokeWithExceptionHandling'
> from org/jruby/javasupport/JavaMethod.java:219:in `invoke'
> from org/jruby/javasupport/JavaClass.java:416:in `execute'
> from
> org/jruby/internal/runtime/methods/SimpleCallbackMethod.java:67:in `call'
> from org/jruby/internal/runtime/methods/DynamicMethod.java:78:in
> `call'
> ... 126 levels...
> from
> ruby.usr.apps.hbase.hbase_minus_0_dot_18_dot_0.bin.hirbInvokermethod__23$RUBY$startOpt:-1:in
> `call'
> from org/jruby/internal/runtime/methods/DynamicMethod.java:74:in
> `call'
> from org/jruby/internal/runtime/methods/CompiledMethod.java:48:in
> `call'
> from org/jruby/runtime/CallSite.java:123:in `cacheAndCall'
> from org/jruby/runtime/CallSite.java:298:in `call'
> from
> ruby/usr/apps/hbase/hbase_minus_0_dot_18_dot_0/bin//usr/apps/hbase/hbase-0.18.0/bin/../bin/hirb.rb:351:in
> `__file__'
> from
> ruby/usr/apps/hbase/hbase_minus_0_dot_18_dot_0/bin//usr/apps/hbase/hbase-0.18.0/bin/../bin/hirb.rb:-1:in
> `__file__'
> from
> ruby/usr/apps/hbase/hbase_minus_0_dot_18_dot_0/bin//usr/apps/hbase/hbase-0.18.0/bin/../bin/hirb.rb:-1:in
> `load'
> from org/jruby/Ruby.java:512:in `runScript'
> from org/jruby/Ruby.java:432:in `runNormally'
> from org/jruby/Ruby.java:312:in `runFromMain'
> from org/jruby/Main.java:144:in `run'
> from org/jruby/Main.java:89:in `run'
> from org/jruby/Main.java:80:in `main'
> from /usr/apps/hbase/hbase-0.18.0/bin/../bin/hirb.rb:232:in `drop'
> {code}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.