Re: Re: Re: Wrong Configuration lead to a failure when enabling table

It is not only about the state on the table descriptor but also the in memory state in the AM. I remember some time back Rajeshbabu worked on a HBCK like tool which will forcefully change the state of these tables in such cases. I don't remember the JIRA now.I thought of restarting the master

Re: client call scan on some region hang

Will integrate patch once QA run finishes. Thanks On Tue, Feb 3, 2015 at 5:40 PM, Bi,hongyu—mike boyl...@gmail.com wrote: Hi ted， sorry for the late response， i just file a jira https://issues.apache.org/jira/browse/HBASE-12957 for this issue thanks 2015-01-07 23:40 GMT+08:00 Ted Yu

Re: Re: Re: Wrong Configuration lead to a failure when enabling table

I tried reproducing this scenario on trunk. The same problem exists. Currently in the master the table state is noted in the Table descriptor and not on the ZK. In 0.98.XX version it should be on the zk. When we tried to enable the table the region assignment failed due to ClassNotFound and

Re: Re: Re: Wrong Configuration lead to a failure when enabling table

Looks like the NPE was caused by the following method in BaseLoadBalancer returning null: protected MapServerName, ListHRegionInfo assignMasterRegions( CollectionHRegionInfo regions, ListServerName servers) { if (servers == null || regions == null || regions.isEmpty()) {

Re: Re: Re: Wrong Configuration lead to a failure when enabling table

What about creating an offline tool which can modify the table descriptor so that table goes to designated state ? Cheers On Tue, Feb 3, 2015 at 8:51 PM, ramkrishna vasudevan ramkrishna.s.vasude...@gmail.com wrote: I tried reproducing this scenario on trunk. The same problem exists.

Re: Re: Re: Wrong Configuration lead to a failure when enabling table

Hi，Ted, Ram, Thank you for your attemtion for this bug. I meet this bug in production environment and the table contains important data. If we are not able to enable this table in current cluster, do you have any idea to get the table data back in some other way? Maybe export,

managing HConnection

Hi all, I am using hbase-0.98.1-cdh5.1.4 client and I am a bit confused by the documentation of HConnection. The document says the following: HConnection instances can be shared. Sharing is usually what you want because rather than each HConnection instance having to do its own discovery of

Re: managing HConnection

Please see '61.1. Cluster Connections' under http://hbase.apache.org/book.html#architecture.client Cheers On Tue, Feb 3, 2015 at 6:47 AM, sleimanjneidi jneidi.slei...@gmail.com wrote: Hi all, I am using hbase-0.98.1-cdh5.1.4 client and I am a bit confused by the documentation of HConnection.

Re: Wrong Configuration lead to a failure when enabling table

Can you try HBCK? Did it help in anyway? Remember something was done related to failure in ENABLE/DISABLE table some time back. Regards Ram On Tue, Feb 3, 2015 at 3:38 PM, yeweichen2...@gmail.com yeweichen2...@gmail.com wrote: Hi, all, II did the following command in hbase shell: disable

Re: Re: Wrong Configuration lead to a failure when enabling table

Can you try HBCK? Did it help in anyway? Remember something was done related to failure in ENABLE/DISABLE table some time back. Regards Ram On Tue, Feb 3, 2015 at 3:38 PM, yeweichen2...@gmail.com yeweichen2...@gmail.com wrote: Hi, all, II did the following command in hbase shell: disable

Re: HBase all files corrupt / missing blocks

Those files and related data are most probably lost I don't see any other option than deleting them. Are you sure those blocks where not missing before the migration? Did you have any crash over the migration process? JM 2015-02-03 13:14 GMT-08:00 Ellimilial K ellimil...@googlemail.com:

Re: HBase all files corrupt / missing blocks

That's quite horrible, oh well, thanks for the help! Yes, positive, we started having issues with HA quorum a couple of days after the migration, HBase has constantly been taking ~200 requests a second via stargate, things seemed to work fine. Mateusz On 3 February 2015 at 22:11, Jean-Marc

Re: managing HConnection

Hi, guys from group helped me a lot. I did solve pretty the same problem (CRUD web-app) 1. Use single instance of HConnection per application. 2. Instantiate it once. 3. create HTable instance for each CRUD operation and safely close it (try-catch-finally). Use the same HConnection to create any

Re: Re: Wrong Configuration lead to a failure when enabling table

I think the only way out here is to clear the zookeeper node. But am not sure on the ramifications of that. Which version are you using? The newer versions are 'protobuf'fed. Are you running this in production? Regards Ram On Tue, Feb 3, 2015 at 5:00 PM, yeweichen2...@gmail.com

HBase all files corrupt / missing blocks

We have recently experienced some issues with our namenodes in HA arrangement and had to recreate namenode metadata from a backup while some new data has been pushed to the regions ervers in the meantime. We're on HBase 98.6. After launching the cluster again, we have realised that we're missing

Re: java API bug ? --- client.HTable init unnecessarily tries hadoop

the rootdir value is http://my-hbase-master.com:8020 http://my-hbase-master.com:8020/apps/hbase/data/lib/apps/hbase/data I'm using 0.98.0 On Wed, Jan 28, 2015 at 4:14 PM, Ted Yu yuzhih...@gmail.com wrote: Is namenode running on my-hbase-master.com

Re: HBase all files corrupt / missing blocks

Hi Mateusz, Data from this HFile is most probably lost. Is the block also reporting missing from fsck? Do you have any datanode down which might contain this block? How big is tis HFile? 929610 bytes only? If so, one option might just to to delete this HFile. How many HFiles are within this

Re: HBase all files corrupt / missing blocks

Hi Mateusz, Thats interesting, did you started the NN with the right fsimage after the upgrade? that might also explain this. cheers, esteban. -- Cloudera, Inc. On Tue, Feb 3, 2015 at 2:26 PM, Ellimilial K ellimil...@googlemail.com wrote: That's quite horrible, oh well, thanks for the

回复：Re: Re: Wrong Configuration lead to a failure when enabling table

my version is 0.98.6-cdh5.2.0, the problem in my production environment. So should I first delete znode? And then how to distable this table？my goal is to fix the wrong table configuration to get my data. from my mobile phone. 在 2015-2-4 上午12:46，ramkrishna vasudevan

Re: HBase all files corrupt / missing blocks

Hi Esteban, I believe the upgrade went fine, i.e. the stack worked for a couple of days until the main namenode died yesterday (possibly timed out on gc?) the backup one died(or did not roll) complaining on out of sync errors from journalnodes. When I restarted journalnodes both namenodes started

Re: HBase all files corrupt / missing blocks

Hi Mateusz, As JMS mentioned, is very likely the data is lost, but that type of corruption is usually due some DNs down or data volumes removed for some reason, have you tried to recover that data from those DNs first? From for what looks like a continuous stream of regions sounds like you had a

Wrong Configuration lead to a failure when enabling table

Hi, all, II did the following command in hbase shell: disable 'TestTable' alter 'TestTable', CONFIGURATION = {'hbase.regionserver.region.split.policy' = 'x'} enable 'TestTable' At first I want to put org.apache.hadoop.hbase.regionserver.ConstantSizeRegionSplitPolicy to the place

Re: HBase all files corrupt / missing blocks

Thank you for the responses! @Jean-Mark This comes from fsck /, I see a flood of those going in at least hundreds, for this particular region: /hbase/data/default/table/ffa95306f599dbff99497e71841724fe/extracted/18c428413d7b4a89959911c9112a6eb9: CORRUPT blockpool

Re: client call scan on some region hang

Hi ted， sorry for the late response， i just file a jira https://issues.apache.org/jira/browse/HBASE-12957 for this issue thanks 2015-01-07 23:40 GMT+08:00 Ted Yu yuzhih...@gmail.com: In 0.98, HRegionServer is annotated with @InterfaceAudience.Private In 1.0+, it is annotated with