Re: HBase Block locality always 0

Hi, Esteban Each region server has about 122 regions, data is large. HDFS replica is defined as default 3, and namenode have some WARN like below. {log} 2015-05-14 20:45:37,463 WARN org.apache.hadoop.hdfs.qjournal.client.QuorumJournalManager: Took 1503ms to send a batch of 3 edits (179 bytes)

Re: Questions related to HBase general use

+ hive-dev Thanks for your question. We recently have been busy adding quite a few features on top on Hive/HBase Integration to make it more stable and easy to use. We also did a talk very recently at HBaseCon 2015 showing off the latest improvements. Slides here[1]. Like Jerry mentioned, if you

Re: Hbase 1.0 Distributed Mode:Issue:Master is initializing

Hi Sridhar! Please be sure to copy your responses to user@hbase and not just an individual. The attached log shows that your master service does not see any Region Servers as available. You should check the logs for the region servers to see why they aren't starting. On Sat, Apr 4, 2015 at

Re: Upgrading from 0.94 (CDH4) to 1.0 (CDH5)

Just an update here. I've got something working locally that can run against either a 0.94.17 hbase or a 1.0 hbase transparently. I implemented as laid out above, but there were a bunch of gotchas. It helps that we maintain our own fork of each version, as I needed to make some supplemental

Re: Upgrading from 0.94 (CDH4) to 1.0 (CDH5)

+1 on moving MR related code to hbase-client or we can have a separate artifact called hbase-mapreduce I also have to include hbase-server along with hbase-client in my project just because of this reason. And once we pull in hbase-server and build an uber jar. hbase-server pulls in a lots of

High CPU usage on region server

Hey, I am seeing a wired issue on my hbase cluster: randomly, one or two region servers in the cluster will have very high CPU utilization(close to 100%), even these servers aren’t doing that much qps. Restart the region server will solve it, but after a while the hot cpu usage problem will come

Re: Upgrading from 0.94 (CDH4) to 1.0 (CDH5)

Thanks Ted. Looks like there's a reason it hasn't been done yet. For the ease of my clients and the migration I may just add hbase-server to my shaded hbase and heavily filter away the things I don't need (leaving only those for mapreduce). Will see how that works. On Thu, May 14, 2015 at 2:33

Re: Upgrading from 0.94 (CDH4) to 1.0 (CDH5)

Looks like there is a JIRA already: HBASE-11843 MapReduce classes shouldn't be in hbase-server Cheers On Thu, May 14, 2015 at 10:41 AM, anil gupta anilgupt...@gmail.com wrote: +1 on moving MR related code to hbase-client or we can have a separate artifact called hbase-mapreduce I also have

[RESULT][VOTE] Third release candidate for HBase 1.1.0 (RC2) is available.

With 4 binding +1 votes and no -0's, the vote has passed. I'll publish the release artifacts shortly. Thanks everyone for helping with the release! -n On Tue, May 12, 2015 at 6:19 PM, Enis Söztutar e...@apache.org wrote: Here is my +1. checked sigs, crcs build src tarsal with hadoop 2.3,

Re: HBase Block locality always 0

Hi Louis, Locality 0 is not right for a cluster of that size and having 3 replicas per block unless all RS cannot connect to the local DN and somehow the local DN to the RS is always excluded from the pipeline. In Hadoop 2.0-alpha there was a bug (HDFS-3224) that caused the NN to report a DN as

Re: HBase MapReduce in Kerberized cluster

I searched (current) 0.98 and branch-1 where I found: ./hbase-client/src/main/java/org/apache/hadoop/hbase/security/token/TokenUtil.java Looking at both 0.98[1] and 0.98.6[2] on github I see TokenUtil as part of hbase-server. Is it necessary for us to add this call to TokenUtil to all MR jobs

Re: HBase MapReduce in Kerberized cluster

Please take a look at HBASE-12493 User class should provide a way to re-use existing token which went into 0.98.9 FYI On Thu, May 14, 2015 at 8:37 AM, Edward C. Skoviak edward.skov...@gmail.com wrote: I searched (current) 0.98 and branch-1 where I found:

cell level coprocessor

Hi, I am trying to use co processor to do some aggregations(eg topn) over all versions of a cell and return it . I found most of the aggregation implementation with coprocessors are done on column . how we can achieve for every cell in that column ,any ideas ,links ??? Use case - if I want

Re: cell level coprocessor

Hi Navdeep, I believe you will need to: * implement RegionScanner that would apply aggregation on Cell level * extend from BaseRegionObserver to force using your RegionScanner in preGet and preScan I don't have a simple example in front of me, but maybe the following will give you some pointers.

Problem tin scanning hbase in reducer phase of mapreduce

I am using hadoop 1.2.1 and hbase 0.94.12 . I have a scenario where in reducer phase i have to read data check if the key of map is already inserted and then put in to hbase table. When i tried in single node all gets and scans worked. But when i tried with 3 node cluster, scanning does not work.

Re: Problem tin scanning hbase in reducer phase of mapreduce

Can you give us a bit more information? Such as stack trace if the scan hangs, master / region server log snippet, etc Thanks On May 13, 2015, at 11:04 PM, Priya prt...@gmail.com wrote: I am using hadoop 1.2.1 and hbase 0.94.12 . I have a scenario where in reducer phase i have to read

Re:Re: Re: How to know the root reason to cause RegionServer OOM?

Thanks for guys' helps. Maybe the root reason is to turn off swap. The cluster contains seven Region servers, although all set vm.swappiness to 0, but two of them has always turned off swap, others turned on. Meanwhile OOM also always encountered on the two machines. I plan to turn on swap and