Re: Please congratulate our new PMC Chair Misty Stanley-Jones

Congrats! Misty!! On Fri, Sep 22, 2017 at 7:16 AM, Pankaj kr wrote: > Congratulations Misty..!! :) > > > -Pankaj- > > > -Original Message- > From: Andrew Purtell [mailto:apurt...@apache.org] > Sent: Friday, September 22, 2017 3:08 AM > To: d...@hbase.apache.org;

Re: [ANNOUNCE] Dima Spivak joins the Apache HBase PMC

Congrats!! On Wed, Aug 31, 2016 at 1:33 PM, Aleksandr Shulman wrote: > Congrats Dima!! > > On Wed, Aug 31, 2016 at 12:37 PM, Andrew Purtell > wrote: > >> On behalf of the Apache HBase PMC I am pleased to announce that Dima Spivak >> has accepted our

Re: Nice blog post on coming zk-less assignment by our Jimmy Xiang

Thanks! Jimmy On Fri, Mar 6, 2015 at 9:39 AM, Nick Dimiduk ndimi...@gmail.com wrote: Great work Jimmy! Excellent explanation. On Thursday, March 5, 2015, Stack st...@duboce.net wrote: See https://blogs.apache.org/hbase/entry/hbase_zk_less_region_assignment St.Ack

Re: numberOfOnlineRegions available in just one regionServer

Do you see other region servers from your master web UI? If so, if you run balancer/balance_switch from the shell, what happens? On Wed, Sep 10, 2014 at 10:24 AM, Ivan Fernandez ivan.fernandez.pe...@gmail.com wrote: Hi, I'm trying to run a HBase cluster on a development environment with

Re: Region stuck in Transition FAILED_OPEN after upgrade to HBase0.98

What's your setting hbase.assignment.timeout.management? Region is FAILED_OPEN state usually needs some manual fix, such as assign from hbase shell. On Tue, Jul 29, 2014 at 6:06 PM, anil gupta anilgupt...@gmail.com wrote: Hi Ted, It seems like the problem self healed. Is there any timeout

Re: how to let hmaster read zookeeper's /hbase/unassigned

Yes, that will work. On Tue, Jul 22, 2014 at 12:39 PM, Libo Yu yu_l...@hotmail.com wrote: My cluster has a standby master process. If I restart it, will it reload data from zookeeper? If it does, I can shut down the current master and let standby master become the active one. Will that work?

Re: how to let hmaster read zookeeper's /hbase/unassigned

There is no way to force the master to reload such data from zookeeper currently. Thanks, Jimmy On Mon, Jul 21, 2014 at 4:20 PM, Libo Yu yu_l...@hotmail.com wrote: Hi all, I removed regions in transition zookeeper path /hbase/unassigned. But I don't want to bring down master node (the

Re: HBase REST using ssl

Hi Demai, You need to set these configurations for your REST server: hbase.rest.ssl.enabled hbase.rest.ssl.keystore.store hbase.rest.ssl.keystore.password hbase.rest.ssl.keystore.keypassword Thanks, Jimmy On Mon, Jun 2, 2014 at 3:23 PM, Demai Ni nid...@gmail.com wrote: hi, folks, I am

Re: [ANNOUNCE] Apache Phoenix has graduated as a top level project

Cool! Congrats! On Fri, May 23, 2014 at 12:18 AM, JungHo Lee hbell.al...@gmail.com wrote: Wow! Congratulations!! - hbell 2014年5月23日金曜日、Job Thomasj...@suntecgroup.comjavascript:_e(%7B%7D,'cvml',' j...@suntecgroup.com'); さんは書きました: Congratulations.

Re: Hbase API questions

HBaseAdmin#getClusterStatus can be used to list all the region servers. For each regionserver, you can use HBaseAdmin#getOnlineRegions to list the regions on it. For store files, they are changing due to compaction/memstore flush. On Thu, Mar 27, 2014 at 8:41 AM, Libo Yu yu_l...@hotmail.com

Re: Hbase API questions

If you really need to get the store files info, you can take a look at ProtobufUtil#getStoreFiles if you use 0.96+. On Thu, Mar 27, 2014 at 9:31 AM, Jimmy Xiang jxi...@cloudera.com wrote: HBaseAdmin#getClusterStatus can be used to list all the region servers. For each regionserver, you can

Re: Hbase data loss scenario

Hi Kiran, Can you check your table TTL setting? Is it possible that the data are expired and purged? Thanks, Jimmy On Thu, Feb 27, 2014 at 10:11 AM, Stack st...@duboce.net wrote: Anything in your logs that might give you a clue? Master logs? HDFS NameNode logs? St.Ack On Thu, Feb 27,

Re: Only map getting created for 100000 rows

Do you have just one region for this table? On Tue, Feb 11, 2014 at 2:59 AM, Tousif tousif.pa...@gmail.com wrote: I would like to know what configuration causes mapreduce to have only one map while input split of 1 and lines per map of 1000 are set in job configuration. Its a 2 node

Re: hbase 0.96 stop master receive ERROR ipc.RPC: RPC.stopProxy called on non proxy.

Which version of Hadoop do you use? On Wed, Nov 20, 2013 at 5:43 PM, Henry Hung ythu...@winbond.com wrote: Hi All, When stopping master or regionserver, I found some ERROR and WARN in the log files, are these errors can cause problem in hbase: 13/11/21 09:31:16 INFO zookeeper.ClientCnxn:

Re: SplitLogManager issue

In the region server log, you should see the details about the failure. On Wed, Sep 25, 2013 at 7:31 PM, kun yan yankunhad...@gmail.com wrote: I use importtsv import data into HDFS, but during the power outage. Horrible, and then I re-import the data.（hbase 0.94） the exception

Re: Please welcome our newest committer, Rajeshbabu Chintaguntla

Congrats! On Wed, Sep 11, 2013 at 9:54 AM, Stack st...@duboce.net wrote: Hurray for Rajesh! On Wed, Sep 11, 2013 at 9:17 AM, ramkrishna vasudevan ramkrishna.s.vasude...@gmail.com wrote: Hi All, Please join me in welcoming Rajeshbabu (Rajesh) as our new HBase committer. Rajesh

Re: ERROR: org.apache.hadoop.hbase.client.NoServerForRegionException:

You can use hbck to fix it: hbase hbck -fixMeta -fixAssignments If that doesn't work, can you restart the region server that holds the ROOT region? Thanks, Jimmy On Fri, Sep 6, 2013 at 3:56 AM, enes yücer enes...@gmail.com wrote: Hi, I'm using cdh 4.2.0 and hbase 0.94.2. our cluster

Re: Too many Compaction Complete messages

Here d should be the column family being compacted. Do you have 3-5 column families of the same region being compacted? On Wed, Sep 4, 2013 at 8:36 AM, Tom Brown tombrow...@gmail.com wrote: Is it normal to receive 3-5 distinct Compaction Complete statuses for the same region each second? For

Re: LocalHBaseCluster exception

Find the hbase-default.xml file in your target folder, check the value for parameter hbase.defaults.for.version. Is it value@@@VERSION@ @@/value? It should be replaced by mvn to the ${project.version}. However, if you do a clean build from eclipse or something else, the replaced value may

Re: getting splitmanager debug logs continuously

Can you start the master as well (besides region servers)? On Thu, Aug 8, 2013 at 2:41 PM, oc tsdb oc.t...@gmail.com wrote: I am using hbase-0.92 Region server was not running on any of the nodes. Restarted the cluster. It started region server on all nodes except HMaster but still

Re: AssignmentManager looping?

Something went wrong with split. It should be easy to fix your cluster. However, it will be more interesting to find out how it happened. Do you remember what has happened since it was good previously? Do you have all the logs? On Thu, Aug 1, 2013 at 7:08 AM, Jean-Marc Spaggiari

Re: AssignmentManager looping?

to bring it back up... JM 2013/8/1 Jimmy Xiang jxi...@cloudera.com Something went wrong with split. It should be easy to fix your cluster. However, it will be more interesting to find out how it happened. Do you remember what has happened since

Re: Delete all data before a given timestamp

When you set up the MR, does it help to set a proper timestamp filter or time range in the scan object? On Tue, Jul 16, 2013 at 5:59 AM, Jean-Marc Spaggiari jean-m...@spaggiari.org wrote: Another option might be to setup the proper TTL on the table? You alter the table to set the TTL to

Re: Scanner problem after bulk load hfile

Do you see any exception/logging in the region server side? On Tue, Jul 16, 2013 at 1:15 PM, Rohit Kelkar rohitkel...@gmail.com wrote: Yes. I tried everything from myTable.flushCommits() to myTable.clearRegionCache() before and after the LoadIncrementalHFiles.doBulkLoad(). But it doesn't

Re: Scanner problem after bulk load hfile

at 3:28 PM, Jimmy Xiang jxi...@cloudera.com wrote: Do you see any exception/logging in the region server side? On Tue, Jul 16, 2013 at 1:15 PM, Rohit Kelkar rohitkel...@gmail.com wrote: Yes. I tried everything from myTable.flushCommits() to myTable.clearRegionCache() before

Re: Hbase ConnectionLoss for /hbase/master

Is this exception seen in the client side? Was your HBase still running fine at that moment? How many connections do you open in your client? Which HBase version is it? Thanks, Jimmy On Wed, Apr 3, 2013 at 1:47 AM, Dhanasekaran Anbalagan bugcy...@gmail.comwrote: Hi Guys, I trying to run

Re: Welcome our newest Committer Anoop

Congratulations! On Wed, Mar 20, 2013 at 6:11 AM, Jonathan Hsieh j...@cloudera.com wrote: welcome welcome! On Wed, Mar 13, 2013 at 10:23 AM, Sergey Shelukhin ser...@hortonworks.comwrote: Congrats! On Tue, Mar 12, 2013 at 10:38 PM, xkwang bruce bruce.xkwa...@gmail.com wrote:

Re: [ANNOUNCE] New Apache HBase Committer - Devaraj Das

Congratulations! On Thu, Feb 7, 2013 at 9:54 AM, Andrew Purtell apurt...@apache.org wrote: Congratulations Devaraj! On Wed, Feb 6, 2013 at 9:19 PM, Ted Yu yuzhih...@gmail.com wrote: Hi, We've brought in one new Apache HBase Committer: Devaraj Das. On behalf of the Apache HBase PMC,

Re: What does Found lingering reference file mean?

RECOVERED_EDITS is not a column family. It should be ignored by hbck. Filed a jira: https://issues.apache.org/jira/browse/HBASE-7640 Thanks, Jimmy On Mon, Jan 21, 2013 at 2:36 PM, Stack st...@duboce.net wrote: Did you get the name of the broken reference? I'd trace its life in namenode

Re: Re: always assinging root

That regionserver is stopping? If not, you may need to restart it. 2012-12-07 13:18:53,947 DEBUG org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler: Processing open of -ROOT-,,0.70236052 2012-12-07 13:18:53,947 INFO org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler:

Re: Does HBase combine multiple Puts against the same region server?

If auto flush is off, multiple puts could be combined into a batch and send to the region server in one RPC call if they are for the same region server. Thanks, Jimmy On Thu, Dec 6, 2012 at 10:34 AM, yun peng pengyunm...@gmail.com wrote: Hi, I have question on how the multiple Puts() are

Re: Does HBase combine multiple Puts against the same region server?

On Thu, Dec 6, 2012 at 1:42 PM, Jimmy Xiang jxi...@cloudera.com wrote: If auto flush is off, multiple puts could be combined into a batch and send to the region server in one RPC call if they are for the same region server. Thanks, Jimmy On Thu, Dec 6, 2012 at 10:34 AM, yun peng pengyunm

Re: regions not balanced, CDH4.1.2

In CDH4.1.2, per table region balancing is turned off by default. You can change the configuration to turn it on. Thanks, Jimmy On Tue, Dec 4, 2012 at 11:10 AM, Ted Yu yuzhih...@gmail.com wrote: Can you give us a little more detail on how much deviation the region counts on region servers

Re: regions not balanced, CDH4.1.2

mean the config hbase.master.loadbalance.bytable? According to [1] and [2], it is true by default. [1] https://issues.apache.org/jira/secure/attachment/12509174/3373.txt [2] http://search-hadoop.com/m/M6z7G1PKejw Norbert On Tue, Dec 4, 2012 at 2:23 PM, Jimmy Xiang jxi...@cloudera.com wrote

Re: could not start HMaster

Is your /tmp folder cleaned up automatically and some files are gone? Thanks, Jimmy On Mon, Oct 15, 2012 at 12:26 PM, yulin...@dell.com wrote: Hi, I set up a single node HBase server on top of Hadoop and it has been working fine with most of my testing scenarios such as creating tables and

Re: Question about WAL writes after region server soft failures

Hi Nick, When the dead region server comes back, it won't be able to write data to the WAL any more. As the first thing of log splitting, the WAL folder for the dead region server is renamed. When the dead region server tries to write to the WAL, it will find the file is not there any more.

Re: MR hbase export is failing

It could be also caused by the MR takes too long to process a batch of data before coming back for another batch. Thanks, Jimmy On Tue, Jul 24, 2012 at 11:52 AM, Jeff Whiting je...@qualtrics.com wrote: What would cause a scanner timeout exception? Is hdfs too slow? Do I just increase the

Re: Is this exception caused by an overloaded node?

This exception means the scanner is expired in the region server side. You can adjust the scanner expiration setting, or make your client fast. Thanks, Jimmy On Fri, Jul 20, 2012 at 9:27 AM, Jonathan Bishop jbishop@gmail.com wrote: Hi, I am running on a cluster where some of the machines

Re: Question about regions splitting

At the very beginning, the two daughter regions are on the same region server as the parent region. But they can be moved to other region servers by region balancer. HFiles of a region may not be on the same host as the region. Thanks, Jimmy On Fri, Jul 20, 2012 at 2:44 PM, Haijia Zhou

Re: Scan only talks to a single region server

Hi Whitney, The scanner will automatically jump to the next region server once the current region server is scanned. In the client, can HTable.getStartEndKeys() see all the regions and region servers? Thanks, Jimmy On Tue, Jul 17, 2012 at 10:47 AM, Whitney Sorenson wsoren...@hubspot.com wrote:

Re: HMaster not failing over dead RegionServers

Bryan, The master could not detect if the region server is dead. How do you set the zookeeper session timeout? Thanks, Jimmy On Sat, Jun 30, 2012 at 8:09 AM, Stack st...@duboce.net wrote: On Sat, Jun 30, 2012 at 7:04 AM, Bryan Beaudreault bbeaudrea...@hubspot.com wrote: 12/06/30 00:07:22

Re: Schedule major compaction programmatically

I am thinking to add a function to check if a table or region in compaction (major or minor). I filed HBASE-6033. It won't show status of a specific compaction request. Will this help? Thanks, Jimmy On Thu, May 17, 2012 at 11:11 AM, Chen Song chen.song...@gmail.com wrote: I would like to

Re: Schedule major compaction programmatically

compact/major_compact issued from hbase shell handles this under the hood? Is it eventually calling HBaseAdmin API or HRegion synchronous API call? Thanks Chen On Thu, May 17, 2012 at 2:24 PM, Jimmy Xiang jxi...@cloudera.com wrote: I am thinking to add a function to check if a table or region

Re: Schedule major compaction programmatically

, Jimmy Xiang jxi...@cloudera.com wrote: It is an async call to the region server to request a compaction. Once the request is accepted, the call returned. There is no sync call here. The request is queued and processed by a pool of threads. Currently, there is a metric to show

Re: Coprocessor Aggregation supposed to be ~20x slower than Scans?

Yes, it is fixed in CDH4. It will be in the coming release. Thanks, Jimmy On Tue, May 15, 2012 at 5:34 PM, Ted Yu yuzhih...@gmail.com wrote: Hopefully this gets fixed in https://repository.cloudera.com/artifactory/public/org/apache/hbase/hbase/0.92.0-cdh4b2-SNAPSHOT/ A developer from

Re: Failed to apply HBASE-5128 on v0.90.6

You don't need to apply this patch to fix your problem. To use the enhanced hbck in 0.90, you can get the latest in 0.90, and build the hbase jar file, then make a copy of your own hbase home, replace the hbase jar in your copy of your hbase home with the hbase jar you just built from latest

Re: Region server shutting down due to HDFS error

Which version of HDFS and HBase are you using? When the problem happens, can you access the HDFS, for example, from hadoop dfs? Thanks, Jimmy On Wed, Mar 28, 2012 at 4:28 AM, Eran Kutner e...@gigya.com wrote: Hi, We have region server sporadically stopping under load due supposedly to

Re: ERROR: org.apache.hadoop.hbase.MasterNotRunningException: Retried 7 Times

What's your hbase.zookeeper.quorom configuration? You can check out this quick start guide: http://hbase.apache.org/book/quickstart.html Thanks, Jimmy On Mon, Feb 13, 2012 at 10:09 AM, Bing Li lbl...@gmail.com wrote: Dear all, After searching on the Web and asking for help from friends, I

Re: ERROR: org.apache.hadoop.hbase.MasterNotRunningException: Retried 7 Times

in Java. I hope I could deploy the system in fully distributed mode when my system is done. So what I am configuring is very simple. Do I need to set up the zookeeper port in hbase-site.xml? Thanks so much! Best, Bing On Tue, Feb 14, 2012 at 3:16 AM, Jimmy Xiang jxi...@cloudera.com wrote

Re: ERROR: org.apache.hadoop.hbase.MasterNotRunningException: Retried 7 Times

org.apache.hadoop.hbase.master.HMaster: Stopping service threads Thanks so much! Bing On Tue, Feb 14, 2012 at 3:35 AM, Jimmy Xiang jxi...@cloudera.com wrote: In this case, you may just use the standalone mode. You can follow the quick start step by step. The default zookeeper port is 2181, you don't need

Re: Problem accessing /master-status

It may not be null actually. It is most likely because the hostname cannot be resolved to an IP address. Thanks, Jimmy On Mon, Feb 6, 2012 at 10:10 AM, devrant evan.con...@gmail.com wrote: I received this error below...does anyone know why the hostname is null? HTTP ERROR 500 Problem

Re: Problem accessing /master-status

: Thanks for the response Jimmy. Do you know if this a error on the server side (/etc/hosts etc) or config files for hbase? (ie. conf/hbase-site.xml etc). Jimmy Xiang wrote: It may not be null actually. It is most likely because the hostname cannot be resolved to an IP address