Delete a region from hbase

2015-01-24 Thread Shuai Lin
Hi all, We're using hbase 0.94-15 from CDH4 repo, and we're planning to delete several regions which contain data that are no longer needed. Basically we plan to use HRegion.deleteRegion

Re: Delete a region from hbase

2015-01-24 Thread Shuai Lin
. Disable the table Disabling the table is acceptable to you ? In 0.98+, you can use online merge feature to deal with empty regions. But online merge is not in 0.94 - see HBASE-8217 Cheers On Sat, Jan 24, 2015 at 9:25 AM, Shuai Lin linshuai2...@gmail.com wrote: Hi all, We're using hbase

Re: Delete a region from hbase

2015-01-25 Thread Shuai Lin
, then delete the region folder from HDFS, and finally assign that region in shell again, and it works fine. Thanks for your help! On Sun, Jan 25, 2015 at 11:03 AM, Stack st...@duboce.net wrote: On Sat, Jan 24, 2015 at 9:25 AM, Shuai Lin linshuai2...@gmail.com wrote: Hi all, We're using hbase 0.94

Region Server OutOfMemory Error

2015-01-06 Thread Shuai Lin
Hi all, We have a hbase cluster of 5 region servers, each, each hosting 60+ regions. But under heavy load the region servers crashes for OOME now and then: # # java.lang.OutOfMemoryError: Java heap space # -XX:OnOutOfMemoryError=kill -9 %p # Executing /bin/sh -c kill -9 16820... We have max

Re: Region Server OutOfMemory Error

2015-01-06 Thread Shuai Lin
Forgot to mention, we are using hbase 0.94.15. On Tue, Jan 6, 2015 at 7:32 PM, Shuai Lin linshuai2...@gmail.com wrote: Hi all, We have a hbase cluster of 5 region servers, each, each hosting 60+ regions. But under heavy load the region servers crashes for OOME now

Re: Strange HBase failure

2015-01-11 Thread Shuai Lin
From the log I see no log was produced during 08:25 to 09:15, why did this happen? 08:25:06.274INFOorg.apache. hadoop.hbase.regionserver.wal.HLog moving old hlog file

Re: 答复: Region Server OutOfMemory Error

2015-01-06 Thread Shuai Lin
:+HeapDumpOnOutOfMemoryError ? the heap dump will make the thing clear 发件人: Shuai Lin linshuai2...@gmail.com 发送时间: 2015年1月6日 19:32 收件人: user@hbase.apache.org 主题: Region Server OutOfMemory Error Hi all, We have a hbase cluster of 5 region servers, each, each hosting 60

Re: Region Server OutOfMemory Error

2015-01-06 Thread Shuai Lin
Yeah, I've read bunches of articles on java GC, including the famous one you mentioned. We don't pass any specific GC params to JVM, except the -XX:+UseG1GC flag. On Wed, Jan 7, 2015 at 2:57 AM, Stack st...@duboce.net wrote: On Tue, Jan 6, 2015 at 3:32 AM, Shuai Lin linshuai2...@gmail.com wrote

Re: Region Server OutOfMemory Error

2015-01-06 Thread Shuai Lin
* Anomaly Detection * Centralized Log Management Solr Elasticsearch Support * http://sematext.com/ On Tue, Jan 6, 2015 at 6:32 AM, Shuai Lin linshuai2...@gmail.com javascript:; wrote: Hi all, We have a hbase cluster of 5 region servers, each, each hosting 60

Re: Region Server OutOfMemory Error

2015-01-06 Thread Shuai Lin
/ On Tue, Jan 6, 2015 at 6:32 AM, Shuai Lin linshuai2...@gmail.com wrote: Hi all, We have a hbase cluster of 5 region servers, each, each hosting 60+ regions. But under heavy load the region servers crashes for OOME now and then: # # java.lang.OutOfMemoryError: Java heap space

Re: Region Server OutOfMemory Error

2015-01-08 Thread Shuai Lin
ran into this exact same issue on G1GC. In my case I had the luxury of giving HBase more heap space. If that is an option for you, you might try it out and see if it helps. -Carlos -Original Message- From: Shuai Lin [mailto:linshuai2...@gmail.com] Sent: Tuesday, January 06, 2015 3:33

Re: 404 for hbase book

2015-01-14 Thread Shuai Lin
Works fine for me. Maybe you can try force refresh the page? On Wed, Jan 14, 2015 at 5:47 PM, Serega Sheypak serega.shey...@gmail.com wrote: Hi, starting from monday (12.01.2015) I'm getting 404 on ony page of http://hbase.apache.org what it could be? Sorry for stupid question. I've tried

Re: 404 for hbase book

2015-01-14 Thread Shuai Lin
/datamodel.html https://www.google.ru/#newwindow=1q=Chapter+5.+Data+Model+-+HBase first link: http://hbase.apache.org/book/datamodel.html Looks like links hasn't been reindexed? Ok, nevermind, they can be accessed directly from hbase site. 2015-01-14 13:01 GMT+03:00 Shuai Lin linshuai2

Re: Region Server OutOfMemory Error

2015-01-07 Thread Shuai Lin
-- Monitoring * Alerting * Anomaly Detection * Centralized Log Management Solr Elasticsearch Support * http://sematext.com/ On Tue, Jan 6, 2015 at 11:42 PM, Shuai Lin linshuai2...@gmail.com wrote: Cool, how can I get a graph like that? On Wed, Jan 7, 2015 at 4:06 AM, Otis Gospodnetic

Removing .oldlogs may lead to replication problem?

2015-08-07 Thread Shuai Lin
Hi all, We have two hbase cluster (one prod, one backup) running hbase 0.94.6 (from cdh4.) and have setup master-master replication. Last week we find the .oldlogs in the prod cluster was growing very large (13TB) and decided to remove it. But not until yesterday do we find that the replication

Re: Some regions never get online after a region server crashes

2016-06-06 Thread Shuai Lin
Would do that, thanks! On Sat, Jun 4, 2016 at 6:55 PM, Ted Yu <yuzhih...@gmail.com> wrote: > I think this sounds like a bug. > > Search in HBase JIRA first. If there is no JIRA with the same symptom, > consider filing one. > > Cheers > > On Fri, Jun 3, 2016 at

Re: Some regions never get online after a region server crashes

2016-06-03 Thread Shuai Lin
t not yet > served. > > d1c7f3f455f2529da82a2f713b5ee067 was one of them. > > On Fri, May 27, 2016 at 12:47 AM, Shuai Lin <linshuai2...@gmail.com> > wrote: > >> Here is the complete log on node6 between 13:10:47 and 13:11:47: >> http://paste.openstack.org/raw/5058

Re: Some regions never get online after a region server crashes

2016-05-27 Thread Shuai Lin
tem.currentTimeMillis() + > this.server.getConfiguration(). > getLong("hbase.regionserver.rpc.startup.waittime", 6); > > BTW can you see what caused rs-node6 to not respond around 13:11:47 ? > > Cheers > > On Fri, May 20, 2016 at 6:20 AM, Shuai Lin <l

Re: Some regions never get online after a region server crashes

2016-05-20 Thread Shuai Lin
16 at 12:42 PM, Ted Yu <yuzhih...@gmail.com> wrote: > Looks like region d1c7f3f455f2529da82a2f713b5ee067 received CLOSE request > when it was opening, leading to RegionAlreadyInTransitionException. > > Was there any clue in master log why the close request was sent ? > > Cheers &g

Re: Some regions never get online after a region server crashes

2016-05-19 Thread Shuai Lin
Hi Ted, Could be please take a look at the log I've pasted above? Thanks! On Thu, May 5, 2016 at 11:02 AM, Shuai Lin <linshuai2...@gmail.com> wrote: > Hi Ted, > > The hbase version is 1.0.0-cdh5.4.8, shipped with cloudera CDH 5.4.8. The > RS logs on node6 can be

Re: Some regions never get online after a region server crashes

2016-05-04 Thread Shuai Lin
erver log w.r.t. d1c7f3f455f2529da82a2f713b5ee067 > from rs-node6 ? > > Which release of hbase are you using ? > > Cheers > > On Wed, May 4, 2016 at 6:07 PM, Shuai Lin <linshuai2...@gmail.com> wrote: > > > Hi list, > > > > Last weekend I got a region serve

Some regions never get online after a region server crashes

2016-05-04 Thread Shuai Lin
Hi list, Last weekend I got a region server crashed, but some regions never got online again on other RSes. I've gone through the logs, and here is the timeline about some of the events: * 13:03:50 on of the region server, rs-node7, died because of a disk failure. Master started to split

Re: Some regions never get online after a region server crashes

2016-05-25 Thread Shuai Lin
Hi Ted, does my conclusion above make sense? Should I open an issue in hbase JIRA? On Fri, May 20, 2016 at 9:20 PM, Shuai Lin <linshuai2...@gmail.com> wrote: > Because of the "opening regions" rpc call sent by master to the region > server node6 got timed out after 1

HBase table snapshots compatibility between 1.0 and 2.1

2019-11-10 Thread Shuai Lin
Hi all, TL;DR Could table snapshots taken in hbase 1.0 be used in hbase 2.1? We have an existing production hbase 1.0 cluster (CDH 5.4) , and we're setting up a new cluster with hbase 2.1 (CDH 6.3). Let's call the old cluster C1 and new one C2. To migrate the existing data from C1 to C2, we

Re: HBase table snapshots compatibility between 1.0 and 2.1

2019-12-03 Thread Shuai Lin
instead of snapshots. > > On 11/11/19 1:47 AM, Shuai Lin wrote: > > Hi all, > > > > TL;DR Could table snapshots taken in hbase 1.0 be used in hbase 2.1? > > > > We have an existing production hbase 1.0 cluster (CDH 5.4) , and we're > > setting up a