Re: Hmaster can't start for the latest trunk version

2011-10-31 Thread Gary Helmling
Yes, HBASE-4510 broke running on one set of conditions, now the fix in HBASE-4680 seems to have broken another. Are the safe mode related changes from HBASE-4510 really necessary right now? Would it be possible to wait for HDFS-2413, when we have a real API for checking safe mode? Or do we

RE: Region has been OPENING for too long

2011-10-31 Thread Ramkrishna S Vasudevan
Hi What I would suggest is try doing a forcefull assign of that region that is showing this log using the shell.(If the logs still continues to appear). Regards Ram -Original Message- From: tovb...@gmail.com [mailto:tovb...@gmail.com] On Behalf Of Matthew Tovbin Sent: Monday,

RE: Region has been OPENING for too long

2011-10-31 Thread Michael Segel
Matthew, What did you set your max region size to be for this table? 14K files totalling 650GB means you have a lot of small files... On average ~45MB (rough calc). How many regions? Do you have mslabs set up? (GC tuning?) Sorry for jumping in on the end of this conversation. -Mike From:

Re: Deployments of HBase with Hadoop 0.20.205?

2011-10-31 Thread Jignesh Patel
I am testing Hbase 0.90.4 with Hadoop 0.20.205. But we are no where near to production. However I noticed the integration is pretty stable. -Jignesh On Mon, Oct 31, 2011 at 12:36 AM, Francis Christopher Liu francis...@rocketmail.com wrote: Hi, We're interested in deploying Hbase with

Re: Region has been OPENING for too long

2011-10-31 Thread Matthew Tovbin
Mike, thanks for responding. BTW, I have a small update. I succeeded opening the table by setting hbase.master.assignment.timeoutmonitor.timeout to 1 hour. Now the table is hosted on single region server which is bad (see status below). Should I compact the table and then split it? What did

Re: Deployments of HBase with Hadoop 0.20.205?

2011-10-31 Thread Stack
On Sun, Oct 30, 2011 at 9:36 PM, Francis Christopher Liu francis...@rocketmail.com wrote: We're interested in deploying Hbase  with hadoop .205 in our sandbox environment. Has anyone tried sizable deployments of hbase with Hadoop 0.20.205? What are your experiences? I've run it in testing

Re: Deployments of HBase with Hadoop 0.20.205?

2011-10-31 Thread David Capwell
Which version would you guys recommend for .205 hadoop: 0.92, or 0.90.4? On Oct 31, 2011, at 10:23:52AM, Stack wrote: On Sun, Oct 30, 2011 at 9:36 PM, Francis Christopher Liu francis...@rocketmail.com wrote: We're interested in deploying Hbase with hadoop .205 in our sandbox environment.

tool to move out consecutive regions

2011-10-31 Thread Geoff Hendrey
Hi Guys - This is a fairly complete little Tool (Configured) whose purpose is to move out a whole slew of regions into a backup directory and restore .META. when done. We found that we needed to do this when a huge volume of keys had been generated into a production table, and it turned out

RE: PENDING_CLOSE for too long

2011-10-31 Thread Geoff Hendrey
attached is my original email to the list, which contains code for a tool to repair your hole in .META. -Original Message- From: Stuart Smith [mailto:stu24m...@yahoo.com] Sent: Saturday, October 29, 2011 1:39 PM To: user@hbase.apache.org Subject: Re: PENDING_CLOSE for too long Hello

Re: Deployments of HBase with Hadoop 0.20.205?

2011-10-31 Thread Stack
On Mon, Oct 31, 2011 at 10:41 AM, David Capwell dcapw...@yahoo-inc.com wrote: Which version would you guys recommend for .205 hadoop: 0.92, or 0.90.4? 0.92 is not out yet (Hopefully an RC will go up this week) so that leaves you with 0.90.4. St.Ack

Re: Hmaster can't start for the latest trunk version

2011-10-31 Thread Stack
I backed out hbase-4680. I made HBASE-4708 to backout the safemode parts of hbase-4510. Any chance of a patch Harsh? Thanks, St.Ack On Mon, Oct 31, 2011 at 1:24 AM, Harsh J ha...@cloudera.com wrote: Gary, We can revert for now, yes. Todd had fixed the constant name change issue earlier, so

Re: Region has been OPENING for too long

2011-10-31 Thread Matthew Tovbin
Mike, thanks for responding. BTW, I have a small update. I succeeded opening the table by setting hbase.master.assignment.timeoutmonitor.timeout to 1 hour. Now the table is hosted on single region server which is bad (see status below). Should I compact the table and then split it? What did

Re: Region has been OPENING for too long

2011-10-31 Thread Matthew Tovbin
Ram, Like I mentioned below the region is up, thanks to hbase.master.assignment.timeoutmonitor.timeout setting. Though, it still located on a single region server. How do I split it? Hi What I would suggest is try doing a forcefull assign of that region that is showing this log using the

Re: Deployments of HBase with Hadoop 0.20.205?

2011-10-31 Thread Francis Liu
Thanks for the responses. Does .90.4 support .205 out of the box or would it need patches? Also how many nodes did the cluster have? On Oct 31, 2011, at 11:00 AM, Stack st...@duboce.net wrote: On Mon, Oct 31, 2011 at 10:41 AM, David Capwell dcapw...@yahoo-inc.com wrote: Which version

Re: Deployments of HBase with Hadoop 0.20.205?

2011-10-31 Thread Stack
On Mon, Oct 31, 2011 at 12:44 PM, Francis Liu francis...@rocketmail.com wrote: Thanks for the responses. Does .90.4 support .205 out of the box or would it need patches? Also how many nodes did the cluster have? No need of patches for 0.90.4. My test cluster was 15 nodes. St.Ack

Re: tool to move out consecutive regions

2011-10-31 Thread Stack
Thanks Geoff. Mind making a JIRA and attaching the code as a patch? Copying and pasting from email might not work so well. Thanks boss, St.Ack On Mon, Oct 31, 2011 at 10:46 AM, Geoff Hendrey ghend...@decarta.com wrote: Hi Guys - This is a fairly complete little Tool (Configured) whose

backporting HBASE-4552 to 0.90

2011-10-31 Thread Ted Yu
Hi, HBASE-4552 has been integrated to 0.92 and TRUNK. From Jonathan: I was leaning towards either 1) deprecating and keeping the old methods in it in (keeping old rpc version) 2) having a patch available but in not including in an official 0.90 since it breaks compatibility Basically if we use

Re: backporting HBASE-4552 to 0.90

2011-10-31 Thread Andrew Purtell
 Basically if we use the approach in HBASE-4552, rolling restart wouldn't work. -1 to an approach that has this outcome. IMO, rolling restart must always be possible on a minor version upgrade. Best regards,    - Andy Problems worthy of attack prove their worth by hitting back. - Piet Hein

Re: backporting HBASE-4552 to 0.90

2011-10-31 Thread Andrew Purtell
Here is an example of something that might work: http://pastebin.com/t9Bbe1F6 My understanding is if you add methods at the end of an interface definition, the interface will remain compatible with a client compiled against the earlier version. This is based on our 0.90-ish internal branch so

Re: backporting HBASE-4552 to 0.90

2011-10-31 Thread Jonathan Hsieh
I was able to get tests HBASE-4552 specific running on 0.90.x with Andrew's patch to 0.90 with a minor tweak to the HFile instantiation code and with a backport of HBASE-3316 (allows Pair to be serialized and sent across the RPC protocol). Jon. On Mon, Oct 31, 2011 at 2:54 PM, Andrew Purtell

Re: save video with hbase

2011-10-31 Thread Jean-Daniel Cryans
Why would you use HBase for that? Regarding your two questions: On Mon, Oct 31, 2011 at 4:17 PM, xtliwen xtli...@gmail.com wrote: Hi everybody, When the client visit the video of a website through my website, it will be transcoded with our video codec server.As the time goes on,the

Re: [jira] [Updated] (HBASE-4695) WAL logs get deleted before region server can fully flush

2011-10-31 Thread Jack Levin
It would be nice to have a patch for 0.90.4 also. Thanks, -Jack On Mon, Oct 31, 2011 at 9:49 AM, stack (Updated) (JIRA) j...@apache.org wrote:     [ https://issues.apache.org/jira/browse/HBASE-4695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated

Re: Re: save video with hbase

2011-10-31 Thread xtliwen
I would like to save the data using hbase.The hbase is designed for small data,such as log.Maybe the video is too large for a row,so I am worried about the performance of the hbase in storing the video data. 2011-11-01 xtliwen 发件人: Jean-Daniel Cryans 发送时间: 2011-11-01 08:07:02 收件人:

Re: Re: save video with hbase

2011-10-31 Thread xtliwen
You are right,100M is too big ,so I plan to split the video to multi parts(avg 5M ), and save in different colums. 2011-11-01 xtliwen 发件人: Doug Meil 发送时间: 2011-11-01 09:54:47 收件人: user@hbase.apache.org 抄送: 主题: Re: save video with hbase Hi there, see...