How to add a new Keyspace?

Hi all, If I want to add a new Keyspace, does it mean I have to distribute my storage-conf.xml to whole nodes? and restart whole nodes? Shen

Re: How to add a new Keyspace?

Sorry, typo in mail adddress.

Re: major differences with Cassandra

Another link: http://bit.ly/aGJi1e On Wed, Jul 7, 2010 at 10:48 PM, Akash Deep Shakya akasha...@gmail.comwrote: I studied Cassandra in detail and currently working in hbase. There are lots of differences, yet similarities between Cassandra and HBase, for HBase data model/arch, there are two

Re: NPE in IHBase with HBase 0.20.5

Hi James, Thanks for the patch, I'll apply it shortly and publish a new version if the build will pass. I've been a little busy lately and I appreciate any help offered in keeping ihbase up to date. Thanks, Yoram On Thu, Jul 8, 2010 at 4:45 AM, Jean-Daniel Cryans jdcry...@apache.orgwrote:

Re: Java Client hangs after around 2 min

Hi, I have installed the jar from http://code.google.com/p/hadoop-gpl-compression/ and have speciifed the required jar in the classpath, and after that I have got the previous error. Further, I have installed hbase in standalone mode and as per my understanding, in standalone mode hbase will

Re: NPE in IHBase with HBase 0.20.5

New version published at http://github.com/ykulbak/ihbasehttp://github.com/ykulbak/ihbase/issues/#issue/7 Cheers, Yoram On Thu, Jul 8, 2010 at 10:35 PM, Ram Kulbak ram.kul...@gmail.com wrote: Hi James, Thanks for the patch, I'll apply it shortly and publish a new version. I've been a

Re: Java Client hangs after around 2 min

You don't, but the LZO code is in C++ so the jar only contains the bindings. You also need to copy the librairies like it does in http://wiki.apache.org/hadoop/UsingLzoCompression : cp build/native/Linux-amd64-64/lib/libgplcompression.* hbase/lib/native/Linux-amd64-64/ But adapted to your

Re: HBase on same boxes as HDFS Data nodes

OS cache is good, glad you figured out your memory problem. J-D On Thu, Jul 8, 2010 at 2:03 AM, Jamie Cockrill jamie.cockr...@gmail.com wrote: Morning all. Day 2 begins... I discussed this with someone else earlier and they pointed out that we also have task trackers running on all of those

Re: columns.to_java_bytes undefined method in HBase.rb line 554

Ted Yu already answered that yesterday: If you look at HBase.rb, line 554, you would find the bug. Here is the correct call: split = KeyValue.parseColumn(column.to_java_bytes) I guess that line was copied from line 546 which isn't in for loop. You can file a JIRA. J-D On Wed,

Re: HBase on same boxes as HDFS Data nodes

More info on this blog post: http://www.larsgeorge.com/2010/05/hbase-file-locality-in-hdfs.html J-D On Thu, Jul 8, 2010 at 10:11 AM, Jean-Daniel Cryans jdcry...@apache.org wrote: This would be done at the expense of network IO, since you will lose locality for jobs that read/write to HBase.

Fwd: HBase on same boxes as HDFS Data nodes

Hi Fairly new to hbase.. the list serve..Following up on this thread the article.. Could some one elaborate why locality is lost upon restart? Is it because of random assignment by HMaster and/or HRegionServer is stateless or other reasons? thanks venkatesh -Original

Re: HBase on same boxes as HDFS Data nodes

Former, Now imagine you stop HBase after saving a lot of data and restarting it subsequently. The region servers are restarted and assign a seemingly random number of regions It's not really because we enjoy it that way, but because the work required just isn't done. If this is of interest to

About data locality (Was: Re: HBase on same boxes as HDFS Data nodes)

(changing the subject, let's not hijack threads) will the data move over time though...for example if i have lots of access to data in DataNode A ? without the current work that is in progress.. HBase has no control on that, but data will be moved if those regions are used. Like the article

Re: About data locality (Was: Re: HBase on same boxes as HDFS Data nodes)

Glad to help. About those tons of Qs, as much as we enjoy answering them, we don't like to repeat ourselves too much (so few hours in a day, so many things we'd like to develop for HBase). So to give you a kick start, I'd like to point you to Google's Bigtable and the Hadoop Definitve Guide as

Re: HBase on same boxes as HDFS Data nodes

Thanks everyone..Please use the new thread that JD created for me (it was my fault) for locality related response.. -Original Message- From: Jonathan Gray jg...@facebook.com To: user@hbase.apache.org user@hbase.apache.org Sent: Thu, Jul 8, 2010 6:40 pm Subject: RE: HBase on

RE: zookeeper HBase

Good to know ZK is IO intense. Since ZK does not require much disk space and is IO intense. Has anyone played with using solid state drives for ZK. We have a 20 node cluster. It would be feasible to have a 3 node ZK all configured with solid state drives. Thanks Arun -Original

Re: zookeeper HBase

It's not IO intense, it's IO latency sensitive eg. if other processes are sucking up most of the IO bandwidth then ZK will have a hard time taking quorum decisions. Disks are cheap, and a single 7.2k dedicated disk can be enough. J-D On Thu, Jul 8, 2010 at 5:38 PM, Arun Ramakrishnan

Re: online automatic region merge

HBASE-1621 isn't about automatic merging and it's still very experimental. The issue with doing automatically is that you have to figure that two regions, together, are smaller in size than the max size of a region to split. At the same time, it's not because two regions are small that you want

Re: online automatic region merge

Considering the following case: After lowering the value of hbase.hregion.max.filesize and manually starting a major compaction, I notice HBase start to split until all regions meet the requirement. But in the case of increasing the value hbase.hregion.max.filesize , nothing happens. Probably