Large data sets

2007-02-02 Thread Jim Kellerman
obstacles you had in growing your system to that size, etc? Thanks in advance. -- Jim Kellerman, Senior Engineer; Powerset[EMAIL PROTECTED]

Re: Loading data into HDFS

2007-08-07 Thread Jim Kellerman
into one it. How is data consistency maintained here ? Thanks in advance, Venkates P B -- Jim Kellerman, Senior Engineer; Powerset [EMAIL PROTECTED]

Re: hbase listTables() broken?

2007-09-04 Thread Jim Kellerman
name. Also, when I run show tables; in HBase shell, it shows the same result. If this is actually a bug and not an error on my end, I can create a JIRA task. Thanks, Andrew -- Jim Kellerman, Senior Engineer; Powerset [EMAIL PROTECTED]

RE: HBase performance

2007-10-11 Thread Jim Kellerman
another data node. We have done almost no tuning for HBase, but I'd be willing to bet that it would handily beat MySql in a drag race. --- Jim Kellerman, Senior Engineer; Powerset [EMAIL PROTECTED] -Original Message- From: Rafael Turk [mailto:[EMAIL PROTECTED] Sent: Thursday, October

RE: HBase performance

2007-10-12 Thread Jim Kellerman
Stonebraker has a new column oriented store called H-Store. It is also talked about in the paper. And now I'll shut up. I didn't intend to create such a firestorm. --- Jim Kellerman, Senior Engineer; Powerset [EMAIL PROTECTED] -Original Message- From: Doug Cutting [mailto:[EMAIL

RE: HBase performance

2007-10-12 Thread Jim Kellerman
for compression? Yes, see hbase.HColumnDescriptor.java compression is controlled on a per column family basis. --- Jim Kellerman, Senior Engineer; Powerset [EMAIL PROTECTED]

RE: A basic question on HBase

2007-10-22 Thread Jim Kellerman
Josh, Could you provide the parameters you used to configure the bloom filter? Thanks. --- Jim Kellerman, Senior Engineer; Powerset [EMAIL PROTECTED] -Original Message- From: Josh Wills [mailto:[EMAIL PROTECTED] Sent: Sunday, October 21, 2007 7:28 PM To: hadoop-user

RE: HBase UnknownScannerException

2007-10-29 Thread Jim Kellerman
(...) table.commit(...) } } will not work because the update will wait for the scanner to finish, (which it won't), and both the update and the next scanner.next should both fail. Hope that helps. --- Jim Kellerman, Senior Engineer; Powerset [EMAIL PROTECTED] -Original Message- From: Cedric Ho

RE: How to Setup Hbase in 10 mintues

2007-10-30 Thread Jim Kellerman
tree), I would be more inclined to merge the scripts since they would have more in common. For now, I think keeping them separate is probably the right thing to do. --- Jim Kellerman -Original Message- From: Doug Cutting [mailto:[EMAIL PROTECTED] Sent: Tuesday, October 30, 2007 9:53

RE: HBase question on HRegions server

2007-11-01 Thread Jim Kellerman
-Original Message- From: Bin YANG [mailto:[EMAIL PROTECTED] Sent: Thursday, November 01, 2007 3:06 AM To: hadoop-user@lucene.apache.org Subject: HBase question on HRegions server Hi, I am confused with some thing in HBase. 1. All data is stored in HDFS. Data is served to clients

RE: HBase question on HRegions server

2007-11-01 Thread Jim Kellerman
in the META directly or ask the Master to write a new tablet row in the META? It depends on the circumstances. Sometimes the region server does, sometimes the master does. thanks. On 11/2/07, Jim Kellerman [EMAIL PROTECTED] wrote: -Original Message- From: Bin YANG [mailto:[EMAIL

RE: NoSuchElementException when creating a table

2007-11-01 Thread Jim Kellerman
...) /cygdrive/c/hadoop/src/contrib/hbase$ bin/stop-hbase.sh stopping master /cygdrive/c/hadoop/src/contrib/hbase$ --- Jim Kellerman, Senior Engineer; Powerset -Original Message- From: Holger Stenzhorn [mailto:[EMAIL PROTECTED] Sent: Thursday, November 01, 2007 2:48 PM To: hadoop-user

RE: hbase feature question

2007-11-17 Thread Jim Kellerman
Currently, HBase supports specifying a maximum number of versions to keep. Older versions are removed during compaction. However, we do not currently support a TTL for columns. Please enter a Jira using the component contrib/hbase and request a feature improvement. Thanks. --- Jim Kellerman

RE: Text and/or ImmutableBytesWritable issue?

2007-11-21 Thread Jim Kellerman
and in the String constructor: new ImmutableBytesWritable(this is a string.getBytes(UTF-8)) and new String(ibw.getBytes(), UTF-8) --- Jim Kellerman, Senior Engineer; Powerset -Original Message- From: Jason Grey [mailto:[EMAIL PROTECTED] Sent: Wednesday, November 21, 2007 8:27 AM To: hadoop-user

RE: Text and/or ImmutableBytesWritable issue?

2007-11-21 Thread Jim Kellerman
Well, it depends on how the Text object is initialized. If it is initialized with a String, it sets its internal length to the length of the string. --- Jim Kellerman, Senior Engineer; Powerset -Original Message- From: stack [mailto:[EMAIL PROTECTED] Sent: Wednesday, November 21

RE: lists

2007-12-05 Thread Jim Kellerman
I hope he was subscribed to this list so he got the message :) --- Jim Kellerman, Senior Engineer; Powerset -Original Message- From: Eric Baldeschwieler [mailto:[EMAIL PROTECTED] Sent: Wednesday, December 05, 2007 12:04 PM To: hadoop-user@lucene.apache.org Subject: Re: lists Hi

RE: api about hbase?

2007-12-14 Thread Jim Kellerman
The only examples we have at this point are the unit tests. They are rather contrived but it's what we have. You can find them in the source tree under src/contrib/hbase/src/test/org/apache/hadoop/hbase --- Jim Kellerman, Senior Engineer; Powerset -Original Message- From: ma qiang

RE: point in time snapshot

2007-12-18 Thread Jim Kellerman
Billy, Are you referring to snapshots of the entire DFS or of HBase? --- Jim Kellerman, Senior Engineer; Powerset -Original Message- From: news [mailto:[EMAIL PROTECTED] On Behalf Of Billy Sent: Tuesday, December 18, 2007 4:29 PM To: hadoop-user@lucene.apache.org Subject: point

RE: HashMap which can spill to disk for Hadoop?

2007-12-19 Thread Jim Kellerman
Have you looked at hadoop.io.MapWritable? --- Jim Kellerman, Senior Engineer; Powerset -Original Message- From: C G [mailto:[EMAIL PROTECTED] Sent: Wednesday, December 19, 2007 11:59 AM To: hadoop-user@lucene.apache.org Subject: HashMap which can spill to disk for Hadoop? Hi All

RE: hbase master heap space

2007-12-22 Thread Jim Kellerman
it. It might be a good idea to add a scanner watcher on the client that shuts them down. --- Jim Kellerman, Senior Engineer; Powerset -Original Message- From: Bryan Duxbury [mailto:[EMAIL PROTECTED] Sent: Friday, December 21, 2007 5:51 PM To: hadoop-user@lucene.apache.org Subject: Re: hbase

RE: REST scanner get error 500 0x1b is not valid

2007-12-31 Thread Jim Kellerman
-Original Message- From: Bryan Duxbury [mailto:[EMAIL PROTECTED] Sent: Monday, December 31, 2007 2:46 PM To: hadoop-user@lucene.apache.org Subject: Re: REST scanner get error 500 0x1b is not valid You're probably right - column names are not base64 encoded. Isn't the contract of

Question for HBase users

2008-01-03 Thread Jim Kellerman
a fault tolerant upgrade utility, should HBase's file structure change again. Additionally, we will be able to provide the equivalent of fsck for HBase after HADOOP-2478. --- Jim Kellerman, Senior Engineer; Powerset No virus found in this outgoing message. Checked by AVG Free Edition. Version: 7.5.516