Re: When to expand vertically vs. horizontally in Hbase

2013-07-05 Thread Aji Janis
this statement if you need a filter which need all the row (there is a method you override in Filter to mark that) than a far row will be more memory intensive. Can you please explain? Thank you for these suggestions btw, good food for thought! On Wednesday, July 3, 2013, Aji Janis wrote: I

Re: When to expand vertically vs. horizontally in Hbase

2013-07-05 Thread Aji Janis
the same key on Order entry, pick slips, shipping, and invoice. That's probably the best example of where CFs come in to play. I'd suggest that you go back and rethink the design if you're having more than a handful. On Jul 5, 2013, at 8:53 AM, Aji Janis aji1...@gmail.com wrote: Asaf

Re: When to expand vertically vs. horizontally in Hbase

2013-07-03 Thread Aji Janis
. Your cells would need to be quite large for 50 to become a problem. I still would recommend using a single CF though. — Sent from iPhone On Tue, Jul 2, 2013 at 9:33 AM, Aji Janis aji1...@gmail.com wrote: The section on Rows vs. Columns at http://hbase.apache.org/book/schema.smackdown.html

When to expand vertically vs. horizontally in Hbase

2013-07-02 Thread Aji Janis
The section on Rows vs. Columns at http://hbase.apache.org/book/schema.smackdown.html talks about expanding horizontally vs. vertically. Can someone please explain to me when to choose rows vs. columns. The sections reads, To be clear, this guideline is in the context is in extremely wide cases,

Filtering help

2013-06-24 Thread Aji Janis
Hello, In my Hbase table I have four families. Not all rows have data for all the families. And not all rows have the same qualifiers either. So imagine this scenario: rowid |f1 |f2 |f3| --- row1 |q1, q2 |q4 |q6 | row2 |q1, q3 |q4,q5 |

Issues adding column families

2013-06-20 Thread Aji Janis
I have the following function for adding column family but its not working for some reason. I am able to get proper configuration and establish the right connection. Can anyone explain whats wrong? Hbase version: http://archive.cloudera.com/cdh/3/*hbase-0.90.6-cdh3u5* /apidocs/

Re: Issues adding column families

2013-06-20 Thread Aji Janis
Haa.. this is what happens when you stare at the code for too long. Thank you! On Thu, Jun 20, 2013 at 2:12 PM, Asaf Mesika asaf.mes...@gmail.com wrote: if (!admin.tableExists(tableName)){ Shouldn't it be: if (admin.tableExists(tableName)){ ? On Thu, Jun 20, 2013 at 6:42 PM, Aji Janis

Hbase connection management

2013-06-07 Thread Aji Janis
Hello, I need guidance on how to manage connection/resources (best practices) in a multi threaded env. Lets say there are 5 tables clients needs access to for random read/write. Multiple read/scans could be done on the same table simultaneously by the same or different clients. I am reading about

Re: querying hbase

2013-05-22 Thread Aji Janis
These tools seem just like what I want! Thank you. I am trying to play with it now but looks like in our Hbase configuration HBASE_MANAGE_ZK is set to False in hbase-env and hbase.zookeeper.property.clientPort is not set in hbase-site and therefore I can't use hbasemanager or hrider. I am new to

ETL tools

2013-05-21 Thread Aji Janis
Hello users, I am interested in hearing about what sort of ETL tools are you using with your cloud based apps. Ideally, I am looking ETL(s) with the following feature: -free (yup) -open-source/community support -handles different types of sources or atleast has plugins may be (email, rss,

querying hbase

2013-05-21 Thread Aji Janis
are there any tools out there that can help in visualizing data stored in Hbase? I know the shell lets you do basic stuff. But if I don't know what rowid I am looking for or if I want to rows with family say *name* (yes SQL like) are there any tools that can help with this? Not trying to use this

Re: querying hbase

2013-05-21 Thread Aji Janis
...@gmail.comwrote: The shell allows you to use filters just like the standard HBase API but with jruby syntax. Have you tried that or that is too painful and you want a simpler tool ? -Viral On Tue, May 21, 2013 at 2:58 PM, Aji Janis aji1...@gmail.com wrote: are there any tools out