Re: scaling a low latency service with HBase

2012-10-22 Thread Dave Latham
, client side cache pools may help. My 2c, Abhishek -Original Message- From: ddlat...@gmail.com [mailto:ddlat...@gmail.com] On Behalf Of Dave Latham Sent: Friday, October 19, 2012 4:31 PM To: user@hbase.apache.org Subject: scaling a low latency service with HBase I need to scale

Re: scaling a low latency service with HBase

2012-10-22 Thread Dave Latham
On Fri, Oct 19, 2012 at 5:22 PM, Amandeep Khurana ama...@gmail.com wrote: Answers inline On Fri, Oct 19, 2012 at 4:31 PM, Dave Latham lat...@davelink.net wrote: I need to scale an internal service / datastore that is currently hosted on an HBase cluster and wanted to ask for advice from

RE: scaling a low latency service with HBase

2012-10-19 Thread Pamecha, Abhishek
locality, external, client side cache pools may help. My 2c, Abhishek -Original Message- From: ddlat...@gmail.com [mailto:ddlat...@gmail.com] On Behalf Of Dave Latham Sent: Friday, October 19, 2012 4:31 PM To: user@hbase.apache.org Subject: scaling a low latency service with HBase I need

Re: scaling a low latency service with HBase

2012-10-19 Thread Amandeep Khurana
Answers inline On Fri, Oct 19, 2012 at 4:31 PM, Dave Latham lat...@davelink.net wrote: I need to scale an internal service / datastore that is currently hosted on an HBase cluster and wanted to ask for advice from anyone out there who may have some to share. The service does simple key value

Re: scaling a low latency service with HBase

2012-10-19 Thread Andrew Purtell
What Amandeep said, and also: You said your working set is randomly distributed but, if frequent invalidation isn't a concern and read accesses are still clustered temporally, an in-memory cache out in front of the cluster would smooth over periods when the disks are busy servicing MR workload or