Re: What's the best approach to search in HBase?

2011-06-18 Thread Otis Gospodnetic
HBasene is dead.  Watch HBASE-3529. Otis We're hiring HBase / Hadoop / Hive / Mahout engineers with interest in Big Data Mining and Analytics http://blog.sematext.com/2011/04/18/hiring-data-mining-analytics-machine-learning-hackers/ From: Hiller, Dean x66079 dean.hil...@broadridge.com To:

RE: hbase architecture question

2011-06-18 Thread Doug Meil
Hi there- There is a section in the hbase book on pre-creating regions. http://hbase.apache.org/book.html#precreate.regions -Original Message- From: Hiller, Dean x66079 [mailto:dean.hil...@broadridge.com] Sent: Friday, June 17, 2011 4:28 PM To: user@hbase.apache.org Subject: RE: hbase

on the impact of incremental counters

2011-06-18 Thread Claudio Martella
Hello list, I was a few days ago at SIGMOD and was happy to attend Facebook's talk on HBase. As I could understand their workflow makes heavy use of incremental couters for analytics and so is mine. For what I understand the cost of incrementing a counter is 2 * N + 1 IOPS, where N is the number

lucene with hbase.

2011-06-18 Thread rsriramtce
Is it possible to insert lucene indexes to hbase table.I am very new to this hbase. Provide me some suggestions. If we store them in hbase can we run in multi node environment -- View this message in context: http://old.nabble.com/lucene-with-hbase.-tp31876144p31876144.html Sent from the HBase

Re: lucene with hbase.

2011-06-18 Thread Jason Rutherglen
Mark Kerzner has a synopsis of a recent discussion: http://shmsoft.blogspot.com/2011/06/search-in-ediscovery.html I think there will be query and index performance degradation if the index is stored in HBase as for example a term per column. For HBASE-3529 I took the approach that Lucene is

Re: lucene with hbase.

2011-06-18 Thread bharath vissapragada
See [1] . This might be of some help to you! [1] https://github.com/akkumar/hbasene/wiki On Sat, Jun 18, 2011 at 10:49 PM, rsriramtce rsriram...@gmail.com wrote: Is it possible to insert lucene indexes to hbase table.I am very new to this hbase. Provide me some suggestions. If we store

Re: on the impact of incremental counters

2011-06-18 Thread Andrew Purtell
This is from memory, but I expect someone will chime in if any detail is inaccurate. :-) If the blocks containing the values you are updating fit into blockcache then read IOPS are avoided, satisfied from cache, not disk. Evictions from blockcache are done on an LRU basis. (Packing related