Re: secondary index feature

2014-01-04 Thread Henning Blohm
m much better. -Anoop- On Fri, Jan 3, 2014 at 7:35 PM, rajeshbabu chintaguntla < rajeshbabu.chintagun...@huawei.com> wrote: No. the regions scanned sequentially. From: Asaf Mesika [asaf.mes...@gmail.com] Sent: Friday, January 03, 2014 7:26 PM To: u

Re: secondary index feature

2014-01-03 Thread James Taylor
impls in it. When RLI is >>>> used >>>> and we make use of index completely at server side, it is irrespective >>>> of >>>> client scan ways. Sequential or parallel, using java or any other client >>>> layer or using SQL layer like Phoenix, using MR or not... all client >>&

Re: secondary index feature

2014-01-03 Thread Henning Blohm
From: Asaf Mesika [asaf.mes...@gmail.com] Sent: Friday, January 03, 2014 7:26 PM To: user@hbase.apache.org Subject: Re: secondary index feature Are the regions scanned in parallel? On Friday, January 3, 2014, rajeshbabu chintaguntla wrote: Here are some

Re: secondary index feature

2014-01-03 Thread James Taylor
might perform much better. >> >> -Anoop- >> >> On Fri, Jan 3, 2014 at 7:35 PM, rajeshbabu chintaguntla < >> rajeshbabu.chintagun...@huawei.com> wrote: >> >> No. the regions scanned sequentially. >>> &g

Re: secondary index feature

2014-01-03 Thread Henning Blohm
ary 03, 2014 7:26 PM To: user@hbase.apache.org Subject: Re: secondary index feature Are the regions scanned in parallel? On Friday, January 3, 2014, rajeshbabu chintaguntla wrote: Here are some performance numbers with RLI. No Region servers : 4 Data per region: 2 GB Regions/RS| Total r

Re: secondary index feature

2014-01-03 Thread Anoop John
gun...@huawei.com> wrote: > No. the regions scanned sequentially. > > From: Asaf Mesika [asaf.mes...@gmail.com] > Sent: Friday, January 03, 2014 7:26 PM > To: user@hbase.apache.org > Subject: Re: secondary index feature > > Are t

RE: secondary index feature

2014-01-03 Thread rajeshbabu chintaguntla
No. the regions scanned sequentially. From: Asaf Mesika [asaf.mes...@gmail.com] Sent: Friday, January 03, 2014 7:26 PM To: user@hbase.apache.org Subject: Re: secondary index feature Are the regions scanned in parallel? On Friday, January 3, 2014

Re: secondary index feature

2014-01-03 Thread Ted Yu
dex scan is taking in hours. >>> >>> >>> Thanks, >>> Rajeshbabu >>> >>> From: Anoop John [anoop.hb...@gmail.com] >>> Sent: Friday, January 03, 2014 3:22 PM >>> To: user@hbase.apache.

Re: secondary index feature

2014-01-03 Thread Asaf Mesika
..@gmail.com ] > Sent: Friday, January 03, 2014 3:22 PM > To: user@hbase.apache.org > Subject: Re: secondary index feature > > >Is there any data on how RLI (or in particular Phoenix) query throughput > correlates with the number of region servers assuming homogeneously > di

Re: secondary index feature

2014-01-03 Thread ramkrishna vasudevan
s taking in hours. > > > > > > Thanks, > > Rajeshbabu > > > > From: Anoop John [anoop.hb...@gmail.com] > > Sent: Friday, January 03, 2014 3:22 PM > > To: user@hbase.apache.org > > Subject: Re: secondary in

Re: secondary index feature

2014-01-03 Thread Anoop John
Without secondary index scan is taking in hours. > > > Thanks, > Rajeshbabu > > From: Anoop John [anoop.hb...@gmail.com] > Sent: Friday, January 03, 2014 3:22 PM > To: user@hbase.apache.org > Subject: Re: secondary index feature >

RE: secondary index feature

2014-01-03 Thread rajeshbabu chintaguntla
taking in hours. Thanks, Rajeshbabu From: Anoop John [anoop.hb...@gmail.com] Sent: Friday, January 03, 2014 3:22 PM To: user@hbase.apache.org Subject: Re: secondary index feature >Is there any data on how RLI (or in particular Phoenix) query through

Re: secondary index feature

2014-01-03 Thread Anoop John
gt; readhttp://jyates.github.io/2012/07/09/consistent-enough- >>>>> >>>>> secondary-indexes.html a while back. >>>>> >>>>> Thanks, >>>>> Henning >>>>> >>>>> Ps.: I might write about this discussion later in

Re: secondary index feature

2014-01-03 Thread Henning Blohm
secondary-indexes.html http://hadoop-hbase.blogspot.com/2012/10/secondary-indexes-part-ii.html Phoenix has a (pretty involved) solution now that works around the fact that HBase has no transactions. -- Lars From: Henning Blohm To: user Sent: Sunday, December 22, 2013 2:11

Re: secondary index feature

2013-12-24 Thread Henning Blohm
now that works around the fact that HBase has no transactions. -- Lars From: Henning Blohm To: user Sent: Sunday, December 22, 2013 2:11 AM Subject: secondary index feature Lately we have added a secondary index feature to a persistence tier over HBASE

Re: secondary index feature

2013-12-23 Thread Jesse Yates
is not so easy >>> to detect stale index entries. >>> >>> I blogged about these issues here: >>> http://hadoop-hbase.blogspot.com/2012/10/musings-on- >>> secondary-indexes.html >>> http://hadoop-hbase.blogspot.com/2012/10/secondary-indexes-part-

Re: secondary index feature

2013-12-23 Thread Henning Blohm
ndexes.html http://hadoop-hbase.blogspot.com/2012/10/secondary-indexes-part-ii.html Phoenix has a (pretty involved) solution now that works around the fact that HBase has no transactions. -- Lars From: Henning Blohm To: user Sent: Sunday, December 22, 2013 2:11 AM Subject

Re: secondary index feature

2013-12-23 Thread James Taylor
es.html >> http://hadoop-hbase.blogspot.com/2012/10/secondary-indexes-part-ii.html >> >> Phoenix has a (pretty involved) solution now that works around the fact >> that HBase has no transactions. >> >> >> -- Lars >> >> >> >> __

Re: secondary index feature

2013-12-23 Thread Henning Blohm
nsactions. -- Lars From: Henning Blohm To: user Sent: Sunday, December 22, 2013 2:11 AM Subject: secondary index feature Lately we have added a secondary index feature to a persistence tier over HBASE. Essentially we implemented what is described as "Dual-Write

Re: secondary index feature

2013-12-23 Thread Henning Blohm
ndary index to HBASE core. FYI On Dec 22, 2013, at 2:11 AM, Henning Blohm wrote: Lately we have added a secondary index feature to a persistence tier over HBASE. Essentially we implemented what is described as "Dual-Write Secondary Index" in http://hbase.apache.org/book/seconda

Re: secondary index feature

2013-12-22 Thread lars hofhansl
.html Phoenix has a (pretty involved) solution now that works around the fact that HBase has no transactions. -- Lars From: Henning Blohm To: user Sent: Sunday, December 22, 2013 2:11 AM Subject: secondary index feature Lately we have added a secondary

Re: secondary index feature

2013-12-22 Thread Anoop John
; > > > > https://github.com/Huawei-Hadoop/hindex > > > > > > > > > On Sun, Dec 22, 2013 at 1:34 PM, Ted Yu wrote: > > > > > >> Rajeshbabu is working on HBASE-10222 which adds support of secondary > > >> index to HBASE core

Re: secondary index feature

2013-12-22 Thread Ted Yu
On Sun, Dec 22, 2013 at 1:34 PM, Ted Yu wrote: > > > >> Rajeshbabu is working on HBASE-10222 which adds support of secondary > >> index to HBASE core. > >> > >> FYI > >> > >> On Dec 22, 2013, at 2:11 AM, Henning Blohm > >>

Re: secondary index feature

2013-12-22 Thread Pradeep Gollakota
at 2:11 AM, Henning Blohm >> wrote: >> >> > Lately we have added a secondary index feature to a persistence tier >> over HBASE. Essentially we implemented what is described as "Dual-Write >> Secondary Index" in http://hbase.apache.org/book/secondary.in

Re: secondary index feature

2013-12-22 Thread Pradeep Gollakota
ich adds support of secondary index > to HBASE core. > > FYI > > On Dec 22, 2013, at 2:11 AM, Henning Blohm > wrote: > > > Lately we have added a secondary index feature to a persistence tier > over HBASE. Essentially we implemented what is described as "

Re: secondary index feature

2013-12-22 Thread Ted Yu
Rajeshbabu is working on HBASE-10222 which adds support of secondary index to HBASE core. FYI On Dec 22, 2013, at 2:11 AM, Henning Blohm wrote: > Lately we have added a secondary index feature to a persistence tier over > HBASE. Essentially we implemented what is described as "

secondary index feature

2013-12-22 Thread Henning Blohm
Lately we have added a secondary index feature to a persistence tier over HBASE. Essentially we implemented what is described as "Dual-Write Secondary Index" in http://hbase.apache.org/book/secondary.indexes.html. I.e. while updating an entity, actually before writing the actu