Re: row filter - binary comparator at certain range

2013-11-01 Thread Asaf Mesika
Bucket seems like a rather good name for it. The method for generating could be Hash, running sequence modded, etc. So HashBucket, RoundRobinBucket, etc. On Tuesday, October 22, 2013, James Taylor wrote: One thing I neglected to mention is that the table is pre-split at the

Re: row filter - binary comparator at certain range

2013-10-22 Thread Tony Duan
Michael Segel michael_segel@... writes: Hi, Alexandr Vasilenko Have you ever resolved this issue?i am also facing this iusse. i also want implement this functionality. Imagine row key of format salt:timestamp and rows goes like this: ... 1:15 1:16 1:17 1:23 2:3 2:5 2:12

Re: row filter - binary comparator at certain range

2013-10-21 Thread James Taylor
Take a look at Phoenix(https://github.com/forcedotcom/phoenix). It supports both salting and fuzzy row filtering through its skip scan. On Sun, Oct 20, 2013 at 10:42 PM, Premal Shah premal.j.s...@gmail.comwrote: Have you looked at FuzzyRowFilter? Seems to me that it might satisfy your

Re: row filter - binary comparator at certain range

2013-10-21 Thread Michael Segel
Lets look at what you are trying to do... You want to take data where the key is a timestamp (long datatype) You append it to a salt value 1=10 or 0-9 your example doesn't say... You have a couple of problems with your choice of a key... First after your initial 10 splits, you will still

Re: row filter - binary comparator at certain range

2013-10-21 Thread Michael Segel
Sorry if this double posts... may have used the wrong email first. On Oct 21, 2013, at 6:36 AM, Michael Segel michael_se...@hotmail.com wrote: Lets look at what you are trying to do... You want to take data where the key is a timestamp (long datatype) You append it to a salt value 1=10

RE: row filter - binary comparator at certain range

2013-10-21 Thread Vladimir Rodionov
:42 PM To: user Subject: Re: row filter - binary comparator at certain range Have you looked at FuzzyRowFilter? Seems to me that it might satisfy your use-case. http://blog.sematext.com/2012/08/09/consider-using-fuzzyrowfilter-when-in-need-for-secondary-indexes-in-hbase/ On Sun, Oct 20, 2013 at 9

RE: row filter - binary comparator at certain range

2013-10-21 Thread Vladimir Rodionov
, Vladimir Rodionov Principal Platform Engineer Carrier IQ, www.carrieriq.com e-mail: vrodio...@carrieriq.com From: Vladimir Rodionov Sent: Monday, October 21, 2013 9:14 AM To: user@hbase.apache.org Subject: RE: row filter - binary comparator at certain range

Re: row filter - binary comparator at certain range

2013-10-21 Thread James Taylor
From: Premal Shah [premal.j.s...@gmail.com] Sent: Sunday, October 20, 2013 10:42 PM To: user Subject: Re: row filter - binary comparator at certain range Have you looked at FuzzyRowFilter? Seems to me that it might satisfy your use-case. http

RE: row filter - binary comparator at certain range

2013-10-21 Thread Vladimir Rodionov
9:37 AM To: user@hbase.apache.org Subject: Re: row filter - binary comparator at certain range Phoenix restricts salting to a single byte. Salting perhaps is misnamed, as the salt byte is a stable hash based on the row key. Phoenix's skip scan supports sub-key ranges. We've found salting in general

Re: row filter - binary comparator at certain range

2013-10-21 Thread Michael Segel
filter - binary comparator at certain range Have you looked at FuzzyRowFilter? Seems to me that it might satisfy your use-case. http://blog.sematext.com/2012/08/09/consider-using-fuzzyrowfilter-when-in-need-for-secondary-indexes-in-hbase/ On Sun, Oct 20, 2013 at 9:31 PM, Tony Duan duanjian

Re: row filter - binary comparator at certain range

2013-10-21 Thread James Taylor
: Re: row filter - binary comparator at certain range Have you looked at FuzzyRowFilter? Seems to me that it might satisfy your use-case. http://blog.sematext.com/2012/08/09/consider-using-fuzzyrowfilter-when-in-need-for-secondary-indexes-in-hbase/ On Sun, Oct 20, 2013 at 9:31 PM

Re: row filter - binary comparator at certain range

2013-10-21 Thread Michael Segel
regards, Vladimir Rodionov Principal Platform Engineer Carrier IQ, www.carrieriq.com e-mail: vrodio...@carrieriq.com From: Premal Shah [premal.j.s...@gmail.com] Sent: Sunday, October 20, 2013 10:42 PM To: user Subject: Re: row filter - binary

Re: row filter - binary comparator at certain range

2013-10-21 Thread James Taylor
Rodionov Principal Platform Engineer Carrier IQ, www.carrieriq.com e-mail: vrodio...@carrieriq.com From: Premal Shah [premal.j.s...@gmail.com] Sent: Sunday, October 20, 2013 10:42 PM To: user Subject: Re: row filter - binary comparator

Re: row filter - binary comparator at certain range

2013-10-21 Thread Michael Segel
Subject: Re: row filter - binary comparator at certain range Have you looked at FuzzyRowFilter? Seems to me that it might satisfy your use-case. http://blog.sematext.com/2012/08/09/consider-using-fuzzyrowfilter-when-in-need-for-secondary-indexes-in-hbase/ On Sun, Oct 20, 2013 at 9

Re: row filter - binary comparator at certain range

2013-10-21 Thread James Taylor
Principal Platform Engineer Carrier IQ, www.carrieriq.com e-mail: vrodio...@carrieriq.com From: Premal Shah [premal.j.s...@gmail.com] Sent: Sunday, October 20, 2013 10:42 PM To: user Subject: Re: row filter - binary comparator at certain range

Re: row filter - binary comparator at certain range

2013-10-20 Thread Tony Duan
Alex Vasilenko aa.vasilenko@... writes: Lars, But how it will behave, when I have salt at the beginning of the key to properly shard table across regions? Imagine row key of format salt:timestamp and rows goes like this: ... 1:15 1:16 1:17 1:23 2:3 2:5 2:12 2:15 2:19 2:25 ...

Re: row filter - binary comparator at certain range

2013-10-20 Thread Premal Shah
Have you looked at FuzzyRowFilter? Seems to me that it might satisfy your use-case. http://blog.sematext.com/2012/08/09/consider-using-fuzzyrowfilter-when-in-need-for-secondary-indexes-in-hbase/ On Sun, Oct 20, 2013 at 9:31 PM, Tony Duan duanjian...@126.com wrote: Alex Vasilenko

Re: row filter - binary comparator at certain range

2012-02-10 Thread Alex Vasilenko
, February 9, 2012 10:03 AM Subject: row filter - binary comparator at certain range Hi all, I'm a brand new user of hbase and hadoop in general. Trying to evaluate hbase for our needs. Question is: why there's BinaryPrefixComparator, but no BinaryRangeComparator

Re: row filter - binary comparator at certain range

2012-02-10 Thread weichao
to the startKey. -- Lars From: Alex Vasilenko aa.vasile...@gmail.com To: user@hbase.apache.org Sent: Thursday, February 9, 2012 10:40 AM Subject: Re: row filter - binary comparator at certain range Lars, I meant

Re: row filter - binary comparator at certain range

2012-02-09 Thread Stack
On Thu, Feb 9, 2012 at 10:03 AM, Alex Vasilenko aa.vasile...@gmail.com wrote: I'm a brand new user of hbase and hadoop in general. Trying to evaluate hbase for our needs. Question is: why there's BinaryPrefixComparator, but no BinaryRangeComparator, where you specify what range of key should be

Re: row filter - binary comparator at certain range

2012-02-09 Thread lars hofhansl
@hbase.apache.org Sent: Thursday, February 9, 2012 10:03 AM Subject: row filter - binary comparator at certain range Hi all, I'm a brand new user of hbase and hadoop in general. Trying to evaluate hbase for our needs. Question is: why there's BinaryPrefixComparator, but no BinaryRangeComparator, where

Re: row filter - binary comparator at certain range

2012-02-09 Thread Alex Vasilenko
Hi Stack, Thanks for info. Then how is it usually done with time-based keys? General recommendation is prepend timestamp with something random prefix to shard table properly. But what if I want to scan table for certain time range? Scan whole table, skipping random prefix and filter by time

Re: row filter - binary comparator at certain range

2012-02-09 Thread Alex Vasilenko
of key. For keys there are ColumnPrefixFilter and ColumnRangeFilter. -- Lars From: Alex Vasilenko aa.vasile...@gmail.com To: user@hbase.apache.org Sent: Thursday, February 9, 2012 10:03 AM Subject: row filter - binary comparator at certain range Hi all

Re: row filter - binary comparator at certain range

2012-02-09 Thread lars hofhansl
Vasilenko aa.vasile...@gmail.com To: user@hbase.apache.org Sent: Thursday, February 9, 2012 10:40 AM Subject: Re: row filter - binary comparator at certain range Lars, I meant range of row keys. BinaryPrefixComparator can be used in conjunction with RowFilter to filter by prefix. Alex 2012/2/9 lars

Re: row filter - binary comparator at certain range

2012-02-09 Thread Alex Vasilenko
: row filter - binary comparator at certain range Hi all, I'm a brand new user of hbase and hadoop in general. Trying to evaluate hbase for our needs. Question is: why there's BinaryPrefixComparator, but no BinaryRangeComparator, where you specify what range of key should be compared

Re: row filter - binary comparator at certain range

2012-02-09 Thread Ted Yu
: row filter - binary comparator at certain range Lars, I meant range of row keys. BinaryPrefixComparator can be used in conjunction with RowFilter to filter by prefix. Alex 2012/2/9 lars hofhansl lhofha...@yahoo.com Note the BinaryPrefixComparator compares values (not keys

Re: row filter - binary comparator at certain range

2012-02-09 Thread Alex Vasilenko
, 2012 10:40 AM Subject: Re: row filter - binary comparator at certain range Lars, I meant range of row keys. BinaryPrefixComparator can be used in conjunction with RowFilter to filter by prefix. Alex 2012/2/9 lars hofhansl lhofha...@yahoo.com Note