[jira] [Created] (PIG-3961) Adding HBaseStorage cell value filters

[Mike Welch (JIRA)]

Mike Welch created PIG-3961:
-------------------------------

             Summary: Adding HBaseStorage cell value filters
                 Key: PIG-3961
                 URL: https://issues.apache.org/jira/browse/PIG-3961
             Project: Pig
          Issue Type: New Feature
            Reporter: Mike Welch
            Priority: Minor


Adding three additional server side filtering options when loading data with 
HBaseStorage:

# specified cf:col does not exist
{{-null cf:col}}
# specified cf:col must exist
{{-notnull cf:col}}
# specified cf:col contains the given value
{{-val cf:col=value}}

These are meant to replace (and optimize by reducing data transfer) the 
frequent paradigm in pig of loading data and immediately filtering for a 
specific condition.  For example

data = load 'hbase://mytable' using 
org.apache.pig.backend.hadoop.hbase.HBaseStorage('cf:*') as (cf:map[]) ;
data_with_value = filter data by cf#'col' = 'value' ;

Can be replaced with:

data_with_value = load 'hbase://mytable' using 
org.apache.pig.backend.hadoop.hbase.HBaseStorage('cf:*', 'cf:col=value') as 
(cf:map[]) ;




--
This message was sent by Atlassian JIRA
(v6.2#6252)