[
https://issues.apache.org/jira/browse/PIG-6?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12648874#action_12648874
]
Alan Gates commented on PIG-6:
------------------------------
A couple of rudimentary comments. My knowledge of hbase is limited, so please
feel free to correct assumptions I have about hbase or point me to appropriate
documentation.
1. I'd like to avoid specialized syntax for hbase type queries. Why do we
need a special load and store syntax? Is it not possible to fit the necessary
information into a combination of the loader constructor arguments and the
filename string. Roughly like: A = load 'hbase query' using
HBaseLoader("Hbase connection info");
2. I like to avoid adding new operators to the logical plans, adding new
DataStorage implementations, etc. I agree that a new slicer and loader will be
needed. I was thinking that the loader and slicer could handle turning the
results of the hbase query into records that could be passed to the rest of the
pig pipeline as is, and the inverse for storage functions. Past that, why does
anything else in pig need to understand hbase? Am I glossing over import
details?
> Addition of Hbase Storage Option In Load/Store Statement
> --------------------------------------------------------
>
> Key: PIG-6
> URL: https://issues.apache.org/jira/browse/PIG-6
> Project: Pig
> Issue Type: New Feature
> Environment: all environments
> Reporter: Edward J. Yoon
>
> It needs to be able to load full table in hbase. (maybe ... difficult? i'm
> not sure yet.)
> Also, as described below,
> It needs to compose an abstract 2d-table only with certain data filtered from
> hbase array structure using arbitrary query-delimited.
> {code}
> A = LOAD table('hbase_table');
> or
> B = LOAD table('hbase_table') Using HbaseQuery('Query-delimited by attributes
> & timestamp') as (f1, f2[, f3]);
> {code}
> Once test is done on my local machines,
> I will clarify the grammars and give you more examples to help you explain
> more storage options.
> Any advice welcome.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
