[
https://issues.apache.org/jira/browse/PIG-1090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12777599#action_12777599
]
Pradeep Kamath commented on PIG-1090:
-------------------------------------
bq. What's the ReadToEndLoader?
This is a internal utility LoadFunc I wrote to make it easy to read side files.
It encapsulates the real Loader. Though this has been implemented as a
LoadFunc, the only LoadFunc method which is truly implemented is getNext(). The
usage pattern is to construct an instance using the constructor which would
take a reference to the true LoadFunc (which can read the side file data) and
then repeatedly call getNext() till null is encountered in the return value.
The implementation of ReadToEndLoader hides the actions of getting InputSplits
from the underlying InputFormat and then processing each split by getting the
RecordReader and processing data in the split before moving to the next.
bq. What's the plan for BinStorage?
An input and output format has already been created and checked in in this
branch for Binstorage
> Update sources to reflect recent changes in load-store interfaces
> -----------------------------------------------------------------
>
> Key: PIG-1090
> URL: https://issues.apache.org/jira/browse/PIG-1090
> Project: Pig
> Issue Type: Sub-task
> Reporter: Pradeep Kamath
> Assignee: Pradeep Kamath
> Attachments: PIG-1090.patch
>
>
> There have been some changes (as recorded in the Changes Section, Nov 2 2009
> sub section of http://wiki.apache.org/pig/LoadStoreRedesignProposal) in the
> load/store interfaces - this jira is to track the task of making those
> changes under src. Changes under test will be addresses in a different jira.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
