[
https://issues.apache.org/jira/browse/PIG-966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12758518#action_12758518
]
Alan Gates commented on PIG-966:
--------------------------------
In thinking about it more, it becomes obvious that we have to separate out
determining the partition keys for an input from getting the schema, as Dmitry
and Ashutosh suggested above. The reason is that Pig cannot ask the loader for
a schema until it has completely defined what will be loaded (because the
schema will depend on what is being loaded). And to completely define what is
being loaded it needs to determine the partition keys and possibly specify a
filter condition for them. So we need to add a getPartitionKeys and
setPartitionFilter to the LoadMetadata interface.
> Proposed rework for LoadFunc, StoreFunc, and Slice/r interfaces
> ---------------------------------------------------------------
>
> Key: PIG-966
> URL: https://issues.apache.org/jira/browse/PIG-966
> Project: Pig
> Issue Type: Improvement
> Components: impl
> Reporter: Alan Gates
> Assignee: Alan Gates
>
> I propose that we rework the LoadFunc, StoreFunc, and Slice/r interfaces
> significantly. See http://wiki.apache.org/pig/LoadStoreRedesignProposal for
> full details
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
