[ 
https://issues.apache.org/jira/browse/PIG-966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12758518#action_12758518
 ] 

Alan Gates commented on PIG-966:
--------------------------------

In thinking about it more, it becomes obvious that we have to separate out 
determining the partition keys for an input from getting the schema, as Dmitry 
and Ashutosh suggested above.  The reason is that Pig cannot ask the loader for 
a schema until it has completely defined what will be loaded (because the 
schema will depend on what is being loaded).  And to completely define what is 
being loaded it needs to determine the partition keys and possibly specify a 
filter condition for them.  So we need to add a getPartitionKeys and 
setPartitionFilter to the LoadMetadata interface.  

> Proposed rework for LoadFunc, StoreFunc, and Slice/r interfaces
> ---------------------------------------------------------------
>
>                 Key: PIG-966
>                 URL: https://issues.apache.org/jira/browse/PIG-966
>             Project: Pig
>          Issue Type: Improvement
>          Components: impl
>            Reporter: Alan Gates
>            Assignee: Alan Gates
>
> I propose that we rework the LoadFunc, StoreFunc, and Slice/r interfaces 
> significantly.  See http://wiki.apache.org/pig/LoadStoreRedesignProposal for 
> full details

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply via email to