Move pruned schema tracking logic from LoadFunc to core code
------------------------------------------------------------
Key: PIG-1330
URL: https://issues.apache.org/jira/browse/PIG-1330
Project: Pig
Issue Type: Improvement
Components: impl
Affects Versions: 0.7.0
Reporter: Daniel Dai
Assignee: Daniel Dai
Fix For: 0.7.0
Currently, LoadFunc.getSchema require a schema after column pruning. The good
side of this is LoadFunc.getSchema matches the data it actually load. This
gives a sense of consistency. However, by doing this, every LoadFunc need to
keep track of the columns pruned. This is an unnecessary burden to the LoadFunc
writer and it is very error proning. This issue is to move this logic from
LoadFunc to Pig core. LoadFunc.getSchema then only need to return original
schema even after pruning.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
