[ https://issues.apache.org/jira/browse/PIG-1324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Daniel Dai updated PIG-1324: ---------------------------- Issue Type: Sub-task (was: New Feature) Parent: PIG-1319 > Logical Optimizer: Nested column pruning > ---------------------------------------- > > Key: PIG-1324 > URL: https://issues.apache.org/jira/browse/PIG-1324 > Project: Pig > Issue Type: Sub-task > Components: impl > Affects Versions: 0.7.0 > Reporter: Daniel Dai > Assignee: Daniel Dai > > Currently, column pruning does not prune sub-fields inside a complex > data-type. For example: > A = load '1.txt' as (a0, a1, a2); > B = group A by a0; > C = foreach B generate group, SUM(A.a1); > Currently, since we group A as a bag, and some part of the bag is used in the > following statement, so none of the fields inside A can be pruned. We shall > keep track of sub-fields and figure out a2 is not actually needed. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.