[ 
https://issues.apache.org/jira/browse/PIG-3650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Travis Woodruff updated PIG-3650:
---------------------------------

    Attachment: PIG-3650.patch

Adding patch to fix. Iterates over all fieldSchemas (removes the Math.min) and 
adds padding to the tuple (as requested PIG-3100) as needed within that loop.

Added new test to reproduce this issue.

Updated imcomplete data test to verify that null padding still works in this 
case,

> Fix for PIG-3100 breaks column pruning
> --------------------------------------
>
>                 Key: PIG-3650
>                 URL: https://issues.apache.org/jira/browse/PIG-3650
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.12.0, 0.12.1
>            Reporter: Travis Woodruff
>            Priority: Critical
>         Attachments: PIG-3650.patch
>
>
> The fix for PIG-3100 does {{Math.min(fieldSchemas.length, tup.size())}} in 
> {{PigStorage.applySchema()}}. This means that if column pruning is in use, 
> all schema columns will not be iterated over (since tup.size() will be less 
> than fieldSchemas.length) and the schema will not be applied to all columns,



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Reply via email to