Dmitriy V. Ryaboy updated PIG-924:

    Attachment: pig_924.2.patch

This patch addresses the reviewer comments.
I put the factor of 0.9 into the 18 shim to restore old behavior (not sure what 
the motivation was for changing this for 20.. 

I set the default hadoop version to 18, so that we can verify correctness by 
running automated tests.

The existing unit tests are sufficient verification of this patch (at least as 
far as 18 is concerned).

> Make Pig work with multiple versions of Hadoop
> ----------------------------------------------
>                 Key: PIG-924
>                 URL: https://issues.apache.org/jira/browse/PIG-924
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Dmitriy V. Ryaboy
>         Attachments: pig_924.2.patch, pig_924.patch
> The current Pig build scripts package hadoop and other dependencies into the 
> pig.jar file.
> This means that if users upgrade Hadoop, they also need to upgrade Pig.
> Pig has relatively few dependencies on Hadoop interfaces that changed between 
> 18, 19, and 20.  It is possibly to write a dynamic shim that allows Pig to 
> use the correct calls for any of the above versions of Hadoop. Unfortunately, 
> the building process precludes us from the ability to do this at runtime, and 
> forces an unnecessary Pig rebuild even if dynamic shims are created.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

Reply via email to