[ 
https://issues.apache.org/jira/browse/PIG-162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shravan Matthur Narayanamurthy updated PIG-162:
-----------------------------------------------

    Attachment: modJumbo.patch

The modified patch that sorts a node's predecessors before doing depth-first in 
the MRCompiler. Basically done so that tests pass. The workaround for this is 
to test isomorphism of two plans which seems to be a bit tricky. Can consider 
this later. However, as Alan pointed out, it might be a good idea to produce 
predictable plans anyway.

Also included is the LocalJobSubmission part and a set of tests similar to 
those for mapReduce submission

There is one catch with the patch. The patch works with hadoop16.jar. But I 
could not create a patch with the jar file as it is binary. Even the build file 
is modified to work with hadoop16.jar. So Alan, can you please copy 
hadoop16.jar from pig_trunk to the lib directory?

I have tried this and it works. For some reason, my svn could not add the bin 
jar file into the patch

> Rework mapreduce submission and monitoring
> ------------------------------------------
>
>                 Key: PIG-162
>                 URL: https://issues.apache.org/jira/browse/PIG-162
>             Project: Pig
>          Issue Type: Sub-task
>         Environment: This bug tracks works to rework the submission and 
> monitoring interface to map reduce as described in  
> http://wiki.apache.org/pig/PigTypesFunctionalSpec
>            Reporter: Alan Gates
>            Assignee: Alan Gates
>         Attachments: mapreduceJumbo.patch, mapreduceJumboWithComInc.patch, 
> modJumbo.patch, split.png, TEST-org.apache.pig.test.TestMRCompiler.txt, 
> TEST-org.apache.pig.test.TestMRCompiler.txt, 
> TEST-org.apache.pig.test.TestUnion.txt
>
>


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply via email to