[ 
https://issues.apache.org/jira/browse/MAPREDUCE-2652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Robert Joseph Evans updated MAPREDUCE-2652:
-------------------------------------------

    Attachment: MR-2652-v1.txt

Adding in a first patch for this issue.  I have manually verified that 
mapreduce.shuffle.port in mapred-site.xml is honored and workes, but I still 
need to update/add unit tests to verify more of the functionality.  I am 
posting the patch to get feedback on it sooner rather then later.

It is also lacking persisting and restoring the ports during restart.  That 
will probably be done on a different JIRA.

> MR-279: Cannot run multiple NMs on a single node 
> -------------------------------------------------
>
>                 Key: MAPREDUCE-2652
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2652
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Robert Joseph Evans
>            Assignee: Robert Joseph Evans
>             Fix For: 0.23.0
>
>         Attachments: MR-2652-v1.txt
>
>
> Currently in MR-279 the Auxiliary services, like ShuffleHandler, have no way 
> to communicate information back to the applications.  Because of this the Map 
> Reduce Application Master has hardcoded in a port of 8080 for shuffle.  This 
> prevents the configuration "mapreduce.shuffle.port" form ever being set to 
> anything but 8080.  The code should be updated to allow this information to 
> be returned to the application master.  Also the data needs to be persisted 
> to the task log so that on restart the data is not lost.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to