[ 
https://issues.apache.org/jira/browse/MAPREDUCE-6444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Augusto Souza updated MAPREDUCE-6444:
-------------------------------------
    Attachment: MAPREDUCE-6444.002.patch

> Add a checkpointable version of shuffle and reduce context supported by a 
> checkpoint manager which uses the HDFS
> ----------------------------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-6444
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6444
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>            Reporter: Augusto Souza
>            Assignee: Augusto Souza
>         Attachments: MAPREDUCE-6444.001.patch, MAPREDUCE-6444.002.patch
>
>
> Patch to add classes to provide a checkpointable version of shuffle and 
> reduce context. Also, add a classe which makes possible to save a checkpoint 
> of a task in HDFS. Those classes are respectively: CheckpointableShuffle, 
> CheckpointableReduceContextImpl and TaskCheckpointManager.
> This improvement also helps in the splitting of patch in MAPREDUCE-5269 that 
> is too large for being reviewed or accepted by Jenkins CI scripts.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to