[jira] [Updated] (MAPREDUCE-5269) Preemption of Reducer (and Shuffle) via checkpointing
[ https://issues.apache.org/jira/browse/MAPREDUCE-5269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated MAPREDUCE-5269: Labels: BB2015-05-TBR (was: ) Preemption of Reducer (and Shuffle) via checkpointing - Key: MAPREDUCE-5269 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5269 Project: Hadoop Map/Reduce Issue Type: Improvement Components: mrv2 Reporter: Carlo Curino Assignee: Carlo Curino Labels: BB2015-05-TBR Attachments: MAPREDUCE-5269.2.patch, MAPREDUCE-5269.3.patch, MAPREDUCE-5269.4.patch, MAPREDUCE-5269.5.patch, MAPREDUCE-5269.6.patch, MAPREDUCE-5269.7.patch, MAPREDUCE-5269.patch This patch tracks the changes in the task runtime (shuffle, reducer context, etc.) that are required to implement checkpoint-based preemption of reducer tasks. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (MAPREDUCE-5269) Preemption of Reducer (and Shuffle) via checkpointing
[ https://issues.apache.org/jira/browse/MAPREDUCE-5269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Augusto Souza updated MAPREDUCE-5269: - Attachment: MAPREDUCE-5269.7.patch Preemption of Reducer (and Shuffle) via checkpointing - Key: MAPREDUCE-5269 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5269 Project: Hadoop Map/Reduce Issue Type: Improvement Components: mrv2 Reporter: Carlo Curino Assignee: Carlo Curino Attachments: MAPREDUCE-5269.2.patch, MAPREDUCE-5269.3.patch, MAPREDUCE-5269.4.patch, MAPREDUCE-5269.5.patch, MAPREDUCE-5269.6.patch, MAPREDUCE-5269.7.patch, MAPREDUCE-5269.patch This patch tracks the changes in the task runtime (shuffle, reducer context, etc.) that are required to implement checkpoint-based preemption of reducer tasks. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (MAPREDUCE-5269) Preemption of Reducer (and Shuffle) via checkpointing
[ https://issues.apache.org/jira/browse/MAPREDUCE-5269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Augusto Souza updated MAPREDUCE-5269: - Attachment: MAPREDUCE-5269.6.patch Preemption of Reducer (and Shuffle) via checkpointing - Key: MAPREDUCE-5269 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5269 Project: Hadoop Map/Reduce Issue Type: Improvement Components: mrv2 Reporter: Carlo Curino Assignee: Carlo Curino Attachments: MAPREDUCE-5269.2.patch, MAPREDUCE-5269.3.patch, MAPREDUCE-5269.4.patch, MAPREDUCE-5269.5.patch, MAPREDUCE-5269.6.patch, MAPREDUCE-5269.patch This patch tracks the changes in the task runtime (shuffle, reducer context, etc.) that are required to implement checkpoint-based preemption of reducer tasks. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (MAPREDUCE-5269) Preemption of Reducer (and Shuffle) via checkpointing
[ https://issues.apache.org/jira/browse/MAPREDUCE-5269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Augusto Souza updated MAPREDUCE-5269: - Attachment: MAPREDUCE-5269.5.patch Trying to fix errors reported by dev-support/test-patch.sh Preemption of Reducer (and Shuffle) via checkpointing - Key: MAPREDUCE-5269 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5269 Project: Hadoop Map/Reduce Issue Type: Improvement Components: mrv2 Reporter: Carlo Curino Assignee: Carlo Curino Attachments: MAPREDUCE-5269.2.patch, MAPREDUCE-5269.3.patch, MAPREDUCE-5269.4.patch, MAPREDUCE-5269.5.patch, MAPREDUCE-5269.patch This patch tracks the changes in the task runtime (shuffle, reducer context, etc.) that are required to implement checkpoint-based preemption of reducer tasks. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (MAPREDUCE-5269) Preemption of Reducer (and Shuffle) via checkpointing
[ https://issues.apache.org/jira/browse/MAPREDUCE-5269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Augusto Souza updated MAPREDUCE-5269: - Attachment: MAPREDUCE-5269.4.patch Fixing MAPREDUCE-5269.3 by removing prefixes in files Preemption of Reducer (and Shuffle) via checkpointing - Key: MAPREDUCE-5269 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5269 Project: Hadoop Map/Reduce Issue Type: Improvement Components: mrv2 Reporter: Carlo Curino Assignee: Carlo Curino Attachments: MAPREDUCE-5269.2.patch, MAPREDUCE-5269.3.patch, MAPREDUCE-5269.4.patch, MAPREDUCE-5269.patch This patch tracks the changes in the task runtime (shuffle, reducer context, etc.) that are required to implement checkpoint-based preemption of reducer tasks. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (MAPREDUCE-5269) Preemption of Reducer (and Shuffle) via checkpointing
[ https://issues.apache.org/jira/browse/MAPREDUCE-5269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Augusto Souza updated MAPREDUCE-5269: - Attachment: MAPREDUCE-5269.3.patch Patch updated to trunk and functional. Preemption of Reducer (and Shuffle) via checkpointing - Key: MAPREDUCE-5269 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5269 Project: Hadoop Map/Reduce Issue Type: Improvement Components: mrv2 Reporter: Carlo Curino Assignee: Carlo Curino Attachments: MAPREDUCE-5269.2.patch, MAPREDUCE-5269.3.patch, MAPREDUCE-5269.patch This patch tracks the changes in the task runtime (shuffle, reducer context, etc.) that are required to implement checkpoint-based preemption of reducer tasks. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (MAPREDUCE-5269) Preemption of Reducer (and Shuffle) via checkpointing
[ https://issues.apache.org/jira/browse/MAPREDUCE-5269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated MAPREDUCE-5269: -- Status: Patch Available (was: Open) Preemption of Reducer (and Shuffle) via checkpointing - Key: MAPREDUCE-5269 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5269 Project: Hadoop Map/Reduce Issue Type: Improvement Components: mrv2 Reporter: Carlo Curino Assignee: Carlo Curino Attachments: MAPREDUCE-5269.2.patch, MAPREDUCE-5269.3.patch, MAPREDUCE-5269.patch This patch tracks the changes in the task runtime (shuffle, reducer context, etc.) that are required to implement checkpoint-based preemption of reducer tasks. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (MAPREDUCE-5269) Preemption of Reducer (and Shuffle) via checkpointing
[ https://issues.apache.org/jira/browse/MAPREDUCE-5269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Augusto Souza updated MAPREDUCE-5269: - Attachment: MAPREDUCE-5269.2.patch After exchanging some information with Carlo Curino and Chris Douglas and with their mentoring, I have updated their patch to work with trunk version of Hadoop. It still need some more testing, but it is working the way it is. Preemption of Reducer (and Shuffle) via checkpointing - Key: MAPREDUCE-5269 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5269 Project: Hadoop Map/Reduce Issue Type: Improvement Components: mrv2 Reporter: Carlo Curino Assignee: Carlo Curino Attachments: MAPREDUCE-5269.2.patch, MAPREDUCE-5269.patch This patch tracks the changes in the task runtime (shuffle, reducer context, etc.) that are required to implement checkpoint-based preemption of reducer tasks. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (MAPREDUCE-5269) Preemption of Reducer (and Shuffle) via checkpointing
[ https://issues.apache.org/jira/browse/MAPREDUCE-5269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated MAPREDUCE-5269: -- Assignee: Carlo Curino Preemption of Reducer (and Shuffle) via checkpointing - Key: MAPREDUCE-5269 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5269 Project: Hadoop Map/Reduce Issue Type: Improvement Components: mrv2 Reporter: Carlo Curino Assignee: Carlo Curino Attachments: MAPREDUCE-5269.patch This patch tracks the changes in the task runtime (shuffle, reducer context, etc.) that are required to implement checkpoint-based preemption of reducer tasks. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-5269) Preemption of Reducer (and Shuffle) via checkpointing
[ https://issues.apache.org/jira/browse/MAPREDUCE-5269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated MAPREDUCE-5269: Attachment: MAPREDUCE-5269.patch Preemption of Reducer (and Shuffle) via checkpointing - Key: MAPREDUCE-5269 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5269 Project: Hadoop Map/Reduce Issue Type: Improvement Components: mrv2 Reporter: Carlo Curino Attachments: MAPREDUCE-5269.patch This patch tracks the changes in the task runtime (shuffle, reducer context, etc.) that are required to implement checkpoint-based preemption of reducer tasks. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
