[jira] [Updated] (MAPREDUCE-6929) TimelineV2Client hangs MR AM

2017-08-02 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated MAPREDUCE-6929: -- Summary: TimelineV2Client hangs MR AM (was: TimelineClient hangs MR AM) > TimelineV2Client

[jira] [Updated] (MAPREDUCE-6674) configure parallel tests for mapreduce-client-jobclient

2017-08-02 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated MAPREDUCE-6674: Attachment: MAPREDUCE-6674.01.patch -01: * rebase to see where we are at >

[jira] [Commented] (MAPREDUCE-6870) Add configuration for MR job to finish when all reducers are complete (even with unfinished mappers)

2017-08-02 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111487#comment-16111487 ] Haibo Chen commented on MAPREDUCE-6870: --- bq. 1. Variable names (is preemptMappersOnReduceFinish

[jira] [Created] (MAPREDUCE-6928) BackupStore Should Checksum Files Persisted To Disk

2017-08-02 Thread BELUGA BEHR (JIRA)
BELUGA BEHR created MAPREDUCE-6928: -- Summary: BackupStore Should Checksum Files Persisted To Disk Key: MAPREDUCE-6928 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6928 Project: Hadoop

[jira] [Created] (MAPREDUCE-6929) TimelineClient hangs MR AM

2017-08-02 Thread Haibo Chen (JIRA)
Haibo Chen created MAPREDUCE-6929: - Summary: TimelineClient hangs MR AM Key: MAPREDUCE-6929 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6929 Project: Hadoop Map/Reduce Issue Type:

[jira] [Commented] (MAPREDUCE-6927) MR job should only set tracking url if history was successfully written

2017-08-02 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111744#comment-16111744 ] Jason Lowe commented on MAPREDUCE-6927: --- Thanks for the report and patch! It would be helpful

[jira] [Assigned] (MAPREDUCE-6923) YARN Shuffle I/O for small partitions

2017-08-02 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash reassigned MAPREDUCE-6923: --- Assignee: Robert Schmidtke > YARN Shuffle I/O for small partitions >

[jira] [Created] (MAPREDUCE-6931) Fix TestDFSIO "Total Throughput" calculation

2017-08-02 Thread Dennis Huo (JIRA)
Dennis Huo created MAPREDUCE-6931: - Summary: Fix TestDFSIO "Total Throughput" calculation Key: MAPREDUCE-6931 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6931 Project: Hadoop Map/Reduce

[jira] [Commented] (MAPREDUCE-6923) YARN Shuffle I/O for small partitions

2017-08-02 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111759#comment-16111759 ] Ravi Prakash commented on MAPREDUCE-6923: - Hi Robert! Thanks for filing the JIRA and your

[jira] [Commented] (MAPREDUCE-6929) TimelineClient hangs MR AM

2017-08-02 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111769#comment-16111769 ] Haibo Chen commented on MAPREDUCE-6929: --- Yeah, that what I expected also. I did not collect the

[jira] [Created] (MAPREDUCE-6930) mapreduce.map.cpu.vcores and mapreduce.reduce.cpu.vcores are both present twice in mapred-default.xml

2017-08-02 Thread Daniel Templeton (JIRA)
Daniel Templeton created MAPREDUCE-6930: --- Summary: mapreduce.map.cpu.vcores and mapreduce.reduce.cpu.vcores are both present twice in mapred-default.xml Key: MAPREDUCE-6930 URL:

[jira] [Commented] (MAPREDUCE-6674) configure parallel tests for mapreduce-client-jobclient

2017-08-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111996#comment-16111996 ] Hadoop QA commented on MAPREDUCE-6674: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (MAPREDUCE-6931) Fix TestDFSIO "Total Throughput" calculation

2017-08-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111987#comment-16111987 ] ASF GitHub Bot commented on MAPREDUCE-6931: --- GitHub user dennishuo opened a pull request:

[jira] [Commented] (MAPREDUCE-6892) Issues with the count of failed/killed tasks in the jhist file

2017-08-02 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111628#comment-16111628 ] Haibo Chen commented on MAPREDUCE-6892: --- bq. 3. Looking at the toTimelineEvent() methods, those

[jira] [Commented] (MAPREDUCE-6929) TimelineClient hangs MR AM

2017-08-02 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111724#comment-16111724 ] Vrushali C commented on MAPREDUCE-6929: --- Hmm, so the NMs did not have timeline collector as an

[jira] [Commented] (MAPREDUCE-6914) Tests use assertTrue(....equals(...)) instead of assertEquals()

2017-08-02 Thread Maya Wexler (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111690#comment-16111690 ] Maya Wexler commented on MAPREDUCE-6914: +1 (non-binding) I verified that all of the test

[jira] [Updated] (MAPREDUCE-6870) Add configuration for MR job to finish when all reducers are complete (even with unfinished mappers)

2017-08-02 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated MAPREDUCE-6870: Attachment: MAPREDUCE-6870-003.patch > Add configuration for MR job to finish when all

[jira] [Commented] (MAPREDUCE-6870) Add configuration for MR job to finish when all reducers are complete (even with unfinished mappers)

2017-08-02 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16110667#comment-16110667 ] Peter Bacsko commented on MAPREDUCE-6870: - Thanks [~haibochen], I addressed your comments.

[jira] [Commented] (MAPREDUCE-6870) Add configuration for MR job to finish when all reducers are complete (even with unfinished mappers)

2017-08-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16110695#comment-16110695 ] Hadoop QA commented on MAPREDUCE-6870: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (MAPREDUCE-6674) configure parallel tests for mapreduce-client-jobclient

2017-08-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112081#comment-16112081 ] Hadoop QA commented on MAPREDUCE-6674: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (MAPREDUCE-6892) Issues with the count of failed/killed tasks in the jhist file

2017-08-02 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16110785#comment-16110785 ] Peter Bacsko commented on MAPREDUCE-6892: - [~haibochen] I have been thinking about this

[jira] [Comment Edited] (MAPREDUCE-6892) Issues with the count of failed/killed tasks in the jhist file

2017-08-02 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16110785#comment-16110785 ] Peter Bacsko edited comment on MAPREDUCE-6892 at 8/2/17 12:28 PM: --

[jira] [Commented] (MAPREDUCE-6927) MR job should only set tracking url if history was successfully written

2017-08-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111262#comment-16111262 ] Hadoop QA commented on MAPREDUCE-6927: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (MAPREDUCE-6927) MR job should only set tracking url if history was successfully written

2017-08-02 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated MAPREDUCE-6927: --- Status: Patch Available (was: Open) > MR job should only set tracking url if history was

[jira] [Updated] (MAPREDUCE-6927) MR job should only set tracking url if history was successfully written

2017-08-02 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated MAPREDUCE-6927: --- Attachment: MAPREDUCE-6927.001.patch > MR job should only set tracking url if history was