[jira] [Commented] (MAPREDUCE-6674) configure parallel tests for mapreduce-client-jobclient

2017-08-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124398#comment-16124398 ] Hadoop QA commented on MAPREDUCE-6674: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (MAPREDUCE-6674) configure parallel tests for mapreduce-client-jobclient

2017-08-11 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated MAPREDUCE-6674: Attachment: MR-4980.018.patch > configure parallel tests for

[jira] [Commented] (MAPREDUCE-6870) Add configuration for MR job to finish when all reducers are complete (even with unfinished mappers)

2017-08-11 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124318#comment-16124318 ] Daniel Templeton commented on MAPREDUCE-6870: - Good question. The change breaks the

[jira] [Updated] (MAPREDUCE-6901) Remove @deprecated tags from DistributedCache

2017-08-11 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated MAPREDUCE-6901: -- Status: Open (was: Patch Available) > Remove @deprecated tags from DistributedCache >

[jira] [Commented] (MAPREDUCE-6674) configure parallel tests for mapreduce-client-jobclient

2017-08-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124187#comment-16124187 ] Hadoop QA commented on MAPREDUCE-6674: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (MAPREDUCE-6674) configure parallel tests for mapreduce-client-jobclient

2017-08-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124154#comment-16124154 ] Hadoop QA commented on MAPREDUCE-6674: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (MAPREDUCE-6674) configure parallel tests for mapreduce-client-jobclient

2017-08-11 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated MAPREDUCE-6674: Attachment: MR-4980.016.patch > configure parallel tests for

[jira] [Commented] (MAPREDUCE-6674) configure parallel tests for mapreduce-client-jobclient

2017-08-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124122#comment-16124122 ] Hadoop QA commented on MAPREDUCE-6674: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (MAPREDUCE-6870) Add configuration for MR job to finish when all reducers are complete (even with unfinished mappers)

2017-08-11 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-6870: -- Hadoop Flags: Incompatible change,Reviewed (was: Reviewed) > Add configuration for MR job

[jira] [Commented] (MAPREDUCE-6870) Add configuration for MR job to finish when all reducers are complete (even with unfinished mappers)

2017-08-11 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124114#comment-16124114 ] Haibo Chen commented on MAPREDUCE-6870: --- Agreed. > Add configuration for MR job to finish when

[jira] [Updated] (MAPREDUCE-6674) configure parallel tests for mapreduce-client-jobclient

2017-08-11 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated MAPREDUCE-6674: Attachment: (was: MR-4980.015.patch) > configure parallel tests for

[jira] [Commented] (MAPREDUCE-6674) configure parallel tests for mapreduce-client-jobclient

2017-08-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124027#comment-16124027 ] Hadoop QA commented on MAPREDUCE-6674: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (MAPREDUCE-6674) configure parallel tests for mapreduce-client-jobclient

2017-08-11 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated MAPREDUCE-6674: Attachment: MR-4980.015.patch > configure parallel tests for

[jira] [Updated] (MAPREDUCE-6674) configure parallel tests for mapreduce-client-jobclient

2017-08-11 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated MAPREDUCE-6674: Attachment: MR-4980.015.patch > configure parallel tests for

[jira] [Commented] (MAPREDUCE-6870) Add configuration for MR job to finish when all reducers are complete (even with unfinished mappers)

2017-08-11 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123993#comment-16123993 ] Erik Krogen commented on MAPREDUCE-6870: Sounds good; I am in agreement. Since this should be

[jira] [Commented] (MAPREDUCE-6870) Add configuration for MR job to finish when all reducers are complete (even with unfinished mappers)

2017-08-11 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123984#comment-16123984 ] Haibo Chen commented on MAPREDUCE-6870: --- In some cases, the single mapper can take hours to

[jira] [Commented] (MAPREDUCE-6674) configure parallel tests for mapreduce-client-jobclient

2017-08-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123965#comment-16123965 ] Hadoop QA commented on MAPREDUCE-6674: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Comment Edited] (MAPREDUCE-6931) Fix TestDFSIO "Total Throughput" calculation

2017-08-11 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123786#comment-16123786 ] Konstantin Shvachko edited comment on MAPREDUCE-6931 at 8/11/17 7:06 PM:

[jira] [Commented] (MAPREDUCE-6931) Fix TestDFSIO "Total Throughput" calculation

2017-08-11 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123786#comment-16123786 ] Konstantin Shvachko commented on MAPREDUCE-6931: I see only one commit in your pull

[jira] [Commented] (MAPREDUCE-6870) Add configuration for MR job to finish when all reducers are complete (even with unfinished mappers)

2017-08-11 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123784#comment-16123784 ] Erik Krogen commented on MAPREDUCE-6870: Given its rarity and that the worst case scenario is

[jira] [Comment Edited] (MAPREDUCE-6870) Add configuration for MR job to finish when all reducers are complete (even with unfinished mappers)

2017-08-11 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123784#comment-16123784 ] Erik Krogen edited comment on MAPREDUCE-6870 at 8/11/17 6:18 PM: -

[jira] [Updated] (MAPREDUCE-6674) configure parallel tests for mapreduce-client-jobclient

2017-08-11 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated MAPREDUCE-6674: Attachment: MR-4980.014.patch > configure parallel tests for

[jira] [Commented] (MAPREDUCE-5767) Data corruption when single value exceeds map buffer size (io.sort.mb)

2017-08-11 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123626#comment-16123626 ] BELUGA BEHR commented on MAPREDUCE-5767: We are also seeing this problem on CDH 5.10.1. This

[jira] [Commented] (MAPREDUCE-6870) Add configuration for MR job to finish when all reducers are complete (even with unfinished mappers)

2017-08-11 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123624#comment-16123624 ] Haibo Chen commented on MAPREDUCE-6870: --- Thanks [~xkrogen] for pointing out the incompatibility!

[jira] [Commented] (MAPREDUCE-6892) Issues with the count of failed/killed tasks in the jhist file

2017-08-11 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123608#comment-16123608 ] Haibo Chen commented on MAPREDUCE-6892: --- Thanks [~pbacsko] for updating the patch! A few more

[jira] [Issue Comment Deleted] (MAPREDUCE-6892) Issues with the count of failed/killed tasks in the jhist file

2017-08-11 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-6892: -- Comment: was deleted (was: Thanks [~pbacsko] for updating the patch! A few more comments:

[jira] [Commented] (MAPREDUCE-6892) Issues with the count of failed/killed tasks in the jhist file

2017-08-11 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123520#comment-16123520 ] Haibo Chen commented on MAPREDUCE-6892: --- Thanks [~pbacsko] for updating the patch! A few more

[jira] [Commented] (MAPREDUCE-6870) Add configuration for MR job to finish when all reducers are complete (even with unfinished mappers)

2017-08-11 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123493#comment-16123493 ] Erik Krogen commented on MAPREDUCE-6870: [~haibo.chen], [~pbacsko], thank you for working on

[jira] [Commented] (MAPREDUCE-6892) Issues with the count of failed/killed tasks in the jhist file

2017-08-11 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123331#comment-16123331 ] Peter Bacsko commented on MAPREDUCE-6892: - Test case passes locally, I believe there is a race

[jira] [Commented] (MAPREDUCE-6892) Issues with the count of failed/killed tasks in the jhist file

2017-08-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123296#comment-16123296 ] Hadoop QA commented on MAPREDUCE-6892: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (MAPREDUCE-6892) Issues with the count of failed/killed tasks in the jhist file

2017-08-11 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123196#comment-16123196 ] Peter Bacsko commented on MAPREDUCE-6892: - [~haibochen] I uploaded patch v3 which addresses

[jira] [Updated] (MAPREDUCE-6892) Issues with the count of failed/killed tasks in the jhist file

2017-08-11 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated MAPREDUCE-6892: Attachment: MAPREDUCE-6892-003.patch > Issues with the count of failed/killed tasks in

[jira] [Commented] (MAPREDUCE-4980) Parallel test execution of hadoop-mapreduce-client-core

2017-08-11 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123088#comment-16123088 ] Steve Loughran commented on MAPREDUCE-4980: --- If its going through configs & is splnning up a