[jira] [Comment Edited] (MAPREDUCE-6190) MR Job is stuck because of one mapper stuck in STARTING

2018-11-26 Thread Zhaohui Xin (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700028#comment-16700028 ] Zhaohui Xin edited comment on MAPREDUCE-6190 at 11/27/18 7:44 AM: --

[jira] [Commented] (MAPREDUCE-6190) MR Job is stuck because of one mapper stuck in STARTING

2018-11-26 Thread Zhaohui Xin (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700028#comment-16700028 ] Zhaohui Xin commented on MAPREDUCE-6190: In our production cluster, the new code mentioned

[jira] [Commented] (MAPREDUCE-7162) MapReduce unit test is broken

2018-11-26 Thread Zhaohui Xin (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700017#comment-16700017 ] Zhaohui Xin commented on MAPREDUCE-7162: [~ajisakaa], very good suggestion. I attached new

[jira] [Commented] (MAPREDUCE-7162) MapReduce unit test is broken

2018-11-26 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700015#comment-16700015 ] Akira Ajisaka commented on MAPREDUCE-7162: -- The source code before MAPREDUCE-7158 intended

[jira] [Updated] (MAPREDUCE-7162) MapReduce unit test is broken

2018-11-26 Thread Zhaohui Xin (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaohui Xin updated MAPREDUCE-7162: --- Attachment: MAPREDUCE-7162.002.patch > MapReduce unit test is broken >

[jira] [Updated] (MAPREDUCE-7162) MapReduce unit test is broken

2018-11-26 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated MAPREDUCE-7162: - Target Version/s: 3.1.2, 3.3.0, 3.2.1 > MapReduce unit test is broken >

[jira] [Commented] (MAPREDUCE-7162) MapReduce unit test is broken

2018-11-26 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1676#comment-1676 ] Akira Ajisaka commented on MAPREDUCE-7162: -- Hi [~uranus], thank you for your patch. I'm

[jira] [Comment Edited] (MAPREDUCE-6190) MR Job is stuck because of one mapper stuck in STARTING

2018-11-26 Thread Zhaohui Xin (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16698105#comment-16698105 ] Zhaohui Xin edited comment on MAPREDUCE-6190 at 11/27/18 2:44 AM: --

[jira] [Commented] (MAPREDUCE-7164) FileOutputCommitter does not report progress while merging paths.

2018-11-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16699689#comment-16699689 ] Hadoop QA commented on MAPREDUCE-7164: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (MAPREDUCE-7164) FileOutputCommitter does not report progress while merging paths.

2018-11-26 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated MAPREDUCE-7164: --- Attachment: MAPREDUCE-7164.001.patch > FileOutputCommitter does not report progress

[jira] [Updated] (MAPREDUCE-7164) FileOutputCommitter does not report progress while merging paths.

2018-11-26 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated MAPREDUCE-7164: --- Status: Patch Available (was: Open) > FileOutputCommitter does not report progress

[jira] [Commented] (MAPREDUCE-7164) FileOutputCommitter does not report progress while merging paths.

2018-11-26 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16699631#comment-16699631 ] Kuhu Shukla commented on MAPREDUCE-7164: A patch that does not fully cover all cases of

[jira] [Commented] (MAPREDUCE-7164) FileOutputCommitter does not report progress while merging paths.

2018-11-26 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16699606#comment-16699606 ] Kuhu Shukla commented on MAPREDUCE-7164: Would it be useful to add progress() functionality

[jira] [Updated] (MAPREDUCE-7164) FileOutputCommitter does not report progress while merging paths.

2018-11-26 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated MAPREDUCE-7164: --- Description: In cases where the rename and merge path logic takes more time than usual,

[jira] [Created] (MAPREDUCE-7164) FileOutputCommitter does not report progress while merging paths.

2018-11-26 Thread Kuhu Shukla (JIRA)
Kuhu Shukla created MAPREDUCE-7164: -- Summary: FileOutputCommitter does not report progress while merging paths. Key: MAPREDUCE-7164 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7164 Project:

[jira] [Updated] (MAPREDUCE-7164) FileOutputCommitter does not report progress while merging paths.

2018-11-26 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated MAPREDUCE-7164: --- Environment: (was: In cases where the rename and merge path logic takes more time

[jira] [Updated] (MAPREDUCE-7160) Job end notification not sent and client service not stopped after YarnRuntimeException in shutDownJob in MRAppMaster.java despite finally block

2018-11-26 Thread John Thomason (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Thomason updated MAPREDUCE-7160: - Description: If a YarnRuntimeException occurs during shutDownJob (in this case, at

[jira] [Updated] (MAPREDUCE-7160) Job end notification not sent and client service not stopped after YarnRuntimeException in shutDownJob in MRAppMaster.java despite finally block

2018-11-26 Thread John Thomason (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Thomason updated MAPREDUCE-7160: - Description: If a YarnRuntimeException occurs during shutDownJob (in this case, at

[jira] [Commented] (MAPREDUCE-7163) MapReduce add NullInputFormat

2018-11-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16699217#comment-16699217 ] Hadoop QA commented on MAPREDUCE-7163: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (MAPREDUCE-7163) MapReduce add NullInputFormat

2018-11-26 Thread Zhaohui Xin (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaohui Xin updated MAPREDUCE-7163: --- Description: When job's inputformat set to NullInputFormat, we can use mapreduce as

[jira] [Updated] (MAPREDUCE-7163) MapReduce add NullInputFormat

2018-11-26 Thread Zhaohui Xin (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaohui Xin updated MAPREDUCE-7163: --- Description: When job's inputformat set to NullInputFormat, we can use mapreduce as

[jira] [Updated] (MAPREDUCE-7163) MapReduce add NullInputFormat

2018-11-26 Thread Zhaohui Xin (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaohui Xin updated MAPREDUCE-7163: --- Attachment: MAPREDUCE-7163.001.patch Status: Patch Available (was: Open) >

[jira] [Created] (MAPREDUCE-7163) MapReduce add NullInputFormat

2018-11-26 Thread Zhaohui Xin (JIRA)
Zhaohui Xin created MAPREDUCE-7163: -- Summary: MapReduce add NullInputFormat Key: MAPREDUCE-7163 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7163 Project: Hadoop Map/Reduce Issue

[jira] [Updated] (MAPREDUCE-7162) MapReduce unit test is broken

2018-11-26 Thread Zhaohui Xin (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaohui Xin updated MAPREDUCE-7162: --- Description: Mapreduce unit test is broken by

[jira] [Commented] (MAPREDUCE-7159) FrameworkUploader: ensure proper permissions of generated framework tar.gz if restrictive umask is used

2018-11-26 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16698672#comment-16698672 ] Peter Bacsko commented on MAPREDUCE-7159: - [~wilfreds] could you take a quick look at this?