[jira] [Commented] (MAPREDUCE-6485) MR job hanged forever because all resources are taken up by reducers and the last map attempt never get resource to run

2017-08-18 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16131973#comment-16131973 ] YunFan Zhou commented on MAPREDUCE-6485: [~varun_impala_149e] [~rohithsharma] Hi, Rohith

[jira] [Commented] (MAPREDUCE-6485) MR job hanged forever because all resources are taken up by reducers and the last map attempt never get resource to run

2015-10-07 Thread Xianyin Xin (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14947924#comment-14947924 ] Xianyin Xin commented on MAPREDUCE-6485: Thanks [~rohithsharma] and [~kasha] for review and

[jira] [Commented] (MAPREDUCE-6485) MR job hanged forever because all resources are taken up by reducers and the last map attempt never get resource to run

2015-10-02 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14941211#comment-14941211 ] Rohith Sharma K S commented on MAPREDUCE-6485: -- Committing shortly.. > MR job hanged

[jira] [Commented] (MAPREDUCE-6485) MR job hanged forever because all resources are taken up by reducers and the last map attempt never get resource to run

2015-10-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14941241#comment-14941241 ] Hudson commented on MAPREDUCE-6485: --- FAILURE: Integrated in Hadoop-trunk-Commit #8554 (See

[jira] [Commented] (MAPREDUCE-6485) MR job hanged forever because all resources are taken up by reducers and the last map attempt never get resource to run

2015-10-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14941295#comment-14941295 ] Hudson commented on MAPREDUCE-6485: --- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #479 (See

[jira] [Commented] (MAPREDUCE-6485) MR job hanged forever because all resources are taken up by reducers and the last map attempt never get resource to run

2015-10-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14941433#comment-14941433 ] Hudson commented on MAPREDUCE-6485: --- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #471 (See

[jira] [Commented] (MAPREDUCE-6485) MR job hanged forever because all resources are taken up by reducers and the last map attempt never get resource to run

2015-10-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14941511#comment-14941511 ] Hudson commented on MAPREDUCE-6485: --- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2414 (See

[jira] [Commented] (MAPREDUCE-6485) MR job hanged forever because all resources are taken up by reducers and the last map attempt never get resource to run

2015-10-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14941455#comment-14941455 ] Hudson commented on MAPREDUCE-6485: --- SUCCESS: Integrated in Hadoop-Yarn-trunk #1209 (See

[jira] [Commented] (MAPREDUCE-6485) MR job hanged forever because all resources are taken up by reducers and the last map attempt never get resource to run

2015-10-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14941598#comment-14941598 ] Hudson commented on MAPREDUCE-6485: --- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #445 (See

[jira] [Commented] (MAPREDUCE-6485) MR job hanged forever because all resources are taken up by reducers and the last map attempt never get resource to run

2015-10-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14941658#comment-14941658 ] Hudson commented on MAPREDUCE-6485: --- FAILURE: Integrated in Hadoop-Hdfs-trunk #2385 (See

[jira] [Commented] (MAPREDUCE-6485) MR job hanged forever because all resources are taken up by reducers and the last map attempt never get resource to run

2015-09-30 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14937459#comment-14937459 ] Rohith Sharma K S commented on MAPREDUCE-6485: -- I will commit it tomorrow if there is no

[jira] [Commented] (MAPREDUCE-6485) MR job hanged forever because all resources are taken up by reducers and the last map attempt never get resource to run

2015-09-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935065#comment-14935065 ] Hadoop QA commented on MAPREDUCE-6485: -- \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (MAPREDUCE-6485) MR job hanged forever because all resources are taken up by reducers and the last map attempt never get resource to run

2015-09-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935257#comment-14935257 ] Hadoop QA commented on MAPREDUCE-6485: -- \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (MAPREDUCE-6485) MR job hanged forever because all resources are taken up by reducers and the last map attempt never get resource to run

2015-09-29 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14936204#comment-14936204 ] Karthik Kambatla commented on MAPREDUCE-6485: - Looks good. One minor comment -

[jira] [Commented] (MAPREDUCE-6485) MR job hanged forever because all resources are taken up by reducers and the last map attempt never get resource to run

2015-09-29 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14936231#comment-14936231 ] Rohith Sharma K S commented on MAPREDUCE-6485: -- +1 for latest patch.. pending jenkins >

[jira] [Commented] (MAPREDUCE-6485) MR job hanged forever because all resources are taken up by reducers and the last map attempt never get resource to run

2015-09-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14936297#comment-14936297 ] Hadoop QA commented on MAPREDUCE-6485: -- \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (MAPREDUCE-6485) MR job hanged forever because all resources are taken up by reducers and the last map attempt never get resource to run

2015-09-25 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14907693#comment-14907693 ] Rohith Sharma K S commented on MAPREDUCE-6485: -- Thinking that TaskAttemptStateInternal

[jira] [Commented] (MAPREDUCE-6485) MR job hanged forever because all resources are taken up by reducers and the last map attempt never get resource to run

2015-09-23 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904277#comment-14904277 ] Rohith Sharma K S commented on MAPREDUCE-6485: -- Looked deeper in to reducer preemption

[jira] [Commented] (MAPREDUCE-6485) MR job hanged forever because all resources are taken up by reducers and the last map attempt never get resource to run

2015-09-23 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904279#comment-14904279 ] Rohith Sharma K S commented on MAPREDUCE-6485: -- Overall patch looks good to me.. Can you

[jira] [Commented] (MAPREDUCE-6485) MR job hanged forever because all resources are taken up by reducers and the last map attempt never get resource to run

2015-09-23 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904285#comment-14904285 ] Rohith Sharma K S commented on MAPREDUCE-6485: -- nit : can you check for greater then

[jira] [Commented] (MAPREDUCE-6485) MR job hanged forever because all resources are taken up by reducers and the last map attempt never get resource to run

2015-09-22 Thread Bob (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903811#comment-14903811 ] Bob commented on MAPREDUCE-6485: [~xinxianyin],Thanks for your deeply analysis. Though we have found

[jira] [Commented] (MAPREDUCE-6485) MR job hanged forever because all resources are taken up by reducers and the last map attempt never get resource to run

2015-09-21 Thread Xianyin Xin (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14900283#comment-14900283 ] Xianyin Xin commented on MAPREDUCE-6485: Hi [~kasha], the two are similar but not the same. In

[jira] [Commented] (MAPREDUCE-6485) MR job hanged forever because all resources are taken up by reducers and the last map attempt never get resource to run

2015-09-21 Thread Xianyin Xin (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901766#comment-14901766 ] Xianyin Xin commented on MAPREDUCE-6485: Correct above comment: we should check if all of the

[jira] [Commented] (MAPREDUCE-6485) MR job hanged forever because all resources are taken up by reducers and the last map attempt never get resource to run

2015-09-21 Thread Xianyin Xin (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14900776#comment-14900776 ] Xianyin Xin commented on MAPREDUCE-6485: Thanks [~rohithsharma], you are right. I find this

[jira] [Commented] (MAPREDUCE-6485) MR job hanged forever because all resources are taken up by reducers and the last map attempt never get resource to run

2015-09-21 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14900410#comment-14900410 ] Rohith Sharma K S commented on MAPREDUCE-6485: -- Got the logs from [~Jobo] offline. One of

[jira] [Commented] (MAPREDUCE-6485) MR job hanged forever because all resources are taken up by reducers and the last map attempt never get resource to run

2015-09-21 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14900407#comment-14900407 ] Rohith Sharma K S commented on MAPREDUCE-6485: -- bq. the killed map is not marked as

[jira] [Commented] (MAPREDUCE-6485) MR job hanged forever because all resources are taken up by reducers and the last map attempt never get resource to run

2015-09-19 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14876950#comment-14876950 ] Varun Saxena commented on MAPREDUCE-6485: - Do you have AM logs ? > MR job hanged forever

[jira] [Commented] (MAPREDUCE-6485) MR job hanged forever because all resources are taken up by reducers and the last map attempt never get resource to run

2015-09-19 Thread Bob (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14877128#comment-14877128 ] Bob commented on MAPREDUCE-6485: @[~varun_saxena] Thanks for your checking this issue. Below are some