[jira] [Updated] (YARN-1885) RM may not send the finished signal to some nodes where the application ran after RM restarts

2014-04-29 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-1885: - Attachment: YARN-1885.patch Attached new patch addressed discussions above, 1) Included integration

[jira] [Commented] (YARN-1408) Preemption caused Invalid State Event: ACQUIRED at KILLED and caused a task timeout for 30mins

2014-04-29 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13984151#comment-13984151 ] Devaraj K commented on YARN-1408: - bq. So in some race conditions, it is possible that a

[jira] [Commented] (YARN-1408) Preemption caused Invalid State Event: ACQUIRED at KILLED and caused a task timeout for 30mins

2014-04-29 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13984152#comment-13984152 ] Devaraj K commented on YARN-1408: - Correction to the above comment. Sorry for the delay

[jira] [Created] (YARN-1996) Provide alternative policies for UNHEALTHY nodes.

2014-04-29 Thread Gera Shegalov (JIRA)
Gera Shegalov created YARN-1996: --- Summary: Provide alternative policies for UNHEALTHY nodes. Key: YARN-1996 URL: https://issues.apache.org/jira/browse/YARN-1996 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-1996) Provide alternative policies for UNHEALTHY nodes.

2014-04-29 Thread Gera Shegalov (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gera Shegalov updated YARN-1996: Attachment: YARN-1996.v01.patch Provide alternative policies for UNHEALTHY nodes.

[jira] [Commented] (YARN-1996) Provide alternative policies for UNHEALTHY nodes.

2014-04-29 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13984167#comment-13984167 ] Steve Loughran commented on YARN-1996: -- This sounds good -not just as failure

[jira] [Commented] (YARN-1980) Possible NPE in KillAMPreemptionPolicy related to ProportionalCapacityPreemptionPolicy

2014-04-29 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13984188#comment-13984188 ] Devaraj K commented on YARN-1980: - Changes involve in mapreduce project, moving to

[jira] [Created] (YARN-1997) input split size

2014-04-29 Thread rrim (JIRA)
rrim created YARN-1997: -- Summary: input split size Key: YARN-1997 URL: https://issues.apache.org/jira/browse/YARN-1997 Project: Hadoop YARN Issue Type: Test Components: api Affects

[jira] [Commented] (YARN-1982) Rename the daemon name to timelineserver

2014-04-29 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13984268#comment-13984268 ] Junping Du commented on YARN-1982: -- +1. Patch looks good to me. Rename the daemon name

[jira] [Updated] (YARN-1912) ResourceLocalizer started without any jvm memory control

2014-04-29 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated YARN-1912: --- Attachment: YARN-1912-1.patch updated the patch based on findbugs warnings.

[jira] [Updated] (YARN-1987) Wrapper for leveldb DBIterator to aid in handling database exceptions

2014-04-29 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-1987: - Attachment: YARN-1987.patch Wrapper for leveldb DBIterator to aid in handling database exceptions

[jira] [Commented] (YARN-1996) Provide alternative policies for UNHEALTHY nodes.

2014-04-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13984432#comment-13984432 ] Hadoop QA commented on YARN-1996: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1987) Wrapper for leveldb DBIterator to aid in handling database exceptions

2014-04-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13984490#comment-13984490 ] Hadoop QA commented on YARN-1987: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1912) ResourceLocalizer started without any jvm memory control

2014-04-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13984485#comment-13984485 ] Hadoop QA commented on YARN-1912: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-738) TestClientRMTokens is failing irregularly while running all yarn tests

2014-04-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13984587#comment-13984587 ] Hudson commented on YARN-738: - SUCCESS: Integrated in Hadoop-trunk-Commit #5584 (See

[jira] [Commented] (YARN-1996) Provide alternative policies for UNHEALTHY nodes.

2014-04-29 Thread Gera Shegalov (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13984664#comment-13984664 ] Gera Shegalov commented on YARN-1996: - [~ste...@apache.org] thanks for pointing out

[jira] [Updated] (YARN-1362) Distinguish between nodemanager shutdown for decommission vs shutdown for restart

2014-04-29 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-1362: - Attachment: YARN-1362.patch Small patch that enhances the NM context that provides get/set for a decomm

[jira] [Commented] (YARN-1929) DeadLock in RM when automatic failover is enabled.

2014-04-29 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13984699#comment-13984699 ] Vinod Kumar Vavilapalli commented on YARN-1929: --- Seems 'fine' to me. It is

[jira] [Updated] (YARN-1612) Change Fair Scheduler to not disable delay scheduling by default

2014-04-29 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated YARN-1612: -- Attachment: YARN-1612-v2.patch Change Fair Scheduler to not disable delay scheduling by default

[jira] [Commented] (YARN-1885) RM may not send the finished signal to some nodes where the application ran after RM restarts

2014-04-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13984722#comment-13984722 ] Jian He commented on YARN-1885: --- Thanks for the update! - some places exceed the 80 column

[jira] [Commented] (YARN-1929) DeadLock in RM when automatic failover is enabled.

2014-04-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13984843#comment-13984843 ] Hudson commented on YARN-1929: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5585 (See

[jira] [Commented] (YARN-1362) Distinguish between nodemanager shutdown for decommission vs shutdown for restart

2014-04-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13984884#comment-13984884 ] Hadoop QA commented on YARN-1362: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1612) Change Fair Scheduler to not disable delay scheduling by default

2014-04-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13984896#comment-13984896 ] Hadoop QA commented on YARN-1612: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1885) RM may not send the finished signal to some nodes where the application ran after RM restarts

2014-04-29 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13984945#comment-13984945 ] Wangda Tan commented on YARN-1885: -- [~jianhe], Thanks for your review! bq. some places

[jira] [Updated] (YARN-1885) RM may not send the finished signal to some nodes where the application ran after RM restarts

2014-04-29 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-1885: - Attachment: YARN-1885.patch RM may not send the finished signal to some nodes where the application ran

[jira] [Updated] (YARN-1696) Document RM HA

2014-04-29 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-1696: -- Attachment: YARN-1696.6.patch Same patch as before but with a few edits to make

[jira] [Commented] (YARN-1696) Document RM HA

2014-04-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13985067#comment-13985067 ] Hadoop QA commented on YARN-1696: - {color:red}-1 overall{color}. Here are the results of

[jira] [Created] (YARN-1998) Change the time zone on the Yarn UI to the local time zone

2014-04-29 Thread Fengdong Yu (JIRA)
Fengdong Yu created YARN-1998: - Summary: Change the time zone on the Yarn UI to the local time zone Key: YARN-1998 URL: https://issues.apache.org/jira/browse/YARN-1998 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-1998) Change the time zone on the Yarn UI to the local time zone

2014-04-29 Thread Fengdong Yu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengdong Yu updated YARN-1998: -- Attachment: YARN-1998.patch Change the time zone on the Yarn UI to the local time zone

[jira] [Updated] (YARN-1998) Change the time zone on the RM web UI to the local time zone

2014-04-29 Thread Fengdong Yu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengdong Yu updated YARN-1998: -- Summary: Change the time zone on the RM web UI to the local time zone (was: Change the time zone on

[jira] [Updated] (YARN-1999) Move HistoryServerRest.apt.vm into the Mapreduce section

2014-04-29 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated YARN-1999: --- Affects Version/s: 2.4.0 Move HistoryServerRest.apt.vm into the Mapreduce section

[jira] [Updated] (YARN-1999) Move HistoryServerRest.apt.vm into the Mapreduce section

2014-04-29 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated YARN-1999: --- Component/s: documentation Move HistoryServerRest.apt.vm into the Mapreduce section

[jira] [Updated] (YARN-1999) Move HistoryServerRest.apt.vm into the Mapreduce section

2014-04-29 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated YARN-1999: --- Target Version/s: 2.5.0 Move HistoryServerRest.apt.vm into the Mapreduce section

[jira] [Created] (YARN-1999) Move HistoryServerRest.apt.vm into the Mapreduce section

2014-04-29 Thread Ravi Prakash (JIRA)
Ravi Prakash created YARN-1999: -- Summary: Move HistoryServerRest.apt.vm into the Mapreduce section Key: YARN-1999 URL: https://issues.apache.org/jira/browse/YARN-1999 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-1885) RM may not send the finished signal to some nodes where the application ran after RM restarts

2014-04-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13985083#comment-13985083 ] Hadoop QA commented on YARN-1885: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1998) Change the time zone on the RM web UI to the local time zone

2014-04-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13985105#comment-13985105 ] Hadoop QA commented on YARN-1998: - {color:red}-1 overall{color}. Here are the results of

[jira] [Created] (YARN-2001) Persist NMs info for RM restart

2014-04-29 Thread Jian He (JIRA)
Jian He created YARN-2001: - Summary: Persist NMs info for RM restart Key: YARN-2001 URL: https://issues.apache.org/jira/browse/YARN-2001 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-556) RM Restart phase 2 - Work preserving restart

2014-04-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13985148#comment-13985148 ] Jian He commented on YARN-556: -- Hi Anubhav, Looked at the prototype patch. Regarding the

[jira] [Updated] (YARN-1368) Common work to re-populate containers’ state into scheduler

2014-04-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-1368: -- Summary: Common work to re-populate containers’ state into scheduler (was: RM should populate running

[jira] [Commented] (YARN-1368) Common work to re-populate containers’ state into scheduler

2014-04-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13985151#comment-13985151 ] Jian He commented on YARN-1368: --- Hi [~adhoot], mind if I take this over ? I have a

[jira] [Commented] (YARN-1963) Support priorities across applications within the same queue

2014-04-29 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13985160#comment-13985160 ] Sunil G commented on YARN-1963: --- We have done few analysis and implemented support for

[jira] [Commented] (YARN-1368) Common work to re-populate containers’ state into scheduler

2014-04-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13985164#comment-13985164 ] Jian He commented on YARN-1368: --- It's good to have a scheduler-agnostic way to recover the

[jira] [Commented] (YARN-1963) Support priorities across applications within the same queue

2014-04-29 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13985193#comment-13985193 ] Sandy Ryza commented on YARN-1963: -- Thanks for picking this up Sunil. Can we separate