[jira] [Commented] (YARN-3443) Create a 'ResourceHandler' subsystem to ease addition of support for new resource types on the NM

2015-04-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394200#comment-14394200 ] Hadoop QA commented on YARN-3443: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-3443) Create a 'ResourceHandler' subsystem to ease addition of support for new resource types on the NM

2015-04-03 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sidharta Seethana updated YARN-3443: Attachment: YARN-3443.002.patch Reattaching the patch with the fixed findbug warning fixed.

[jira] [Created] (YARN-3446) FairScheduler HeadRoom calculation should exclude nodes in the blacklist.

2015-04-03 Thread zhihai xu (JIRA)
zhihai xu created YARN-3446: --- Summary: FairScheduler HeadRoom calculation should exclude nodes in the blacklist. Key: YARN-3446 URL: https://issues.apache.org/jira/browse/YARN-3446 Project: Hadoop YARN

[jira] [Commented] (YARN-3410) YARN admin should be able to remove individual application records from RMStateStore

2015-04-03 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394249#comment-14394249 ] Rohith commented on YARN-3410: -- Attached the initial patch for removing individual

[jira] [Commented] (YARN-3410) YARN admin should be able to remove individual application records from RMStateStore

2015-04-03 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394248#comment-14394248 ] Rohith commented on YARN-3410: -- bq. what's the use case of using rmadmin removing a state

[jira] [Updated] (YARN-3410) YARN admin should be able to remove individual application records from RMStateStore

2015-04-03 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith updated YARN-3410: - Attachment: 0001-YARN-3410-v1.patch YARN admin should be able to remove individual application records from

[jira] [Commented] (YARN-2901) Add errors and warning metrics page to RM, NM web UI

2015-04-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394305#comment-14394305 ] Hudson commented on YARN-2901: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #152 (See

[jira] [Commented] (YARN-3365) Add support for using the 'tc' tool via container-executor

2015-04-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394307#comment-14394307 ] Hudson commented on YARN-3365: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #152 (See

[jira] [Commented] (YARN-3415) Non-AM containers can be counted towards amResourceUsage of a Fair Scheduler queue

2015-04-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394313#comment-14394313 ] Hudson commented on YARN-3415: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #152 (See

[jira] [Commented] (YARN-2729) Support script based NodeLabelsProvider Interface in Distributed Node Label Configuration Setup

2015-04-03 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394149#comment-14394149 ] Naganarasimha G R commented on YARN-2729: - bq. Revisted interval, I think it's

[jira] [Commented] (YARN-2901) Add errors and warning metrics page to RM, NM web UI

2015-04-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394327#comment-14394327 ] Hudson commented on YARN-2901: -- FAILURE: Integrated in Hadoop-Yarn-trunk #886 (See

[jira] [Commented] (YARN-3365) Add support for using the 'tc' tool via container-executor

2015-04-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394329#comment-14394329 ] Hudson commented on YARN-3365: -- FAILURE: Integrated in Hadoop-Yarn-trunk #886 (See

[jira] [Commented] (YARN-3415) Non-AM containers can be counted towards amResourceUsage of a Fair Scheduler queue

2015-04-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394335#comment-14394335 ] Hudson commented on YARN-3415: -- FAILURE: Integrated in Hadoop-Yarn-trunk #886 (See

[jira] [Commented] (YARN-2140) Add support for network IO isolation/scheduling for containers

2015-04-03 Thread Do Hoai Nam (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394546#comment-14394546 ] Do Hoai Nam commented on YARN-2140: --- For the case of ingress traffic you can check our

[jira] [Commented] (YARN-3415) Non-AM containers can be counted towards amResourceUsage of a Fair Scheduler queue

2015-04-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394507#comment-14394507 ] Hudson commented on YARN-3415: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #143 (See

[jira] [Commented] (YARN-2901) Add errors and warning metrics page to RM, NM web UI

2015-04-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394499#comment-14394499 ] Hudson commented on YARN-2901: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #143 (See

[jira] [Commented] (YARN-3365) Add support for using the 'tc' tool via container-executor

2015-04-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394501#comment-14394501 ] Hudson commented on YARN-3365: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #143 (See

[jira] [Commented] (YARN-3415) Non-AM containers can be counted towards amResourceUsage of a Fair Scheduler queue

2015-04-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394522#comment-14394522 ] Hudson commented on YARN-3415: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2084 (See

[jira] [Commented] (YARN-2901) Add errors and warning metrics page to RM, NM web UI

2015-04-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394514#comment-14394514 ] Hudson commented on YARN-2901: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2084 (See

[jira] [Commented] (YARN-3365) Add support for using the 'tc' tool via container-executor

2015-04-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394516#comment-14394516 ] Hudson commented on YARN-3365: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2084 (See

[jira] [Updated] (YARN-3444) Fixed typo (capability)

2015-04-03 Thread Gabor Liptak (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Liptak updated YARN-3444: --- Attachment: YARN-3444.patch Fixed typo (capability) --- Key:

[jira] [Updated] (YARN-1680) availableResources sent to applicationMaster in heartbeat should exclude blacklistedNodes free memory.

2015-04-03 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-1680: Component/s: capacityscheduler availableResources sent to applicationMaster in heartbeat should exclude

[jira] [Commented] (YARN-3415) Non-AM containers can be counted towards amResourceUsage of a Fair Scheduler queue

2015-04-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394822#comment-14394822 ] Hudson commented on YARN-3415: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #153 (See

[jira] [Commented] (YARN-3365) Add support for using the 'tc' tool via container-executor

2015-04-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394816#comment-14394816 ] Hudson commented on YARN-3365: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #153 (See

[jira] [Commented] (YARN-2901) Add errors and warning metrics page to RM, NM web UI

2015-04-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394814#comment-14394814 ] Hudson commented on YARN-2901: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #153 (See

[jira] [Updated] (YARN-3444) Fixed typo (capability)

2015-04-03 Thread Gabor Liptak (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Liptak updated YARN-3444: --- Target Version/s: 2.6.1 Fixed typo (capability) --- Key:

[jira] [Updated] (YARN-2140) Add support for network IO isolation/scheduling for containers

2015-04-03 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-2140: -- Assignee: Sidharta Seethana (was: Wei Yan) Add support for network IO isolation/scheduling for containers

[jira] [Updated] (YARN-3411) [Storage implementation] explore the native HBase write schema for storage

2015-04-03 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-3411: - Attachment: ATSv2BackendHBaseSchemaproposal.pdf Attaching the schema proposal for storing ATS information

[jira] [Updated] (YARN-81) Make sure YARN declares correct set of dependencies

2015-04-03 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-81?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-81: --- Attachment: YARN-81.patch Upload a patch to fix most of warnings. Some Unused declared dependencies found

[jira] [Commented] (YARN-2666) TestFairScheduler.testContinuousScheduling fails Intermittently

2015-04-03 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394748#comment-14394748 ] zhihai xu commented on YARN-2666: - thanks [~ozawa]!

[jira] [Commented] (YARN-3365) Add support for using the 'tc' tool via container-executor

2015-04-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394869#comment-14394869 ] Hudson commented on YARN-3365: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2102 (See

[jira] [Commented] (YARN-3415) Non-AM containers can be counted towards amResourceUsage of a Fair Scheduler queue

2015-04-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394876#comment-14394876 ] Hudson commented on YARN-3415: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2102 (See

[jira] [Updated] (YARN-81) Make sure YARN declares correct set of dependencies

2015-04-03 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-81?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-81: --- Attachment: YARN-81-v2.patch Fix minor format issue in v2 patch. Make sure YARN declares correct set of

[jira] [Assigned] (YARN-81) Make sure YARN declares correct set of dependencies

2015-04-03 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-81?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reassigned YARN-81: -- Assignee: Junping Du Make sure YARN declares correct set of dependencies

[jira] [Commented] (YARN-81) Make sure YARN declares correct set of dependencies

2015-04-03 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-81?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394619#comment-14394619 ] Junping Du commented on YARN-81: It is open for a long time. Assign to myself to work on it.

[jira] [Moved] (YARN-3447) Dodgy code Warnings in org.apache.hadoop.yarn.util.Log4jWarningErrorMetricsAppender

2015-04-03 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula moved MAPREDUCE-6306 to YARN-3447: --- Key: YARN-3447 (was: MAPREDUCE-6306) Project:

[jira] [Commented] (YARN-2901) Add errors and warning metrics page to RM, NM web UI

2015-04-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394867#comment-14394867 ] Hudson commented on YARN-2901: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2102 (See

[jira] [Commented] (YARN-2003) Support to process Job priority from Submission Context in AppAttemptAddedSchedulerEvent [RM side]

2015-04-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394891#comment-14394891 ] Hadoop QA commented on YARN-2003: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2004) Priority scheduling support in Capacity scheduler

2015-04-03 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-2004: -- Attachment: 0005-YARN-2004.patch Uploading CS changes. Hi [~leftnoteasy] YARN-2004 need to have some changes in

[jira] [Resolved] (YARN-329) yarn CHANGES.txt link missing from docs Reference

2015-04-03 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du resolved YARN-329. - Resolution: Fixed Fix Version/s: 2.6.0 This get fixed since 2.6.0 release. Mark it as resolved.

[jira] [Updated] (YARN-329) yarn CHANGES.txt link missing from docs Reference

2015-04-03 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-329: -- Fix Version/s: (was: 2.6.0) yarn CHANGES.txt link missing from docs Reference

[jira] [Resolved] (YARN-2969) allocate resource on different nodes for task

2015-04-03 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du resolved YARN-2969. -- Resolution: Duplicate allocate resource on different nodes for task

[jira] [Commented] (YARN-81) Make sure YARN declares correct set of dependencies

2015-04-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-81?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395043#comment-14395043 ] Hadoop QA commented on YARN-81: --- {color:red}-1 overall{color}. Here are the results of testing

[jira] [Commented] (YARN-81) Make sure YARN declares correct set of dependencies

2015-04-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-81?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395056#comment-14395056 ] Hadoop QA commented on YARN-81: --- {color:red}-1 overall{color}. Here are the results of testing

[jira] [Resolved] (YARN-374) Job History Server doesn't show jobs which killed by ClientRMProtocol.forceKillApplication

2015-04-03 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du resolved YARN-374. - Resolution: Not a Problem Job History Server doesn't show jobs which killed by

[jira] [Commented] (YARN-374) Job History Server doesn't show jobs which killed by ClientRMProtocol.forceKillApplication

2015-04-03 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395158#comment-14395158 ] Junping Du commented on YARN-374: - Given we already have generic history server (now is

[jira] [Commented] (YARN-2969) allocate resource on different nodes for task

2015-04-03 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395175#comment-14395175 ] Junping Du commented on YARN-2969: -- Duplicated with YARN-1042: add ability to specify

[jira] [Commented] (YARN-197) Add a separate log server

2015-04-03 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394939#comment-14394939 ] Junping Du commented on YARN-197: - Hi [~seth.siddha...@gmail.com], given we already have

[jira] [Commented] (YARN-329) yarn CHANGES.txt link missing from docs Reference

2015-04-03 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395063#comment-14395063 ] Allen Wittenauer commented on YARN-329: --- Removing the fix version because we need an

[jira] [Resolved] (YARN-463) Show explicitly excluded nodes on the UI

2015-04-03 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du resolved YARN-463. - Resolution: Implemented We already have decommission nodes in UI page, so resolve this JIRA. Show

[jira] [Updated] (YARN-3319) Implement a FairOrderingPolicy

2015-04-03 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3319: -- Summary: Implement a FairOrderingPolicy (was: Implement a Fair SchedulerOrderingPolicy) Implement a

[jira] [Updated] (YARN-3318) Create Initial OrderingPolicy Framework and FifoOrderingPolicy

2015-04-03 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3318: -- Summary: Create Initial OrderingPolicy Framework and FifoOrderingPolicy (was: Create Initial

[jira] [Updated] (YARN-3318) Create Initial OrderingPolicy Framework and FifoOrderingPolicy

2015-04-03 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3318: -- Description: Create the initial framework required for using OrderingPolicies and an initial

[jira] [Commented] (YARN-3318) Create Initial OrderingPolicy Framework and FifoOrderingPolicy

2015-04-03 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395508#comment-14395508 ] Craig Welch commented on YARN-3318: --- [~vinodkv] bq. ...We can strictly focus on the

[jira] [Commented] (YARN-2893) AMLaucher: sporadic job failures due to EOFException in readTokenStorageStream

2015-04-03 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395412#comment-14395412 ] zhihai xu commented on YARN-2893: - Hi [~jira.shegalov], I can catch the exception for all

[jira] [Resolved] (YARN-505) NPE at AsyncDispatcher$GenericEventHandler

2015-04-03 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du resolved YARN-505. - Resolution: Won't Fix NPE at AsyncDispatcher$GenericEventHandler

[jira] [Commented] (YARN-551) The option shell_command of DistributedShell had better support compound command

2015-04-03 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395475#comment-14395475 ] Junping Du commented on YARN-551: - DistributedShell support option of --shell_args to put

[jira] [Resolved] (YARN-551) The option shell_command of DistributedShell had better support compound command

2015-04-03 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du resolved YARN-551. - Resolution: Not a Problem The option shell_command of DistributedShell had better support compound

[jira] [Commented] (YARN-375) FIFO scheduler may crash due to bugg app

2015-04-03 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395503#comment-14395503 ] Junping Du commented on YARN-375: - This won't happen because after AM sending resource

[jira] [Resolved] (YARN-375) FIFO scheduler may crash due to bugg app

2015-04-03 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du resolved YARN-375. - Resolution: Not a Problem FIFO scheduler may crash due to bugg app

[jira] [Updated] (YARN-3448) Add Rolling Time To Lives Level DB Plugin Capabilities

2015-04-03 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated YARN-3448: -- Description: For large applications, the majority of the time in LeveldbTimelineStore is spent

[jira] [Assigned] (YARN-3448) Add Rolling Time To Lives Level DB Plugin Capabilities

2015-04-03 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles reassigned YARN-3448: - Assignee: Jonathan Eagles Add Rolling Time To Lives Level DB Plugin Capabilities

[jira] [Updated] (YARN-3318) Create Initial OrderingPolicy Framework

2015-04-03 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3318: -- Summary: Create Initial OrderingPolicy Framework (was: Create Initial OrderingPolicy Framework,

[jira] [Updated] (YARN-3318) Create Initial OrderingPolicy Framework, integrate with CapacityScheduler LeafQueue supporting present behavior

2015-04-03 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3318: -- Description: Create the initial framework required for using OrderingPolicies (was: Create the initial

[jira] [Updated] (YARN-3318) Create Initial OrderingPolicy Framework

2015-04-03 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3318: -- Attachment: YARN-3318.45.patch Create Initial OrderingPolicy Framework

[jira] [Commented] (YARN-505) NPE at AsyncDispatcher$GenericEventHandler

2015-04-03 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395456#comment-14395456 ] Junping Du commented on YARN-505: - We should never handle null event for AsyncDispatcher,

[jira] [Updated] (YARN-3435) AM container to be allocated Appattempt AM container shown as null

2015-04-03 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-3435: --- Component/s: resourcemanager AM container to be allocated Appattempt AM container shown as

[jira] [Updated] (YARN-3436) Doc WebServicesIntro.html Example Rest API url wrong

2015-04-03 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-3436: --- Component/s: resourcemanager documentation Doc WebServicesIntro.html Example

[jira] [Resolved] (YARN-800) Clicking on an AM link for a running app leads to a HTTP 500

2015-04-03 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du resolved YARN-800. - Resolution: Duplicate Clicking on an AM link for a running app leads to a HTTP 500

[jira] [Commented] (YARN-3318) Create Initial OrderingPolicy Framework and FifoOrderingPolicy

2015-04-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395518#comment-14395518 ] Hadoop QA commented on YARN-3318: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2893) AMLaucher: sporadic job failures due to EOFException in readTokenStorageStream

2015-04-03 Thread Gera Shegalov (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395255#comment-14395255 ] Gera Shegalov commented on YARN-2893: - Thanks [~zxu] for the patch, and apologies for

[jira] [Updated] (YARN-3319) Implement a FairOrderingPolicy

2015-04-03 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3319: -- Attachment: YARN-3319.45.patch Implement a FairOrderingPolicy --

[jira] [Resolved] (YARN-520) webservices API ws/v1/cluster/nodes doesn't return LOST nodes

2015-04-03 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du resolved YARN-520. - Resolution: Duplicate webservices API ws/v1/cluster/nodes doesn't return LOST nodes

[jira] [Commented] (YARN-520) webservices API ws/v1/cluster/nodes doesn't return LOST nodes

2015-04-03 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395465#comment-14395465 ] Junping Du commented on YARN-520: - This is already addressed and resolved in YARN-642.

[jira] [Updated] (YARN-3319) Implement a FairOrderingPolicy

2015-04-03 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3319: -- Description: Implement a FairOrderingPolicy which prefers to allocate to SchedulerProcesses with least

[jira] [Commented] (YARN-402) Dispatcher warn message is too late

2015-04-03 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395402#comment-14395402 ] Junping Du commented on YARN-402: - Thanks [~lohit] for reporting this issue. I think it

[jira] [Commented] (YARN-3318) Create Initial OrderingPolicy Framework and FifoOrderingPolicy

2015-04-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395427#comment-14395427 ] Hadoop QA commented on YARN-3318: - {color:red}-1 overall{color}. Here are the results of

[jira] [Created] (YARN-3449) Recover appTokenKeepAliveMap upon nodemanager restart

2015-04-03 Thread Junping Du (JIRA)
Junping Du created YARN-3449: Summary: Recover appTokenKeepAliveMap upon nodemanager restart Key: YARN-3449 URL: https://issues.apache.org/jira/browse/YARN-3449 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-3319) Implement a FairOrderingPolicy

2015-04-03 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3319: -- Attachment: YARN-3319.47.patch Implement a FairOrderingPolicy --

[jira] [Updated] (YARN-3318) Create Initial OrderingPolicy Framework and FifoOrderingPolicy

2015-04-03 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3318: -- Attachment: YARN-3318.47.patch Create Initial OrderingPolicy Framework and FifoOrderingPolicy

[jira] [Created] (YARN-3448) Add Rolling Time To Lives Level DB Plugin Capabilities

2015-04-03 Thread Jonathan Eagles (JIRA)
Jonathan Eagles created YARN-3448: - Summary: Add Rolling Time To Lives Level DB Plugin Capabilities Key: YARN-3448 URL: https://issues.apache.org/jira/browse/YARN-3448 Project: Hadoop YARN

[jira] [Commented] (YARN-402) Dispatcher warn message is too late

2015-04-03 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395408#comment-14395408 ] Junping Du commented on YARN-402: - Forget that the queue can be constructed with other queue

[jira] [Commented] (YARN-2893) AMLaucher: sporadic job failures due to EOFException in readTokenStorageStream

2015-04-03 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395409#comment-14395409 ] zhihai xu commented on YARN-2893: - [~jira.shegalov], thanks for the review. I can put back

[jira] [Updated] (YARN-3448) Add Rolling Time To Lives Level DB Plugin Capabilities

2015-04-03 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated YARN-3448: -- Attachment: YARN-3448.1.patch Add Rolling Time To Lives Level DB Plugin Capabilities

[jira] [Updated] (YARN-3318) Create Initial OrderingPolicy Framework and FifoOrderingPolicy

2015-04-03 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3318: -- Attachment: YARN-3318.48.patch javac error looks bogus, existing error has simply moved findbugs looks

[jira] [Commented] (YARN-3318) Create Initial OrderingPolicy Framework and FifoOrderingPolicy

2015-04-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395566#comment-14395566 ] Hadoop QA commented on YARN-3318: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3437) convert load test driver to timeline service v.2

2015-04-03 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394437#comment-14394437 ] Junping Du commented on YARN-3437: -- Thanks [~sjlee0] for delivering a patch here! Just

[jira] [Commented] (YARN-3444) Fixed typo (capability)

2015-04-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394583#comment-14394583 ] Hadoop QA commented on YARN-3444: - {color:red}-1 overall{color}. Here are the results of