[jira] [Created] (YARN-2134) FairSchduler AllocationConfiguration doesn't treat hierarchical queues settings

2014-06-09 Thread Andrey Stepachev (JIRA)
Andrey Stepachev created YARN-2134: -- Summary: FairSchduler AllocationConfiguration doesn't treat hierarchical queues settings Key: YARN-2134 URL: https://issues.apache.org/jira/browse/YARN-2134 Proje

[jira] [Updated] (YARN-2134) FairSchduler AllocationConfiguration doesn't treat hierarchical queues settings

2014-06-09 Thread Andrey Stepachev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-2134: --- Attachment: broken-hier-queues.diff > FairSchduler AllocationConfiguration doesn't treat hiera

[jira] [Updated] (YARN-2134) FairSchduler AllocationConfiguration doesn't treat hierarchical queues settings

2014-06-09 Thread Andrey Stepachev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-2134: --- Attachment: YARN-2134.diff > FairSchduler AllocationConfiguration doesn't treat hierarchical q

[jira] [Updated] (YARN-2134) FairSchduler AllocationConfiguration doesn't treat hierarchical queues settings

2014-06-09 Thread Andrey Stepachev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-2134: --- Description: AllocationConfiguration doesn't fully qualify queue names with respect to 'root.

[jira] [Updated] (YARN-2134) FairSchduler AllocationConfiguration doesn't treat hierarchical queues settings

2014-06-09 Thread Andrey Stepachev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-2134: --- Fix Version/s: 2.5.0 > FairSchduler AllocationConfiguration doesn't treat hierarchical queues

[jira] [Updated] (YARN-2134) FairSchduler AllocationConfiguration doesn't treat hierarchical queues settings

2014-06-09 Thread Andrey Stepachev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-2134: --- Description: AllocationConfiguration doesn't fully qualify queue names with respect to 'root.

[jira] [Commented] (YARN-1864) Fair Scheduler Dynamic Hierarchical User Queues

2014-06-09 Thread Andrey Stepachev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14021819#comment-14021819 ] Andrey Stepachev commented on YARN-1864: created queues doesn't respect parent queu

[jira] [Commented] (YARN-2134) FairSchduler AllocationConfiguration doesn't treat hierarchical queues settings

2014-06-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14021828#comment-14021828 ] Hadoop QA commented on YARN-2134: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (YARN-2134) FairSchduler AllocationConfiguration doesn't treat hierarchical queues settings

2014-06-09 Thread Andrey Stepachev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-2134: --- Attachment: YARN-2134.diff > FairSchduler AllocationConfiguration doesn't treat hierarchical q

[jira] [Updated] (YARN-2134) FairSchduler AllocationConfiguration doesn't treat hierarchical queues settings

2014-06-09 Thread Andrey Stepachev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-2134: --- Attachment: (was: YARN-2134.diff) > FairSchduler AllocationConfiguration doesn't treat hie

[jira] [Commented] (YARN-2134) FairSchduler AllocationConfiguration doesn't treat hierarchical queues settings

2014-06-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14021869#comment-14021869 ] Hadoop QA commented on YARN-2134: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-1408) Preemption caused Invalid State Event: ACQUIRED at KILLED and caused a task timeout for 30mins

2014-06-09 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14021881#comment-14021881 ] Sunil G commented on YARN-1408: --- Thank you Wangda for the comment. I was thinking of using *A

[jira] [Commented] (YARN-1368) Common work to re-populate containers’ state into scheduler

2014-06-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14021926#comment-14021926 ] Hudson commented on YARN-1368: -- FAILURE: Integrated in Hadoop-Yarn-trunk #578 (See [https://b

[jira] [Updated] (YARN-2134) FairSchduler AllocationConfiguration doesn't treat hierarchical queues settings

2014-06-09 Thread Andrey Stepachev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-2134: --- Attachment: (was: YARN-2134.diff) > FairSchduler AllocationConfiguration doesn't treat hie

[jira] [Updated] (YARN-2134) FairSchduler AllocationConfiguration doesn't treat hierarchical queues settings

2014-06-09 Thread Andrey Stepachev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-2134: --- Attachment: YARN-2134.diff > FairSchduler AllocationConfiguration doesn't treat hierarchical q

[jira] [Commented] (YARN-2134) FairSchduler AllocationConfiguration doesn't treat hierarchical queues settings

2014-06-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14023411#comment-14023411 ] Hadoop QA commented on YARN-2134: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (YARN-2134) FairSchduler AllocationConfiguration doesn't treat hierarchical queues settings

2014-06-09 Thread Andrey Stepachev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-2134: --- Attachment: (was: broken-hier-queues.diff) > FairSchduler AllocationConfiguration doesn't

[jira] [Updated] (YARN-2134) FairSchduler AllocationConfiguration doesn't treat hierarchical queues settings

2014-06-09 Thread Andrey Stepachev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-2134: --- Description: Automatically created queues doesn't allow to set default parameters. If queue no

[jira] [Updated] (YARN-2134) FairSchduler AllocationConfiguration doesn't treat hierarchical queues settings

2014-06-09 Thread Andrey Stepachev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-2134: --- Description: Automatically created queues (f.e. by queue placement rules) doesn't allow to set

[jira] [Updated] (YARN-2134) FairSchduler AllocationConfiguration doesn't treat hierarchical queues settings

2014-06-09 Thread Andrey Stepachev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-2134: --- Description: Automatically created queues (f.e. by queue placement rules) doesn't allow to set

[jira] [Updated] (YARN-2134) FairSchduler AllocationConfiguration doesn't treat hierarchical queues settings

2014-06-09 Thread Andrey Stepachev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-2134: --- Description: Automatically created queues (f.e. by queue placement rules) doesn't allow to set

[jira] [Updated] (YARN-2134) FairSchduler AllocationConfiguration doesn't treat hierarchical queues settings

2014-06-09 Thread Andrey Stepachev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-2134: --- Attachment: YARN-2134-v2.diff > FairSchduler AllocationConfiguration doesn't treat hierarchica

[jira] [Updated] (YARN-2134) FairSchduler AllocationConfiguration doesn't treat hierarchical queues settings

2014-06-09 Thread Andrey Stepachev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-2134: --- Attachment: YARN-2134-v2.diff > FairSchduler AllocationConfiguration doesn't treat hierarchica

[jira] [Updated] (YARN-2134) FairSchduler AllocationConfiguration doesn't treat hierarchical queues settings

2014-06-09 Thread Andrey Stepachev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-2134: --- Attachment: (was: YARN-2134-v2.diff) > FairSchduler AllocationConfiguration doesn't treat

[jira] [Commented] (YARN-2134) FairSchduler AllocationConfiguration doesn't treat hierarchical queues settings

2014-06-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14025199#comment-14025199 ] Hadoop QA commented on YARN-2134: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-1368) Common work to re-populate containers’ state into scheduler

2014-06-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14025208#comment-14025208 ] Hudson commented on YARN-1368: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1769 (See [https://

[jira] [Commented] (YARN-2075) TestRMAdminCLI consistently fail on trunk and branch-2

2014-06-09 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14025268#comment-14025268 ] Rushabh S Shah commented on YARN-2075: -- [~zjshen]: HAAdmin#getTargetIds is a generic

[jira] [Commented] (YARN-1408) Preemption caused Invalid State Event: ACQUIRED at KILLED and caused a task timeout for 30mins

2014-06-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14025274#comment-14025274 ] Wangda Tan commented on YARN-1408: -- [~sunilg], This approach looks good to me. > Preempti

[jira] [Commented] (YARN-1368) Common work to re-populate containers’ state into scheduler

2014-06-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14025271#comment-14025271 ] Hudson commented on YARN-1368: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1796 (See [htt

[jira] [Commented] (YARN-1424) RMAppAttemptImpl should precompute a zeroed ApplicationResourceUsageReport to return when attempt not active

2014-06-09 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14025314#comment-14025314 ] Jason Lowe commented on YARN-1424: -- -1 was chosen to explicitly mark the field as having a

[jira] [Commented] (YARN-1424) RMAppAttemptImpl should precompute a zeroed ApplicationResourceUsageReport to return when attempt not active

2014-06-09 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14025332#comment-14025332 ] Ray Chiang commented on YARN-1424: -- [~kasha] should I go back to using -1 as the invalid r

[jira] [Updated] (YARN-1879) Mark Idempotent/AtMostOnce annotations to ApplicationMasterProtocol

2014-06-09 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-1879: - Attachment: YARN-1879.8.patch Rebased on trunk. > Mark Idempotent/AtMostOnce annotations to Appl

[jira] [Updated] (YARN-1339) Recover DeletionService state upon nodemanager restart

2014-06-09 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-1339: - Attachment: YARN-1339v5.patch Refreshed patch to trunk. > Recover DeletionService state upon nodemanager

[jira] [Commented] (YARN-2130) Cleanup: Adding getRMAppManager, getQueueACLsManager, getApplicationACLsManager to RMContext

2014-06-09 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14025396#comment-14025396 ] Tsuyoshi OZAWA commented on YARN-2130: -- Thank you for the suggestions, Karthik. Yes, I

[jira] [Commented] (YARN-1709) Admission Control: Reservation subsystem

2014-06-09 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14025401#comment-14025401 ] Chris Douglas commented on YARN-1709: - First pass: {{RLE::addInterval/removeInterval}}

[jira] [Resolved] (YARN-1371) FIFO scheduler to re-populate container allocation state

2014-06-09 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli resolved YARN-1371. --- Resolution: Duplicate Fix Version/s: 2.5.0 Assignee: Jian He (

[jira] [Resolved] (YARN-1369) Capacity scheduler to re-populate container allocation state

2014-06-09 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli resolved YARN-1369. --- Resolution: Duplicate Fix Version/s: 2.5.0 Assignee: Jian He (

[jira] [Commented] (YARN-1424) RMAppAttemptImpl should precompute a zeroed ApplicationResourceUsageReport to return when attempt not active

2014-06-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14025414#comment-14025414 ] Karthik Kambatla commented on YARN-1424: Thanks Jason. I think it makes sense to ke

[jira] [Updated] (YARN-2030) Use StateMachine to simplify handleStoreEvent() in RMStateStore

2014-06-09 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-2030: -- Attachment: YARN-2030.v6.patch > Use StateMachine to simplify handleStoreEvent() in RMStateStore > -

[jira] [Commented] (YARN-2030) Use StateMachine to simplify handleStoreEvent() in RMStateStore

2014-06-09 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14025421#comment-14025421 ] Jian He commented on YARN-2030: --- Patch looks good to me, did a minor rename from operand -> s

[jira] [Commented] (YARN-2030) Use StateMachine to simplify handleStoreEvent() in RMStateStore

2014-06-09 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14025451#comment-14025451 ] Vinod Kumar Vavilapalli commented on YARN-2030: --- Quickly looked at it. Fine o

[jira] [Commented] (YARN-1339) Recover DeletionService state upon nodemanager restart

2014-06-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14025459#comment-14025459 ] Hadoop QA commented on YARN-1339: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2030) Use StateMachine to simplify handleStoreEvent() in RMStateStore

2014-06-09 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14025467#comment-14025467 ] Jian He commented on YARN-2030: --- bq. we should perhaps have more states like for fencing. Mak

[jira] [Commented] (YARN-1879) Mark Idempotent/AtMostOnce annotations to ApplicationMasterProtocol

2014-06-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14025487#comment-14025487 ] Hadoop QA commented on YARN-1879: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2030) Use StateMachine to simplify handleStoreEvent() in RMStateStore

2014-06-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14025501#comment-14025501 ] Hadoop QA commented on YARN-2030: - {color:green}+1 overall{color}. Here are the results of

[jira] [Created] (YARN-2135) Distributed shell should support passing generic parameters from cli

2014-06-09 Thread Karam Singh (JIRA)
Karam Singh created YARN-2135: - Summary: Distributed shell should support passing generic parameters from cli Key: YARN-2135 URL: https://issues.apache.org/jira/browse/YARN-2135 Project: Hadoop YARN

[jira] [Commented] (YARN-2022) Preempting an Application Master container can be kept as least priority when multiple applications are marked for preemption by ProportionalCapacityPreemptionPolicy

2014-06-09 Thread Mayank Bansal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14025581#comment-14025581 ] Mayank Bansal commented on YARN-2022: - Hi [~sunilg] and [~curino] Me and [~vinodkv] we

[jira] [Commented] (YARN-2136) RMStateStore can explicitly handle store/update events when fenced

2014-06-09 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14025594#comment-14025594 ] Jian He commented on YARN-2136: --- Given that RMStateStore now is augmented with state machine,

[jira] [Created] (YARN-2136) RMStateStore can explicitly handle store/update events when fenced

2014-06-09 Thread Jian He (JIRA)
Jian He created YARN-2136: - Summary: RMStateStore can explicitly handle store/update events when fenced Key: YARN-2136 URL: https://issues.apache.org/jira/browse/YARN-2136 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-2030) Use StateMachine to simplify handleStoreEvent() in RMStateStore

2014-06-09 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14025599#comment-14025599 ] Jian He commented on YARN-2030: --- Committing this. Filed YARN-2136 for handling events at fe

[jira] [Commented] (YARN-1424) RMAppAttemptImpl should precompute a zeroed ApplicationResourceUsageReport to return when attempt not active

2014-06-09 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14025606#comment-14025606 ] Ray Chiang commented on YARN-1424: -- [~vinodkv] Thanks. I'm still getting used to the proc

[jira] [Created] (YARN-2137) Add support for logaggregation to a path on non-default filecontext

2014-06-09 Thread Sumit Kumar (JIRA)
Sumit Kumar created YARN-2137: - Summary: Add support for logaggregation to a path on non-default filecontext Key: YARN-2137 URL: https://issues.apache.org/jira/browse/YARN-2137 Project: Hadoop YARN

[jira] [Commented] (YARN-2030) Use StateMachine to simplify handleStoreEvent() in RMStateStore

2014-06-09 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14025626#comment-14025626 ] Jian He commented on YARN-2030: --- Noticed an existing issue that the storedException passed in

[jira] [Updated] (YARN-2137) Add support for logaggregation to a path on non-default filecontext

2014-06-09 Thread Sumit Kumar (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sumit Kumar updated YARN-2137: -- Description: Current log-aggregation implementation supports logaggregation to default filecontext only

[jira] [Updated] (YARN-2137) Add support for logaggregation to a path on non-default filecontext

2014-06-09 Thread Sumit Kumar (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sumit Kumar updated YARN-2137: -- Attachment: YARN-2137.patch Attaching the patch for review. > Add support for logaggregation to a path

[jira] [Commented] (YARN-2030) Use StateMachine to simplify handleStoreEvent() in RMStateStore

2014-06-09 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14025648#comment-14025648 ] Jian He commented on YARN-2030: --- Opened YARN-2138 for handling un-handled store op failed exc

[jira] [Created] (YARN-2138) RMStateStore eats store op failed exceptions

2014-06-09 Thread Jian He (JIRA)
Jian He created YARN-2138: - Summary: RMStateStore eats store op failed exceptions Key: YARN-2138 URL: https://issues.apache.org/jira/browse/YARN-2138 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-2137) Add support for logaggregation to a path on non-default filecontext

2014-06-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14025689#comment-14025689 ] Hadoop QA commented on YARN-2137: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-1424) RMAppAttemptImpl should precompute a zeroed ApplicationResourceUsageReport to return when attempt not active

2014-06-09 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-1424: - Attachment: YARN1424-03.patch >From two patches: - Moves dummy ApplicationResourceUsageReport to RMServerU

[jira] [Commented] (YARN-2138) RMStateStore eats store op failed exceptions

2014-06-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14025724#comment-14025724 ] Karthik Kambatla commented on YARN-2138: {{RMStateStore#notifyStoreOperationFailed}

[jira] [Commented] (YARN-2136) RMStateStore can explicitly handle store/update events when fenced

2014-06-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14025729#comment-14025729 ] Karthik Kambatla commented on YARN-2136: Adding a FENCED state makes sense to me. O

[jira] [Commented] (YARN-2138) RMStateStore eats store op failed exceptions

2014-06-09 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14025736#comment-14025736 ] Jian He commented on YARN-2138: --- bq. RMStateStore#notifyStoreOperationFailed handles RMFatal

[jira] [Commented] (YARN-2138) RMStateStore eats store op failed exceptions

2014-06-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14025774#comment-14025774 ] Karthik Kambatla commented on YARN-2138: I would suggest working on it here. I can

[jira] [Commented] (YARN-1424) RMAppAttemptImpl should precompute a zeroed ApplicationResourceUsageReport to return when attempt not active

2014-06-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14025789#comment-14025789 ] Hadoop QA commented on YARN-1424: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2130) Cleanup: Adding getRMAppManager, getQueueACLsManager, getApplicationACLsManager to RMContext

2014-06-09 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-2130: - Attachment: YARN-2130.2.patch > Cleanup: Adding getRMAppManager, getQueueACLsManager, > getApplic

[jira] [Updated] (YARN-2130) Cleanup: Adding getRMAppManager, getQueueACLsManager, getApplicationACLsManager to RMContext

2014-06-09 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-2130: - Attachment: (was: YARN-2130.2.patch) > Cleanup: Adding getRMAppManager, getQueueACLsManager,

[jira] [Updated] (YARN-2130) Cleanup: Adding getRMAppManager, getQueueACLsManager, getApplicationACLsManager to RMContext

2014-06-09 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-2130: - Attachment: YARN-2130.2.patch > Cleanup: Adding getRMAppManager, getQueueACLsManager, > getApplic

[jira] [Commented] (YARN-2130) Cleanup: Adding getRMAppManager, getQueueACLsManager, getApplicationACLsManager to RMContext

2014-06-09 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14025838#comment-14025838 ] Tsuyoshi OZAWA commented on YARN-2130: -- Updated a patch to address Karthik's comment:

[jira] [Commented] (YARN-2022) Preempting an Application Master container can be kept as least priority when multiple applications are marked for preemption by ProportionalCapacityPreemptionPolicy

2014-06-09 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14025879#comment-14025879 ] Carlo Curino commented on YARN-2022: Mayank, I completely agree with you and vinod, hen

[jira] [Commented] (YARN-2130) Cleanup: Adding getRMAppManager, getQueueACLsManager, getApplicationACLsManager to RMContext

2014-06-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14025886#comment-14025886 ] Hadoop QA commented on YARN-2130: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2130) Cleanup: Adding getRMAppManager, getQueueACLsManager, getApplicationACLsManager to RMContext

2014-06-09 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14025903#comment-14025903 ] Tsuyoshi OZAWA commented on YARN-2130: -- The test failure has been filed as YARN-2075,

[jira] [Updated] (YARN-2001) Threshold for RM to accept requests from AM after failover

2014-06-09 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-2001: -- Attachment: YARN-2001.1.patch Preliminary patch to demonstrate the idea: 1. Add a new timeout config to make sc

[jira] [Created] (YARN-2139) Add support for disk IO isolation/scheduling for containers

2014-06-09 Thread Wei Yan (JIRA)
Wei Yan created YARN-2139: - Summary: Add support for disk IO isolation/scheduling for containers Key: YARN-2139 URL: https://issues.apache.org/jira/browse/YARN-2139 Project: Hadoop YARN Issue Type:

[jira] [Created] (YARN-2140) Add support for network IO isolation/scheduling for containers

2014-06-09 Thread Wei Yan (JIRA)
Wei Yan created YARN-2140: - Summary: Add support for network IO isolation/scheduling for containers Key: YARN-2140 URL: https://issues.apache.org/jira/browse/YARN-2140 Project: Hadoop YARN Issue Typ

[jira] [Commented] (YARN-1424) RMAppAttemptImpl should precompute a zeroed ApplicationResourceUsageReport to return when attempt not active

2014-06-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14025959#comment-14025959 ] Karthik Kambatla commented on YARN-1424: Nits: # TestClientRMService has a few line

[jira] [Created] (YARN-2141) Resource consumption logging

2014-06-09 Thread Carlo Curino (JIRA)
Carlo Curino created YARN-2141: -- Summary: Resource consumption logging Key: YARN-2141 URL: https://issues.apache.org/jira/browse/YARN-2141 Project: Hadoop YARN Issue Type: Improvement

[jira] [Commented] (YARN-2130) Cleanup: Adding getRMAppManager, getQueueACLsManager, getApplicationACLsManager to RMContext

2014-06-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14025971#comment-14025971 ] Karthik Kambatla commented on YARN-2130: The current patch looks reasonable to me.

[jira] [Commented] (YARN-2130) Cleanup: Adding getRMAppManager, getQueueACLsManager, getApplicationACLsManager to RMContext

2014-06-09 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14025983#comment-14025983 ] Tsuyoshi OZAWA commented on YARN-2130: -- Let's do this on this JIRA. I'll update it.

[jira] [Commented] (YARN-2141) Resource consumption logging

2014-06-09 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14025985#comment-14025985 ] Carlo Curino commented on YARN-2141: This is the product of conversations with [~chris.

[jira] [Commented] (YARN-2141) Resource consumption logging

2014-06-09 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14025993#comment-14025993 ] Hitesh Shah commented on YARN-2141: --- Credit to [~gopalv] for the YARN "top" idea. > Reso

[jira] [Updated] (YARN-2138) Cleanup notifyDone* methods in RMStateStore

2014-06-09 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-2138: -- Description: The storedException passed into notifyDoneStoringApplication is always null. Similarly for other no

[jira] [Commented] (YARN-2030) Use StateMachine to simplify handleStoreEvent() in RMStateStore

2014-06-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14026005#comment-14026005 ] Hudson commented on YARN-2030: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5672 (See [https:

[jira] [Commented] (YARN-2140) Add support for network IO isolation/scheduling for containers

2014-06-09 Thread haosdent (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14026054#comment-14026054 ] haosdent commented on YARN-2140: How to implement this? Cgroup? > Add support for network

[jira] [Commented] (YARN-2137) Add support for logaggregation to a path on non-default filecontext

2014-06-09 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14026055#comment-14026055 ] Varun Vasudev commented on YARN-2137: - Sumit, have you tested this with the client? The

[jira] [Commented] (YARN-2124) ProportionalCapacityPreemptionPolicy cannot work because it's initialized before scheduler initialized

2014-06-09 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14026080#comment-14026080 ] Jian He commented on YARN-2124: --- Patch looks good overall. Test case: seems just starting RM

[jira] [Commented] (YARN-2137) Add support for logaggregation to a path on non-default filecontext

2014-06-09 Thread Sumit Kumar (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14026113#comment-14026113 ] Sumit Kumar commented on YARN-2137: --- [~vvasudev] i tested with the unit test only. if you

[jira] [Commented] (YARN-2137) Add support for logaggregation to a path on non-default filecontext

2014-06-09 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14026116#comment-14026116 ] Varun Vasudev commented on YARN-2137: - No sorry. I should have been more clear. http:/

[jira] [Commented] (YARN-2130) Cleanup: Adding getRMAppManager, getQueueACLsManager, getApplicationACLsManager to RMContext

2014-06-09 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14026119#comment-14026119 ] Tsuyoshi OZAWA commented on YARN-2130: -- In addition to getClientRMService/getResource

[jira] [Updated] (YARN-2130) Cleanup: Adding getRMAppManager, getQueueACLsManager, getApplicationACLsManager to RMContext

2014-06-09 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-2130: - Attachment: YARN-2130.3.patch > Cleanup: Adding getRMAppManager, getQueueACLsManager, > getApplic

[jira] [Commented] (YARN-2083) In fair scheduler, Queue should not been assigned more containers when its usedResource had reach the maxResource limit

2014-06-09 Thread Yi Tian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14026130#comment-14026130 ] Yi Tian commented on YARN-2083: --- could anyone review this patch? > In fair scheduler, Queue

[jira] [Created] (YARN-2142) Add one service to check the nodes' TRUST status

2014-06-09 Thread anders (JIRA)
anders created YARN-2142: Summary: Add one service to check the nodes' TRUST status Key: YARN-2142 URL: https://issues.apache.org/jira/browse/YARN-2142 Project: Hadoop YARN Issue Type: New Feature

[jira] [Commented] (YARN-1408) Preemption caused Invalid State Event: ACQUIRED at KILLED and caused a task timeout for 30mins

2014-06-09 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14026159#comment-14026159 ] Vinod Kumar Vavilapalli commented on YARN-1408: --- Pitching in late, apologies.

[jira] [Commented] (YARN-2130) Cleanup: Adding getRMAppManager, getQueueACLsManager, getApplicationACLsManager to RMContext

2014-06-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14026161#comment-14026161 ] Hadoop QA commented on YARN-2130: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-1964) Create Docker analog of the LinuxContainerExecutor in YARN

2014-06-09 Thread Dinesh Subhraveti (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14026170#comment-14026170 ] Dinesh Subhraveti commented on YARN-1964: - We are putting together issues across YA

[jira] [Commented] (YARN-2124) ProportionalCapacityPreemptionPolicy cannot work because it's initialized before scheduler initialized

2014-06-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14026171#comment-14026171 ] Wangda Tan commented on YARN-2124: -- [~jianhe], Good catch, I'll try to see if RM.start can