[jira] [Updated] (YARN-3985) Make ReservationSystem persist state using RMStateStore reservation APIs

2015-09-15 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-3985: Attachment: YARN-3985.002.patch Retriggering jenkins as failures seem unrelated > Make ReservationSy

[jira] [Updated] (YARN-3985) Make ReservationSystem persist state using RMStateStore reservation APIs

2015-09-16 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-3985: Attachment: YARN-3985.002.patch All the failed tests passed locally for me. Rerunning the tests > Ma

[jira] [Commented] (YARN-4143) Optimize the check for AMContainer allocation needed by blacklisting and ContainerType

2015-09-16 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14791259#comment-14791259 ] Anubhav Dhoot commented on YARN-4143: - Copying comments from YARN-2005 Sunil G added

[jira] [Commented] (YARN-4143) Optimize the check for AMContainer allocation needed by blacklisting and ContainerType

2015-09-17 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14804344#comment-14804344 ] Anubhav Dhoot commented on YARN-4143: - I think we can minimize the impact of checking o

[jira] [Updated] (YARN-4143) Optimize the check for AMContainer allocation needed by blacklisting and ContainerType

2015-09-17 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-4143: Attachment: YARN-4143.001.patch Attached patch ensures checks are done only when AM is not allocated

[jira] [Created] (YARN-4180) AMLauncher does not retry on failures when talking to NM

2015-09-17 Thread Anubhav Dhoot (JIRA)
Anubhav Dhoot created YARN-4180: --- Summary: AMLauncher does not retry on failures when talking to NM Key: YARN-4180 URL: https://issues.apache.org/jira/browse/YARN-4180 Project: Hadoop YARN Iss

[jira] [Commented] (YARN-4180) AMLauncher does not retry on failures when talking to NM

2015-09-17 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14804619#comment-14804619 ] Anubhav Dhoot commented on YARN-4180: - Propose using retries in the ContainerManagement

[jira] [Commented] (YARN-2005) Blacklisting support for scheduling AMs

2015-09-18 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14876038#comment-14876038 ] Anubhav Dhoot commented on YARN-2005: - Thanks [~jianhe], [~sunilg], [~jlowe] for the re

[jira] [Commented] (YARN-3985) Make ReservationSystem persist state using RMStateStore reservation APIs

2015-09-18 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14876049#comment-14876049 ] Anubhav Dhoot commented on YARN-3985: - Addressed feedback and opened YARN-4184 for remo

[jira] [Created] (YARN-4184) Remove update reservation state api from state store as its not used by ReservationSystem

2015-09-18 Thread Anubhav Dhoot (JIRA)
Anubhav Dhoot created YARN-4184: --- Summary: Remove update reservation state api from state store as its not used by ReservationSystem Key: YARN-4184 URL: https://issues.apache.org/jira/browse/YARN-4184 P

[jira] [Created] (YARN-4185) Retry interval delay for NM client can be improved from the fixed static retry

2015-09-18 Thread Anubhav Dhoot (JIRA)
Anubhav Dhoot created YARN-4185: --- Summary: Retry interval delay for NM client can be improved from the fixed static retry Key: YARN-4185 URL: https://issues.apache.org/jira/browse/YARN-4185 Project: Ha

[jira] [Updated] (YARN-3985) Make ReservationSystem persist state using RMStateStore reservation APIs

2015-09-18 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-3985: Attachment: YARN-3985.003.patch > Make ReservationSystem persist state using RMStateStore reservation

[jira] [Updated] (YARN-4180) AMLauncher does not retry on failures when talking to NM

2015-09-18 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-4180: Attachment: YARN-4180.001.patch reuse the same retry proxy used by AM client for RM client. Also open

[jira] [Commented] (YARN-3920) FairScheduler container reservation on a node should be configurable to limit it to large containers

2015-09-18 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14876473#comment-14876473 ] Anubhav Dhoot commented on YARN-3920: - Thx [~asuresh] for review and commit! > FairSch

[jira] [Commented] (YARN-4143) Optimize the check for AMContainer allocation needed by blacklisting and ContainerType

2015-09-18 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14876494#comment-14876494 ] Anubhav Dhoot commented on YARN-4143: - Cannot think of an API to add to the scheduler t

[jira] [Commented] (YARN-4131) Add API and CLI to kill container on given containerId

2015-09-18 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14876669#comment-14876669 ] Anubhav Dhoot commented on YARN-4131: - Can you please add [~kasha] and me to this? We a

[jira] [Commented] (YARN-4180) AMLauncher does not retry on failures when talking to NM

2015-09-22 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14903217#comment-14903217 ] Anubhav Dhoot commented on YARN-4180: - The test failure looks unrelated. > AMLauncher

[jira] [Updated] (YARN-4180) AMLauncher does not retry on failures when talking to NM

2015-09-22 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-4180: Attachment: YARN-4180.002.patch Addressed feedback > AMLauncher does not retry on failures when talk

[jira] [Created] (YARN-4204) ConcurrentModificationException in FairSchedulerQueueInfo

2015-09-23 Thread Anubhav Dhoot (JIRA)
Anubhav Dhoot created YARN-4204: --- Summary: ConcurrentModificationException in FairSchedulerQueueInfo Key: YARN-4204 URL: https://issues.apache.org/jira/browse/YARN-4204 Project: Hadoop YARN Iss

[jira] [Commented] (YARN-4204) ConcurrentModificationException in FairSchedulerQueueInfo

2015-09-23 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14905621#comment-14905621 ] Anubhav Dhoot commented on YARN-4204: - Issue is getChildQueues is returning an unmodifi

[jira] [Updated] (YARN-4204) ConcurrentModificationException in FairSchedulerQueueInfo

2015-09-23 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-4204: Attachment: YARN-4204.001.patch > ConcurrentModificationException in FairSchedulerQueueInfo > ---

[jira] [Updated] (YARN-4204) ConcurrentModificationException in FairSchedulerQueueInfo

2015-09-24 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-4204: Description: Saw this exception which caused RM to go down {noformat} java.util.ConcurrentModificatio

[jira] [Updated] (YARN-4180) AMLauncher does not retry on failures when talking to NM

2015-09-24 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-4180: Attachment: YARN-4180.002.patch Try triggering jenkins again > AMLauncher does not retry on failures

[jira] [Updated] (YARN-4204) ConcurrentModificationException in FairSchedulerQueueInfo

2015-09-24 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-4204: Attachment: YARN-4204.002.patch Add unit test to repro ConcurrentModificationException > ConcurrentM

[jira] [Commented] (YARN-4204) ConcurrentModificationException in FairSchedulerQueueInfo

2015-09-28 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14933547#comment-14933547 ] Anubhav Dhoot commented on YARN-4204: - Committed to trunk and branch-2. Thanks [~kasha]

[jira] [Updated] (YARN-4180) AMLauncher does not retry on failures when talking to NM

2015-09-28 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-4180: Attachment: YARN-4180-branch-2.7.2.txt Minor conflicts in backporting changes to branch 2.7 > AMLaun

[jira] [Commented] (YARN-4185) Retry interval delay for NM client can be improved from the fixed static retry

2015-09-30 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14938190#comment-14938190 ] Anubhav Dhoot commented on YARN-4185: - can we try to reuse the existing values for retr

[jira] [Updated] (YARN-3996) YARN-789 (Support for zero capabilities in fairscheduler) is broken after YARN-3305

2015-09-30 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-3996: Assignee: Neelesh Srinivas Salian (was: Anubhav Dhoot) > YARN-789 (Support for zero capabilities in

[jira] [Updated] (YARN-4185) Retry interval delay for NM client can be improved from the fixed static retry

2015-09-30 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-4185: Assignee: Neelesh Srinivas Salian (was: Anubhav Dhoot) > Retry interval delay for NM client can be i

[jira] [Commented] (YARN-3996) YARN-789 (Support for zero capabilities in fairscheduler) is broken after YARN-3305

2015-09-30 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14938225#comment-14938225 ] Anubhav Dhoot commented on YARN-3996: - SchedulerUtils has multiple overloads of normali

[jira] [Commented] (YARN-3996) YARN-789 (Support for zero capabilities in fairscheduler) is broken after YARN-3305

2015-10-02 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941443#comment-14941443 ] Anubhav Dhoot commented on YARN-3996: - Approach looks ok > YARN-789 (Support for zero

[jira] [Commented] (YARN-4185) Retry interval delay for NM client can be improved from the fixed static retry

2015-10-05 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943809#comment-14943809 ] Anubhav Dhoot commented on YARN-4185: - I don't think option 2 where you restart from 1

[jira] [Created] (YARN-4235) FairScheduler PrimaryGroup does not handle empty groups returned for a user

2015-10-07 Thread Anubhav Dhoot (JIRA)
Anubhav Dhoot created YARN-4235: --- Summary: FairScheduler PrimaryGroup does not handle empty groups returned for a user Key: YARN-4235 URL: https://issues.apache.org/jira/browse/YARN-4235 Project: Hadoo

[jira] [Updated] (YARN-4235) FairScheduler PrimaryGroup does not handle empty groups returned for a user

2015-10-07 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-4235: Attachment: YARN-4235.001.patch Handle empty groups > FairScheduler PrimaryGroup does not handle emp

[jira] [Moved] (YARN-4247) Deadlock in FSAppAttempt and RMAppAttemptImpl causes RM to stop processing events

2015-10-09 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot moved MAPREDUCE-6509 to YARN-4247: Component/s: (was: resourcemanager) resourcemana

[jira] [Commented] (YARN-4247) Deadlock in FSAppAttempt and RMAppAttemptImpl causes RM to stop processing events

2015-10-09 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951161#comment-14951161 ] Anubhav Dhoot commented on YARN-4247: - Looking at the jstack here is the deadlock betwe

[jira] [Updated] (YARN-4247) Deadlock in FSAppAttempt and RMAppAttemptImpl causes RM to stop processing events

2015-10-09 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-4247: Attachment: YARN-4247.001.patch Fix removes need for locking from FSAppAttempt to RMAppAttemptImpl.

[jira] [Updated] (YARN-4247) Deadlock in FSAppAttempt and RMAppAttemptImpl causes RM to stop processing events

2015-10-09 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-4247: Attachment: YARN-4247.001.patch retrigger jenkins > Deadlock in FSAppAttempt and RMAppAttemptImpl ca

[jira] [Commented] (YARN-4235) FairScheduler PrimaryGroup does not handle empty groups returned for a user

2015-10-09 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951331#comment-14951331 ] Anubhav Dhoot commented on YARN-4235: - Thanks [~rohithsharma] for review and commit! >

[jira] [Commented] (YARN-4247) Deadlock in FSAppAttempt and RMAppAttemptImpl causes RM to stop processing events

2015-10-10 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14952032#comment-14952032 ] Anubhav Dhoot commented on YARN-4247: - Tested this in a cluster. Before this fix the cl

[jira] [Commented] (YARN-4247) Deadlock in FSAppAttempt and RMAppAttemptImpl causes RM to stop processing events

2015-10-11 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14952545#comment-14952545 ] Anubhav Dhoot commented on YARN-4247: - Yup. I had tested without that change. Resolving

[jira] [Commented] (YARN-4032) Corrupted state from a previous version can still cause RM to fail with NPE due to same reasons as YARN-2834

2015-10-12 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14953924#comment-14953924 ] Anubhav Dhoot commented on YARN-4032: - This is a sample log {noformat} 2015-10-10 04:3

[jira] [Updated] (YARN-4032) Corrupted state from a previous version can still cause RM to fail with NPE due to same reasons as YARN-2834

2015-10-12 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-4032: Attachment: YARN-4032.prelim.patch Prelim patch based on the discussion > Corrupted state from a pre

[jira] [Commented] (YARN-4227) FairScheduler: RM quits processing expired container from a removed node

2015-10-14 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14957372#comment-14957372 ] Anubhav Dhoot commented on YARN-4227: - The previous statement should also be updated to

[jira] [Updated] (YARN-3985) Make ReservationSystem persist state using RMStateStore reservation APIs

2015-10-19 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-3985: Attachment: YARN-3985.004.patch Thanks for the review [~asuresh]. Attached patch removes sleep by add

[jira] [Updated] (YARN-3985) Make ReservationSystem persist state using RMStateStore reservation APIs

2015-10-20 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-3985: Attachment: YARN-3985.005.patch Added a retry since there are multiple events that we need to wait fo

[jira] [Updated] (YARN-3985) Make ReservationSystem persist state using RMStateStore reservation APIs

2015-10-20 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-3985: Attachment: YARN-3985.005.patch > Make ReservationSystem persist state using RMStateStore reservation

[jira] [Commented] (YARN-3985) Make ReservationSystem persist state using RMStateStore reservation APIs

2015-10-20 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14965804#comment-14965804 ] Anubhav Dhoot commented on YARN-3985: - Reran the test multiple times without failure >

[jira] [Updated] (YARN-4184) Remove update reservation state api from state store as its not used by ReservationSystem

2015-10-21 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-4184: Assignee: Subru Krishnan (was: Anubhav Dhoot) > Remove update reservation state api from state store

[jira] [Commented] (YARN-3739) Add recovery of reservation system to RM failover process

2015-10-21 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14968136#comment-14968136 ] Anubhav Dhoot commented on YARN-3739: - Minor comment on loadState you can enumerate on

[jira] [Commented] (YARN-3739) Add recovery of reservation system to RM failover process

2015-10-22 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14969137#comment-14969137 ] Anubhav Dhoot commented on YARN-3739: - +1 > Add recovery of reservation system to RM f

[jira] [Updated] (YARN-3739) Add reservation system recovery to RM recovery process

2015-10-22 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-3739: Summary: Add reservation system recovery to RM recovery process (was: Add recovery of reservation sy

[jira] [Updated] (YARN-3739) Add reservation system recovery to RM recovery process

2015-10-22 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-3739: Fix Version/s: 2.8.0 > Add reservation system recovery to RM recovery process > -

[jira] [Updated] (YARN-3738) Add support for recovery of reserved apps (running under dynamic queues) to Capacity Scheduler

2015-10-23 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-3738: Attachment: YARN-3738-v3.patch Retriggering jenkins with same patch > Add support for recovery of re

[jira] [Commented] (YARN-3738) Add support for recovery of reserved apps (running under dynamic queues) to Capacity Scheduler

2015-10-23 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14971817#comment-14971817 ] Anubhav Dhoot commented on YARN-3738: - +1 pending jenkins > Add support for recovery o

[jira] [Updated] (YARN-4032) Corrupted state from a previous version can still cause RM to fail with NPE due to same reasons as YARN-2834

2015-10-31 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-4032: Assignee: (was: Anubhav Dhoot) Unassigning this from myself since I am not going to have time to

[jira] [Commented] (YARN-3491) PublicLocalizer#addResource is too slow.

2015-05-06 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14530596#comment-14530596 ] Anubhav Dhoot commented on YARN-3491: - LGTM > PublicLocalizer#addResource is too slow.

[jira] [Assigned] (YARN-3467) Expose allocatedMB, allocatedVCores, and runningContainers metrics on running Applications in RM Web UI

2015-05-06 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot reassigned YARN-3467: --- Assignee: Anubhav Dhoot > Expose allocatedMB, allocatedVCores, and runningContainers metrics o

[jira] [Commented] (YARN-3423) RM HA setup, "Cluster" tab links populated with AM hostname instead of RM

2015-05-07 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14532584#comment-14532584 ] Anubhav Dhoot commented on YARN-3423: - getResolvedRemoteRMWebAppURLWithoutScheme will g

[jira] [Updated] (YARN-1814) Better error message when browsing logs in the RM/NM webuis

2015-05-08 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-1814: Labels: (was: BB2015-05-TBR) > Better error message when browsing logs in the RM/NM webuis > --

[jira] [Commented] (YARN-1814) Better error message when browsing logs in the RM/NM webuis

2015-05-08 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14535190#comment-14535190 ] Anubhav Dhoot commented on YARN-1814: - Patch LGTM > Better error message when browsing

[jira] [Updated] (YARN-1814) Better error message when browsing logs in the RM/NM webuis

2015-05-08 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-1814: Attachment: YARN-1814-2.patch Fixed the checkstyle error and verified locally checkstyle is fixed >

[jira] [Updated] (YARN-1782) CLI should let users to query cluster metrics

2015-05-08 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-1782: Labels: BB2015-05-RFC (was: BB2015-05-TBR) > CLI should let users to query cluster metrics > ---

[jira] [Updated] (YARN-1782) CLI should let users to query cluster metrics

2015-05-08 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-1782: Labels: (was: BB2015-05-RFC) > CLI should let users to query cluster metrics >

[jira] [Updated] (YARN-1814) Better error message when browsing logs in the RM/NM webuis

2015-05-08 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-1814: Labels: BB2015-05-RFC (was: ) > Better error message when browsing logs in the RM/NM webuis > --

[jira] [Commented] (YARN-1287) Consolidate MockClocks

2015-05-08 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14535276#comment-14535276 ] Anubhav Dhoot commented on YARN-1287: - Could we combine this functionality into Control

[jira] [Updated] (YARN-1287) Consolidate MockClocks

2015-05-08 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-1287: Labels: newbie (was: BB2015-05-TBR newbie) > Consolidate MockClocks > -- > >

[jira] [Updated] (YARN-3271) FairScheduler: Move tests related to max-runnable-apps from TestFairScheduler to TestAppRunnability

2015-05-08 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-3271: Labels: BB2015-05-RFC (was: BB2015-05-TBR) > FairScheduler: Move tests related to max-runnable-apps

[jira] [Updated] (YARN-1287) Consolidate MockClocks

2015-05-08 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-1287: Attachment: YARN-1287.004.patch Added a patch that uses ControlledClock instead of MockClock and upda

[jira] [Updated] (YARN-3259) FairScheduler: Update to fairShare could be triggered early on node events instead of waiting for update interval

2015-05-09 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-3259: Attachment: YARN-3259.002.patch Addressed feedback > FairScheduler: Update to fairShare could be tri

[jira] [Updated] (YARN-1287) Consolidate MockClocks

2015-05-09 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-1287: Attachment: YARN-1287.005.patch Fixed test failure > Consolidate MockClocks > --

[jira] [Created] (YARN-3675) FairScheduler: RM quits when node removal races with continousscheduling on the same node

2015-05-18 Thread Anubhav Dhoot (JIRA)
Anubhav Dhoot created YARN-3675: --- Summary: FairScheduler: RM quits when node removal races with continousscheduling on the same node Key: YARN-3675 URL: https://issues.apache.org/jira/browse/YARN-3675 P

[jira] [Updated] (YARN-3675) FairScheduler: RM quits when node removal races with continousscheduling on the same node

2015-05-19 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-3675: Attachment: YARN-3675.001.patch > FairScheduler: RM quits when node removal races with continoussched

[jira] [Commented] (YARN-3675) FairScheduler: RM quits when node removal races with continousscheduling on the same node

2015-05-19 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14551885#comment-14551885 ] Anubhav Dhoot commented on YARN-3675: - This fixes the issue where scheduling can happen

[jira] [Assigned] (YARN-2005) Blacklisting support for scheduling AMs

2015-05-20 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot reassigned YARN-2005: --- Assignee: Anubhav Dhoot > Blacklisting support for scheduling AMs > --

[jira] [Commented] (YARN-2005) Blacklisting support for scheduling AMs

2015-05-20 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552669#comment-14552669 ] Anubhav Dhoot commented on YARN-2005: - Assigning to myself to as I am starting work on

[jira] [Updated] (YARN-3675) FairScheduler: RM quits when node removal races with continousscheduling on the same node

2015-05-20 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-3675: Attachment: YARN-3675.002.patch Fixed checkstyle issue > FairScheduler: RM quits when node removal

[jira] [Updated] (YARN-3467) Expose allocatedMB, allocatedVCores, and runningContainers metrics on running Applications in RM Web UI

2015-05-20 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-3467: Attachment: ApplicationAttemptPage.png > Expose allocatedMB, allocatedVCores, and runningContainers m

[jira] [Commented] (YARN-3467) Expose allocatedMB, allocatedVCores, and runningContainers metrics on running Applications in RM Web UI

2015-05-20 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552699#comment-14552699 ] Anubhav Dhoot commented on YARN-3467: - Attaching the ApplicationAttempt page. It does s

[jira] [Updated] (YARN-3675) FairScheduler: RM quits when node removal races with continousscheduling on the same node

2015-05-20 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-3675: Attachment: YARN-3675.003.patch Removed spurious changes and changed visibility of attemptScheduling

[jira] [Commented] (YARN-3675) FairScheduler: RM quits when node removal races with continousscheduling on the same node

2015-05-20 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14553482#comment-14553482 ] Anubhav Dhoot commented on YARN-3675: - Failure does not repro locally for me and seems

[jira] [Updated] (YARN-3467) Expose allocatedMB, allocatedVCores, and runningContainers metrics on running Applications in RM Web UI

2015-05-26 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-3467: Attachment: YARN-3467.001.patch Changes show allocated CPU and memory on the Applications page > Exp

[jira] [Updated] (YARN-3467) Expose allocatedMB, allocatedVCores, and runningContainers metrics on running Applications in RM Web UI

2015-05-26 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-3467: Attachment: Screen Shot 2015-05-26 at 5.46.54 PM.png Shows the 2 new sortable columns for Allocated m

[jira] [Updated] (YARN-3467) Expose allocatedMB, allocatedVCores, and runningContainers metrics on running Applications in RM Web UI

2015-05-30 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-3467: Attachment: YARN-3467.002.patch Fixed checkstyle issue > Expose allocatedMB, allocatedVCores, and ru

[jira] [Commented] (YARN-3467) Expose allocatedMB, allocatedVCores, and runningContainers metrics on running Applications in RM Web UI

2015-05-30 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14566363#comment-14566363 ] Anubhav Dhoot commented on YARN-3467: - Thanks [~kasha] for review and commit! > Expose

[jira] [Commented] (YARN-3751) TestAHSWebServices fails after YARN-3467

2015-06-01 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14567323#comment-14567323 ] Anubhav Dhoot commented on YARN-3751: - There was no failure for this class in the jenki

[jira] [Commented] (YARN-3467) Expose allocatedMB, allocatedVCores, and runningContainers metrics on running Applications in RM Web UI

2015-06-01 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14567327#comment-14567327 ] Anubhav Dhoot commented on YARN-3467: - Did you mean its very verbose? > Expose allocat

[jira] [Updated] (YARN-2573) Integrate ReservationSystem with the RM failover mechanism

2015-06-04 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-2573: Attachment: Design for Reservation HA.pdf Attaching design for the umbrella jira > Integrate Reserv

[jira] [Updated] (YARN-3259) FairScheduler: Update to fairShare could be triggered early on node events instead of waiting for update interval

2015-06-05 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-3259: Attachment: YARN-3259.003.patch Addressed feedback > FairScheduler: Update to fairShare could be tri

[jira] [Commented] (YARN-3259) FairScheduler: Trigger fairShare updates on node events

2015-06-05 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14574918#comment-14574918 ] Anubhav Dhoot commented on YARN-3259: - Thanks [~kasha] for review and commit! > FairSc

[jira] [Created] (YARN-3800) Simplify inmemory state for ReservationAllocation

2015-06-12 Thread Anubhav Dhoot (JIRA)
Anubhav Dhoot created YARN-3800: --- Summary: Simplify inmemory state for ReservationAllocation Key: YARN-3800 URL: https://issues.apache.org/jira/browse/YARN-3800 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-3800) Simplify inmemory state for ReservationAllocation

2015-06-12 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-3800: Attachment: YARN-3800.001.patch > Simplify inmemory state for ReservationAllocation > ---

[jira] [Updated] (YARN-3800) Simplify inmemory state for ReservationAllocation

2015-06-13 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-3800: Attachment: YARN-3800.002.patch Fixed checkstyle issues. > Simplify inmemory state for ReservationAl

[jira] [Updated] (YARN-3800) Simplify inmemory state for ReservationAllocation

2015-06-22 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-3800: Attachment: YARN-3800.002.patch Addressed feedback > Simplify inmemory state for ReservationAllocati

[jira] [Updated] (YARN-3800) Simplify inmemory state for ReservationAllocation

2015-06-22 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-3800: Attachment: YARN-3800.003.patch fixed checkstyle > Simplify inmemory state for ReservationAllocation

[jira] [Commented] (YARN-3800) Simplify inmemory state for ReservationAllocation

2015-06-23 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14598647#comment-14598647 ] Anubhav Dhoot commented on YARN-3800: - Addressed feedback > Simplify inmemory state fo

[jira] [Updated] (YARN-3800) Simplify inmemory state for ReservationAllocation

2015-06-23 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-3800: Attachment: YARN-3800.004.patch > Simplify inmemory state for ReservationAllocation > ---

[jira] [Updated] (YARN-2005) Blacklisting support for scheduling AMs

2015-06-25 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-2005: Attachment: YARN-2005.001.patch > Blacklisting support for scheduling AMs > -

[jira] [Updated] (YARN-2005) Blacklisting support for scheduling AMs

2015-06-26 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-2005: Attachment: YARN-2005.002.patch Addressed the test failure. Unmanaged AM also executes the AMLaunched

[jira] [Commented] (YARN-2005) Blacklisting support for scheduling AMs

2015-06-26 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603767#comment-14603767 ] Anubhav Dhoot commented on YARN-2005: - The checkstyle error is unavoidable (preexisting

  1   2   3   4   5   6   7   >