[jira] [Commented] (YARN-5677) RM can be in active-active state for an extended period

2016-09-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530124#comment-15530124 ] Daniel Templeton commented on YARN-5677: [~jianhe], is leader election on by default in Hadoop 3?

[jira] [Commented] (YARN-5676) Add a HashBasedRouterPolicy, that routes jobs based on queue name hash.

2016-09-28 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530223#comment-15530223 ] Carlo Curino commented on YARN-5676: For very large queue structures, it is convenient to specify a

[jira] [Updated] (YARN-4329) Allow fetching exact reason as to why a submitted app is in ACCEPTED state in Fair Scheduler

2016-09-28 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-4329: --- Attachment: YARN-4329.002.patch Hi [~templedf], thanks for the review. I uploaded the new patch for your

[jira] [Commented] (YARN-5677) RM can be in active-active state for an extended period

2016-09-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530118#comment-15530118 ] Daniel Templeton commented on YARN-5677: Just tested the leader election (with the right property

[jira] [Updated] (YARN-5599) Publish AM launch command to ATS

2016-09-28 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-5599: Attachment: YARN-5599-branch-2.patch > Publish AM launch command to ATS >

[jira] [Commented] (YARN-5599) Publish AM launch command to ATS

2016-09-28 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530315#comment-15530315 ] Rohith Sharma K S commented on YARN-5599: - updated branch-2 patch > Publish AM launch command to

[jira] [Comment Edited] (YARN-5659) getPathFromYarnURL should use standard methods

2016-09-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530407#comment-15530407 ] Hitesh Shah edited comment on YARN-5659 at 9/28/16 6:06 PM: [~sershe] Just

[jira] [Commented] (YARN-4205) Add a service for monitoring application life time out

2016-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530187#comment-15530187 ] Hadoop QA commented on YARN-4205: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4061) [Fault tolerance] Fault tolerant writer for timeline v2

2016-09-28 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530324#comment-15530324 ] Joep Rottinghuis commented on YARN-4061: HBASE-12728 introduced the BufferedMutator. > [Fault

[jira] [Commented] (YARN-3432) Cluster metrics have wrong Total Memory when there is reserved memory on CS

2016-09-28 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530162#comment-15530162 ] Brahma Reddy Battula commented on YARN-3432: Oh sorry, missed this..didn't get time to work..

[jira] [Commented] (YARN-5659) getPathFromYarnURL should use standard methods

2016-09-28 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530399#comment-15530399 ] Sergey Shelukhin commented on YARN-5659: Hmm.. which one should I add? I am not very familiar with

[jira] [Commented] (YARN-5659) getPathFromYarnURL should use standard methods

2016-09-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530407#comment-15530407 ] Hitesh Shah commented on YARN-5659: --- [~sershe] Just annotate the functions that are only required by unit

[jira] [Comment Edited] (YARN-4329) Allow fetching exact reason as to why a submitted app is in ACCEPTED state in Fair Scheduler

2016-09-28 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530473#comment-15530473 ] Yufei Gu edited comment on YARN-4329 at 9/28/16 6:33 PM: - Hi [~templedf], thanks

[jira] [Updated] (YARN-5600) Add a parameter to ContainerLaunchContext to emulate yarn.nodemanager.delete.debug-delay-sec on a per-application basis

2016-09-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-5600: --- Assignee: Miklos Szegedi (was: Daniel Templeton) > Add a parameter to ContainerLaunchContext

[jira] [Commented] (YARN-5400) Light cleanup in ZKRMStateStore

2016-09-28 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531129#comment-15531129 ] Robert Kanter commented on YARN-5400: - Yup. I was just talking to [~templedf] about that. It's a

[jira] [Commented] (YARN-5466) DefaultContainerExecutor needs JavaDocs

2016-09-28 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531132#comment-15531132 ] Miklos Szegedi commented on YARN-5466: -- looks good to me +1(non-binding) > DefaultContainerExecutor

[jira] [Updated] (YARN-5486) Update OpportunisticContainerAllocatorAMService::allocate method to handle OPPORTUNISTIC container requests

2016-09-28 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos updated YARN-5486: - Attachment: YARN-5486.004.patch Adding new patch. Fixed remaining checkstyle

[jira] [Updated] (YARN-5384) Expose priority in ReservationSystem submission APIs

2016-09-28 Thread Sean Po (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Po updated YARN-5384: -- Attachment: YARN-5384.v6.patch YARN-5384.v6.patch fixes the checkstyle issues. > Expose priority in

[jira] [Updated] (YARN-4327) RM can not renew TIMELINE_DELEGATION_TOKEN in secure clusters

2016-09-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-4327: -- Component/s: security > RM can not renew TIMELINE_DELEGATION_TOKEN in secure clusters >

[jira] [Commented] (YARN-5145) [YARN-3368] Move new YARN UI configuration to HADOOP_CONF_DIR

2016-09-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530061#comment-15530061 ] Sunil G commented on YARN-5145: --- Currently {{/logs}} has added as a new context to existing webserver in RM.

[jira] [Commented] (YARN-3139) Improve locks in AbstractYarnScheduler/CapacityScheduler/FairScheduler

2016-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531876#comment-15531876 ] Hadoop QA commented on YARN-3139: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5400) Light cleanup in ZKRMStateStore

2016-09-28 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530923#comment-15530923 ] Robert Kanter commented on YARN-5400: - +1 > Light cleanup in ZKRMStateStore >

[jira] [Commented] (YARN-5685) Non-embedded HA failover is broken

2016-09-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530951#comment-15530951 ] Daniel Templeton commented on YARN-5685: I think I finally get it. The net is that HA now requires

[jira] [Comment Edited] (YARN-5685) Non-embedded HA failover is broken

2016-09-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530951#comment-15530951 ] Daniel Templeton edited comment on YARN-5685 at 9/28/16 9:37 PM: - I think I

[jira] [Commented] (YARN-5685) Non-embedded HA failover is broken

2016-09-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530963#comment-15530963 ] Daniel Templeton commented on YARN-5685: BTW, the bug introduced by YARN-4559 (that I had in the

[jira] [Updated] (YARN-5685) Non-embedded HA failover is broken

2016-09-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-5685: --- Description: If HA is enabled with automatic failover enabled and embedded failover disabled,

[jira] [Commented] (YARN-4561) Compaction coprocessor enhancements: On/Off, whitelisting, blacklisting

2016-09-28 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530564#comment-15530564 ] Joep Rottinghuis commented on YARN-4561: For late arriving data that was spooled using whatever we

[jira] [Commented] (YARN-5599) Publish AM launch command to ATS

2016-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530666#comment-15530666 ] Hadoop QA commented on YARN-5599: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5678) Misleading log message in FSLeafQueue and FSParentQueue

2016-09-28 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-5678: --- Summary: Misleading log message in FSLeafQueue and FSParentQueue (was: Misleading log message in FSLeafQueue)

[jira] [Commented] (YARN-4329) Allow fetching exact reason as to why a submitted app is in ACCEPTED state in Fair Scheduler

2016-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530633#comment-15530633 ] Hadoop QA commented on YARN-4329: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5400) Light cleanup in ZKRMStateStore

2016-09-28 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530671#comment-15530671 ] Robert Kanter commented on YARN-5400: - Will do momentarily. > Light cleanup in ZKRMStateStore >

[jira] [Commented] (YARN-4329) Allow fetching exact reason as to why a submitted app is in ACCEPTED state in Fair Scheduler

2016-09-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530632#comment-15530632 ] Daniel Templeton commented on YARN-4329: Thanks, [~yufei]. Maybe I'm an old codger, but I'd really

[jira] [Updated] (YARN-5400) Light cleanup in ZKRMStateStore

2016-09-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-5400: --- Attachment: YARN-5400.003.patch Here's a rebased version. > Light cleanup in ZKRMStateStore >

[jira] [Commented] (YARN-5400) Light cleanup in ZKRMStateStore

2016-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530861#comment-15530861 ] Hadoop QA commented on YARN-5400: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5145) [YARN-3368] Move new YARN UI configuration to HADOOP_CONF_DIR

2016-09-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-5145: -- Attachment: 0001-YARN-5145-Run-NewUI-WithOldPort-POC.patch Attaching a POC patch to host new web UI under same

[jira] [Updated] (YARN-5145) [YARN-3368] Move new YARN UI configuration to HADOOP_CONF_DIR

2016-09-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-5145: -- Attachment: newUIInOldRMWebServer.png > [YARN-3368] Move new YARN UI configuration to HADOOP_CONF_DIR >

[jira] [Commented] (YARN-4561) Compaction coprocessor enhancements: On/Off, whitelisting, blacklisting

2016-09-28 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530597#comment-15530597 ] Joep Rottinghuis commented on YARN-4561: All data that comes in late would be marked as suspicious.

[jira] [Commented] (YARN-5400) Light cleanup in ZKRMStateStore

2016-09-28 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530688#comment-15530688 ] Robert Kanter commented on YARN-5400: - Hmm, it doesn't apply cleanly now: {noformat} >> [27] 12:51 :

[jira] [Commented] (YARN-5685) Non-embedded HA failover is broken

2016-09-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530642#comment-15530642 ] Daniel Templeton commented on YARN-5685: The issue is more than that change from YARN-4559. I'm

[jira] [Commented] (YARN-5400) Light cleanup in ZKRMStateStore

2016-09-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531223#comment-15531223 ] Arpit Agarwal commented on YARN-5400: - No problem and thank you for the quick fix Robert. I verified

[jira] [Created] (YARN-5688) Make allocation of opportunistic containers asynchronous

2016-09-28 Thread Konstantinos Karanasos (JIRA)
Konstantinos Karanasos created YARN-5688: Summary: Make allocation of opportunistic containers asynchronous Key: YARN-5688 URL: https://issues.apache.org/jira/browse/YARN-5688 Project: Hadoop

[jira] [Updated] (YARN-5677) RM can be in active-active state for an extended period

2016-09-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-5677: --- Attachment: YARN-5677.001.patch This patch fixes the issue in trunk. I opted to be

[jira] [Commented] (YARN-5677) RM can be in active-active state for an extended period

2016-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531486#comment-15531486 ] Hadoop QA commented on YARN-5677: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5384) Expose priority in ReservationSystem submission APIs

2016-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531522#comment-15531522 ] Hadoop QA commented on YARN-5384: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-5685) Non-embedded HA failover is broken

2016-09-28 Thread Daniel Templeton (JIRA)
Daniel Templeton created YARN-5685: -- Summary: Non-embedded HA failover is broken Key: YARN-5685 URL: https://issues.apache.org/jira/browse/YARN-5685 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-5400) Light cleanup in ZKRMStateStore

2016-09-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531122#comment-15531122 ] Arpit Agarwal commented on YARN-5400: - Looks like this commit broke the build for branch-2. [~rkanter]

[jira] [Updated] (YARN-5384) Expose priority in ReservationSystem submission APIs

2016-09-28 Thread Sean Po (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Po updated YARN-5384: -- Attachment: YARN-5384.v5.patch Thanks [~subru] for your comments! YARN-5384.v5.patch addresses all your

[jira] [Updated] (YARN-5384) Expose priority in ReservationSystem submission APIs

2016-09-28 Thread Sean Po (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Po updated YARN-5384: -- Attachment: YARN-5384.v4.patch > Expose priority in ReservationSystem submission APIs >

[jira] [Updated] (YARN-2995) Enhance UI to show cluster resource utilization of various container types

2016-09-28 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos updated YARN-2995: - Attachment: YARN-2995.001.patch Adding first version of the patch. > Enhance UI

[jira] [Commented] (YARN-5384) Expose priority in ReservationSystem submission APIs

2016-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531411#comment-15531411 ] Hadoop QA commented on YARN-5384: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5683) Support specifying storage type for per-application local dirs

2016-09-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531569#comment-15531569 ] Tao Yang commented on YARN-5683: Thanks for comments, [~grey]. We think

[jira] [Commented] (YARN-5384) Expose priority in ReservationSystem submission APIs

2016-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531542#comment-15531542 ] Hadoop QA commented on YARN-5384: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5486) Update OpportunisticContainerAllocatorAMService::allocate method to handle OPPORTUNISTIC container requests

2016-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531533#comment-15531533 ] Hadoop QA commented on YARN-5486: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5683) Support specifying storage type for per-application local dirs

2016-09-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-5683: --- Description: h3. Introduction * Some applications of various frameworks (Flink, Spark and MapReduce etc)

[jira] [Updated] (YARN-3139) Improve locks in AbstractYarnScheduler/CapacityScheduler/FairScheduler

2016-09-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3139: - Attachment: YARN-3139.6.patch [~jianhe], added the null check, somehow I forgot updating this. Fixed this

[jira] [Updated] (YARN-4205) Add a service for monitoring application life time out

2016-09-28 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-4205: Attachment: 0007-YARN-4205.2.patch Fixing TestPBImplRecords failure and some of the

[jira] [Commented] (YARN-4061) [Fault tolerance] Fault tolerant writer for timeline v2

2016-09-28 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15529989#comment-15529989 ] Joep Rottinghuis commented on YARN-4061: I'm going to write up some requirements for what we'd want

[jira] [Commented] (YARN-5599) Publish AM launch command to ATS

2016-09-28 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15528688#comment-15528688 ] Varun Saxena commented on YARN-5599: +1. Will commit shortly. > Publish AM launch command to ATS >

[jira] [Commented] (YARN-5677) RM can be in active-active state for an extended period

2016-09-28 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15528575#comment-15528575 ] Jian He commented on YARN-5677: --- [~templedf], this curator based leader election code is new in 2.9, and

[jira] [Updated] (YARN-5599) Publish AM launch command to ATS

2016-09-28 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-5599: --- Summary: Publish AM launch command to ATS (was: Post AM launcher artifacts to ATS) > Publish AM

[jira] [Created] (YARN-5683) Support specifying storage type for per-application local dirs

2016-09-28 Thread Tao Yang (JIRA)
Tao Yang created YARN-5683: -- Summary: Support specifying storage type for per-application local dirs Key: YARN-5683 URL: https://issues.apache.org/jira/browse/YARN-5683 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-5683) Support specifying storage type for per-application local dirs

2016-09-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-5683: --- Description: h3. Introduction * Some applications of various frameworks (Flink, Spark and MapReduce etc)

[jira] [Updated] (YARN-5683) Support specifying storage type for per-application local dirs

2016-09-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-5683: --- Description: h3. Introduction * Some applications of various frameworks (Flink, Spark and MapReduce etc)

[jira] [Comment Edited] (YARN-3139) Improve locks in AbstractYarnScheduler/CapacityScheduler/FairScheduler

2016-09-28 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15529409#comment-15529409 ] Jian He edited comment on YARN-3139 at 9/28/16 12:10 PM: - Patch looks good to me.

[jira] [Updated] (YARN-5683) Support specifying storage type for per-application local dirs

2016-09-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-5683: --- Attachment: flow_diagram_for_MapReduce.png > Support specifying storage type for per-application local dirs >

[jira] [Commented] (YARN-3139) Improve locks in AbstractYarnScheduler/CapacityScheduler/FairScheduler

2016-09-28 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15529409#comment-15529409 ] Jian He commented on YARN-3139: --- Patch looks good to me. bq. Instead of taking readLock, I think we can

[jira] [Updated] (YARN-5683) Support specifying storage type for per-application local dirs

2016-09-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-5683: --- Attachment: YARN-5683-1.patch > Support specifying storage type for per-application local dirs >

[jira] [Updated] (YARN-4205) Add a service for monitoring application life time out

2016-09-28 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-4205: Attachment: 0007-YARN-4205.patch Updated the patch with following major changes from

[jira] [Commented] (YARN-5599) Publish AM launch command to ATS

2016-09-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15529267#comment-15529267 ] Hudson commented on YARN-5599: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10506 (See

[jira] [Commented] (YARN-5662) Provide an option to enable ContainerMonitor

2016-09-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15529266#comment-15529266 ] Hudson commented on YARN-5662: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10506 (See

[jira] [Updated] (YARN-5683) Support specifying storage type for per-application local dirs

2016-09-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-5683: --- Description: h1. Introduction * Some applications of various frameworks (Flink, Spark and MapReduce etc)

[jira] [Commented] (YARN-4205) Add a service for monitoring application life time out

2016-09-28 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15529380#comment-15529380 ] Jian He commented on YARN-4205: --- latest patch looks good to me > Add a service for monitoring application

[jira] [Updated] (YARN-4205) Add a service for monitoring application life time out

2016-09-28 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-4205: Attachment: 0007-YARN-4205.1.patch I forgot to include test file. Updating new patch with

[jira] [Commented] (YARN-4743) ResourceManager crash because TimSort

2016-09-28 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15528957#comment-15528957 ] Yufei Gu commented on YARN-4743: Hi [~gzh1992n], thanks for working on this. Some thoughts about the patch.

[jira] [Commented] (YARN-5554) MoveApplicationAcrossQueues does not check user permission on the target queue

2016-09-28 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15528729#comment-15528729 ] Yufei Gu commented on YARN-5554: The latest patch looks good to me. +1(non-binding). >

[jira] [Comment Edited] (YARN-4743) ResourceManager crash because TimSort

2016-09-28 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15528957#comment-15528957 ] Yufei Gu edited comment on YARN-4743 at 9/28/16 9:06 AM: - Hi [~gzh1992n], thanks

[jira] [Commented] (YARN-4855) Should check if node exists when replace nodelabels

2016-09-28 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15529000#comment-15529000 ] Naganarasimha G R commented on YARN-4855: - bq. so it will be better to not add the hyphen-connected

[jira] [Commented] (YARN-4205) Add a service for monitoring application life time out

2016-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15529649#comment-15529649 ] Hadoop QA commented on YARN-4205: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5599) Publish AM launch command to ATS

2016-09-28 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15529549#comment-15529549 ] Varun Saxena commented on YARN-5599: [~rohithsharma] can you provide a branch-2 patch ? This would

[jira] [Commented] (YARN-5683) Support specifying storage type for per-application local dirs

2016-09-28 Thread Lei Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15529614#comment-15529614 ] Lei Guo commented on YARN-5683: --- This is related the constraint label YARN-3409, but different at detail

[jira] [Commented] (YARN-4205) Add a service for monitoring application life time out

2016-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15529513#comment-15529513 ] Hadoop QA commented on YARN-4205: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5682) [YARN-3368] Fix maven build to keep all generated or downloaded files in target folder

2016-09-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15528995#comment-15528995 ] Sunil G commented on YARN-5682: --- Hi [~wangda] I ran {{mvn install -Pyarn-ui}} with and w/o {{mvn clean}}

[jira] [Commented] (YARN-5682) [YARN-3368] Fix maven build to keep all generated or downloaded files in target folder

2016-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15528887#comment-15528887 ] Hadoop QA commented on YARN-5682: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-5684) testDecreaseAfterIncreaseWithAllocationExpiration fails intermittently

2016-09-28 Thread Rohith Sharma K S (JIRA)
Rohith Sharma K S created YARN-5684: --- Summary: testDecreaseAfterIncreaseWithAllocationExpiration fails intermittently Key: YARN-5684 URL: https://issues.apache.org/jira/browse/YARN-5684 Project:

[jira] [Comment Edited] (YARN-5400) Light cleanup in ZKRMStateStore

2016-09-28 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531129#comment-15531129 ] Robert Kanter edited comment on YARN-5400 at 9/28/16 10:57 PM: --- Yup. I was

[jira] [Updated] (YARN-5400) Light cleanup in ZKRMStateStore

2016-09-28 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated YARN-5400: Attachment: YARN-5400.addendum.patch Ok, it should be fixed now. Sorry about that. I've attached

[jira] [Commented] (YARN-5400) Light cleanup in ZKRMStateStore

2016-09-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531187#comment-15531187 ] Hudson commented on YARN-5400: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10509 (See

[jira] [Created] (YARN-5686) DefaultContainerExecutor random working dir algorigthm skews results

2016-09-28 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-5686: Summary: DefaultContainerExecutor random working dir algorigthm skews results Key: YARN-5686 URL: https://issues.apache.org/jira/browse/YARN-5686 Project: Hadoop

[jira] [Created] (YARN-5687) Refactor TestOpportunisticContainerAllocation to extend TestAMRMClient

2016-09-28 Thread Konstantinos Karanasos (JIRA)
Konstantinos Karanasos created YARN-5687: Summary: Refactor TestOpportunisticContainerAllocation to extend TestAMRMClient Key: YARN-5687 URL: https://issues.apache.org/jira/browse/YARN-5687