[jira] [Comment Edited] (YARN-5716) Add global scheduler interface definition and update CapacityScheduler to use it.

2016-10-21 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15597090#comment-15597090 ] Sunil G edited comment on YARN-5716 at 10/22/16 3:59 AM: - Sorry for

[jira] [Commented] (YARN-5716) Add global scheduler interface definition and update CapacityScheduler to use it.

2016-10-21 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15597090#comment-15597090 ] Sunil G commented on YARN-5716: --- Sorry for pitching in late. Patch and approaches looks rea

[jira] [Commented] (YARN-5716) Add global scheduler interface definition and update CapacityScheduler to use it.

2016-10-21 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596971#comment-15596971 ] Jian He commented on YARN-5716: --- latest patch looks good to me > Add global scheduler interf

[jira] [Commented] (YARN-5433) Audit dependencies for Category-X

2016-10-21 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596772#comment-15596772 ] Sangjin Lee commented on YARN-5433: --- A couple of jars with included source: - hbase-serve

[jira] [Comment Edited] (YARN-5525) Make log aggregation service class configurable

2016-10-21 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596356#comment-15596356 ] Botong Huang edited comment on YARN-5525 at 10/22/16 12:12 AM: --

[jira] [Comment Edited] (YARN-5525) Make log aggregation service class configurable

2016-10-21 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596356#comment-15596356 ] Botong Huang edited comment on YARN-5525 at 10/22/16 12:11 AM: --

[jira] [Comment Edited] (YARN-5525) Make log aggregation service class configurable

2016-10-21 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596356#comment-15596356 ] Botong Huang edited comment on YARN-5525 at 10/22/16 12:11 AM: --

[jira] [Comment Edited] (YARN-5525) Make log aggregation service class configurable

2016-10-21 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596356#comment-15596356 ] Botong Huang edited comment on YARN-5525 at 10/22/16 12:10 AM: --

[jira] [Comment Edited] (YARN-5525) Make log aggregation service class configurable

2016-10-21 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596356#comment-15596356 ] Botong Huang edited comment on YARN-5525 at 10/22/16 12:10 AM: --

[jira] [Commented] (YARN-5433) Audit dependencies for Category-X

2016-10-21 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596734#comment-15596734 ] Sangjin Lee commented on YARN-5433: --- I also see the servlet API and the jsp API included

[jira] [Commented] (YARN-5433) Audit dependencies for Category-X

2016-10-21 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596720#comment-15596720 ] Sangjin Lee commented on YARN-5433: --- I looked into new dependencies that timelineservice

[jira] [Resolved] (YARN-5766) TestAMRMClient fails in setup

2016-10-21 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton resolved YARN-5766. Resolution: Invalid Assignee: Daniel Templeton Darn it. Another localize effect. I bo

[jira] [Commented] (YARN-3649) Allow configurable prefix for hbase table names (like prod, exp, test etc)

2016-10-21 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596660#comment-15596660 ] Varun Saxena commented on YARN-3649: Thanks [~vrushalic] for the patch. Couple of com

[jira] [Updated] (YARN-5767) Fix the order that resources are cleaned up from the local Public/Private caches

2016-10-21 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-5767: --- Description: If you look at {{ResourceLocalizationService#handleCacheCleanup}}, you can see that publi

[jira] [Updated] (YARN-5767) Fix the order that resources are cleaned up from the local Public/Private caches

2016-10-21 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-5767: --- Affects Version/s: (was: 2.6.5) (was: 2.7.3) 2.6.0

[jira] [Updated] (YARN-5767) Fix the order that resources are cleaned up from the local Public/Private caches

2016-10-21 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-5767: --- Description: If you look at {{ResourceLocalizationService#handleCacheCleanup}}, you can see that publi

[jira] [Updated] (YARN-5767) Fix the order that resources are cleaned up from the local Public/Private caches

2016-10-21 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-5767: --- Description: If you look at {{ResourceLocalizationService#handleCacheCleanup}}, you can see that publi

[jira] [Commented] (YARN-5767) Fix the order that resources are cleaned up from the local Public/Private caches

2016-10-21 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596593#comment-15596593 ] Chris Trezzo commented on YARN-5767: I see two initial high-level approaches to this pr

[jira] [Created] (YARN-5767) Fix the order that resources are cleaned up from the local Public/Private caches

2016-10-21 Thread Chris Trezzo (JIRA)
Chris Trezzo created YARN-5767: -- Summary: Fix the order that resources are cleaned up from the local Public/Private caches Key: YARN-5767 URL: https://issues.apache.org/jira/browse/YARN-5767 Project: Had

[jira] [Commented] (YARN-4597) Add SCHEDULE to NM container lifecycle

2016-10-21 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596564#comment-15596564 ] Jian He commented on YARN-4597: --- bq. Will rerun and see if they are required… but in anycase,

[jira] [Commented] (YARN-4734) Merge branch:YARN-3368 to trunk

2016-10-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596557#comment-15596557 ] Hadoop QA commented on YARN-4734: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-5433) Audit dependencies for Category-X

2016-10-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596537#comment-15596537 ] Andrew Wang commented on YARN-5433: --- findbugs is the most glaring issue, but we should ch

[jira] [Updated] (YARN-5433) Audit dependencies for Category-X

2016-10-21 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-5433: -- Assignee: Sangjin Lee I'll take a look. This is specifically about excluding findbugs (annotations), cor

[jira] [Commented] (YARN-5716) Add global scheduler interface definition and update CapacityScheduler to use it.

2016-10-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596491#comment-15596491 ] Hadoop QA commented on YARN-5716: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-5369) Improve Yarn logs command to get container logs based on Node Id

2016-10-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596451#comment-15596451 ] Hadoop QA commented on YARN-5369: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-4597) Add SCHEDULE to NM container lifecycle

2016-10-21 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596462#comment-15596462 ] Jian He commented on YARN-4597: --- bq. the current default one only takes into account actual

[jira] [Commented] (YARN-5711) AM cannot reconnect to RM after failover when using RequestHedgingRMFailoverProxyProvider

2016-10-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596435#comment-15596435 ] Hadoop QA commented on YARN-5711: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-5369) Improve Yarn logs command to get container logs based on Node Id

2016-10-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596391#comment-15596391 ] Hadoop QA commented on YARN-5369: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596365#comment-15596365 ] Hadoop QA commented on YARN-2009: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-5679) TestAHSWebServices is failing

2016-10-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596359#comment-15596359 ] Hudson commented on YARN-5679: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1065

[jira] [Commented] (YARN-5525) Make log aggregation service class configurable

2016-10-21 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596356#comment-15596356 ] Botong Huang commented on YARN-5525: True, so I will only add the new field in LogAggre

[jira] [Commented] (YARN-4734) Merge branch:YARN-3368 to trunk

2016-10-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596354#comment-15596354 ] Hadoop QA commented on YARN-4734: - (!) A patch to the testing environment has been detected

[jira] [Updated] (YARN-4734) Merge branch:YARN-3368 to trunk

2016-10-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4734: - Attachment: YARN-4734.15.patch Attached ver.15 patch. > Merge branch:YARN-3368 to trunk >

[jira] [Commented] (YARN-4734) Merge branch:YARN-3368 to trunk

2016-10-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596349#comment-15596349 ] Hadoop QA commented on YARN-4734: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-5747) Application timeline metric aggregation in timeline v2 will lose last round aggregation when an application finishes

2016-10-21 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-5747: --- Fix Version/s: 3.0.0-alpha2 > Application timeline metric aggregation in timeline v2 will lose last rou

[jira] [Commented] (YARN-4734) Merge branch:YARN-3368 to trunk

2016-10-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596343#comment-15596343 ] Hadoop QA commented on YARN-4734: - (!) A patch to the testing environment has been detected

[jira] [Commented] (YARN-5715) introduce entity prefix for return and sort order

2016-10-21 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596324#comment-15596324 ] Varun Saxena commented on YARN-5715: Thanks [~rohithsharma] for the patch. It looks go

[jira] [Updated] (YARN-5711) AM cannot reconnect to RM after failover when using RequestHedgingRMFailoverProxyProvider

2016-10-21 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-5711: - Attachment: YARN-5711-v2.patch Thanks [~jianhe] for the quick review. I have updated the patch to

[jira] [Updated] (YARN-5716) Add global scheduler interface definition and update CapacityScheduler to use it.

2016-10-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-5716: - Attachment: YARN-5716.007.patch Attached ver.7 patch, fixed locality statistics and added one more test for

[jira] [Commented] (YARN-5679) TestAHSWebServices is failing

2016-10-21 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596272#comment-15596272 ] Robert Kanter commented on YARN-5679: - +1 > TestAHSWebServices is failing > --

[jira] [Created] (YARN-5766) TestAMRMClient fails in setup

2016-10-21 Thread Daniel Templeton (JIRA)
Daniel Templeton created YARN-5766: -- Summary: TestAMRMClient fails in setup Key: YARN-5766 URL: https://issues.apache.org/jira/browse/YARN-5766 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-5611) Provide an API to update lifetime of an application.

2016-10-21 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596258#comment-15596258 ] Sunil G commented on YARN-5611: --- Thanks folks for the summary and approach looks fine. Couple

[jira] [Commented] (YARN-5711) AM cannot reconnect to RM after failover when using RequestHedgingRMFailoverProxyProvider

2016-10-21 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596253#comment-15596253 ] Jian He commented on YARN-5711: --- looks good, + 1 > AM cannot reconnect to RM after failover

[jira] [Commented] (YARN-5760) [ATSv2] Create HBase connection only if an app collector is publishing from NM

2016-10-21 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596237#comment-15596237 ] Varun Saxena commented on YARN-5760: bq. Well IIUC it might not be just limited to the

[jira] [Commented] (YARN-5525) Make log aggregation service class configurable

2016-10-21 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596232#comment-15596232 ] Jian He commented on YARN-5525: --- bq. How about I add the AppLogAggregator in Yarn conf as the

[jira] [Commented] (YARN-4329) Allow fetching exact reason as to why a submitted app is in ACCEPTED state in Fair Scheduler

2016-10-21 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596226#comment-15596226 ] Daniel Templeton commented on YARN-4329: Latest patch looks great. A couple of tin

[jira] [Commented] (YARN-5258) Document Use of Docker with LinuxContainerExecutor

2016-10-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596216#comment-15596216 ] Hadoop QA commented on YARN-5258: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Commented] (YARN-5433) Audit dependencies for Category-X

2016-10-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596209#comment-15596209 ] Andrew Wang commented on YARN-5433: --- [~sjlee0] could you or someone else who worked on TS

[jira] [Commented] (YARN-5754) Variable earliest missing null check in computeShares() in FifoPolicy.java

2016-10-21 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596190#comment-15596190 ] Yufei Gu commented on YARN-5754: Thanks [~templedf]. > Variable earliest missing null chec

[jira] [Updated] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-21 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-2009: -- Attachment: YARN-2009.0014.patch Thank you very [~eepayne] for uncovering user-limit scenario. Highly appreciate

[jira] [Commented] (YARN-5725) Test uncaught exception in TestContainersMonitorResourceChange.testContainersResourceChange when setting IP and host

2016-10-21 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596192#comment-15596192 ] Daniel Templeton commented on YARN-5725: The checkstyle complaints are not typicall

[jira] [Commented] (YARN-5747) Application timeline metric aggregation in timeline v2 will lose last round aggregation when an application finishes

2016-10-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596189#comment-15596189 ] Hudson commented on YARN-5747: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1065

[jira] [Commented] (YARN-4126) RM should not issue delegation tokens in unsecure mode

2016-10-21 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596178#comment-15596178 ] Jian He commented on YARN-4126: --- ok,I'll revert it from 2.8, branch-2, and leave it in trunk

[jira] [Commented] (YARN-5754) Variable earliest missing null check in computeShares() in FifoPolicy.java

2016-10-21 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596160#comment-15596160 ] Daniel Templeton commented on YARN-5754: LGTM. That's inline with the {{FairShareP

[jira] [Commented] (YARN-5725) Test uncaught exception in TestContainersMonitorResourceChange.testContainersResourceChange when setting IP and host

2016-10-21 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596146#comment-15596146 ] Miklos Szegedi commented on YARN-5725: -- On the checkstyle comment: @Override:5: Method

[jira] [Commented] (YARN-5760) [ATSv2] Create HBase connection only if an app collector is publishing from NM

2016-10-21 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596122#comment-15596122 ] Naganarasimha G R commented on YARN-5760: - Thanks [~varun_saxena], for raising it.

[jira] [Commented] (YARN-5711) AM cannot reconnect to RM after failover when using RequestHedgingRMFailoverProxyProvider

2016-10-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596097#comment-15596097 ] Hadoop QA commented on YARN-5711: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-4126) RM should not issue delegation tokens in unsecure mode

2016-10-21 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596094#comment-15596094 ] Robert Kanter commented on YARN-4126: - Right. It's not really used. The incompatibili

[jira] [Updated] (YARN-5258) Document Use of Docker with LinuxContainerExecutor

2016-10-21 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-5258: --- Attachment: YARN-5258.002.patch This patch cleans up some rendering issues and adds the top lev

[jira] [Commented] (YARN-4126) RM should not issue delegation tokens in unsecure mode

2016-10-21 Thread Venkat Ranganathan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596091#comment-15596091 ] Venkat Ranganathan commented on YARN-4126: -- While myself, [~jianhe] and [~vinodkv]

[jira] [Commented] (YARN-5750) YARN-4126 broke Oozie on unsecure cluster

2016-10-21 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596084#comment-15596084 ] Robert Kanter commented on YARN-5750: - Ya, the proxy user functionality. Oozie still r

[jira] [Commented] (YARN-5716) Add global scheduler interface definition and update CapacityScheduler to use it.

2016-10-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596082#comment-15596082 ] Hadoop QA commented on YARN-5716: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-5658) YARN should have a hook to delete a path from HDFS when an application ends

2016-10-21 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596062#comment-15596062 ] Jian He commented on YARN-5658: --- Agree with Daniel here, this is a much smaller change and so

[jira] [Commented] (YARN-4126) RM should not issue delegation tokens in unsecure mode

2016-10-21 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596031#comment-15596031 ] Jian He commented on YARN-4126: --- The delegationToken retrieved from RM in non-secure cluster

[jira] [Commented] (YARN-4882) Change the log level to DEBUG for recovering completed applications

2016-10-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596004#comment-15596004 ] Hadoop QA commented on YARN-4882: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-5750) YARN-4126 broke Oozie on unsecure cluster

2016-10-21 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15595993#comment-15595993 ] Jian He commented on YARN-5750: --- By impersonation, do you mean the hadoop proxy user function

[jira] [Comment Edited] (YARN-5711) AM cannot reconnect to RM after failover when using RequestHedgingRMFailoverProxyProvider

2016-10-21 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15595978#comment-15595978 ] Subru Krishnan edited comment on YARN-5711 at 10/21/16 6:44 PM: -

[jira] [Updated] (YARN-5711) AM cannot reconnect to RM after failover when using RequestHedgingRMFailoverProxyProvider

2016-10-21 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-5711: - Attachment: YARN-5711.v1.1.patch Re-uploading same patch to kick Yetus. > AM cannot reconnect to R

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15595958#comment-15595958 ] Hadoop QA commented on YARN-2009: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-5611) Provide an API to update lifetime of an application.

2016-10-21 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15595938#comment-15595938 ] Rohith Sharma K S commented on YARN-5611: - We (me [~jianhe] and [~vinodkv]) had off

[jira] [Commented] (YARN-5725) Test uncaught exception in TestContainersMonitorResourceChange.testContainersResourceChange when setting IP and host

2016-10-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15595933#comment-15595933 ] Hadoop QA commented on YARN-5725: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-5762) Summarize ApplicationNotFoundException in the RM log

2016-10-21 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15595885#comment-15595885 ] Daniel Templeton commented on YARN-5762: Seems reasonable. I don't think there's e

[jira] [Commented] (YARN-5725) Test uncaught exception in TestContainersMonitorResourceChange.testContainersResourceChange when setting IP and host

2016-10-21 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15595856#comment-15595856 ] Miklos Szegedi commented on YARN-5725: -- I submitted the patch again, since the test au

[jira] [Updated] (YARN-5725) Test uncaught exception in TestContainersMonitorResourceChange.testContainersResourceChange when setting IP and host

2016-10-21 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-5725: - Attachment: YARN-5725.003.patch > Test uncaught exception in > TestContainersMonitorResourceChange

[jira] [Updated] (YARN-4882) Change the log level to DEBUG for recovering completed applications

2016-10-21 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-4882: --- Attachment: YARN-4882.002.patch New patch to address comments. > Change the log level to DEBUG

[jira] [Updated] (YARN-5765) LinuxContainerExecutor creates appcache/{appId} with wrong group owner.

2016-10-21 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-5765: - Description: LinuxContainerExecutor creates usercache/\{userId\}/appcache/\{appId\} with wrong group owner

[jira] [Updated] (YARN-5765) LinuxContainerExecutor creates appcache/{appId} with wrong group owner.

2016-10-21 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-5765: - Description: LinuxContainerExecutor creates usercache/{userId}/appcache/{appId} with wrong group owner, cau

[jira] [Updated] (YARN-5765) LinuxContainerExecutor creates appcache/{appId} with wrong group owner.

2016-10-21 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-5765: - Description: LinuxContainerExecutor creates usercache/\{userId\}/appcache/\{appId\} with wrong group owner,

[jira] [Created] (YARN-5765) LinuxContainerExecutor creates appcache/{appId} with wrong group owner.

2016-10-21 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-5765: Summary: LinuxContainerExecutor creates appcache/{appId} with wrong group owner. Key: YARN-5765 URL: https://issues.apache.org/jira/browse/YARN-5765 Project: Hadoop YARN

[jira] [Updated] (YARN-5716) Add global scheduler interface definition and update CapacityScheduler to use it.

2016-10-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-5716: - Attachment: YARN-5716.006.patch Rebased to latest trunk (006) > Add global scheduler interface definition

[jira] [Commented] (YARN-4126) RM should not issue delegation tokens in unsecure mode

2016-10-21 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15595819#comment-15595819 ] Robert Kanter commented on YARN-4126: - Oozie had previously been always getting a deleg

[jira] [Updated] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-21 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-2009: -- Attachment: YARN-2009.0013.patch New test case has an issue. Fixed. > Priority support for preemption in Proport

[jira] [Updated] (YARN-5264) Store all queue-specific information in FSQueue

2016-10-21 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-5264: --- Component/s: fairscheduler > Store all queue-specific information in FSQueue >

[jira] [Commented] (YARN-5759) Capability to register for a notification/callback on the expiry of timeouts

2016-10-21 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15595494#comment-15595494 ] Rohith Sharma K S commented on YARN-5759: - I believe intention of notification/call

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15595206#comment-15595206 ] Hadoop QA commented on YARN-2009: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-5388) MAPREDUCE-6719 requires changes to DockerContainerExecutor

2016-10-21 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15595189#comment-15595189 ] Varun Vasudev commented on YARN-5388: - Agree with [~templedf] - let's commit the branch

[jira] [Commented] (YARN-5388) MAPREDUCE-6719 requires changes to DockerContainerExecutor

2016-10-21 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15595152#comment-15595152 ] Daniel Templeton commented on YARN-5388: Post MAPREDUCE-6719, the DCE is broken, an

[jira] [Commented] (YARN-5715) introduce entity prefix for return and sort order

2016-10-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15595052#comment-15595052 ] Hadoop QA commented on YARN-5715: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-21 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-2009: -- Attachment: YARN-2009.0012.patch New test case name is {{testPreemptionWithTwoUsers}} I have mocked the user-lim

[jira] [Comment Edited] (YARN-4882) Change the log level to DEBUG for recovering completed applications

2016-10-21 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15595013#comment-15595013 ] Daniel Templeton edited comment on YARN-4882 at 10/21/16 1:06 PM: ---

[jira] [Commented] (YARN-4882) Change the log level to DEBUG for recovering completed applications

2016-10-21 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15595013#comment-15595013 ] Daniel Templeton commented on YARN-4882: That's where I started, but I didn't want

[jira] [Commented] (YARN-4126) RM should not issue delegation tokens in unsecure mode

2016-10-21 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15595010#comment-15595010 ] Jason Lowe commented on YARN-4126: -- I'm just going off of [~rkanter]'s post in the yarn-de

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-21 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15594997#comment-15594997 ] Sunil G commented on YARN-2009: --- [~eepayne], I have added a unit test case which was not adde

[jira] [Updated] (YARN-5715) introduce entity prefix for return and sort order

2016-10-21 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-5715: Attachment: YARN-5715-YARN-5355.06.patch Updated the patch for branch YARN-5355.. I would pre

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-21 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15594971#comment-15594971 ] Eric Payne commented on YARN-2009: -- bq. the test code which i posted was from my unit test