[jira] [Updated] (YARN-7248) NM returns new SCHEDULED container status to older clients

2017-09-27 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7248: -- Target Version/s: 2.9.0, 3.1.0 (was: 2.9.0) > NM returns new SCHEDULED container status to older clients

[jira] [Commented] (YARN-6570) No logs were found for running application, running container

2017-09-27 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16183683#comment-16183683 ] Junping Du commented on YARN-6570: -- Sorry for replying late as on vacation recently and th

[jira] [Commented] (YARN-7260) yarn.router.pipeline.cache-max-size is missing in yarn-default.xml

2017-09-27 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16183659#comment-16183659 ] Rohith Sharma K S commented on YARN-7260: - bq. The test is failing because yarn-def

[jira] [Commented] (YARN-7248) NM returns new SCHEDULED container status to older clients

2017-09-27 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16183654#comment-16183654 ] Junping Du commented on YARN-7248: -- I think we should fix this in 3.0-beta also given roll

[jira] [Updated] (YARN-7248) NM returns new SCHEDULED container status to older clients

2017-09-27 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-7248: - Target Version/s: 2.9.0 (was: 2.9.0, 3.0.0-beta1) > NM returns new SCHEDULED container status to older cli

[jira] [Updated] (YARN-7248) NM returns new SCHEDULED container status to older clients

2017-09-27 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-7248: - Target Version/s: 2.9.0, 3.0.0-beta1 (was: 2.9.0) > NM returns new SCHEDULED container status to older cli

[jira] [Commented] (YARN-4090) Make Collections.sort() more efficient by caching resource usage

2017-09-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16183644#comment-16183644 ] Hadoop QA commented on YARN-4090: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-7262) Add a hierarchy into the ZKRMStateStore for delegation token znodes to prevent jute buffer overflow

2017-09-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16183638#comment-16183638 ] Hadoop QA commented on YARN-7262: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-7252) Removing queue then failing over results in exception

2017-09-27 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-7252: Fix Version/s: YARN-5734 > Removing queue then failing over results in exception > --

[jira] [Updated] (YARN-7251) Misc changes to YARN-5734

2017-09-27 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-7251: Attachment: YARN-7251-YARN-5734.006-final.patch > Misc changes to YARN-5734 > ---

[jira] [Updated] (YARN-4090) Make Collections.sort() more efficient by caching resource usage

2017-09-27 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-4090: --- Affects Version/s: 2.8.1 3.0.0-alpha3 > Make Collections.sort() more efficient by cachin

[jira] [Updated] (YARN-4090) Make Collections.sort() more efficient by caching resource usage

2017-09-27 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-4090: --- Attachment: YARN-4090.009.patch Thanks, [~templedf]. Uploaded the patch v9 for your comments. > Make Collectio

[jira] [Commented] (YARN-6550) Capture launch_container.sh logs

2017-09-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16183578#comment-16183578 ] Hadoop QA commented on YARN-6550: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-7207) Cache the local host name when getting application list in RM

2017-09-27 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16183572#comment-16183572 ] Allen Wittenauer commented on YARN-7207: Actually, let me expand on that a bit, bec

[jira] [Commented] (YARN-7207) Cache the local host name when getting application list in RM

2017-09-27 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16183566#comment-16183566 ] Allen Wittenauer commented on YARN-7207: bq. Single call of getLocalHost is pretty

[jira] [Commented] (YARN-7207) Cache the local host name when getting application list in RM

2017-09-27 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16183554#comment-16183554 ] Yufei Gu commented on YARN-7207: There are different symptoms. Single call of getLocalHost

[jira] [Commented] (YARN-7252) Removing queue then failing over results in exception

2017-09-27 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16183536#comment-16183536 ] Wangda Tan commented on YARN-7252: -- +1, thanks [~jhung]! > Removing queue then failing ov

[jira] [Updated] (YARN-7262) Add a hierarchy into the ZKRMStateStore for delegation token znodes to prevent jute buffer overflow

2017-09-27 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated YARN-7262: Attachment: YARN-7262.001.patch The patch adds the ability to configure a hierarchy like that in YARN

[jira] [Commented] (YARN-7251) Misc changes to YARN-5734

2017-09-27 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16183535#comment-16183535 ] Wangda Tan commented on YARN-7251: -- +1 to the addendum patch, thanks [~jhung]! > Misc cha

[jira] [Commented] (YARN-7207) Cache the local host name when getting application list in RM

2017-09-27 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16183527#comment-16183527 ] Allen Wittenauer commented on YARN-7207: If resolving the local hostname is slow, t

[jira] [Updated] (YARN-6550) Capture launch_container.sh logs

2017-09-27 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-6550: --- Attachment: YARN-6550.branch-2.001.patch Attached patch for branch-2 > Capture launch_containe

[jira] [Commented] (YARN-6625) yarn application -list returns a tracking URL for AM that doesn't work in secured and HA environment

2017-09-27 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16183507#comment-16183507 ] Wangda Tan commented on YARN-6625: -- Thanks [~yufeigu]! > yarn application -list returns a

[jira] [Commented] (YARN-7248) NM returns new SCHEDULED container status to older clients

2017-09-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16183506#comment-16183506 ] Hadoop QA commented on YARN-7248: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-7009) TestNMClient.testNMClientNoCleanupOnStop is flaky by design

2017-09-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16183504#comment-16183504 ] Hadoop QA commented on YARN-7009: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-6550) Capture launch_container.sh logs

2017-09-27 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16183501#comment-16183501 ] Suma Shivaprasad commented on YARN-6550: This patch was tested internally with runs

[jira] [Comment Edited] (YARN-6550) Capture launch_container.sh logs

2017-09-27 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16183501#comment-16183501 ] Suma Shivaprasad edited comment on YARN-6550 at 9/28/17 12:41 AM: ---

[jira] [Commented] (YARN-7191) Improve yarn-service documentation

2017-09-27 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16183498#comment-16183498 ] Billie Rinaldi commented on YARN-7191: -- +1 for patch 04. I will commit with --whitespa

[jira] [Commented] (YARN-2497) Changes for fair scheduler to support allocate resource respect labels

2017-09-27 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16183476#comment-16183476 ] Wangda Tan commented on YARN-2497: -- [~templedf], I found the latest patch changed reports

[jira] [Commented] (YARN-6509) Add a size threshold beyond which yarn logs will require a force option

2017-09-27 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16183474#comment-16183474 ] Wangda Tan commented on YARN-6509: -- [~xgong], Thanks for the patch, several comments re

[jira] [Commented] (YARN-7250) Update Shared cache client api to use URLs

2017-09-27 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16183463#comment-16183463 ] Chris Trezzo commented on YARN-7250: Thank you [~vrushalic] for the review! I will wait

[jira] [Comment Edited] (YARN-7250) Update Shared cache client api to use URLs

2017-09-27 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16183461#comment-16183461 ] Vrushali C edited comment on YARN-7250 at 9/27/17 11:44 PM: +1

[jira] [Commented] (YARN-7250) Update Shared cache client api to use URLs

2017-09-27 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16183461#comment-16183461 ] Vrushali C commented on YARN-7250: -- +1 Patch LGTM with the following understanding: - Th

[jira] [Commented] (YARN-7250) Update Shared cache client api to use URLs

2017-09-27 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16183443#comment-16183443 ] Chris Trezzo commented on YARN-7250: Also to clarify, this is a client side only change

[jira] [Commented] (YARN-7257) AggregatedLogsBlock reports a bad 'end' value as a bad 'start' value

2017-09-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16183407#comment-16183407 ] Hudson commented on YARN-7257: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1298

[jira] [Commented] (YARN-7191) Improve yarn-service documentation

2017-09-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16183393#comment-16183393 ] Hadoop QA commented on YARN-7191: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-7257) AggregatedLogsBlock reports a bad 'end' value as a bad 'start' value

2017-09-27 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16183388#comment-16183388 ] Xuan Gong commented on YARN-7257: - +1. Thanks for the fix, Jason > AggregatedLogsBlock rep

[jira] [Commented] (YARN-2497) Changes for fair scheduler to support allocate resource respect labels

2017-09-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16183386#comment-16183386 ] Hadoop QA commented on YARN-2497: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-6626) Embed REST API service into RM

2017-09-27 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16183343#comment-16183343 ] Jian He commented on YARN-6626: --- Thanks Eric, looks like a few things can be removed in the p

[jira] [Updated] (YARN-7248) NM returns new SCHEDULED container status to older clients

2017-09-27 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7248: -- Attachment: YARN-7248.003.patch Thanks for the rev Jason. Updated the patch (.003) with the changes > NM

[jira] [Commented] (YARN-6871) Add additional deSelects params in RMWebServices#getAppReport

2017-09-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16183337#comment-16183337 ] Hadoop QA commented on YARN-6871: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-7191) Improve yarn-service documentation

2017-09-27 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16183335#comment-16183335 ] Jian He commented on YARN-7191: --- updated the doc again. > Improve yarn-service documentation

[jira] [Updated] (YARN-7191) Improve yarn-service documentation

2017-09-27 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7191: -- Attachment: YARN-7191.yarn-native-services.04.patch > Improve yarn-service documentation > --

[jira] [Commented] (YARN-7207) Cache the local host name when getting application list in RM

2017-09-27 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16183314#comment-16183314 ] Yufei Gu commented on YARN-7207: File YARN-7263 for #2. > Cache the local host name when

[jira] [Updated] (YARN-7009) TestNMClient.testNMClientNoCleanupOnStop is flaky by design

2017-09-27 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7009: - Attachment: YARN-7009.007.patch > TestNMClient.testNMClientNoCleanupOnStop is flaky by design > ---

[jira] [Updated] (YARN-7263) Check host name resolution performance when resource manager starts up

2017-09-27 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-7263: --- Description: According to YARN-7207, host name resolution could be slow in some environment, which affects RM p

[jira] [Created] (YARN-7263) Check host name resolution performance when resource manager starts up

2017-09-27 Thread Yufei Gu (JIRA)
Yufei Gu created YARN-7263: -- Summary: Check host name resolution performance when resource manager starts up Key: YARN-7263 URL: https://issues.apache.org/jira/browse/YARN-7263 Project: Hadoop YARN

[jira] [Commented] (YARN-6625) yarn application -list returns a tracking URL for AM that doesn't work in secured and HA environment

2017-09-27 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16183308#comment-16183308 ] Yufei Gu commented on YARN-6625: [~wangda], not much as I know. May take time to rebase tho

[jira] [Commented] (YARN-7009) TestNMClient.testNMClientNoCleanupOnStop is flaky by design

2017-09-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16183278#comment-16183278 ] Hadoop QA commented on YARN-7009: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-7248) NM returns new SCHEDULED container status to older clients

2017-09-27 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16183279#comment-16183279 ] Jason Lowe commented on YARN-7248: -- Thanks for updating the patch! I believe the unit tes

[jira] [Commented] (YARN-6625) yarn application -list returns a tracking URL for AM that doesn't work in secured and HA environment

2017-09-27 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16183271#comment-16183271 ] Wangda Tan commented on YARN-6625: -- [~yufeigu] / [~rkanter], Thanks for working on this

[jira] [Created] (YARN-7262) Add a hierarchy into the ZKRMStateStore for delegation token znodes to prevent jute buffer overflow

2017-09-27 Thread Robert Kanter (JIRA)
Robert Kanter created YARN-7262: --- Summary: Add a hierarchy into the ZKRMStateStore for delegation token znodes to prevent jute buffer overflow Key: YARN-7262 URL: https://issues.apache.org/jira/browse/YARN-7262

[jira] [Updated] (YARN-6871) Add additional deSelects params in RMWebServices#getAppReport

2017-09-27 Thread Tanuj Nayak (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanuj Nayak updated YARN-6871: -- Attachment: YARN-6871-branch-2.v1.patch My apologies, attached branch2 patch with corrected naming. > Ad

[jira] [Commented] (YARN-6871) Add additional deSelects params in RMWebServices#getAppReport

2017-09-27 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16183230#comment-16183230 ] Giovanni Matteo Fumarola commented on YARN-6871: Thanks [~tanujnay] for the

[jira] [Commented] (YARN-7190) Ensure only NM classpath in 2.x gets TSv2 related hbase jars, not the user classpath

2017-09-27 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16183228#comment-16183228 ] Jason Lowe commented on YARN-7190: -- My personal preference would be to remove any new jar

[jira] [Commented] (YARN-6871) Add additional deSelects params in RMWebServices#getAppReport

2017-09-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16183208#comment-16183208 ] Hadoop QA commented on YARN-6871: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-2497) Changes for fair scheduler to support allocate resource respect labels

2017-09-27 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-2497: --- Attachment: YARN-2497.007.patch CS is doing what you described, but FS is seeing {{NODE_LABEL_

[jira] [Updated] (YARN-6871) Add additional deSelects params in RMWebServices#getAppReport

2017-09-27 Thread Tanuj Nayak (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanuj Nayak updated YARN-6871: -- Attachment: YARN-6871.009.patch > Add additional deSelects params in RMWebServices#getAppReport > ---

[jira] [Commented] (YARN-7241) Merge YARN-5734 to trunk/branch-2

2017-09-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16183194#comment-16183194 ] Hadoop QA commented on YARN-7241: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-6626) Embed REST API service into RM

2017-09-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16183184#comment-16183184 ] Hadoop QA commented on YARN-6626: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-7216) Missing ability to list configuration vs status

2017-09-27 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7216: Description: API Server has /ws/v1/services/{service_name}. This REST end point returns Services object whi

[jira] [Commented] (YARN-2497) Changes for fair scheduler to support allocate resource respect labels

2017-09-27 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16183134#comment-16183134 ] Wangda Tan commented on YARN-2497: -- [~templedf], could you check my comment above: https:

[jira] [Commented] (YARN-7190) Ensure only NM classpath in 2.x gets TSv2 related hbase jars, not the user classpath

2017-09-27 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16183131#comment-16183131 ] Varun Saxena commented on YARN-7190: Before updating a patch, thought of taking an opin

[jira] [Updated] (YARN-6059) Update paused container state in the NM state store

2017-09-27 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-6059: - Fix Version/s: (was: 3.0.0) 3.1.0 > Update paused container state in the NM state st

[jira] [Updated] (YARN-5216) Expose configurable preemption policy for OPPORTUNISTIC containers running on the NM

2017-09-27 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-5216: - Fix Version/s: 3.1.0 2.9.0 > Expose configurable preemption policy for OPPORTUNISTIC con

[jira] [Updated] (YARN-5292) NM Container lifecycle and state transitions to support for PAUSED container state.

2017-09-27 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-5292: - Fix Version/s: 3.1.0 2.9.0 > NM Container lifecycle and state transitions to support for

[jira] [Created] (YARN-7261) Add debug message in class FSDownload for better download latency monitoring

2017-09-27 Thread Yufei Gu (JIRA)
Yufei Gu created YARN-7261: -- Summary: Add debug message in class FSDownload for better download latency monitoring Key: YARN-7261 URL: https://issues.apache.org/jira/browse/YARN-7261 Project: Hadoop YARN

[jira] [Commented] (YARN-7253) Shared Cache Manager daemon command listed as admin subcmd in yarn script

2017-09-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16183082#comment-16183082 ] Hudson commented on YARN-7253: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1298

[jira] [Updated] (YARN-7009) TestNMClient.testNMClientNoCleanupOnStop is flaky by design

2017-09-27 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7009: - Attachment: YARN-7009.006.patch > TestNMClient.testNMClientNoCleanupOnStop is flaky by design > ---

[jira] [Commented] (YARN-7260) yarn.router.pipeline.cache-max-size is missing in yarn-default.xml

2017-09-27 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16183071#comment-16183071 ] Giovanni Matteo Fumarola commented on YARN-7260: Thanks [~jlowe] for taking

[jira] [Commented] (YARN-2497) Changes for fair scheduler to support allocate resource respect labels

2017-09-27 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16183070#comment-16183070 ] Daniel Templeton commented on YARN-2497: The opportunistic containers test that fai

[jira] [Commented] (YARN-2497) Changes for fair scheduler to support allocate resource respect labels

2017-09-27 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16183056#comment-16183056 ] Daniel Templeton commented on YARN-2497: Remaining checkstyle issues are bogus. Lo

[jira] [Commented] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-09-27 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16183050#comment-16183050 ] Andrew Wang commented on YARN-6623: --- Folks, this is currently marked as the last blocker

[jira] [Commented] (YARN-7248) NM returns new SCHEDULED container status to older clients

2017-09-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16183043#comment-16183043 ] Hadoop QA commented on YARN-7248: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-2497) Changes for fair scheduler to support allocate resource respect labels

2017-09-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16183033#comment-16183033 ] Hadoop QA commented on YARN-2497: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-7259) add rolling policy to LogAggregationIndexedFileController

2017-09-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16183024#comment-16183024 ] Hadoop QA commented on YARN-7259: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-7251) Misc changes to YARN-5734

2017-09-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16183009#comment-16183009 ] Hadoop QA commented on YARN-7251: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-7244) ShuffleHandler is not aware of disks that are added

2017-09-27 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16183000#comment-16183000 ] Jason Lowe commented on YARN-7244: -- bq. Only potential issue which I see is that, once a s

[jira] [Commented] (YARN-6626) Embed REST API service into RM

2017-09-27 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16182918#comment-16182918 ] Eric Yang commented on YARN-6626: - [~gsaha] RM hardcoded the Jersey initialization code usi

[jira] [Updated] (YARN-6626) Embed REST API service into RM

2017-09-27 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-6626: Attachment: YARN-6626.yarn-native-services.009.patch - Removed "extends WebService" from ApiServer class type

[jira] [Comment Edited] (YARN-6182) [YARN-3368] Fix alignment issues and missing information in queue pages

2017-09-27 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16182908#comment-16182908 ] Sunil G edited comment on YARN-6182 at 9/27/17 5:05 PM: +1 Committi

[jira] [Commented] (YARN-6182) [YARN-3368] Fix alignment issues and missing information in queue pages

2017-09-27 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16182908#comment-16182908 ] Sunil G commented on YARN-6182: --- +1 Comitting tomorrow if no objections. > [YARN-3368] Fix a

[jira] [Commented] (YARN-6373) [YARN-3368] Improvements in cluster-overview page in YARN-UI

2017-09-27 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16182906#comment-16182906 ] Sunil G commented on YARN-6373: --- [~GergelyNovak], changes seems fine. Could you please help t

[jira] [Comment Edited] (YARN-7202) End-to-end UT for api-server

2017-09-27 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16182886#comment-16182886 ] Eric Yang edited comment on YARN-7202 at 9/27/17 5:02 PM: -- [~jianh

[jira] [Updated] (YARN-7259) add rolling policy to LogAggregationIndexedFileController

2017-09-27 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-7259: Attachment: YARN-7259.1.patch > add rolling policy to LogAggregationIndexedFileController > -

[jira] [Commented] (YARN-7202) End-to-end UT for api-server

2017-09-27 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16182886#comment-16182886 ] Eric Yang commented on YARN-7202: - [~jianhe] In the example that you provided, it is showin

[jira] [Comment Edited] (YARN-7207) Cache the local host name when getting application list in RM

2017-09-27 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16182871#comment-16182871 ] Robert Kanter edited comment on YARN-7207 at 9/27/17 4:47 PM: --

[jira] [Commented] (YARN-7207) Cache the local host name when getting application list in RM

2017-09-27 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16182871#comment-16182871 ] Robert Kanter commented on YARN-7207: - +1 LGTM > Cache the local host name when gettin

[jira] [Assigned] (YARN-7205) Log improvements for the ResourceUtils

2017-09-27 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G reassigned YARN-7205: - Assignee: Sunil G > Log improvements for the ResourceUtils > -- > >

[jira] [Commented] (YARN-7260) yarn.router.pipeline.cache-max-size is missing in yarn-default.xml

2017-09-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16182820#comment-16182820 ] Hadoop QA commented on YARN-7260: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-7244) ShuffleHandler is not aware of disks that are added

2017-09-27 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16182720#comment-16182720 ] Sunil G commented on YARN-7244: --- Thanks [~jlowe] for adding more clarity on this. 'pull' mod

[jira] [Commented] (YARN-7244) ShuffleHandler is not aware of disks that are added

2017-09-27 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16182678#comment-16182678 ] Jason Lowe commented on YARN-7244: -- Thanks for the patch! The core issue here is that the

[jira] [Commented] (YARN-6871) Add additional deSelects params in RMWebServices#getAppReport

2017-09-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16182659#comment-16182659 ] Hudson commented on YARN-6871: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1298

[jira] [Commented] (YARN-7241) Merge YARN-5734 to trunk/branch-2

2017-09-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16182658#comment-16182658 ] Hadoop QA commented on YARN-7241: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-7260) yarn.router.pipeline.cache-max-size is missing in yarn-default.xml

2017-09-27 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-7260: - Attachment: YARN-7260-branch-2.001.patch Attaching a patch that fixes the missed rename in yarn-default.xml

[jira] [Updated] (YARN-7260) yarn.router.pipeline.cache-max-size is missing in yarn-default.xml

2017-09-27 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-7260: - Affects Version/s: 2.9.0 Target Version/s: 2.9.0 Summary: yarn.router.pipeline.cache-max-

[jira] [Assigned] (YARN-7260) yarn.router,.

2017-09-27 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned YARN-7260: Assignee: Jason Lowe Summary: yarn.router,. (was: TestYarnConfigurationFields fails in branch-

[jira] [Updated] (YARN-7248) NM returns new SCHEDULED container status to older clients

2017-09-27 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7248: -- Attachment: YARN-7248.002.patch Updating patch (v002) per discussion. > NM returns new SCHEDULED contain

[jira] [Commented] (YARN-7248) NM returns new SCHEDULED container status to older clients

2017-09-27 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16182572#comment-16182572 ] Arun Suresh commented on YARN-7248: --- Thanks for the reviews [~leftnoteasy] and [~jlowe]

[jira] [Commented] (YARN-7237) Cleanup usages of ResourceProfiles

2017-09-27 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16182515#comment-16182515 ] Daniel Templeton commented on YARN-7237: My comments: # Rather than creating our o

[jira] [Commented] (YARN-7251) Misc changes to YARN-5734

2017-09-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16182487#comment-16182487 ] Hadoop QA commented on YARN-7251: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

  1   2   >