[jira] [Commented] (YARN-7275) NM Statestore cleanup for Container updates

2017-10-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201473#comment-16201473 ] Hadoop QA commented on YARN-7275: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7198) Add jsvc support for RegistryDNS

2017-10-11 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201458#comment-16201458 ] Jian He commented on YARN-7198: --- Thanks, I'll check these. > Add jsvc support for RegistryDNS >

[jira] [Commented] (YARN-7202) Add UT for api-server

2017-10-11 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201456#comment-16201456 ] Jian He commented on YARN-7202: --- lgtm overall, minor comments: How about rename setApiServer to

[jira] [Comment Edited] (YARN-7202) Add UT for api-server

2017-10-11 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201456#comment-16201456 ] Jian He edited comment on YARN-7202 at 10/12/17 5:18 AM: - lgtm overall, minor

[jira] [Commented] (YARN-7198) Add jsvc support for RegistryDNS

2017-10-11 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201450#comment-16201450 ] Allen Wittenauer commented on YARN-7198: I'm still fighting to get this running, but a few things

[jira] [Updated] (YARN-7170) Investigate bower dependencies for YARN UI v2

2017-10-11 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-7170: --- Attachment: YARN-7170.002.patch -02: * upgrade frontend-maven-plugin * also move it's version

[jira] [Commented] (YARN-6492) Generate queue metrics for each partition

2017-10-11 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201432#comment-16201432 ] Manikandan R commented on YARN-6492: Sorry for the delay. Had a offline discussions with

[jira] [Updated] (YARN-6492) Generate queue metrics for each partition

2017-10-11 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R updated YARN-6492: --- Attachment: partition_metrics.txt > Generate queue metrics for each partition >

[jira] [Commented] (YARN-6608) Backport all SLS improvements from trunk to branch-2

2017-10-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201437#comment-16201437 ] Wangda Tan commented on YARN-6608: -- [~curino], my pleasure. 1) For test case: Most test cases are failed

[jira] [Updated] (YARN-6608) Backport all SLS improvements from trunk to branch-2

2017-10-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-6608: - Attachment: YARN-6608-branch-2.v6.patch > Backport all SLS improvements from trunk to branch-2 >

[jira] [Updated] (YARN-7275) NM Statestore cleanup for Container updates

2017-10-11 Thread kartheek muthyala (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kartheek muthyala updated YARN-7275: Attachment: YARN-7275.003.patch Sorry [~asuresh], couldn't reply to you earlier on this.

[jira] [Commented] (YARN-7317) Fix overallocation resulted from ceiling in LocalityMulticastAMRMProxyPolicy

2017-10-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201414#comment-16201414 ] Hadoop QA commented on YARN-7317: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-7318) Fix shell check warnings of SLS.

2017-10-11 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-7318: Summary: Fix shell check warnings of SLS. Key: YARN-7318 URL: https://issues.apache.org/jira/browse/YARN-7318 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-7317) Fix overallocation resulted from ceiling in LocalityMulticastAMRMProxyPolicy

2017-10-11 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-7317: --- Attachment: YARN-7317.v4.patch > Fix overallocation resulted from ceiling in

[jira] [Commented] (YARN-7244) ShuffleHandler is not aware of disks that are added

2017-10-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201392#comment-16201392 ] Hadoop QA commented on YARN-7244: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7317) Fix overallocation resulted from ceiling in LocalityMulticastAMRMProxyPolicy

2017-10-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201362#comment-16201362 ] Hadoop QA commented on YARN-7317: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6523) Newly retrieved security Tokens are sent as part of each heartbeat to each node from RM which is not desirable in large cluster

2017-10-11 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-6523: Summary: Newly retrieved security Tokens are sent as part of each heartbeat to each node

[jira] [Comment Edited] (YARN-6856) Support CLI for Node Attributes Mapping

2017-10-11 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201354#comment-16201354 ] Naganarasimha G R edited comment on YARN-6856 at 10/12/17 2:30 AM: ---

[jira] [Commented] (YARN-6856) Support CLI for Node Attributes Mapping

2017-10-11 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201354#comment-16201354 ] Naganarasimha G R commented on YARN-6856: - [~sunilg], I > Support CLI for Node Attributes Mapping

[jira] [Commented] (YARN-6608) Backport all SLS improvements from trunk to branch-2

2017-10-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201351#comment-16201351 ] Hadoop QA commented on YARN-6608: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7202) Add UT for api-server

2017-10-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201327#comment-16201327 ] Hadoop QA commented on YARN-7202: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7317) Fix overallocation resulted from ceiling in LocalityMulticastAMRMProxyPolicy

2017-10-11 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-7317: --- Attachment: YARN-7317.v3.patch > Fix overallocation resulted from ceiling in

[jira] [Commented] (YARN-7317) Fix overallocation resulted from ceiling in LocalityMulticastAMRMProxyPolicy

2017-10-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201306#comment-16201306 ] Hadoop QA commented on YARN-7317: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7244) ShuffleHandler is not aware of disks that are added

2017-10-11 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-7244: -- Attachment: YARN-7244.004.patch Rebasing patch on trunk. > ShuffleHandler is not aware of disks that

[jira] [Commented] (YARN-6457) Allow custom SSL configuration to be supplied in WebApps

2017-10-11 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201287#comment-16201287 ] Robert Kanter commented on YARN-6457: - Sorry for raising the alarm - we're still looking into this, but

[jira] [Commented] (YARN-7169) Backport new yarn-ui to branch2 code (starting with YARN-5355_branch2)

2017-10-11 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201278#comment-16201278 ] Sunil G commented on YARN-7169: --- [~vrushalic] for UI, we need maven 3.3 as a minimum version. We use

[jira] [Updated] (YARN-7317) Fix overallocation resulted from ceiling in LocalityMulticastAMRMProxyPolicy

2017-10-11 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-7317: --- Attachment: YARN-7317.v2.patch Thanks [~curino] for the review, v2 patch uploaded. > Fix

[jira] [Commented] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-10-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201275#comment-16201275 ] Wangda Tan commented on YARN-4511: -- Thanks Haibo, applogize for my late responses, was busy with other

[jira] [Commented] (YARN-7269) Tracking URL in the app state does not get redirected to ApplicationMaster for Running applications

2017-10-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201274#comment-16201274 ] Hadoop QA commented on YARN-7269: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6608) Backport all SLS improvements from trunk to branch-2

2017-10-11 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201272#comment-16201272 ] Carlo Curino commented on YARN-6608: Awesome! [~wangda], thanks for the help, hopefully we can make it

[jira] [Commented] (YARN-6546) SLS is slow while loading 10k queues

2017-10-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201259#comment-16201259 ] Hadoop QA commented on YARN-6546: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7202) Add UT for api-server

2017-10-11 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7202: Attachment: YARN-7202.yarn-native-services.013.patch Removed integration test until updateService API is

[jira] [Commented] (YARN-7269) Tracking URL in the app state does not get redirected to ApplicationMaster for Running applications

2017-10-11 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201248#comment-16201248 ] Jian He commented on YARN-7269: --- lgtm > Tracking URL in the app state does not get redirected to

[jira] [Commented] (YARN-5926) clean up registry code for java 7/8

2017-10-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201246#comment-16201246 ] Hadoop QA commented on YARN-5926: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7291) Better input parsing for resource in allocation file

2017-10-11 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-7291: --- Labels: newbie (was: ) > Better input parsing for resource in allocation file >

[jira] [Commented] (YARN-4858) start-yarn and stop-yarn scripts to support timeline and sharedcachemanager

2017-10-11 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201231#comment-16201231 ] Subru Krishnan commented on YARN-4858: -- Pushing it out from 2.9.0 due to lack of recent activity. Feel

[jira] [Comment Edited] (YARN-7170) Investigate bower dependencies for YARN UI v2

2017-10-11 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201243#comment-16201243 ] Subru Krishnan edited comment on YARN-7170 at 10/11/17 11:57 PM: -

[jira] [Commented] (YARN-7170) Investigate bower dependencies for YARN UI v2

2017-10-11 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201243#comment-16201243 ] Subru Krishnan commented on YARN-7170: -- @sunil G/[~akhilpb], do you intend to get this for 2.9.0 as it

[jira] [Commented] (YARN-3861) Add fav icon to YARN & MR daemons web UI

2017-10-11 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201228#comment-16201228 ] Subru Krishnan commented on YARN-3861: -- Pushing it out from 2.9.0 due to lack of recent activity. Feel

[jira] [Commented] (YARN-2748) Upload logs in the sub-folders under the local log dir when aggregating logs

2017-10-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201242#comment-16201242 ] Hadoop QA commented on YARN-2748: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-3625) RollingLevelDBTimelineStore Incorrectly Forbids Related Entity in Same Put

2017-10-11 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-3625: - Target Version/s: 3.1.0 (was: 2.9.0) > RollingLevelDBTimelineStore Incorrectly Forbids Related

[jira] [Commented] (YARN-3625) RollingLevelDBTimelineStore Incorrectly Forbids Related Entity in Same Put

2017-10-11 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201226#comment-16201226 ] Subru Krishnan commented on YARN-3625: -- Pushing it out from 2.9.0 due to lack of recent activity. Feel

[jira] [Commented] (YARN-5926) clean up registry code for java 7/8

2017-10-11 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201237#comment-16201237 ] Subru Krishnan commented on YARN-5926: -- Pushing it out from 2.9.0 due to lack of recent activity. Feel

[jira] [Commented] (YARN-4988) Limit filter in ApplicationBaseProtocol#getApplications should return latest applications

2017-10-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201236#comment-16201236 ] Hadoop QA commented on YARN-4988: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5926) clean up registry code for java 7/8

2017-10-11 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-5926: - Target Version/s: 3.0.0 (was: 2.9.0) > clean up registry code for java 7/8 >

[jira] [Commented] (YARN-4988) Limit filter in ApplicationBaseProtocol#getApplications should return latest applications

2017-10-11 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201234#comment-16201234 ] Subru Krishnan commented on YARN-4988: -- [~rohithsharma], this looks relevant so are you still

[jira] [Updated] (YARN-3861) Add fav icon to YARN & MR daemons web UI

2017-10-11 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-3861: - Target Version/s: 3.0.0 (was: 3.1.0) > Add fav icon to YARN & MR daemons web UI >

[jira] [Updated] (YARN-4858) start-yarn and stop-yarn scripts to support timeline and sharedcachemanager

2017-10-11 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-4858: - Target Version/s: 2.9.1 (was: 2.9.0) > start-yarn and stop-yarn scripts to support timeline and

[jira] [Updated] (YARN-7269) Tracking URL in the app state does not get redirected to ApplicationMaster for Running applications

2017-10-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7269: - Attachment: YARN-7269.addendum.002.patch Attached ver.2 addendum patch fixed unit test failures. >

[jira] [Commented] (YARN-4721) RM to try to auth with HDFS on startup, retry with max diagnostics on failure

2017-10-11 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201229#comment-16201229 ] Subru Krishnan commented on YARN-4721: -- Pushing it out from 2.9.0 due to lack of recent activity. Feel

[jira] [Updated] (YARN-4721) RM to try to auth with HDFS on startup, retry with max diagnostics on failure

2017-10-11 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-4721: - Target Version/s: 3.1.0 (was: 2.9.0) > RM to try to auth with HDFS on startup, retry with max

[jira] [Updated] (YARN-3861) Add fav icon to YARN & MR daemons web UI

2017-10-11 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-3861: - Target Version/s: 3.1.0 (was: 2.9.0) > Add fav icon to YARN & MR daemons web UI >

[jira] [Updated] (YARN-3514) Active directory usernames like domain\login cause YARN failures

2017-10-11 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-3514: - Target Version/s: 3.1.0 (was: 2.9.0) > Active directory usernames like domain\login cause YARN

[jira] [Commented] (YARN-3514) Active directory usernames like domain\login cause YARN failures

2017-10-11 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201218#comment-16201218 ] Subru Krishnan commented on YARN-3514: -- Pushing it out from 2.9.0 due to lack of recent activity. Feel

[jira] [Commented] (YARN-2748) Upload logs in the sub-folders under the local log dir when aggregating logs

2017-10-11 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201217#comment-16201217 ] Subru Krishnan commented on YARN-2748: -- Pushing it out from 2.9.0 due to lack of recent activity. Feel

[jira] [Updated] (YARN-2748) Upload logs in the sub-folders under the local log dir when aggregating logs

2017-10-11 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-2748: - Target Version/s: 3.1.0 (was: 2.9.0) > Upload logs in the sub-folders under the local log dir

[jira] [Updated] (YARN-2681) Support bandwidth enforcement for containers while reading from HDFS

2017-10-11 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-2681: - Target Version/s: 3.1.0 (was: 2.9.0) > Support bandwidth enforcement for containers while reading

[jira] [Commented] (YARN-2681) Support bandwidth enforcement for containers while reading from HDFS

2017-10-11 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201215#comment-16201215 ] Subru Krishnan commented on YARN-2681: -- Pushing it out from 2.9.0 due to lack of recent activity &

[jira] [Commented] (YARN-1564) add workflow YARN services

2017-10-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201212#comment-16201212 ] Hadoop QA commented on YARN-1564: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-2031) YARN Proxy model doesn't support REST APIs in AMs

2017-10-11 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201213#comment-16201213 ] Subru Krishnan commented on YARN-2031: -- Pushing it out from 2.9.0 due to lack of recent activity. Feel

[jira] [Updated] (YARN-2031) YARN Proxy model doesn't support REST APIs in AMs

2017-10-11 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-2031: - Target Version/s: 3.1.0 (was: 2.9.0) > YARN Proxy model doesn't support REST APIs in AMs >

[jira] [Updated] (YARN-1564) add workflow YARN services

2017-10-11 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-1564: - Target Version/s: 3.1.0 (was: 2.9.0) > add workflow YARN services > -- >

[jira] [Commented] (YARN-574) PrivateLocalizer does not support parallel resource download via ContainerLocalizer

2017-10-11 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201200#comment-16201200 ] Subru Krishnan commented on YARN-574: - Pushing it out from 2.9.0 due to lack of recent activity. Feel

[jira] [Commented] (YARN-1564) add workflow YARN services

2017-10-11 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201203#comment-16201203 ] Subru Krishnan commented on YARN-1564: -- Pushing it out from 2.9.0 due to apparent complexity & lack of

[jira] [Updated] (YARN-6608) Backport all SLS improvements from trunk to branch-2

2017-10-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-6608: - Attachment: YARN-6608-branch-2.v5.patch Attached ver.5 patch, fixed compilation issues and ASF warnings,

[jira] [Updated] (YARN-574) PrivateLocalizer does not support parallel resource download via ContainerLocalizer

2017-10-11 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-574: Target Version/s: 3.1.0 (was: 2.9.0) > PrivateLocalizer does not support parallel resource download

[jira] [Commented] (YARN-7205) Log improvements for the ResourceUtils

2017-10-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201193#comment-16201193 ] Hudson commented on YARN-7205: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13076 (See

[jira] [Commented] (YARN-7244) ShuffleHandler is not aware of disks that are added

2017-10-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201163#comment-16201163 ] Hadoop QA commented on YARN-7244: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6546) SLS is slow while loading 10k queues

2017-10-11 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6546: --- Attachment: YARN-6546.002.patch Thanks for the review, [~miklos.szeg...@cloudera.com]. Uploaded patch v2 for

[jira] [Commented] (YARN-7169) Backport new yarn-ui to branch2 code (starting with YARN-5355_branch2)

2017-10-11 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201137#comment-16201137 ] Vrushali C commented on YARN-7169: -- Hmm, I see this build error on jenkins: {code} [ERROR] Failed to

[jira] [Commented] (YARN-7224) Support GPU isolation for docker container

2017-10-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201127#comment-16201127 ] Hadoop QA commented on YARN-7224: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7169) Backport new yarn-ui to branch2 code (starting with YARN-5355_branch2)

2017-10-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201125#comment-16201125 ] Hadoop QA commented on YARN-7169: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7286) Add support for docker to have no capabilities

2017-10-11 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201121#comment-16201121 ] Sidharta Seethana commented on YARN-7286: - Agreed, we shouldn't be changing that behavior at this

[jira] [Updated] (YARN-7244) ShuffleHandler is not aware of disks that are added

2017-10-11 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-7244: -- Attachment: YARN-7244.003.patch Updated patch closer to the design Jason mentioned earlier. Adds a new

[jira] [Commented] (YARN-7307) Revisit resource-types.xml loading behaviors

2017-10-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201076#comment-16201076 ] Wangda Tan commented on YARN-7307: -- Also, instead of adding new dynamic resources fields to ResourceUtils,

[jira] [Commented] (YARN-7317) Fix overallocation resulted from ceiling in LocalityMulticastAMRMProxyPolicy

2017-10-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201072#comment-16201072 ] Hadoop QA commented on YARN-7317: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7307) Revisit resource-types.xml loading behaviors

2017-10-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201070#comment-16201070 ] Wangda Tan commented on YARN-7307: -- [~sunilg], Thanks for working on the patch, several

[jira] [Commented] (YARN-7317) Fix overallocation resulted from ceiling in LocalityMulticastAMRMProxyPolicy

2017-10-11 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201024#comment-16201024 ] Carlo Curino commented on YARN-7317: Thanks [~botong] for the improvement. The patch generally looks

[jira] [Commented] (YARN-6744) Recover component information on YARN native services AM restart

2017-10-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201020#comment-16201020 ] Hadoop QA commented on YARN-6744: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-7127) Merge yarn-native-service branch into trunk

2017-10-11 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16200989#comment-16200989 ] Gour Saha edited comment on YARN-7127 at 10/11/17 9:28 PM: --- I totally agree with

[jira] [Commented] (YARN-7127) Merge yarn-native-service branch into trunk

2017-10-11 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16200989#comment-16200989 ] Gour Saha commented on YARN-7127: - I totally agree with [~jianhe]'s comment above. It is not as simple as

[jira] [Commented] (YARN-7286) Add support for docker to have no capabilities

2017-10-11 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16200987#comment-16200987 ] Jason Lowe commented on YARN-7286: -- I suspect the behavior difference stems from the different handling of

[jira] [Resolved] (YARN-4122) Add support for GPU as a resource

2017-10-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan resolved YARN-4122. -- Resolution: Duplicate This is duplicated by YARN-6620, closing as dup. > Add support for GPU as a

[jira] [Updated] (YARN-4599) Set OOM control for memory cgroups

2017-10-11 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-4599: -- Issue Type: Sub-task (was: Bug) Parent: YARN-1747 > Set OOM control for

[jira] [Updated] (YARN-7317) Fix overallocation resulted from ceiling in LocalityMulticastAMRMProxyPolicy

2017-10-11 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-7317: --- Attachment: YARN-7317.v1.patch > Fix overallocation resulted from ceiling in

[jira] [Commented] (YARN-6668) Use cgroup to get container resource utilization

2017-10-11 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16200971#comment-16200971 ] Vinod Kumar Vavilapalli commented on YARN-6668: --- Haven't looked into the patch, but how does

[jira] [Commented] (YARN-7127) Merge yarn-native-service branch into trunk

2017-10-11 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16200955#comment-16200955 ] Jian He commented on YARN-7127: --- [~eyang], This is just one of the reasons. There more reasons from design

[jira] [Updated] (YARN-6744) Recover component information on YARN native services AM restart

2017-10-11 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-6744: - Attachment: YARN-6744-yarn-native-services.004.patch Fix unit test failure. > Recover component

[jira] [Comment Edited] (YARN-7286) Add support for docker to have no capabilities

2017-10-11 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16200904#comment-16200904 ] Sidharta Seethana edited comment on YARN-7286 at 10/11/17 8:30 PM: --- The

[jira] [Commented] (YARN-7286) Add support for docker to have no capabilities

2017-10-11 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16200904#comment-16200904 ] Sidharta Seethana commented on YARN-7286: - The {{DEFAULT_NM_DOCKER_CONTAINER_CAPABILITIES}} list

[jira] [Commented] (YARN-6940) FairScheduler: Enable Container update CodePaths and container resize testcase

2017-10-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16200882#comment-16200882 ] Hadoop QA commented on YARN-6940: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6620) Add support in NodeManager to isolate GPU devices by using CGroups

2017-10-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16200864#comment-16200864 ] Wangda Tan commented on YARN-6620: -- Thanks [~sunilg] for committing the patch, thanks

[jira] [Commented] (YARN-7169) Backport new yarn-ui to branch2 code (starting with YARN-5355_branch2)

2017-10-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16200805#comment-16200805 ] Hadoop QA commented on YARN-7169: - (!) A patch to the testing environment has been detected. Re-executing

[jira] [Created] (YARN-7317) Fix overallocation resulted from ceiling in LocalityMulticastAMRMProxyPolicy

2017-10-11 Thread Botong Huang (JIRA)
Botong Huang created YARN-7317: -- Summary: Fix overallocation resulted from ceiling in LocalityMulticastAMRMProxyPolicy Key: YARN-7317 URL: https://issues.apache.org/jira/browse/YARN-7317 Project: Hadoop

[jira] [Updated] (YARN-7169) Backport new yarn-ui to branch2 code (starting with YARN-5355_branch2)

2017-10-11 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-7169: - Attachment: YARN-7169-YARN-5355_branch2.0002.patch Uploading YARN-7169-YARN-5355_branch2.0002.patch after

[jira] [Updated] (YARN-7169) Backport new yarn-ui to branch2 code (starting with YARN-5355_branch2)

2017-10-11 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-7169: - Attachment: ui_commits(1) Attaching list of commits that I have backported in file "ui_commits(1)" >

[jira] [Commented] (YARN-6620) Add support in NodeManager to isolate GPU devices by using CGroups

2017-10-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16200723#comment-16200723 ] Hudson commented on YARN-6620: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #13073 (See

[jira] [Updated] (YARN-7169) Backport new yarn-ui to branch2 code (starting with YARN-5355_branch2)

2017-10-11 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-7169: - Attachment: YARN-7190-YARN-5355_branch2.01.patch Uploading patch 002 now. I have backported all the

[jira] [Updated] (YARN-7169) Backport new yarn-ui to branch2 code (starting with YARN-5355_branch2)

2017-10-11 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-7169: - Attachment: (was: YARN-7190-YARN-5355_branch2.01.patch) > Backport new yarn-ui to branch2 code

[jira] [Commented] (YARN-7190) Ensure only NM classpath in 2.x gets TSv2 related hbase jars, not the user classpath

2017-10-11 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16200714#comment-16200714 ] Vrushali C commented on YARN-7190: -- I applied the patch file. I had to ignore the yarn.cmd changes due to

  1   2   >