[jira] [Created] (YARN-8862) [GPG] add Yarn Registry cleanup in ApplicationCleaner

2018-10-09 Thread Botong Huang (JIRA)
Botong Huang created YARN-8862: -- Summary: [GPG] add Yarn Registry cleanup in ApplicationCleaner Key: YARN-8862 URL: https://issues.apache.org/jira/browse/YARN-8862 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-8862) [GPG] add Yarn Registry cleanup in ApplicationCleaner

2018-10-09 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8862: --- Issue Type: Sub-task (was: Task) Parent: YARN-7402 > [GPG] add Yarn Registry cleanup in

[jira] [Commented] (YARN-7225) Add queue and partition info to RM audit log

2018-10-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644243#comment-16644243 ] Hadoop QA commented on YARN-7225: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8569) Create an interface to provide cluster information to application

2018-10-09 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644277#comment-16644277 ] Eric Yang commented on YARN-8569: - {quote} 1) We use use set_user before the method to drop privileges.

[jira] [Comment Edited] (YARN-8569) Create an interface to provide cluster information to application

2018-10-09 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644277#comment-16644277 ] Eric Yang edited comment on YARN-8569 at 10/10/18 12:25 AM: {quote} 1) We use

[jira] [Updated] (YARN-8862) [GPG] add Yarn Registry cleanup in ApplicationCleaner

2018-10-09 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8862: --- Attachment: YARN-8862-YARN-7402.v2.patch > [GPG] add Yarn Registry cleanup in ApplicationCleaner >

[jira] [Commented] (YARN-8842) Update QueueMetrics with custom resource values

2018-10-09 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644473#comment-16644473 ] Wilfred Spiegelenburg commented on YARN-8842: - Thank you [~snemeth]. I am glad we gave this

[jira] [Comment Edited] (YARN-8842) Update QueueMetrics with custom resource values

2018-10-09 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644473#comment-16644473 ] Wilfred Spiegelenburg edited comment on YARN-8842 at 10/10/18 5:29 AM:

[jira] [Commented] (YARN-8842) Update QueueMetrics with custom resource values

2018-10-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644482#comment-16644482 ] Hadoop QA commented on YARN-8842: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

2018-10-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644491#comment-16644491 ] Hadoop QA commented on YARN-8858: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

2018-10-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8858: -- Fix Version/s: 3.0.4 > CapacityScheduler should respect maximum node resource when per-queue >

[jira] [Reopened] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

2018-10-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reopened YARN-8858: --- > CapacityScheduler should respect maximum node resource when per-queue > maximum-allocation is being

[jira] [Commented] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

2018-10-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644375#comment-16644375 ] Weiwei Yang commented on YARN-8858: --- Hi [~leftnoteasy], the patch has conflict to branch-2.8, could you

[jira] [Commented] (YARN-8842) Update QueueMetrics with custom resource values

2018-10-09 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644398#comment-16644398 ] Szilard Nemeth commented on YARN-8842: -- patch008 fixes a missing null check > Update QueueMetrics

[jira] [Updated] (YARN-8842) Update QueueMetrics with custom resource values

2018-10-09 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8842: - Attachment: YARN-8842.008.patch > Update QueueMetrics with custom resource values >

[jira] [Commented] (YARN-8827) Plumb per application resource utilization from the NM to RM

2018-10-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644410#comment-16644410 ] Arun Suresh commented on YARN-8827: --- Thanks for the review [~elgoiri]. Committing this.. > Plumb per

[jira] [Reopened] (YARN-8468) Enable the use of queue based maximum container allocation limit and implement it in FairScheduler

2018-10-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reopened YARN-8468: --- > Enable the use of queue based maximum container allocation limit and > implement it in FairScheduler >

[jira] [Commented] (YARN-8569) Create an interface to provide cluster information to application

2018-10-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644427#comment-16644427 ] Wangda Tan commented on YARN-8569: -- [~eyang],    {quote}In sync_yarn_sysfs, check_nm_local_dir make sure

[jira] [Resolved] (YARN-8468) Enable the use of queue based maximum container allocation limit and implement it in FairScheduler

2018-10-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved YARN-8468. --- Resolution: Fixed > Enable the use of queue based maximum container allocation limit and > implement

[jira] [Reopened] (YARN-8468) Enable the use of queue based maximum container allocation limit and implement it in FairScheduler

2018-10-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reopened YARN-8468: --- > Enable the use of queue based maximum container allocation limit and > implement it in FairScheduler >

[jira] [Commented] (YARN-8468) Enable the use of queue based maximum container allocation limit and implement it in FairScheduler

2018-10-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1660#comment-1660 ] Weiwei Yang commented on YARN-8468: --- Manually trigger the build won't work as the patch is already

[jira] [Updated] (YARN-8468) Enable the use of queue based maximum container allocation limit and implement it in FairScheduler

2018-10-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8468: -- Attachment: YARN-8468-branch-3.1.020.patch > Enable the use of queue based maximum container allocation

[jira] [Commented] (YARN-5742) Serve aggregated logs of historical apps from timeline service

2018-10-09 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644452#comment-16644452 ] Rohith Sharma K S commented on YARN-5742: - Thanks [~abmodi] bq. throw new

[jira] [Commented] (YARN-5742) Serve aggregated logs of historical apps from timeline service

2018-10-09 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644453#comment-16644453 ] Rohith Sharma K S commented on YARN-5742: - [~vinodkv] [~vrushalic] [~sunilg] could you guys take a

[jira] [Comment Edited] (YARN-5742) Serve aggregated logs of historical apps from timeline service

2018-10-09 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644453#comment-16644453 ] Rohith Sharma K S edited comment on YARN-5742 at 10/10/18 4:51 AM: ---

[jira] [Commented] (YARN-8753) [UI2] Lost nodes representation missing from Nodemanagers Chart

2018-10-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644454#comment-16644454 ] Hadoop QA commented on YARN-8753: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

2018-10-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8858: -- Fix Version/s: 2.9.2 > CapacityScheduler should respect maximum node resource when per-queue >

[jira] [Updated] (YARN-8720) CapacityScheduler does not enforce max resource allocation check at queue level

2018-10-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8720: -- Fix Version/s: 2.10.0 > CapacityScheduler does not enforce max resource allocation check at queue >

[jira] [Commented] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

2018-10-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644359#comment-16644359 ] Hudson commented on YARN-8858: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15164 (See

[jira] [Updated] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

2018-10-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8858: -- Fix Version/s: 2.10.0 > CapacityScheduler should respect maximum node resource when per-queue >

[jira] [Commented] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

2018-10-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644374#comment-16644374 ] Weiwei Yang commented on YARN-8858: --- Hi [~leftnoteasy] I have committed the patch to trunk,

[jira] [Updated] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

2018-10-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8858: -- Attachment: YARN-8858-branch-2.8.001.patch > CapacityScheduler should respect maximum node resource

[jira] [Commented] (YARN-8842) Update QueueMetrics with custom resource values

2018-10-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644380#comment-16644380 ] Hadoop QA commented on YARN-8842: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8862) [GPG] add Yarn Registry cleanup in ApplicationCleaner

2018-10-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644397#comment-16644397 ] Hadoop QA commented on YARN-8862: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8827) Plumb per application resource utilization from the NM to RM

2018-10-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-8827: -- Summary: Plumb per application resource utilization from the NM to RM (was: Plumb per app, per user

[jira] [Updated] (YARN-8827) Plumb aggregated application resource utilization from the NM to RM

2018-10-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-8827: -- Summary: Plumb aggregated application resource utilization from the NM to RM (was: Plumb per

[jira] [Updated] (YARN-8827) Plumb aggregated application resource utilization from the NM to RM

2018-10-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-8827: -- Affects Version/s: YARN-1011 > Plumb aggregated application resource utilization from the NM to RM >

[jira] [Updated] (YARN-8827) Plumb aggregated application resource utilization from the NM to RM

2018-10-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-8827: -- Fix Version/s: YARN-1011 > Plumb aggregated application resource utilization from the NM to RM >

[jira] [Commented] (YARN-8813) Improve debug messages for NM preemption of OPPORTUNISTIC containers

2018-10-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644178#comment-16644178 ] Hadoop QA commented on YARN-8813: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7644) NM gets backed up deleting docker containers

2018-10-09 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-7644: Attachment: YARN-7644.006.patch > NM gets backed up deleting docker containers >

[jira] [Commented] (YARN-8813) Improve debug messages for NM preemption of OPPORTUNISTIC containers

2018-10-09 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644221#comment-16644221 ] Robert Kanter commented on YARN-8813: - Thanks [~haibochen].  Committed to YARN-1011 branch! >

[jira] [Commented] (YARN-8813) Improve debug messages for NM preemption of OPPORTUNISTIC containers

2018-10-09 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644220#comment-16644220 ] Robert Kanter commented on YARN-8813: - +1 LGTM > Improve debug messages for NM preemption of

[jira] [Commented] (YARN-8827) Plumb per app, per user and per queue resource utilization from the NM to RM

2018-10-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644330#comment-16644330 ] Hadoop QA commented on YARN-8827: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

2018-10-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8858: -- Fix Version/s: 3.1.2 > CapacityScheduler should respect maximum node resource when per-queue >

[jira] [Commented] (YARN-8468) Enable the use of queue based maximum container allocation limit and implement it in FairScheduler

2018-10-09 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16642924#comment-16642924 ] Antal Bálint Steinbach commented on YARN-8468: -- Hi [~cheersyang] , Yes, it is related. I

[jira] [Commented] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

2018-10-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16642861#comment-16642861 ] Weiwei Yang commented on YARN-8858: --- Patch looks good to me, pending on jenkins.     >

[jira] [Commented] (YARN-8856) TestTimelineReaderWebServicesHBaseStorage tests failing with NoClassDefFoundError

2018-10-09 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16642849#comment-16642849 ] Rohith Sharma K S commented on YARN-8856: - I just ran test in trunk and failed. I found that below

[jira] [Commented] (YARN-8830) SLS tool not working in trunk

2018-10-09 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16642928#comment-16642928 ] Bibin A Chundatt commented on YARN-8830: [~sunilg]/[~leftnoteasy] Could you please review patch

[jira] [Commented] (YARN-5742) Serve aggregated logs of historical apps from timeline service

2018-10-09 Thread Abhishek Modi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16642862#comment-16642862 ] Abhishek Modi commented on YARN-5742: - Thanks [~rohithsharma] for updated patch. Overall it looks good

[jira] [Comment Edited] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

2018-10-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16642861#comment-16642861 ] Weiwei Yang edited comment on YARN-8858 at 10/9/18 6:25 AM: Patch looks good

[jira] [Updated] (YARN-8468) Enable the use of queue based maximum container allocation limit and implement it in FairScheduler

2018-10-09 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antal Bálint Steinbach updated YARN-8468: - Attachment: YARN-8468-branch-3.1.019.patch > Enable the use of queue based

[jira] [Commented] (YARN-8830) SLS tool not working in trunk

2018-10-09 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16642932#comment-16642932 ] Sunil Govindan commented on YARN-8830: -- Thanks [~bibinchundatt]. Cud u pls help to do a dry run of

[jira] [Commented] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

2018-10-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16643168#comment-16643168 ] Hadoop QA commented on YARN-8858: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-8468) Enable the use of queue based maximum container allocation limit and implement it in FairScheduler

2018-10-09 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16642924#comment-16642924 ] Antal Bálint Steinbach edited comment on YARN-8468 at 10/9/18 9:00 AM:

[jira] [Commented] (YARN-8468) Enable the use of queue based maximum container allocation limit and implement it in FairScheduler

2018-10-09 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16643006#comment-16643006 ] Antal Bálint Steinbach commented on YARN-8468: -- It looks like 3.2 already contains this

[jira] [Issue Comment Deleted] (YARN-8468) Enable the use of queue based maximum container allocation limit and implement it in FairScheduler

2018-10-09 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antal Bálint Steinbach updated YARN-8468: - Comment: was deleted (was: It looks like 3.2 already contains this commit. So

[jira] [Updated] (YARN-8468) Enable the use of queue based maximum container allocation limit and implement it in FairScheduler

2018-10-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8468: -- Fix Version/s: 3.1.2 > Enable the use of queue based maximum container allocation limit and >

[jira] [Commented] (YARN-8468) Enable the use of queue based maximum container allocation limit and implement it in FairScheduler

2018-10-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16643524#comment-16643524 ] Weiwei Yang commented on YARN-8468: --- Pushed to branch-3.1, closing this and updated the fixed version.

[jira] [Commented] (YARN-8853) Application Attempts tab not shown correctly when there are no attempts

2018-10-09 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16643595#comment-16643595 ] Sunil Govindan commented on YARN-8853: -- Straight forward patch. Getting in shortly. > Application

[jira] [Updated] (YARN-8827) Plumb per app, per user and per queue resource utilization from the NM to RM

2018-10-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-8827: -- Attachment: YARN-8827-YARN-1011.05.patch > Plumb per app, per user and per queue resource utilization

[jira] [Commented] (YARN-8807) FairScheduler crashes RM with oversubscription turned on if an application is killed.

2018-10-09 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16643638#comment-16643638 ] Haibo Chen commented on YARN-8807: -- The unit test failures are all unrelated. > FairScheduler crashes RM

[jira] [Commented] (YARN-8827) Plumb per app, per user and per queue resource utilization from the NM to RM

2018-10-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16643401#comment-16643401 ] Hadoop QA commented on YARN-8827: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

2018-10-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16643503#comment-16643503 ] Weiwei Yang commented on YARN-8858: --- Hi [~leftnoteasy] Are the change in \{{MockAM}} and \{{MockRM}}

[jira] [Commented] (YARN-8813) Improve debug messages for NM preemption of OPPORTUNISTIC containers

2018-10-09 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16643633#comment-16643633 ] Haibo Chen commented on YARN-8813: -- The unit test failure is unrelated. The checkstyle does not quite

[jira] [Updated] (YARN-8468) Enable the use of queue based maximum container allocation limit and implement it in FairScheduler

2018-10-09 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antal Bálint Steinbach updated YARN-8468: - Attachment: (was: YARN-8468-branch-3.1.019.patch) > Enable the use of queue

[jira] [Commented] (YARN-8468) Enable the use of queue based maximum container allocation limit and implement it in FairScheduler

2018-10-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16643272#comment-16643272 ] Hadoop QA commented on YARN-8468: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-8860) Federation client intercepter class contains unwanted character

2018-10-09 Thread Rakesh Shah (JIRA)
Rakesh Shah created YARN-8860: - Summary: Federation client intercepter class contains unwanted character Key: YARN-8860 URL: https://issues.apache.org/jira/browse/YARN-8860 Project: Hadoop YARN

[jira] [Commented] (YARN-7644) NM gets backed up deleting docker containers

2018-10-09 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16643405#comment-16643405 ] Jason Lowe commented on YARN-7644: -- Ah yes, sorry I was confusing reaping a container with killing it.

[jira] [Updated] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

2018-10-09 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-8858: - Target Version/s: 2.10.0, 3.2.0, 2.9.2, 3.0.4, 3.1.2, 2.8.6 (was: 3.2.0, 3.1.2) > CapacityScheduler

[jira] [Assigned] (YARN-8860) Federation client intercepter class contains unwanted character

2018-10-09 Thread Abhishek Modi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi reassigned YARN-8860: --- Assignee: Abhishek Modi > Federation client intercepter class contains unwanted character >

[jira] [Updated] (YARN-8468) Enable the use of queue based maximum container allocation limit and implement it in FairScheduler

2018-10-09 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antal Bálint Steinbach updated YARN-8468: - Attachment: YARN-8468-branch-3.1.019.patch > Enable the use of queue based

[jira] [Commented] (YARN-8468) Enable the use of queue based maximum container allocation limit and implement it in FairScheduler

2018-10-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16643494#comment-16643494 ] Weiwei Yang commented on YARN-8468: --- Thanks for fixing this. Looks good to me, I am going to commit this

[jira] [Updated] (YARN-8852) Add documentation for submarine installation details

2018-10-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8852: - Component/s: submarine > Add documentation for submarine installation details >

[jira] [Updated] (YARN-8852) Add documentation for submarine installation details

2018-10-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8852: - Component/s: documentation > Add documentation for submarine installation details >

[jira] [Commented] (YARN-1013) CS should watch resource utilization of containers and allocate speculative containers if appropriate

2018-10-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16643785#comment-16643785 ] Arun Suresh commented on YARN-1013: --- Linking to YARN-8827, since we plan to get the CS to use the

[jira] [Updated] (YARN-8853) [UI2] Application Attempts tab is not shown correctly when there are no attempts

2018-10-09 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8853: - Summary: [UI2] Application Attempts tab is not shown correctly when there are no attempts (was:

[jira] [Commented] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

2018-10-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16643732#comment-16643732 ] Wangda Tan commented on YARN-8858: -- Thanks [~cheersyang] for the review., they should not be necessary,

[jira] [Commented] (YARN-8853) [UI2] Application Attempts tab is not shown correctly when there are no attempts

2018-10-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16643735#comment-16643735 ] Hudson commented on YARN-8853: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15149 (See

[jira] [Updated] (YARN-8569) Create an interface to provide cluster information to application

2018-10-09 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8569: Attachment: YARN-8569.011.patch > Create an interface to provide cluster information to application >

[jira] [Updated] (YARN-8861) executorLock is misleading in ContainerLaunch

2018-10-09 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-8861: Description: The name of the variable {{executorLock}} is confusing. Rename it to {{launchLock}}.

[jira] [Commented] (YARN-8590) Fair scheduler promotion does not update container execution type and token

2018-10-09 Thread Zoltan Siegl (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16643781#comment-16643781 ] Zoltan Siegl commented on YARN-8590: Yes, it would be a larger refactor around those tests. It sounds

[jira] [Created] (YARN-8861) executorLock is misleading in ContainerLaunch

2018-10-09 Thread Chandni Singh (JIRA)
Chandni Singh created YARN-8861: --- Summary: executorLock is misleading in ContainerLaunch Key: YARN-8861 URL: https://issues.apache.org/jira/browse/YARN-8861 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-7652) Handle AM register requests asynchronously in FederationInterceptor

2018-10-09 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16643789#comment-16643789 ] Botong Huang commented on YARN-7652: Thanks [~goiri] for the review and commit! > Handle AM register

[jira] [Commented] (YARN-8827) Plumb per app, per user and per queue resource utilization from the NM to RM

2018-10-09 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16643713#comment-16643713 ] Íñigo Goiri commented on YARN-8827: --- Some minor comments: * NodeStatusPBImpl extra line before

[jira] [Commented] (YARN-8827) Plumb per app, per user and per queue resource utilization from the NM to RM

2018-10-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16643783#comment-16643783 ] Arun Suresh commented on YARN-8827: --- Thanks [~elgoiri] .. Attached updated patch. bq. .. I think we

[jira] [Updated] (YARN-7644) NM gets backed up deleting docker containers

2018-10-09 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-7644: Attachment: YARN-7644.003.patch > NM gets backed up deleting docker containers >

[jira] [Commented] (YARN-8448) AM HTTPS Support

2018-10-09 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16643719#comment-16643719 ] Haibo Chen commented on YARN-8448: -- Thanks [~rkanter] for the elaboration. OFF is what YARN does as of

[jira] [Commented] (YARN-8852) Add documentation for submarine installation details

2018-10-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16643730#comment-16643730 ] Wangda Tan commented on YARN-8852: -- +1, will commit patch shortly. > Add documentation for submarine

[jira] [Updated] (YARN-8827) Plumb per app, per user and per queue resource utilization from the NM to RM

2018-10-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-8827: -- Attachment: YARN-8827-YARN-1011.06.patch > Plumb per app, per user and per queue resource utilization

[jira] [Updated] (YARN-8842) Update QueueMetrics with custom resource values

2018-10-09 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8842: - Attachment: YARN-8842.006.patch > Update QueueMetrics with custom resource values >

[jira] [Commented] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

2018-10-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644213#comment-16644213 ] Hadoop QA commented on YARN-8858: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-3854) Add localization support for docker images

2018-10-09 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-3854: Attachment: Localization Support For Docker Images.pdf > Add localization support for docker images

[jira] [Commented] (YARN-8569) Create an interface to provide cluster information to application

2018-10-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644223#comment-16644223 ] Wangda Tan commented on YARN-8569: -- Discussed with [~eyang]/[~suma.shivaprasad] offline,  Several

[jira] [Commented] (YARN-7644) NM gets backed up deleting docker containers

2018-10-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644263#comment-16644263 ] Hadoop QA commented on YARN-7644: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-8864) NM incorrectly logs container user as the user who sent a stop container request in its audit log

2018-10-09 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-8864: Summary: NM incorrectly logs container user as the user who sent a stop container request in its audit log Key: YARN-8864 URL: https://issues.apache.org/jira/browse/YARN-8864

[jira] [Commented] (YARN-8827) Plumb per app, per user and per queue resource utilization from the NM to RM

2018-10-09 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644275#comment-16644275 ] Íñigo Goiri commented on YARN-8827: --- I assume that Yetus will come without the javadoc -1 for

[jira] [Commented] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

2018-10-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644322#comment-16644322 ] Weiwei Yang commented on YARN-8858: --- +1. The UT failure should not be related. I applied the patch and

[jira] [Updated] (YARN-8842) Update QueueMetrics with custom resource values

2018-10-09 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8842: - Attachment: YARN-8842.007.patch > Update QueueMetrics with custom resource values >

[jira] [Commented] (YARN-8842) Update QueueMetrics with custom resource values

2018-10-09 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644207#comment-16644207 ] Szilard Nemeth commented on YARN-8842: -- According to our offline discussion with [~haibochen], here

[jira] [Commented] (YARN-8468) Enable the use of queue based maximum container allocation limit and implement it in FairScheduler

2018-10-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644219#comment-16644219 ] Weiwei Yang commented on YARN-8468: --- Thanks [~leftnoteasy], I over looked that issue in the jenkins

  1   2   >