[jira] [Updated] (YARN-8384) stdout, stderr logs of a Native Service container is coming with group as nobody

[ https://issues.apache.org/jira/browse/YARN-8384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8384: - Target Version/s: 3.2.0, 3.1.1 Priority: Critical (was: Blocker) > stdout, stderr logs of a N

[jira] [Updated] (YARN-8384) stdout, stderr logs of a Native Service container is coming with group as nobody

[ https://issues.apache.org/jira/browse/YARN-8384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8384: - Priority: Blocker (was: Major) > stdout, stderr logs of a Native Service container is coming with group a

[jira] [Commented] (YARN-7962) Race Condition When Stopping DelegationTokenRenewer

[ https://issues.apache.org/jira/browse/YARN-7962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16497022#comment-16497022 ] Wangda Tan commented on YARN-7962: -- The attached patch looks good, +1. Thanks [~belugabeh

[jira] [Updated] (YARN-7962) Race Condition When Stopping DelegationTokenRenewer

[ https://issues.apache.org/jira/browse/YARN-7962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7962: - Attachment: (was: YARN-7962.005.patch) > Race Condition When Stopping DelegationTokenRenewer > ---

[jira] [Updated] (YARN-7962) Race Condition When Stopping DelegationTokenRenewer

[ https://issues.apache.org/jira/browse/YARN-7962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7962: - Attachment: YARN-7962.6.patch > Race Condition When Stopping DelegationTokenRenewer >

[jira] [Updated] (YARN-7962) Race Condition When Stopping DelegationTokenRenewer

[ https://issues.apache.org/jira/browse/YARN-7962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7962: - Attachment: YARN-7962.005.patch > Race Condition When Stopping DelegationTokenRenewer > --

[jira] [Commented] (YARN-8349) Remove YARN registry entries when a service is killed by the RM

[ https://issues.apache.org/jira/browse/YARN-8349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16497004#comment-16497004 ] Wangda Tan commented on YARN-8349: -- Thanks [~billie.rinaldi], A couple of questions / c

[jira] [Commented] (YARN-8379) Add an option to allow Capacity Scheduler preemption to balance satisfied queues

[ https://issues.apache.org/jira/browse/YARN-8379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16495817#comment-16495817 ] Wangda Tan commented on YARN-8379: -- To make better resource balances between queues, we p

[jira] [Created] (YARN-8379) Add an option to allow Capacity Scheduler preemption to balance satisfied queues

Wangda Tan created YARN-8379: Summary: Add an option to allow Capacity Scheduler preemption to balance satisfied queues Key: YARN-8379 URL: https://issues.apache.org/jira/browse/YARN-8379 Project: Hadoop

[jira] [Updated] (YARN-8369) Javadoc build failed due to "bad use of '>'"

[ https://issues.apache.org/jira/browse/YARN-8369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8369: - Priority: Critical (was: Major) > Javadoc build failed due to "bad use of '>'" >

[jira] [Updated] (YARN-8213) Add Capacity Scheduler performance metrics

[ https://issues.apache.org/jira/browse/YARN-8213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8213: - Summary: Add Capacity Scheduler performance metrics (was: Add Capacity Scheduler metrics) > Add Capacity

[jira] [Commented] (YARN-8366) Expose debug log information when user intend to enable GPU without setting nvidia-smi path

[ https://issues.apache.org/jira/browse/YARN-8366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16491505#comment-16491505 ] Wangda Tan commented on YARN-8366: -- Thanks [~Zian Chen] for filing the issue. Basically, w

[jira] [Commented] (YARN-8360) Yarn service conflict between restart policy and NM configuration

[ https://issues.apache.org/jira/browse/YARN-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16491503#comment-16491503 ] Wangda Tan commented on YARN-8360: -- Thanks [~suma.shivaprasad] for the proposal and [~csin

[jira] [Commented] (YARN-8213) Add Capacity Scheduler metrics

[ https://issues.apache.org/jira/browse/YARN-8213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16491219#comment-16491219 ] Wangda Tan commented on YARN-8213: -- Looks good, +1. Thanks [~cheersyang]. Will commit to

[jira] [Commented] (YARN-8320) [Umbrella] Support CPU isolation for latency-sensitive (LS) service

[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16491177#comment-16491177 ] Wangda Tan commented on YARN-8320: -- Thanks [~cheersyang], To me the benefit of exclusive

[jira] [Updated] (YARN-8361) Change App Name Placement Rule to use App Name instead of App Id for configuration

[ https://issues.apache.org/jira/browse/YARN-8361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8361: - Fix Version/s: (was: 3.1.1) (was: 3.2.0) > Change App Name Placement Rule to use

[jira] [Commented] (YARN-8361) Change App Name Placement Rule to use App Name instead of App Id for configuration

[ https://issues.apache.org/jira/browse/YARN-8361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16490014#comment-16490014 ] Wangda Tan commented on YARN-8361: -- +1, thanks [~Zian Chen], will commit once Jenkins come

[jira] [Commented] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16489384#comment-16489384 ] Wangda Tan commented on YARN-8292: -- Thanks [~jlowe]/[~eepayne], I just uploaded ver.9 patc

[jira] [Updated] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8292: - Attachment: YARN-8292.009.patch > Fix the dominant resource preemption cannot happen when some of the resou

[jira] [Commented] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16488201#comment-16488201 ] Wangda Tan commented on YARN-8292: -- Updated (008) patch. > Fix the dominant resource pree

[jira] [Commented] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16488200#comment-16488200 ] Wangda Tan commented on YARN-8292: -- Thanks [~jlowe], addressed all comments. TestPreemptio

[jira] [Updated] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8292: - Attachment: YARN-8292.008.patch > Fix the dominant resource preemption cannot happen when some of the resou

[jira] [Updated] (YARN-7530) hadoop-yarn-services-api should be part of hadoop-yarn-services

[ https://issues.apache.org/jira/browse/YARN-7530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7530: - Fix Version/s: 3.2.0 > hadoop-yarn-services-api should be part of hadoop-yarn-services > --

[jira] [Updated] (YARN-7530) hadoop-yarn-services-api should be part of hadoop-yarn-services

[ https://issues.apache.org/jira/browse/YARN-7530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7530: - Priority: Blocker (was: Trivial) > hadoop-yarn-services-api should be part of hadoop-yarn-services > -

[jira] [Updated] (YARN-7530) hadoop-yarn-services-api should be part of hadoop-yarn-services

[ https://issues.apache.org/jira/browse/YARN-7530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7530: - Fix Version/s: (was: 3.2.0) > hadoop-yarn-services-api should be part of hadoop-yarn-services > ---

[jira] [Commented] (YARN-8320) Support CPU isolation for latency-sensitive (LS) service

[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16487596#comment-16487596 ] Wangda Tan commented on YARN-8320: -- Thanks [~cheersyang] / [~yangjiandan] for the detailed

[jira] [Updated] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8292: - Attachment: YARN-8292.007.patch > Fix the dominant resource preemption cannot happen when some of the resou

[jira] [Commented] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16484735#comment-16484735 ] Wangda Tan commented on YARN-8292: -- Thanks [~jlowe], all great comments. Addressed all of

[jira] [Created] (YARN-8343) YARN should have ability to run images only from a whitelist docker registries

Wangda Tan created YARN-8343: Summary: YARN should have ability to run images only from a whitelist docker registries Key: YARN-8343 URL: https://issues.apache.org/jira/browse/YARN-8343 Project: Hadoop YA

[jira] [Commented] (YARN-8343) YARN should have ability to run images only from a whitelist docker registries

[ https://issues.apache.org/jira/browse/YARN-8343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16484695#comment-16484695 ] Wangda Tan commented on YARN-8343: -- cc: [~shaneku...@gmail.com], [~eyang], [~ebadger], [~j

[jira] [Created] (YARN-8342) Using docker image from a non-privileged registry, the launch_command is not honored

Wangda Tan created YARN-8342: Summary: Using docker image from a non-privileged registry, the launch_command is not honored Key: YARN-8342 URL: https://issues.apache.org/jira/browse/YARN-8342 Project: Had

[jira] [Commented] (YARN-8320) Support CPU isolation for latency-sensitive (LS) service

[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16484553#comment-16484553 ] Wangda Tan commented on YARN-8320: -- Thanks [~cheersyang] / [~yangjiandan], I don't have mu

[jira] [Updated] (YARN-8339) Service AM should localize static/archive resource types to container working directory instead of 'resources'

[ https://issues.apache.org/jira/browse/YARN-8339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8339: - Target Version/s: 3.1.1 Priority: Critical (was: Major) > Service AM should localize static/ar

[jira] [Commented] (YARN-8339) Service AM should localize static/archive resource types to container working directory instead of 'resources'

[ https://issues.apache.org/jira/browse/YARN-8339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16484538#comment-16484538 ] Wangda Tan commented on YARN-8339: -- Thanks [~suma.shivaprasad] for the quick fix, patch LG

[jira] [Created] (YARN-8340) Capacity Scheduler Intra Queue Preemption Should Work When 3rd or more resources enabled.

Wangda Tan created YARN-8340: Summary: Capacity Scheduler Intra Queue Preemption Should Work When 3rd or more resources enabled. Key: YARN-8340 URL: https://issues.apache.org/jira/browse/YARN-8340 Project

[jira] [Commented] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16484519#comment-16484519 ] Wangda Tan commented on YARN-8292: -- Thanks [~eepayne], I just created YARN-8340 to track i

[jira] [Commented] (YARN-8332) Incorrect min/max allocation property name in resource types doc

[ https://issues.apache.org/jira/browse/YARN-8332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16484513#comment-16484513 ] Wangda Tan commented on YARN-8332: -- +1, committing .. > Incorrect min/max allocation prop

[jira] [Commented] (YARN-8213) Add Capacity Scheduler metrics

[ https://issues.apache.org/jira/browse/YARN-8213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16484509#comment-16484509 ] Wangda Tan commented on YARN-8213: -- [~cheersyang], I would prefer to not do that, many of

[jira] [Updated] (YARN-8290) SystemMetricsPublisher.appACLsUpdated should be invoked after application information is published to ATS to avoid "User is not set in the application report" Exception

[ https://issues.apache.org/jira/browse/YARN-8290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8290: - Priority: Critical (was: Major) > SystemMetricsPublisher.appACLsUpdated should be invoked after applicatio

[jira] [Updated] (YARN-8290) SystemMetricsPublisher.appACLsUpdated should be invoked after application information is published to ATS to avoid "User is not set in the application report" Exception

[ https://issues.apache.org/jira/browse/YARN-8290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8290: - Summary: SystemMetricsPublisher.appACLsUpdated should be invoked after application information is published

[jira] [Updated] (YARN-8290) SystemMetricsPublisher.appACLsUpdated should be invoked after application information is published to ATS to avoid

[ https://issues.apache.org/jira/browse/YARN-8290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8290: - Summary: SystemMetricsPublisher.appACLsUpdated should be invoked after application information is published

[jira] [Commented] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16483185#comment-16483185 ] Wangda Tan commented on YARN-8292: -- Rebased to latest trunk (006) > Fix the dominant reso

[jira] [Updated] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8292: - Attachment: YARN-8292.006.patch > Fix the dominant resource preemption cannot happen when some of the resou

[jira] [Commented] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16483181#comment-16483181 ] Wangda Tan commented on YARN-8292: -- Thanks [~eepayne], I just checked both, For the in

[jira] [Commented] (YARN-8079) Support static and archive unmodified local resources in service AM

[ https://issues.apache.org/jira/browse/YARN-8079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16482065#comment-16482065 ] Wangda Tan commented on YARN-8079: -- Thanks [~suma.shivaprasad].  While using this feature

[jira] [Commented] (YARN-8234) Improve RM system metrics publisher's performance by pushing events to timeline server in batch

[ https://issues.apache.org/jira/browse/YARN-8234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16481321#comment-16481321 ] Wangda Tan commented on YARN-8234: -- Updated target version to 3.1.1, we need fix this issu

[jira] [Updated] (YARN-8234) Improve RM system metrics publisher's performance by pushing events to timeline server in batch

[ https://issues.apache.org/jira/browse/YARN-8234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8234: - Target Version/s: 3.1.1 Priority: Critical (was: Major) > Improve RM system metrics publisher'

[jira] [Updated] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8292: - Attachment: YARN-8292.005.patch > Fix the dominant resource preemption cannot happen when some of the resou

[jira] [Commented] (YARN-8015) Support inter-app placement constraints in AppPlacementAllocator

[ https://issues.apache.org/jira/browse/YARN-8015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16481199#comment-16481199 ] Wangda Tan commented on YARN-8015: -- Thanks [~cheersyang], in general the patch looks good.

[jira] [Commented] (YARN-8290) Yarn application failed to recover with "Error Launching job : User is not set in the application report" error after RM restart

[ https://issues.apache.org/jira/browse/YARN-8290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16481193#comment-16481193 ] Wangda Tan commented on YARN-8290: -- Patch looks good, +1, will commit by tonight.  > Yarn

[jira] [Commented] (YARN-8320) Add support CPU isolation for latency-sensitive (LS) service

[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16481002#comment-16481002 ] Wangda Tan commented on YARN-8320: -- Thanks [~yangjiandan] This is definitely a very intere

[jira] [Commented] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16479948#comment-16479948 ] Wangda Tan commented on YARN-8292: -- The failed test: TestProportionalCapacityPreemptionPol

[jira] [Commented] (YARN-8290) Yarn application failed to recover with "Error Launching job : User is not set in the application report" error after RM restart

[ https://issues.apache.org/jira/browse/YARN-8290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16479947#comment-16479947 ] Wangda Tan commented on YARN-8290: -- Thanks [~eyang],  It looks like {code:java} 467 t

[jira] [Commented] (YARN-8234) Improve RM system metrics publisher's performance by pushing events to timeline server in batch

[ https://issues.apache.org/jira/browse/YARN-8234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16479865#comment-16479865 ] Wangda Tan commented on YARN-8234: -- [~ziqian hu], Could you upload a patch against trunk?

[jira] [Commented] (YARN-8290) Yarn application failed to recover with "Error Launching job : User is not set in the application report" error after RM restart

[ https://issues.apache.org/jira/browse/YARN-8290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16479804#comment-16479804 ] Wangda Tan commented on YARN-8290: -- Thanks [~eyang], one comment: I think we should remov

[jira] [Deleted] (YARN-8315) HDP 3.0.0 perfromance is slower than HDP 2.6.4

[ https://issues.apache.org/jira/browse/YARN-8315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan deleted YARN-8315: - > HDP 3.0.0 perfromance is slower than HDP 2.6.4 > -- > >

[jira] [Issue Comment Deleted] (YARN-8315) HDP 3.0.0 perfromance is slower than HDP 2.6.4

[ https://issues.apache.org/jira/browse/YARN-8315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8315: - Comment: was deleted (was: [https://docs.hortonworks.com/HDPDocuments/HDP3/HDP-3.0.0/bk_ambari-installatio

[jira] [Comment Edited] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16479773#comment-16479773 ] Wangda Tan edited comment on YARN-8292 at 5/17/18 9:41 PM: --- And f

[jira] [Commented] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16479773#comment-16479773 ] Wangda Tan commented on YARN-8292: -- And forgot to mention: The issue reported by [~eepay

[jira] [Commented] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16479772#comment-16479772 ] Wangda Tan commented on YARN-8292: -- Finally found the issue :). The issue is caused by im

[jira] [Updated] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8292: - Attachment: YARN-8292.004.patch > Fix the dominant resource preemption cannot happen when some of the resou

[jira] [Commented] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16479604#comment-16479604 ] Wangda Tan commented on YARN-8292: -- Nice catching! Thanks [~eepayne], Let me troubleshoo

[jira] [Commented] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16478266#comment-16478266 ] Wangda Tan commented on YARN-8292: -- [~jlowe], I think you're correct :). I take my word ba

[jira] [Updated] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8292: - Attachment: YARN-8292.003.patch > Fix the dominant resource preemption cannot happen when some of the resou

[jira] [Commented] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16478246#comment-16478246 ] Wangda Tan commented on YARN-8292: -- Attached ver.2 patch, which fixed 0 value rare-resourc

[jira] [Updated] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8292: - Attachment: YARN-8292.002.patch > Fix the dominant resource preemption cannot happen when some of the resou

[jira] [Commented] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16478244#comment-16478244 ] Wangda Tan commented on YARN-8292: -- [~eepayne], It is actually on in {{setup()}}. :). [~j

[jira] [Updated] (YARN-8305) [UI2] No information available per container about the memory/vcores

[ https://issues.apache.org/jira/browse/YARN-8305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8305: - Reporter: Sumana Sathish (was: Gergely Novák) > [UI2] No information available per container about the mem

[jira] [Updated] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8292: - Description: This is an example of the problem:   {code} // guaranteed, max,used, pending

[jira] [Updated] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8292: - Fix Version/s: (was: 3.1.1) (was: 3.2.0) > Fix the dominant resource preemption

[jira] [Updated] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8292: - Target Version/s: 3.2.0, 3.1.1 > Fix the dominant resource preemption cannot happen when some of the resour

[jira] [Comment Edited] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16478026#comment-16478026 ] Wangda Tan edited comment on YARN-8292 at 5/16/18 8:16 PM: --- Thank

[jira] [Commented] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16478026#comment-16478026 ] Wangda Tan commented on YARN-8292: -- Thanks [~eepayne], Let me revise the example a bit,

[jira] [Comment Edited] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16477999#comment-16477999 ] Wangda Tan edited comment on YARN-8292 at 5/16/18 8:08 PM: --- [~jlo

[jira] [Commented] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16477999#comment-16477999 ] Wangda Tan commented on YARN-8292: -- [~jlowe], thanks for your review, bq. I think the ch

[jira] [Commented] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16477832#comment-16477832 ] Wangda Tan commented on YARN-8292: -- [~eepayne] / [~sunilg], Since both of you're asking

[jira] [Updated] (YARN-8141) YARN Native Service: Respect YARN_CONTAINER_RUNTIME_DOCKER_LOCAL_RESOURCE_MOUNTS specified in service spec

[ https://issues.apache.org/jira/browse/YARN-8141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8141: - Target Version/s: 3.2.0, 3.1.1 (was: 3.2.0) > YARN Native Service: Respect > YARN_CONTAINER_RUNTIME_DOCKE

[jira] [Updated] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8292: - Fix Version/s: 3.1.1 3.2.0 > Fix the dominant resource preemption cannot happen when som

[jira] [Updated] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8292: - Attachment: YARN-8292.001.patch > Fix the dominant resource preemption cannot happen when some of the resou

[jira] [Commented] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16476304#comment-16476304 ] Wangda Tan commented on YARN-8292: -- I propose to change the logic to following: If the pr

[jira] [Updated] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8292: - Description:   This is an example of the problem: (Same if we have more than 2 resources)   Let's say we

[jira] [Updated] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8292: - Description:   This is an example of the problem: (Same if we have more than 2 resources)   Let's say we h

[jira] [Updated] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8292: - Summary: Fix the dominant resource preemption cannot happen when some of the resource vector becomes negati

[jira] [Assigned] (YARN-8292) Preemption of GPU resource does not happen if memory/vcores is not required to be preempted

[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-8292: Assignee: Wangda Tan (was: Tan, Wangda) > Preemption of GPU resource does not happen if memory/vcor

[jira] [Commented] (YARN-8250) Create another implementation of ContainerScheduler to support NM overallocation

[ https://issues.apache.org/jira/browse/YARN-8250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16476088#comment-16476088 ] Wangda Tan commented on YARN-8250: -- Thanks [~haibochen] for the detailed explanation, bq

[jira] [Commented] (YARN-8250) Create another implementation of ContainerScheduler to support NM overallocation

[ https://issues.apache.org/jira/browse/YARN-8250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16475062#comment-16475062 ] Wangda Tan commented on YARN-8250: -- [~haibochen],  I took a very brief look at implemente

[jira] [Commented] (YARN-8141) YARN Native Service: Respect YARN_CONTAINER_RUNTIME_DOCKER_LOCAL_RESOURCE_MOUNTS specified in service spec

[ https://issues.apache.org/jira/browse/YARN-8141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16472652#comment-16472652 ] Wangda Tan commented on YARN-8141: -- [~shaneku...@gmail.com], an example is user stores had

[jira] [Commented] (YARN-8141) YARN Native Service: Respect YARN_CONTAINER_RUNTIME_DOCKER_LOCAL_RESOURCE_MOUNTS specified in service spec

[ https://issues.apache.org/jira/browse/YARN-8141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16472573#comment-16472573 ] Wangda Tan commented on YARN-8141: -- Thanks [~csingh] / [~shaneku...@gmail.com] for the dis

[jira] [Resolved] (YARN-8272) Several items are missing from Hadoop 3.1.0 documentation

[ https://issues.apache.org/jira/browse/YARN-8272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan resolved YARN-8272. -- Resolution: Duplicate Closing as dup of HADOOP-15374 > Several items are missing from Hadoop 3.1.0 docum

[jira] [Commented] (YARN-8272) Several items are missing from Hadoop 3.1.0 documentation

[ https://issues.apache.org/jira/browse/YARN-8272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16472447#comment-16472447 ] Wangda Tan commented on YARN-8272: -- Oh sweet! Thanks [~ajisakaa] and [~tasanuma0829]! > S

[jira] [Updated] (YARN-8258) [UI2] New UI webappcontext should inherit all filters from default context

[ https://issues.apache.org/jira/browse/YARN-8258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8258: - Reporter: Sumana Sathish (was: Sunil G) > [UI2] New UI webappcontext should inherit all filters from defau

[jira] [Updated] (YARN-8280) [UI2] GPU is not present in the drop down box under 'Nodes Heatmap'

[ https://issues.apache.org/jira/browse/YARN-8280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8280: - Reporter: Sumana Sathish (was: Gergely Novák) > [UI2] GPU is not present in the drop down box under 'Nodes

[jira] [Commented] (YARN-8265) AM should retrieve new IP for restarted container

[ https://issues.apache.org/jira/browse/YARN-8265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16471336#comment-16471336 ] Wangda Tan commented on YARN-8265: -- [~billie.rinaldi],  I agree with you, the correct fix

[jira] [Updated] (YARN-8265) AM should retrieve new IP for restarted container

[ https://issues.apache.org/jira/browse/YARN-8265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8265: - Target Version/s: 3.2.0 (was: 3.1.1) > AM should retrieve new IP for restarted container > ---

[jira] [Updated] (YARN-8265) AM should retrieve new IP for restarted container

[ https://issues.apache.org/jira/browse/YARN-8265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8265: - Target Version/s: 3.1.1 > AM should retrieve new IP for restarted container > -

[jira] [Updated] (YARN-8265) AM should retrieve new IP for restarted container

[ https://issues.apache.org/jira/browse/YARN-8265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8265: - Fix Version/s: (was: 3.1.1) (was: 3.2.0) > AM should retrieve new IP for restart

[jira] [Updated] (YARN-8236) Invalid kerberos principal file name cause NPE in native service

[ https://issues.apache.org/jira/browse/YARN-8236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8236: - Priority: Critical (was: Major) > Invalid kerberos principal file name cause NPE in native service > -

[jira] [Updated] (YARN-8149) Revisit behavior of Re-Reservation in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-8149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8149: - Priority: Major (was: Critical) > Revisit behavior of Re-Reservation in Capacity Scheduler > -

[jira] [Updated] (YARN-8149) Revisit behavior of Re-Reservation in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-8149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8149: - Target Version/s: 3.2.0 (was: 3.2.0, 3.1.1) > Revisit behavior of Re-Reservation in Capacity Scheduler > -

[jira] [Commented] (YARN-8149) Revisit behavior of Re-Reservation in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-8149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16471327#comment-16471327 ] Wangda Tan commented on YARN-8149: -- According to previous discussion, downgrade priority a

<    4   5   6   7   8   9   10   11   12   13   >