[jira] [Updated] (YARN-4166) Support changing container cpu resource

2017-04-20 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated YARN-4166: Attachment: YARN-4166.001.patch > Support changing container cpu resource >

[jira] [Commented] (YARN-4166) Support changing container cpu resource

2017-04-20 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15976485#comment-15976485 ] Yang Wang commented on YARN-4166: - [~Naganarasimha] Thanks for you help. I have already upload a patch for

[jira] [Updated] (YARN-4166) Support changing container cpu resource

2017-04-20 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated YARN-4166: Attachment: YARN-4166.002.patch > Support changing container cpu resource >

[jira] [Commented] (YARN-4166) Support changing container cpu resource

2017-04-20 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977015#comment-15977015 ] Yang Wang commented on YARN-4166: - Sure, I have fix the red flags. Findbugs red flag has nothing to do with

[jira] [Updated] (YARN-4166) Support changing container cpu resource

2017-04-19 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated YARN-4166: Attachment: YARN-4166-branch2.8-001.patch > Support changing container cpu resource >

[jira] [Updated] (YARN-4166) Support changing container cpu resource

2017-04-19 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated YARN-4166: Attachment: (was: YARN-4166-branch2.8-001.patch) > Support changing container cpu resource >

[jira] [Updated] (YARN-4166) Support changing container cpu resource

2017-04-19 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated YARN-4166: Attachment: YARN-4166-branch2.8-001.patch > Support changing container cpu resource >

[jira] [Commented] (YARN-4166) Support changing container cpu resource

2017-04-19 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15974605#comment-15974605 ] Yang Wang commented on YARN-4166: - Upload a patch for branch-2.8 > Support changing container cpu resource

[jira] [Commented] (YARN-4166) Support changing container cpu resource

2017-04-19 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15974513#comment-15974513 ] Yang Wang commented on YARN-4166: - [~Naganarasimha] Sorry, I can not upload a patch. Could you give me the

[jira] [Commented] (YARN-4166) Support changing container cpu resource

2017-04-18 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15972334#comment-15972334 ] Yang Wang commented on YARN-4166: - Hi [~Naganarasimha], Are you still working on this, could you share

[jira] [Commented] (YARN-4166) Support changing container cpu resource

2017-04-18 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15974130#comment-15974130 ] Yang Wang commented on YARN-4166: - We want to use container resize(YARN-1197) in production ASAP. And I

[jira] [Issue Comment Deleted] (YARN-4166) Support changing container cpu resource

2017-04-19 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated YARN-4166: Comment: was deleted (was: We want to use container resize(YARN-1197) in production ASAP. And I already

[jira] [Updated] (YARN-6951) Fix debug log when Resource handler chain is enabled

2017-08-04 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated YARN-6951: Description: {code:title=LinuxContainerExecutor.java} ... ... if (LOG.isDebugEnabled()) {

[jira] [Assigned] (YARN-6951) Fix debug log when Resource handler chain is enabled

2017-08-04 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang reassigned YARN-6951: --- Assignee: Yang Wang > Fix debug log when Resource handler chain is enabled >

[jira] [Created] (YARN-6951) Fix debug log when Resource handler chain is enabled

2017-08-04 Thread Yang Wang (JIRA)
Yang Wang created YARN-6951: --- Summary: Fix debug log when Resource handler chain is enabled Key: YARN-6951 URL: https://issues.apache.org/jira/browse/YARN-6951 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-6951) Fix debug log when Resource handler chain is enabled

2017-08-04 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated YARN-6951: Attachment: YARN-6951.001.patch > Fix debug log when Resource handler chain is enabled >

[jira] [Commented] (YARN-5621) Support LinuxContainerExecutor to create symlinks for continuously localized resources

2017-08-04 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16114150#comment-16114150 ] Yang Wang commented on YARN-5621: - {code:title=LinuxContainerExecutor.java} protected void

[jira] [Comment Edited] (YARN-5621) Support LinuxContainerExecutor to create symlinks for continuously localized resources

2017-08-04 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16114150#comment-16114150 ] Yang Wang edited comment on YARN-5621 at 8/4/17 9:08 AM: -

[jira] [Assigned] (YARN-6966) NodeManager metrics may return wrong negative values when NM restart

2017-08-15 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang reassigned YARN-6966: --- Assignee: Yang Wang > NodeManager metrics may return wrong negative values when NM restart >

[jira] [Updated] (YARN-6966) NodeManager metrics may return wrong negative values when NM restart

2017-08-15 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated YARN-6966: Attachment: YARN-6966.002.patch update the patch > NodeManager metrics may return wrong negative values

[jira] [Assigned] (YARN-6589) Recover all resources when NM restart

2017-08-15 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang reassigned YARN-6589: --- Assignee: Yang Wang > Recover all resources when NM restart > - >

[jira] [Updated] (YARN-4166) Support changing container cpu resource

2017-08-15 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated YARN-4166: Attachment: (was: YARN-4166-branch2.8-001.patch) > Support changing container cpu resource >

[jira] [Updated] (YARN-6966) NodeManager metrics may return wrong negative values when NM restart

2017-08-15 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated YARN-6966: Attachment: YARN-6966.003.patch > NodeManager metrics may return wrong negative values when NM restart >

[jira] [Updated] (YARN-6589) Recover all resources when NM restart

2017-08-15 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated YARN-6589: Attachment: YARN-6589-YARN-3926.001.patch > Recover all resources when NM restart >

[jira] [Commented] (YARN-4166) Support changing container cpu resource

2017-04-27 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986157#comment-15986157 ] Yang Wang commented on YARN-4166: - [~Naganarasimha], Thanks for your comments on this patch, I will update

[jira] [Comment Edited] (YARN-6212) NodeManager metrics returning wrong negative values

2017-08-07 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16116452#comment-16116452 ] Yang Wang edited comment on YARN-6212 at 8/8/17 2:25 AM: - Hi,

[jira] [Updated] (YARN-6966) NodeManager metrics may return wrong negative values when NM restart

2017-08-08 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated YARN-6966: Summary: NodeManager metrics may return wrong negative values when NM restart (was: NodeManager metrics may

[jira] [Created] (YARN-6966) NodeManager metrics may returning wrong negative values when after restart

2017-08-08 Thread Yang Wang (JIRA)
Yang Wang created YARN-6966: --- Summary: NodeManager metrics may returning wrong negative values when after restart Key: YARN-6966 URL: https://issues.apache.org/jira/browse/YARN-6966 Project: Hadoop YARN

[jira] [Updated] (YARN-6966) NodeManager metrics may return wrong negative values when NM restart

2017-08-08 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated YARN-6966: Attachment: YARN-6966.001.patch > NodeManager metrics may return wrong negative values when NM restart >

[jira] [Commented] (YARN-6212) NodeManager metrics returning wrong negative values

2017-08-07 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16116452#comment-16116452 ] Yang Wang commented on YARN-6212: - Hi, Miklos Szegedi I'm afraid this JIRA is not a duplicate of YARN-3933.

[jira] [Updated] (YARN-4166) Support changing container cpu resource

2017-05-03 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated YARN-4166: Attachment: YARN-4166.003.patch > Support changing container cpu resource >

[jira] [Created] (YARN-6589) Recover all resources when NM restart

2017-05-11 Thread Yang Wang (JIRA)
Yang Wang created YARN-6589: --- Summary: Recover all resources when NM restart Key: YARN-6589 URL: https://issues.apache.org/jira/browse/YARN-6589 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-6578) Return container resource utilization from NM ContainerStatus call

2017-05-10 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16004415#comment-16004415 ] Yang Wang commented on YARN-6578: - [~Naganarasimha], thanks for your reply. I plan to get usage from

[jira] [Updated] (YARN-6578) Return container resource utilization from NM ContainerStatus call

2017-05-10 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated YARN-6578: Attachment: YARN-6578.001.patch > Return container resource utilization from NM ContainerStatus call >

[jira] [Commented] (YARN-6578) Return container resource utilization from NM ContainerStatus call

2017-05-10 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16004749#comment-16004749 ] Yang Wang commented on YARN-6578: - [~Naganarasimha], I have uploaded a WIP patch. > Return container

[jira] [Created] (YARN-6578) Return container resource utilization from NM ContainerStatus call

2017-05-10 Thread Yang Wang (JIRA)
Yang Wang created YARN-6578: --- Summary: Return container resource utilization from NM ContainerStatus call Key: YARN-6578 URL: https://issues.apache.org/jira/browse/YARN-6578 Project: Hadoop YARN

[jira] [Updated] (YARN-6630) Container worker dir could not recover when NM restart

2017-05-24 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated YARN-6630: Attachment: YARN-6630.001.patch > Container worker dir could not recover when NM restart >

[jira] [Updated] (YARN-6630) Container worker dir could not recover when NM restart

2017-05-23 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated YARN-6630: Description: When yarn.nodemanager.recovery.enabled is true and ContainerRetryPolicy is NEVER_RETRY,

[jira] [Commented] (YARN-6630) Container worker dir could not recover when NM restart

2017-05-24 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16024097#comment-16024097 ] Yang Wang commented on YARN-6630: - Hi, [~jianhe], Could you help to review the patch. We already have a

[jira] [Updated] (YARN-6630) Container worker dir could not recover when NM restart

2017-05-26 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated YARN-6630: Description: When ContainerRetryPolicy is NEVER_RETRY, container worker dir will not be saved in NM state

[jira] [Created] (YARN-6630) Container worker dir could not recover when NM restart

2017-05-22 Thread Yang Wang (JIRA)
Yang Wang created YARN-6630: --- Summary: Container worker dir could not recover when NM restart Key: YARN-6630 URL: https://issues.apache.org/jira/browse/YARN-6630 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-6630) Container worker dir could not recover when NM restart

2017-05-26 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025973#comment-16025973 ] Yang Wang commented on YARN-6630: - When ContainerRetryPolicy is NEVER_RETRY, container.workdir also needs

[jira] [Commented] (YARN-6630) Container worker dir could not recover when NM restart

2017-05-26 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025952#comment-16025952 ] Yang Wang commented on YARN-6630: - Yes, yarn.nodemanager.recovery.enabled=true and ContainerRetryPolicy=

[jira] [Commented] (YARN-6630) Container worker dir could not recover when NM restart

2017-05-24 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16022445#comment-16022445 ] Yang Wang commented on YARN-6630: - When yarn.nodemanager.recovery.enabled is true, nm will not clear any

[jira] [Commented] (YARN-4166) Support changing container cpu resource

2017-05-04 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15996225#comment-15996225 ] Yang Wang commented on YARN-4166: - Update the patch according to [~Naganarasimha]'s suggestion #

[jira] [Updated] (YARN-4166) Support changing container cpu resource

2017-05-03 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated YARN-4166: Attachment: YARN-4166.004.patch > Support changing container cpu resource >

[jira] [Updated] (YARN-6589) Recover all resources when NM restart

2017-09-19 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated YARN-6589: Attachment: YARN-6589.001.patch > Recover all resources when NM restart >

[jira] [Commented] (YARN-6589) Recover all resources when NM restart

2017-09-19 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172660#comment-16172660 ] Yang Wang commented on YARN-6589: - Thanks for your comment, [~leftnoteasy] ContainerImpl.java in the trunk

[jira] [Commented] (YARN-6630) Container worker dir could not recover when NM restart

2017-09-19 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172698#comment-16172698 ] Yang Wang commented on YARN-6630: - Thanks for your comments, [~djp]. Update the patch and rebase trunk. >

[jira] [Updated] (YARN-6630) Container worker dir could not recover when NM restart

2017-09-19 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated YARN-6630: Attachment: YARN-6630.002.patch > Container worker dir could not recover when NM restart >

[jira] [Assigned] (YARN-7661) NodeManager metrics return wrong value after update node resource

2017-12-15 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang reassigned YARN-7661: --- Assignee: Yang Wang > NodeManager metrics return wrong value after update node resource >

[jira] [Created] (YARN-7660) NodeManager metrics return wrong value after update node resource

2017-12-15 Thread Yang Wang (JIRA)
Yang Wang created YARN-7660: --- Summary: NodeManager metrics return wrong value after update node resource Key: YARN-7660 URL: https://issues.apache.org/jira/browse/YARN-7660 Project: Hadoop YARN

[jira] [Created] (YARN-7661) NodeManager metrics return wrong value after update node resource

2017-12-15 Thread Yang Wang (JIRA)
Yang Wang created YARN-7661: --- Summary: NodeManager metrics return wrong value after update node resource Key: YARN-7661 URL: https://issues.apache.org/jira/browse/YARN-7661 Project: Hadoop YARN

[jira] [Updated] (YARN-7661) NodeManager metrics return wrong value after update node resource

2017-12-15 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated YARN-7661: Attachment: YARN-7661.001.patch Attach a patch to resolve this issue. > NodeManager metrics return wrong

[jira] [Created] (YARN-7659) NodeManager metrics return wrong value after update resource

2017-12-15 Thread Yang Wang (JIRA)
Yang Wang created YARN-7659: --- Summary: NodeManager metrics return wrong value after update resource Key: YARN-7659 URL: https://issues.apache.org/jira/browse/YARN-7659 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-7660) NM node resource should be updated through heartbeat when rmadmin updateNodeResource execute successfully

2017-12-15 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated YARN-7660: Summary: NM node resource should be updated through heartbeat when rmadmin updateNodeResource execute

[jira] [Updated] (YARN-7660) NM node resource should be updated through heartbeat when rmadmin updateNodeResource execute successfully

2017-12-15 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated YARN-7660: Description: When yarn rmadmin -updateNodeResource is used to update node resource, and execute

[jira] [Assigned] (YARN-7647) NM print inappropriate error log when node-labels is enabled

2017-12-12 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang reassigned YARN-7647: --- Assignee: Yang Wang > NM print inappropriate error log when node-labels is enabled >

[jira] [Updated] (YARN-7647) NM print inappropriate error log when node-labels is enabled

2017-12-12 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated YARN-7647: Attachment: YARN-7647.001.patch > NM print inappropriate error log when node-labels is enabled >

[jira] [Created] (YARN-7647) NM print inappropriate error log when node-labels is enabled

2017-12-12 Thread Yang Wang (JIRA)
Yang Wang created YARN-7647: --- Summary: NM print inappropriate error log when node-labels is enabled Key: YARN-7647 URL: https://issues.apache.org/jira/browse/YARN-7647 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-7661) NodeManager metrics return wrong value after update node resource

2017-12-18 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16296229#comment-16296229 ] Yang Wang commented on YARN-7661: - [~jlowe], thanks for your review and commit. > NodeManager metrics

[jira] [Commented] (YARN-7661) NodeManager metrics return wrong value after update node resource

2017-12-17 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16294470#comment-16294470 ] Yang Wang commented on YARN-7661: - [~jlowe] Thanks for your comment. I have fixed the test and updated the

[jira] [Updated] (YARN-7661) NodeManager metrics return wrong value after update node resource

2017-12-17 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated YARN-7661: Attachment: YARN-7661.002.patch > NodeManager metrics return wrong value after update node resource >

[jira] [Updated] (YARN-6589) Recover all resources when NM restart

2017-12-08 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated YARN-6589: Attachment: YARN-6589.002.patch The constructor in ContainerImpl has change, we do not need to recover

[jira] [Updated] (YARN-6578) Return container resource utilization from NM ContainerStatus call

2018-05-07 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated YARN-6578: Attachment: YARN-6578.003.patch > Return container resource utilization from NM ContainerStatus call >

[jira] [Commented] (YARN-6578) Return container resource utilization from NM ContainerStatus call

2018-05-07 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16465620#comment-16465620 ] Yang Wang commented on YARN-6578: - [~cheersyang], thanks for your comment. Have fixed the findbugs issues.

[jira] [Updated] (YARN-6578) Return container resource utilization from NM ContainerStatus call

2018-05-04 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated YARN-6578: Description: When the applicationMaster wants to change(increase/decrease) resources of an allocated

[jira] [Commented] (YARN-6578) Return container resource utilization from NM ContainerStatus call

2018-05-20 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16482142#comment-16482142 ] Yang Wang commented on YARN-6578: - [~Naganarasimha] thanks for your comment. Currently we just return

[jira] [Created] (YARN-8331) Race condition in NM container launched after done

2018-05-20 Thread Yang Wang (JIRA)
Yang Wang created YARN-8331: --- Summary: Race condition in NM container launched after done Key: YARN-8331 URL: https://issues.apache.org/jira/browse/YARN-8331 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-6630) Container worker dir could not recover when NM restart

2018-05-03 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated YARN-6630: Attachment: YARN-6630.003.patch > Container worker dir could not recover when NM restart >

[jira] [Commented] (YARN-6589) Recover all resources when NM restart

2018-05-03 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462233#comment-16462233 ] Yang Wang commented on YARN-6589: - ContainerImpl#getResource() has been changed to get from

[jira] [Updated] (YARN-6589) Recover all resources when NM restart

2018-05-03 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated YARN-6589: Release Note: (was: ContainerImpl#getResource() has been changed to get from containerTokenIdentifier and

[jira] [Updated] (YARN-6578) Return container resource utilization from NM ContainerStatus call

2018-05-04 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated YARN-6578: Attachment: YARN-6578.002.patch > Return container resource utilization from NM ContainerStatus call >

[jira] [Commented] (YARN-8153) Guaranteed containers always stay in SCHEDULED on NM after restart

2018-04-12 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16436727#comment-16436727 ] Yang Wang commented on YARN-8153: - [~cheersyang] Thanks for your comment. I have fixed the UT failure. >

[jira] [Updated] (YARN-8153) Guaranteed containers always stay in SCHEDULED on NM after restart

2018-04-12 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated YARN-8153: Attachment: YARN-8153.002.patch > Guaranteed containers always stay in SCHEDULED on NM after restart >

[jira] [Commented] (YARN-8153) Guaranteed containers always stay in SCHEDULED on NM after restart

2018-04-13 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16437186#comment-16437186 ] Yang Wang commented on YARN-8153: - [~cheersyang] Thanks for your commit. > Guaranteed containers always

[jira] [Created] (YARN-8153) Guaranteed containers always stay in SCHEDULED on NM after restart

2018-04-11 Thread Yang Wang (JIRA)
Yang Wang created YARN-8153: --- Summary: Guaranteed containers always stay in SCHEDULED on NM after restart Key: YARN-8153 URL: https://issues.apache.org/jira/browse/YARN-8153 Project: Hadoop YARN

[jira] [Assigned] (YARN-8153) Guaranteed containers always stay in SCHEDULED on NM after restart

2018-04-11 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang reassigned YARN-8153: --- Assignee: Yang Wang > Guaranteed containers always stay in SCHEDULED on NM after restart >

[jira] [Updated] (YARN-8153) Guaranteed containers always stay in SCHEDULED on NM after restart

2018-04-11 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated YARN-8153: Attachment: YARN-8153.001.patch > Guaranteed containers always stay in SCHEDULED on NM after restart >

[jira] [Updated] (YARN-6578) Return container resource utilization from NM ContainerStatus call

2018-03-22 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated YARN-6578: Description: When the applicationMaster wants to change(increase/decrease) resources of an allocated

[jira] [Assigned] (YARN-6578) Return container resource utilization from NM ContainerStatus call

2018-03-22 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang reassigned YARN-6578: --- Assignee: Yang Wang > Return container resource utilization from NM ContainerStatus call >

[jira] [Updated] (YARN-8984) OutstandingSchedRequests in AMRMClient could not be removed when AllocationTags is null or empty

2018-11-06 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated YARN-8984: Attachment: YARN-8984-001.patch > OutstandingSchedRequests in AMRMClient could not be removed when >

[jira] [Created] (YARN-8984) OutstandingSchedRequests in AMRMClient could not be removed when AllocationTags is null or empty

2018-11-06 Thread Yang Wang (JIRA)
Yang Wang created YARN-8984: --- Summary: OutstandingSchedRequests in AMRMClient could not be removed when AllocationTags is null or empty Key: YARN-8984 URL: https://issues.apache.org/jira/browse/YARN-8984

[jira] [Commented] (YARN-8984) OutstandingSchedRequests in AMRMClient could not be removed when AllocationTags is null or empty

2018-11-06 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677649#comment-16677649 ] Yang Wang commented on YARN-8984: - It could be a critical bug when resync, all the

[jira] [Assigned] (YARN-8984) OutstandingSchedRequests in AMRMClient could not be removed when AllocationTags is null or empty

2018-11-06 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang reassigned YARN-8984: --- Assignee: Yang Wang > OutstandingSchedRequests in AMRMClient could not be removed when >

[jira] [Commented] (YARN-8984) AMRMClient#OutstandingSchedRequests leaks when AllocationTags is null or empty

2018-11-08 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679208#comment-16679208 ] Yang Wang commented on YARN-8984: - [~cheersyang], I do not think it will throw a NPE when

[jira] [Updated] (YARN-8984) AMRMClient#OutstandingSchedRequests leaks when AllocationTags is null or empty

2018-11-07 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated YARN-8984: Attachment: YARN-8984-003.patch > AMRMClient#OutstandingSchedRequests leaks when AllocationTags is null or

[jira] [Commented] (YARN-8984) AMRMClient#OutstandingSchedRequests leaks when AllocationTags is null or empty

2018-11-07 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16678081#comment-16678081 ] Yang Wang commented on YARN-8984: - There's no difference between in a separate class and in 

[jira] [Updated] (YARN-8984) AMRMClient#OutstandingSchedRequests leaks when AllocationTags is null or empty

2018-11-07 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated YARN-8984: Attachment: YARN-8984-002.patch > AMRMClient#OutstandingSchedRequests leaks when AllocationTags is null or

[jira] [Commented] (YARN-8984) AMRMClient#OutstandingSchedRequests leaks when AllocationTags is null or empty

2018-11-07 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677802#comment-16677802 ] Yang Wang commented on YARN-8984: - Hi, [~cheersyang] I have tried to move the test to 

[jira] [Updated] (YARN-8984) AMRMClient#OutstandingSchedRequests leaks when AllocationTags is null or empty

2018-11-09 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated YARN-8984: Attachment: YARN-8984-005.patch > AMRMClient#OutstandingSchedRequests leaks when AllocationTags is null or

[jira] [Commented] (YARN-8984) AMRMClient#OutstandingSchedRequests leaks when AllocationTags is null or empty

2018-11-09 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681142#comment-16681142 ] Yang Wang commented on YARN-8984: - [~cheersyang], thanks for your comments. I have added a test to verify

[jira] [Updated] (YARN-8984) AMRMClient#OutstandingSchedRequests leaks when AllocationTags is null or empty

2018-11-08 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated YARN-8984: Attachment: YARN-8984-004.patch > AMRMClient#OutstandingSchedRequests leaks when AllocationTags is null or

[jira] [Commented] (YARN-8984) AMRMClient#OutstandingSchedRequests leaks when AllocationTags is null or empty

2018-11-08 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680902#comment-16680902 ] Yang Wang commented on YARN-8984: - [~botong], [~kkaranasos] Thanks for your reply. I have add the null

[jira] [Commented] (YARN-8984) AMRMClient#OutstandingSchedRequests leaks when AllocationTags is null or empty

2018-11-21 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16694602#comment-16694602 ] Yang Wang commented on YARN-8984: - Hi, [~kkaranasos], [~botong], [~asuresh] Could you please take a look

[jira] [Commented] (YARN-8984) AMRMClient#OutstandingSchedRequests leaks when AllocationTags is null or empty

2018-11-22 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16695741#comment-16695741 ] Yang Wang commented on YARN-8984: - [~cheersyang] [~kkaranasos] Thanks for all your reviews and commit. >

[jira] [Commented] (YARN-7007) NPE in RM while using YarnClient.getApplications()

2020-01-10 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/YARN-7007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012913#comment-17012913 ] Yang Wang commented on YARN-7007: - [~Tao Yang] Cool, many thanks. > NPE in RM while using

[jira] [Commented] (YARN-7007) NPE in RM while using YarnClient.getApplications()

2020-01-09 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/YARN-7007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012529#comment-17012529 ] Yang Wang commented on YARN-7007: - [~cheersyang] [~Tao Yang] We come across the same problem in