[jira] [Commented] (YARN-6861) Reader API for sub application entities

2017-08-20 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16134450#comment-16134450 ] Varun Saxena commented on YARN-6861: Committed to YARN-5355. [~rohithsharma], the patch isn't compiling

[jira] [Updated] (YARN-7062) yarn job args changed by ContainerLaunch.expandEnvironment(), such as "{{" and "}}"

2017-08-20 Thread Lingfeng Su (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lingfeng Su updated YARN-7062: -- Description: I passed a json string like "{User: Billy, {Age: 18}}" to main method args, when running

[jira] [Updated] (YARN-7062) yarn job args changed by ContainerLaunch.expandEnvironment(), such as "{{" and "}}"

2017-08-20 Thread Lingfeng Su (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lingfeng Su updated YARN-7062: -- Priority: Major (was: Minor) > yarn job args changed by ContainerLaunch.expandEnvironment(), such as

[jira] [Updated] (YARN-7062) yarn job args changed by ContainerLaunch.expandEnvironment(), such as "{{" and "}}"

2017-08-20 Thread Lingfeng Su (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lingfeng Su updated YARN-7062: -- Description: I passed a json string like "{User: Billy, {Age: 18}}" to main method args, when running

[jira] [Commented] (YARN-6047) Documentation updates for TimelineService v2

2017-08-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16134548#comment-16134548 ] Hadoop QA commented on YARN-6047: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7044) TestContainerAllocation#testAMContainerAllocationWhenDNSUnavailable fails on trunk

2017-08-20 Thread Lingfeng Su (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16134442#comment-16134442 ] Lingfeng Su commented on YARN-7044: --- I met the same problem when running junit test in

[jira] [Updated] (YARN-6979) Add flag to notify all types of container updates to NM via NodeHeartbeatResponse

2017-08-20 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6979: -- Summary: Add flag to notify all types of container updates to NM via NodeHeartbeatResponse (was: Add

[jira] [Reopened] (YARN-6979) Add flag to notify all types of container updates to NM via NodeHeartbeatResponse

2017-08-20 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh reopened YARN-6979: --- Re-opening to fix a class name and add some minor javadocs > Add flag to notify all types of container

[jira] [Commented] (YARN-7057) FSAppAttempt#getResourceUsage doesn't need to consider resources queued for preemption

2017-08-20 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16134487#comment-16134487 ] Karthik Kambatla commented on YARN-7057: The test failure in CapacityScheduler should be unrelated.

[jira] [Updated] (YARN-7062) yarn job args changed by ContainerLaunch.expandEnvironment(), such as "{{" and "}}"

2017-08-20 Thread Lingfeng Su (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lingfeng Su updated YARN-7062: -- Description: I passed a json string like "{User: Billy, {Age: 18}}" to main method args, when running

[jira] [Updated] (YARN-7062) yarn job args changed by ContainerLaunch.expandEnvironment(), such as "{{" and "}}"

2017-08-20 Thread Lingfeng Su (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lingfeng Su updated YARN-7062: -- Priority: Minor (was: Major) > yarn job args changed by ContainerLaunch.expandEnvironment(), such as

[jira] [Commented] (YARN-7058) Add null check in AMRMClientImpl#getMatchingRequest

2017-08-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16134454#comment-16134454 ] Hadoop QA commented on YARN-7058: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6960) definition of active queue allows idle long-running apps to distort fair shares

2017-08-20 Thread Steven Rand (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Rand updated YARN-6960: -- Attachment: YARN-6960.002.patch Attaching a slightly modified patch that sets the fair share of an

[jira] [Created] (YARN-7060) Consider using delegation token for publishing entities from NM

2017-08-20 Thread Varun Saxena (JIRA)
Varun Saxena created YARN-7060: -- Summary: Consider using delegation token for publishing entities from NM Key: YARN-7060 URL: https://issues.apache.org/jira/browse/YARN-7060 Project: Hadoop YARN

[jira] [Created] (YARN-7059) Use app user to publish entities from NM

2017-08-20 Thread Varun Saxena (JIRA)
Varun Saxena created YARN-7059: -- Summary: Use app user to publish entities from NM Key: YARN-7059 URL: https://issues.apache.org/jira/browse/YARN-7059 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Updated] (YARN-7061) Use token for communication between NM and node collector

2017-08-20 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-7061: --- Description: We can consider using token for communication between NM and node collector once

[jira] [Commented] (YARN-6979) Add flag to notify all types of container updates to NM via NodeHeartbeatResponse

2017-08-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16134505#comment-16134505 ] Hadoop QA commented on YARN-6979: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6047) Documentation updates for TimelineService v2

2017-08-20 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-6047: --- Attachment: TimelineServiceV2.html > Documentation updates for TimelineService v2 >

[jira] [Updated] (YARN-6047) Documentation updates for TimelineService v2

2017-08-20 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-6047: --- Attachment: YARN-6047-YARN-5355.004.patch Made some changes in documentation for security and changed

[jira] [Commented] (YARN-6979) Add flag to allow all container updates to be initiated via NodeHeartbeatResponse

2017-08-20 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1613#comment-1613 ] Arun Suresh commented on YARN-6979: --- +1, Will check this in shortly > Add flag to allow all container

[jira] [Updated] (YARN-6979) Add flag to notify all types of container updates to NM via NodeHeartbeatResponse

2017-08-20 Thread kartheek muthyala (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kartheek muthyala updated YARN-6979: Attachment: YARN-6979.addendum-001.patch Attaching the addendum patch for renaming

[jira] [Updated] (YARN-7062) yarn job args changed by ContainerLaunch.expandEnvironment(), such as "{{" and "}}"

2017-08-20 Thread Lingfeng Su (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lingfeng Su updated YARN-7062: -- Description: I passed a json string like "{User: Billy, {Age: 18}}" to main method args, when running

[jira] [Updated] (YARN-7062) yarn job args changed by ContainerLaunch.expandEnvironment(), such as "{{" and "}}"

2017-08-20 Thread Lingfeng Su (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lingfeng Su updated YARN-7062: -- Description: I passed a json string like "{User: Billy, {Age: 18}}" to main method args, when running

[jira] [Commented] (YARN-6475) Fix some long function checkstyle issues

2017-08-20 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16134517#comment-16134517 ] Arun Suresh commented on YARN-6475: --- [~templedf] / [~soumabrata], can we cherry-pick this to branch-2 as

[jira] [Commented] (YARN-6861) Reader API for sub application entities

2017-08-20 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16134540#comment-16134540 ] Varun Saxena commented on YARN-6861: BTW, should we return the app user id as well in INFO. There is no

[jira] [Commented] (YARN-6979) Add flag to notify all types of container updates to NM via NodeHeartbeatResponse

2017-08-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16134472#comment-16134472 ] Hudson commented on YARN-6979: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12215 (See

[jira] [Created] (YARN-7061) Use token for communication between NM and node collector

2017-08-20 Thread Varun Saxena (JIRA)
Varun Saxena created YARN-7061: -- Summary: Use token for communication between NM and node collector Key: YARN-7061 URL: https://issues.apache.org/jira/browse/YARN-7061 Project: Hadoop YARN

[jira] [Commented] (YARN-6979) Add flag to notify all types of container updates to NM via NodeHeartbeatResponse

2017-08-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16134512#comment-16134512 ] Hudson commented on YARN-6979: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12216 (See

[jira] [Created] (YARN-7062) yarn job args changed by ContainerLaunch.expandEnvironment(), such as "{{" and "}}"

2017-08-20 Thread Lingfeng Su (JIRA)
Lingfeng Su created YARN-7062: - Summary: yarn job args changed by ContainerLaunch.expandEnvironment(), such as "{{" and "}}" Key: YARN-7062 URL: https://issues.apache.org/jira/browse/YARN-7062 Project:

[jira] [Updated] (YARN-7062) yarn job args changed by ContainerLaunch.expandEnvironment(), such as "{{" and "}}"

2017-08-20 Thread Lingfeng Su (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lingfeng Su updated YARN-7062: -- Description: I passed a json string like "{User: Billy, {Age: 18}}" to main method args, when running

[jira] [Commented] (YARN-7047) Moving logging APIs over to slf4j in hadoop-yarn-server-nodemanager

2017-08-20 Thread Yeliang Cang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16134701#comment-16134701 ] Yeliang Cang commented on YARN-7047: Thanks [~ajisakaa] for the review! Submit patch004 to undo changes

[jira] [Comment Edited] (YARN-6979) Add flag to notify all types of container updates to NM via NodeHeartbeatResponse

2017-08-20 Thread kartheek muthyala (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16134685#comment-16134685 ] kartheek muthyala edited comment on YARN-6979 at 8/21/17 4:08 AM: -- Thank

[jira] [Commented] (YARN-6979) Add flag to notify all types of container updates to NM via NodeHeartbeatResponse

2017-08-20 Thread kartheek muthyala (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16134685#comment-16134685 ] kartheek muthyala commented on YARN-6979: - Thank you Arun for the review and committing this to

[jira] [Updated] (YARN-6384) Add configuratin to set max cpu usage when strict-resource-usage is false with cgroups

2017-08-20 Thread dengkai (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dengkai updated YARN-6384: -- Attachment: YARN-6384-0.patch > Add configuratin to set max cpu usage when strict-resource-usage is false >

[jira] [Commented] (YARN-6861) Reader API for sub application entities

2017-08-20 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16134640#comment-16134640 ] Rohith Sharma K S commented on YARN-6861: - bq. should we return the app user id as well in INFO As

[jira] [Updated] (YARN-7047) Moving logging APIs over to slf4j in hadoop-yarn-server-nodemanager

2017-08-20 Thread Yeliang Cang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yeliang Cang updated YARN-7047: --- Attachment: YARN-7047.004.patch > Moving logging APIs over to slf4j in hadoop-yarn-server-nodemanager

[jira] [Commented] (YARN-7035) Add health checker to ResourceManager

2017-08-20 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16134636#comment-16134636 ] sandflee commented on YARN-7035: Thanks [~yufeigu], YARN-6061 is very useful to handle critical thread

[jira] [Commented] (YARN-7047) Moving logging APIs over to slf4j in hadoop-yarn-server-nodemanager

2017-08-20 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16134690#comment-16134690 ] Akira Ajisaka commented on YARN-7047: - bq. LOG in "IOUtils.cleanup(LOG, os);" is defined in

[jira] [Commented] (YARN-7047) Moving logging APIs over to slf4j in hadoop-yarn-server-nodemanager

2017-08-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16134727#comment-16134727 ] Hadoop QA commented on YARN-7047: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-7047) Moving logging APIs over to slf4j in hadoop-yarn-server-nodemanager

2017-08-20 Thread Yeliang Cang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16132989#comment-16132989 ] Yeliang Cang edited comment on YARN-7047 at 8/20/17 11:06 AM: -- In

[jira] [Commented] (YARN-6979) Add flag to allow all container updates to be initiated via NodeHeartbeatResponse

2017-08-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16134388#comment-16134388 ] Hadoop QA commented on YARN-6979: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-7058) Add null check in AMRMClientImpl#getMatchingRequest

2017-08-20 Thread Kousuke Saruta (JIRA)
Kousuke Saruta created YARN-7058: Summary: Add null check in AMRMClientImpl#getMatchingRequest Key: YARN-7058 URL: https://issues.apache.org/jira/browse/YARN-7058 Project: Hadoop YARN Issue

[jira] [Assigned] (YARN-7058) Add null check in AMRMClientImpl#getMatchingRequest

2017-08-20 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta reassigned YARN-7058: Assignee: Kousuke Saruta > Add null check in AMRMClientImpl#getMatchingRequest >

[jira] [Updated] (YARN-7058) Add null check in AMRMClientImpl#getMatchingRequest

2017-08-20 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated YARN-7058: - Attachment: YARN-7058-branch-2.001.patch > Add null check in AMRMClientImpl#getMatchingRequest >

[jira] [Commented] (YARN-6979) Add flag to allow all container updates to be initiated via NodeHeartbeatResponse

2017-08-20 Thread kartheek muthyala (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16134410#comment-16134410 ] kartheek muthyala commented on YARN-6979: - [~asuresh], I have fixed the unit test according to your

[jira] [Updated] (YARN-6960) definition of active queue allows idle long-running apps to distort fair shares

2017-08-20 Thread Steven Rand (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Rand updated YARN-6960: -- Attachment: YARN-6960.001.patch > definition of active queue allows idle long-running apps to distort

[jira] [Commented] (YARN-6960) definition of active queue allows idle long-running apps to distort fair shares

2017-08-20 Thread Steven Rand (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16134416#comment-16134416 ] Steven Rand commented on YARN-6960: --- [~dan...@cloudera.com], I've uploaded a patch proposing a new

[jira] [Commented] (YARN-7043) Cleanup ResourceProfileManager

2017-08-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16134355#comment-16134355 ] Hadoop QA commented on YARN-7043: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6861) Reader API for sub application entities

2017-08-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16134333#comment-16134333 ] Hadoop QA commented on YARN-6861: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6979) Add flag to allow all container updates to be initiated via NodeHeartbeatResponse

2017-08-20 Thread kartheek muthyala (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kartheek muthyala updated YARN-6979: Attachment: YARN-6979.003.patch On top of the last version of the patch, this patch enhances

[jira] [Updated] (YARN-7043) Cleanup ResourceProfileManager

2017-08-20 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7043: -- Attachment: YARN-7043.YARN-3926.004.patch Fixed jenkins. > Cleanup ResourceProfileManager >