[jira] [Updated] (YARN-8414) Nodemanager crashes soon if ATSv2 HBase is either down or absent

2018-06-11 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8414: Description: Test cluster has 1000 apps running, and a user trigger capacity scheduler queue changes.

[jira] [Updated] (YARN-8414) Nodemanager crashes soon if ATSv2 HBase is either down or absent

2018-06-11 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8414: Description: Test cluster has 1000 apps running, and a user trigger capacity scheduler queue changes.

[jira] [Commented] (YARN-8370) Some nodemanager tests fail on Windows due to improper path/file separator

2018-06-11 Thread Anbang Hu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16508983#comment-16508983 ] Anbang Hu commented on YARN-8370: - Thanks [~giovanni.fumarola] for the reminder. Uploaded an updated

[jira] [Commented] (YARN-8412) Move ResourceRequest.clone logic everywhere into a proper API

2018-06-11 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16509005#comment-16509005 ] genericqa commented on YARN-8412: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8415) TimelineWebServices.getEntity should throw a ForbiddenException(403) instead of 404 when ACL checks fail

2018-06-11 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-8415: --- Description: {noformat} private TimelineEntity doGetEntity( String entityType,

[jira] [Updated] (YARN-8415) TimelineWebServices.getEntity should throw a ForbiddenException(403) instead of 404 when ACL checks fail

2018-06-11 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-8415: --- Description: {noformat} private TimelineEntity doGetEntity( String entityType,

[jira] [Commented] (YARN-8416) YARN in HA not failing over to a new resource manager.

2018-06-11 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16509015#comment-16509015 ] Takanobu Asanuma commented on YARN-8416: Moved this jira to YARN project. > YARN in HA not

[jira] [Commented] (YARN-8415) TimelineWebServices.getEntity should throw a ForbiddenException(403) instead of 404 when ACL checks fail

2018-06-11 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16509080#comment-16509080 ] genericqa commented on YARN-8415: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8370) Some Node Manager tests fail on Windows due to improper path/file separator

2018-06-11 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16509087#comment-16509087 ] Íñigo Goiri commented on YARN-8370: --- The Yetus run is clean and the unit tests passing. +1 on

[jira] [Created] (YARN-8417) Should skip passing HDFS_HOME, HADOOP_CONF_DIR, JAVA_HOME, etc. to Docker container.

2018-06-11 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-8417: Summary: Should skip passing HDFS_HOME, HADOOP_CONF_DIR, JAVA_HOME, etc. to Docker container. Key: YARN-8417 URL: https://issues.apache.org/jira/browse/YARN-8417 Project:

[jira] [Updated] (YARN-8370) Some Node Manager tests fail on Windows due to improper path/file separator

2018-06-11 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated YARN-8370: -- Summary: Some Node Manager tests fail on Windows due to improper path/file separator (was: Some

[jira] [Commented] (YARN-8403) Nodemanager logs failed to download file with INFO level

2018-06-11 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16508999#comment-16508999 ] genericqa commented on YARN-8403: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8415) TimelineWebServices.getEntity should throw a ForbiddenException(403) instead of 404 when ACL checks fail

2018-06-11 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-8415: --- Description: {noformat} private TimelineEntity doGetEntity( String entityType,

[jira] [Updated] (YARN-8415) TimelineWebServices.getEntity should throw a ForbiddenException(403) instead of 404 when ACL checks fail

2018-06-11 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-8415: --- Description: {noformat} private TimelineEntity doGetEntity( String entityType,

[jira] [Moved] (YARN-8416) YARN in HA not failing over to a new resource manager.

2018-06-11 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma moved HDFS-13669 to YARN-8416: --- Affects Version/s: (was: 2.7.1) 2.7.1

[jira] [Updated] (YARN-8415) TimelineWebServices.getEntity should throw a ForbiddenException(403) instead of 404 when ACL checks fail

2018-06-11 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-8415: --- Summary: TimelineWebServices.getEntity should throw a ForbiddenException(403) instead of 404

[jira] [Commented] (YARN-8370) Some Node Manager tests fail on Windows due to improper path/file separator

2018-06-11 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16509061#comment-16509061 ] genericqa commented on YARN-8370: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8406) Do the improvement to the FSLeafQueue about calculating fair share for apps

2018-06-11 Thread zhuqi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-8406: Attachment: YARN-7467-002.patch > Do the improvement to the FSLeafQueue about calculating fair share for apps >

[jira] [Updated] (YARN-8406) Do the improvement to the FSLeafQueue about calculating fair share for apps

2018-06-11 Thread zhuqi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-8406: Attachment: (was: YARN-7467-002.patch) > Do the improvement to the FSLeafQueue about calculating fair share for

[jira] [Comment Edited] (YARN-7467) FSLeafQueue unnecessarily calls ComputeFairShares.computeShare() to calculate fair share for apps

2018-06-11 Thread zhuqi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16509074#comment-16509074 ] zhuqi edited comment on YARN-7467 at 6/12/18 2:40 AM: -- [~templedf] , thanks for your

[jira] [Comment Edited] (YARN-8403) Nodemanager logs failed to download file with INFO level

2018-06-11 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16508697#comment-16508697 ] Eric Yang edited comment on YARN-8403 at 6/11/18 10:49 PM: --- [~vinodkv],

[jira] [Commented] (YARN-8403) Nodemanager logs failed to download file with INFO level

2018-06-11 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16508908#comment-16508908 ] Eric Yang commented on YARN-8403: - - Patch 003 added test case. > Nodemanager logs failed to download

[jira] [Updated] (YARN-8403) Nodemanager logs failed to download file with INFO level

2018-06-11 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8403: Attachment: (was: YARN-8403.003.patch) > Nodemanager logs failed to download file with INFO level >

[jira] [Commented] (YARN-8242) YARN NM: OOM error while reading back the state store on recovery

2018-06-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16508948#comment-16508948 ] Wangda Tan commented on YARN-8242: -- Given there's no more progress on this Jira, and this is not a

[jira] [Assigned] (YARN-8415) TimelineWebServices should throw a ForbiddenException(403) instead of 404 when ACL checks fail

2018-06-11 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad reassigned YARN-8415: -- Assignee: Suma Shivaprasad > TimelineWebServices should throw a

[jira] [Updated] (YARN-8415) TimelineWebServices should throw a ForbiddenException(403) instead of 404 when ACL checks fail

2018-06-11 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-8415: --- Summary: TimelineWebServices should throw a ForbiddenException(403) instead of 404 when ACL

[jira] [Created] (YARN-8415) TimelineWebServices should throw a ForBiddenException ( 403

2018-06-11 Thread Suma Shivaprasad (JIRA)
Suma Shivaprasad created YARN-8415: -- Summary: TimelineWebServices should throw a ForBiddenException ( 403 Key: YARN-8415 URL: https://issues.apache.org/jira/browse/YARN-8415 Project: Hadoop YARN

[jira] [Updated] (YARN-8415) TimelineWebServices.getEntity should throw a ForbiddenException(403) instead of 404 when ACL checks fail

2018-06-11 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-8415: --- Attachment: YARN-8415.2.patch > TimelineWebServices.getEntity should throw a

[jira] [Commented] (YARN-8415) TimelineWebServices.getEntity should throw a ForbiddenException(403) instead of 404 when ACL checks fail

2018-06-11 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16509057#comment-16509057 ] Suma Shivaprasad commented on YARN-8415: Removed logging of domainId for getEntity calls since it

[jira] [Commented] (YARN-8415) TimelineWebServices.getEntity should throw a ForbiddenException(403) instead of 404 when ACL checks fail

2018-06-11 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16509103#comment-16509103 ] genericqa commented on YARN-8415: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8370) Some Node Manager tests fail on Windows due to improper path/file separator

2018-06-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16509102#comment-16509102 ] Hudson commented on YARN-8370: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14402 (See

[jira] [Commented] (YARN-8220) Running Tensorflow on YARN with GPU and Docker - Examples

2018-06-11 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16509112#comment-16509112 ] Eric Yang commented on YARN-8220: - [~leftnoteasy] If JAVA_HOME, CLASSPATH, HDFS_HOME are not changeable.

[jira] [Commented] (YARN-8419) In "New Service" section of new YARN UI, user cannot submit service as Submit button is always disabled.

2018-06-11 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16509195#comment-16509195 ] Sunil Govindan commented on YARN-8419: -- Thanks [~suma.shivaprasad]. Patch looks straight forward.

[jira] [Assigned] (YARN-8419) In "New Service" section of new YARN UI, user cannot submit service as Submit button is always disabled.

2018-06-11 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan reassigned YARN-8419: Assignee: Suma Shivaprasad > In "New Service" section of new YARN UI, user cannot submit

[jira] [Updated] (YARN-8257) Native service should automatically adding escapes for environment/launch cmd before sending to YARN

2018-06-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8257: - Target Version/s: 3.1.2 > Native service should automatically adding escapes for environment/launch cmd

[jira] [Updated] (YARN-8257) Native service should automatically adding escapes for environment/launch cmd before sending to YARN

2018-06-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8257: - Target Version/s: (was: 3.1.1) > Native service should automatically adding escapes for

[jira] [Updated] (YARN-8370) Some nodemanager tests fail on Windows due to improper path/file separator

2018-06-11 Thread Anbang Hu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anbang Hu updated YARN-8370: Description: Following nodemanager tests fail on Windows due to path/file separator issue: *

[jira] [Updated] (YARN-8370) Some nodemanager tests fail on Windows due to improper path/file separator

2018-06-11 Thread Anbang Hu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anbang Hu updated YARN-8370: Description: Following nodemanager tests fail on Windows due to path/file separator issue: *

[jira] [Comment Edited] (YARN-7467) FSLeafQueue unnecessarily calls ComputeFairShares.computeShare() to calculate fair share for apps

2018-06-11 Thread zhuqi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16509074#comment-16509074 ] zhuqi edited comment on YARN-7467 at 6/12/18 2:05 AM: -- [~templedf] , thanks for your

[jira] [Commented] (YARN-5565) Capacity Scheduler not assigning value correctly.

2018-06-11 Thread gurmukh singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16509115#comment-16509115 ] gurmukh singh commented on YARN-5565: - This behavior is still true for 2.7.6. > Capacity Scheduler

[jira] [Commented] (YARN-8413) Flow activity page is failing with "Timeline server failed with an error"

2018-06-11 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16509154#comment-16509154 ] Sunil Govindan commented on YARN-8413: -- Setting async to false means that the statement you are

[jira] [Commented] (YARN-8404) RM Event dispatcher is blocked if ATS1/1.5 server is not running.

2018-06-11 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16509149#comment-16509149 ] Sunil Govindan commented on YARN-8404: -- I offline synced up with [~rohithsharma]. Moving async

[jira] [Updated] (YARN-8413) Flow activity page is failing with "Timeline server failed with an error"

2018-06-11 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8413: - Attachment: YARN-8413.001.patch > Flow activity page is failing with "Timeline server failed with

[jira] [Assigned] (YARN-8413) Flow activity page is failing with "Timeline server failed with an error"

2018-06-11 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan reassigned YARN-8413: Assignee: Sunil Govindan > Flow activity page is failing with "Timeline server failed with

[jira] [Updated] (YARN-8419) In "New Service" section of new YARN UI, user cannot submit service as Submit button is always disabled.

2018-06-11 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-8419: --- Attachment: YARN-8419.1.patch > In "New Service" section of new YARN UI, user cannot submit

[jira] [Commented] (YARN-8413) Flow activity page is failing with "Timeline server failed with an error"

2018-06-11 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16509200#comment-16509200 ] genericqa commented on YARN-8413: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-8414) Nodemanager crashes soon if ATSv2 HBase is either down or absent

2018-06-11 Thread Eric Yang (JIRA)
Eric Yang created YARN-8414: --- Summary: Nodemanager crashes soon if ATSv2 HBase is either down or absent Key: YARN-8414 URL: https://issues.apache.org/jira/browse/YARN-8414 Project: Hadoop YARN

[jira] [Commented] (YARN-8414) Nodemanager crashes soon if ATSv2 HBase is either down or absent

2018-06-11 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16508922#comment-16508922 ] Eric Yang commented on YARN-8414: - Timeline collector retries HBase write without any pause in between

[jira] [Created] (YARN-8413) Flow activity page is failing with "Timeline server failed with an error"

2018-06-11 Thread Yesha Vora (JIRA)
Yesha Vora created YARN-8413: Summary: Flow activity page is failing with "Timeline server failed with an error" Key: YARN-8413 URL: https://issues.apache.org/jira/browse/YARN-8413 Project: Hadoop YARN

[jira] [Commented] (YARN-8234) Improve RM system metrics publisher's performance by pushing events to timeline server in batch

2018-06-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16508952#comment-16508952 ] Wangda Tan commented on YARN-8234: -- Bulk update on non-blocker issues which are targeted to 3.1.1: If

[jira] [Updated] (YARN-8370) Some nodemanager tests fail on Windows due to improper path/file separator

2018-06-11 Thread Anbang Hu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anbang Hu updated YARN-8370: Description: Following nodemanager tests fail on Windows due to path/file separator issue: *

[jira] [Commented] (YARN-8363) Upgrade common-langs version to 3.7 in hadoop-yarn-project

2018-06-11 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16509059#comment-16509059 ] Takanobu Asanuma commented on YARN-8363: Uploaded the 2nd patch addressing the whitespace issue.

[jira] [Updated] (YARN-8406) Do the improvement to the FSLeafQueue about calculating fair share for apps

2018-06-11 Thread zhuqi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-8406: Attachment: test 02.png > Do the improvement to the FSLeafQueue about calculating fair share for apps >

[jira] [Commented] (YARN-8411) Enable stopped system services to be started during RM start

2018-06-11 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16509131#comment-16509131 ] genericqa commented on YARN-8411: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8403) Nodemanager logs failed to download file with INFO level

2018-06-11 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8403: Attachment: YARN-8403.003.patch > Nodemanager logs failed to download file with INFO level >

[jira] [Updated] (YARN-8403) Nodemanager logs failed to download file with INFO level

2018-06-11 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8403: Attachment: YARN-8403.003.patch > Nodemanager logs failed to download file with INFO level >

[jira] [Updated] (YARN-8370) Some nodemanager tests fail on Windows due to improper path/file separator

2018-06-11 Thread Anbang Hu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anbang Hu updated YARN-8370: Attachment: YARN-8370.001.patch > Some nodemanager tests fail on Windows due to improper path/file

[jira] [Commented] (YARN-8414) Nodemanager crashes soon if ATSv2 HBase is either down or absent

2018-06-11 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16509039#comment-16509039 ] Eric Yang commented on YARN-8414: - There are general protection code in place to close idle connections:

[jira] [Comment Edited] (YARN-7467) FSLeafQueue unnecessarily calls ComputeFairShares.computeShare() to calculate fair share for apps

2018-06-11 Thread zhuqi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16509074#comment-16509074 ] zhuqi edited comment on YARN-7467 at 6/12/18 2:03 AM: -- [~templedf] , thanks for your

[jira] [Commented] (YARN-7467) FSLeafQueue unnecessarily calls ComputeFairShares.computeShare() to calculate fair share for apps

2018-06-11 Thread zhuqi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16509074#comment-16509074 ] zhuqi commented on YARN-7467: - [~templedf] , thanks for your comment, i should improve my code of course. * I

[jira] [Updated] (YARN-8242) YARN NM: OOM error while reading back the state store on recovery

2018-06-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8242: - Priority: Critical (was: Blocker) > YARN NM: OOM error while reading back the state store on recovery >

[jira] [Updated] (YARN-8363) Upgrade common-langs version to 3.7 in hadoop-yarn-project

2018-06-11 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated YARN-8363: --- Attachment: YARN-8363.2.patch > Upgrade common-langs version to 3.7 in hadoop-yarn-project >

[jira] [Commented] (YARN-8414) Nodemanager crashes soon if ATSv2 HBase is either down or absent

2018-06-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16508954#comment-16508954 ] Wangda Tan commented on YARN-8414: -- Bulk update on non-blocker issues which are targeted to 3.1.1: If

[jira] [Commented] (YARN-8242) YARN NM: OOM error while reading back the state store on recovery

2018-06-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16508958#comment-16508958 ] Wangda Tan commented on YARN-8242: -- Bulk update on non-blocker issues which are targeted to 3.1.1: If

[jira] [Updated] (YARN-8415) TimelineWebServices.getEntity should throw a ForbiddenException(403) instead of 404 when ACL checks fail

2018-06-11 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-8415: --- Attachment: YARN-8415.1.patch > TimelineWebServices.getEntity should throw a

[jira] [Commented] (YARN-8220) Running Tensorflow on YARN with GPU and Docker - Examples

2018-06-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16509094#comment-16509094 ] Wangda Tan commented on YARN-8220: -- Discussed with [~eyang] about this and did some tests: Currently,

[jira] [Updated] (YARN-8411) Enable stopped system services to be started during RM start

2018-06-11 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-8411: - Target Version/s: 3.2.0, 3.1.1 Priority: Critical (was: Major) > Enable stopped

[jira] [Assigned] (YARN-8411) Enable stopped system services to be started during RM start

2018-06-11 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi reassigned YARN-8411: Assignee: Billie Rinaldi > Enable stopped system services to be started during RM start >

[jira] [Updated] (YARN-8411) Enable stopped system services to be started during RM start

2018-06-11 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-8411: - Fix Version/s: (was: 3.2.0) > Enable stopped system services to be started during RM start >

[jira] [Updated] (YARN-8406) Do the improvement to the FSLeafQueue about calculating fair share for apps

2018-06-11 Thread zhuqi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-8406: Attachment: YARN-7467-002.patch > Do the improvement to the FSLeafQueue about calculating fair share for apps >

[jira] [Updated] (YARN-8411) Enable stopped system services to be started during RM start

2018-06-11 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-8411: - Attachment: YARN-8411.01.patch > Enable stopped system services to be started during RM start >

[jira] [Created] (YARN-8418) App local logs could leaked if log aggregation fails to initialize for the app

2018-06-11 Thread Bibin A Chundatt (JIRA)
Bibin A Chundatt created YARN-8418: -- Summary: App local logs could leaked if log aggregation fails to initialize for the app Key: YARN-8418 URL: https://issues.apache.org/jira/browse/YARN-8418

[jira] [Created] (YARN-8419) In "New Service" section of new YARN UI, user cannot submit service as Submit button is always disabled.

2018-06-11 Thread Suma Shivaprasad (JIRA)
Suma Shivaprasad created YARN-8419: -- Summary: In "New Service" section of new YARN UI, user cannot submit service as Submit button is always disabled. Key: YARN-8419 URL:

[jira] [Commented] (YARN-8419) In "New Service" section of new YARN UI, user cannot submit service as Submit button is always disabled.

2018-06-11 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16509216#comment-16509216 ] genericqa commented on YARN-8419: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8405) RM zk-state-store.parent-path ACLs has been changed since HADOOP-14773

2018-06-11 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16508412#comment-16508412 ] Rohith Sharma K S commented on YARN-8405: - thanks [~elgoiri] for patch! My concern on patch is

[jira] [Commented] (YARN-8250) Create another implementation of ContainerScheduler to support NM overallocation

2018-06-11 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16508382#comment-16508382 ] Haibo Chen commented on YARN-8250: -- My apologies, Arun. I did not mean to indicate in any way you are

[jira] [Commented] (YARN-8220) Running Tensorflow on YARN with GPU and Docker - Examples

2018-06-11 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16508408#comment-16508408 ] Eric Yang commented on YARN-8220: - [~leftnoteasy] Base on RunTensorflowJobUsingNativeServiceSpec.md the

[jira] [Commented] (YARN-6931) Make the aggregation interval in AppLevelTimelineCollector configurable

2018-06-11 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16508447#comment-16508447 ] Haibo Chen commented on YARN-6931: -- Thanks [~abmodi] for the patch. I have one minor comment.  We can

[jira] [Commented] (YARN-8250) Create another implementation of ContainerScheduler to support NM overallocation

2018-06-11 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16508385#comment-16508385 ] Haibo Chen commented on YARN-8250: -- In the meantime, I'll try to see how well YARN-6675 works with some

[jira] [Updated] (YARN-8405) RM zk-state-store.parent-path ACLs has been changed since HADOOP-14773

2018-06-11 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated YARN-8405: -- Attachment: YARN-8405.003.patch > RM zk-state-store.parent-path ACLs has been changed since

[jira] [Commented] (YARN-8405) RM zk-state-store.parent-path ACLs has been changed since HADOOP-14773

2018-06-11 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16508377#comment-16508377 ] Íñigo Goiri commented on YARN-8405: --- Thanks [~rohithsharma], I updated the patch with the old method and

[jira] [Assigned] (YARN-8405) RM zk-state-store.parent-path ACLs has been changed since HADOOP-14773

2018-06-11 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli reassigned YARN-8405: - Assignee: Íñigo Goiri > RM zk-state-store.parent-path ACLs has been

[jira] [Updated] (YARN-8363) Upgrade common-langs version to 3.7 in hadoop-yarn-project

2018-06-11 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated YARN-8363: --- Attachment: YARN-8363.1.patch > Upgrade common-langs version to 3.7 in hadoop-yarn-project >

[jira] [Commented] (YARN-8363) Upgrade common-langs version to 3.7 in hadoop-yarn-project

2018-06-11 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16507900#comment-16507900 ] Takanobu Asanuma commented on YARN-8363: Uploaded the 1st patch. I've confirmed that the native

[jira] [Updated] (YARN-8323) FairScheduler.allocConf should be declared as volatile

2018-06-11 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8323: - Attachment: YARN-8323-001.patch > FairScheduler.allocConf should be declared as volatile >

[jira] [Commented] (YARN-8323) FairScheduler.allocConf should be declared as volatile

2018-06-11 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16508052#comment-16508052 ] genericqa commented on YARN-8323: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8323) FairScheduler.allocConf should be declared as volatile

2018-06-11 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16508056#comment-16508056 ] Szilard Nemeth commented on YARN-8323: -- The unit test failure and findbugs warning is unrelated. >

[jira] [Commented] (YARN-6132) SliderClient bondToCluster should call findInstance with live states filter

2018-06-11 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16508193#comment-16508193 ] Daniel Templeton commented on YARN-6132: Can be add a fixed in version for this issue? >

[jira] [Commented] (YARN-8259) Revisit liveliness checks for Docker containers

2018-06-11 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16508198#comment-16508198 ] Jim Brennan commented on YARN-8259: --- I think we should go with Option 1 with documentation to whitelist

[jira] [Commented] (YARN-8363) Upgrade common-langs version to 3.7 in hadoop-yarn-project

2018-06-11 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16508214#comment-16508214 ] genericqa commented on YARN-8363: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4984) LogAggregationService shouldn't swallow exception in handling createAppDir() which cause thread leak.

2018-06-11 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16508220#comment-16508220 ] Bibin A Chundatt commented on YARN-4984: [~leftnoteasy]/[~djp] After the patch there could be a

[jira] [Comment Edited] (YARN-4984) LogAggregationService shouldn't swallow exception in handling createAppDir() which cause thread leak.

2018-06-11 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16508220#comment-16508220 ] Bibin A Chundatt edited comment on YARN-4984 at 6/11/18 3:42 PM: -

[jira] [Comment Edited] (YARN-4984) LogAggregationService shouldn't swallow exception in handling createAppDir() which cause thread leak.

2018-06-11 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16508220#comment-16508220 ] Bibin A Chundatt edited comment on YARN-4984 at 6/11/18 3:44 PM: -

[jira] [Updated] (YARN-6586) YARN to facilitate HTTPS in AM web server

2018-06-11 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated YARN-6586: Attachment: Design Document v1.pdf > YARN to facilitate HTTPS in AM web server >

[jira] [Assigned] (YARN-6586) YARN to facilitate HTTPS in AM web server

2018-06-11 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter reassigned YARN-6586: --- Assignee: Robert Kanter > YARN to facilitate HTTPS in AM web server >

[jira] [Updated] (YARN-6586) YARN to facilitate HTTPS in AM web server

2018-06-11 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated YARN-6586: Attachment: YARN-6586.poc.patch > YARN to facilitate HTTPS in AM web server >

[jira] [Commented] (YARN-6586) YARN to facilitate HTTPS in AM web server

2018-06-11 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16508286#comment-16508286 ] Robert Kanter commented on YARN-6586: - I've written up a design document and created a PoC patch that

[jira] [Comment Edited] (YARN-6586) YARN to facilitate HTTPS in AM web server

2018-06-11 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16508286#comment-16508286 ] Robert Kanter edited comment on YARN-6586 at 6/11/18 4:19 PM: -- I've written

[jira] [Commented] (YARN-8405) RM zk-state-store.parent-path ACLs has been changed since HADOOP-14773

2018-06-11 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16508453#comment-16508453 ] Íñigo Goiri commented on YARN-8405: --- bq. My concern on patch is ZKCuratorManager is utils class which is

[jira] [Created] (YARN-8411) Enable stopped system services to be started during RM start

2018-06-11 Thread Billie Rinaldi (JIRA)
Billie Rinaldi created YARN-8411: Summary: Enable stopped system services to be started during RM start Key: YARN-8411 URL: https://issues.apache.org/jira/browse/YARN-8411 Project: Hadoop YARN

  1   2   >