[jira] [Commented] (YARN-7108) Refreshing Default Node Label Expression of a queue does not reflect for running apps

2017-08-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143419#comment-16143419 ] Sunil G commented on YARN-7108: --- bq.sample mapreduce on default queue Did this MR job submit with any

[jira] [Created] (YARN-7108) Refreshing Default Node Label Expression of a queue does not reflect for running apps

2017-08-28 Thread Prabhu Joseph (JIRA)
Prabhu Joseph created YARN-7108: --- Summary: Refreshing Default Node Label Expression of a queue does not reflect for running apps Key: YARN-7108 URL: https://issues.apache.org/jira/browse/YARN-7108

[jira] [Updated] (YARN-6877) Create an abstract log reader for extendability

2017-08-28 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-6877: Attachment: YARN-6877-trunk.005.patch > Create an abstract log reader for extendability >

[jira] [Commented] (YARN-7051) Avoid concurrent modification exception in FifoIntraQueuePreemptionPlugin

2017-08-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143464#comment-16143464 ] Sunil G commented on YARN-7051: --- Thanks [~eepayne] for the contribution. Committed to trunk/branch-2 and

[jira] [Comment Edited] (YARN-5402) Fix NoSuchMethodError in ClusterMetricsInfo

2017-08-28 Thread yuelongsun (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16135062#comment-16135062 ] yuelongsun edited comment on YARN-5402 at 8/28/17 7:26 AM: --- I got the same

[jira] [Updated] (YARN-7088) Fix application start time and add submit time to UIs

2017-08-28 Thread Abdullah Yousufi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abdullah Yousufi updated YARN-7088: --- Attachment: YARN-7088.001.patch > Fix application start time and add submit time to UIs >

[jira] [Updated] (YARN-7110) NodeManager always crash for spark shuffle service out of memory

2017-08-28 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YunFan Zhou updated YARN-7110: -- Attachment: screenshot-1.png > NodeManager always crash for spark shuffle service out of memory >

[jira] [Commented] (YARN-7091) Rename application to service in yarn-native-services

2017-08-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143521#comment-16143521 ] Hadoop QA commented on YARN-7091: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-7110) NodeManager always crash for spark shuffle service out of memory

2017-08-28 Thread YunFan Zhou (JIRA)
YunFan Zhou created YARN-7110: - Summary: NodeManager always crash for spark shuffle service out of memory Key: YARN-7110 URL: https://issues.apache.org/jira/browse/YARN-7110 Project: Hadoop YARN

[jira] [Updated] (YARN-7110) NodeManager always crash for spark shuffle service out of memory

2017-08-28 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YunFan Zhou updated YARN-7110: -- Component/s: nodemanager > NodeManager always crash for spark shuffle service out of memory >

[jira] [Created] (YARN-7109) Extend aggregation operation for new ATS design

2017-08-28 Thread Zian Chen (JIRA)
Zian Chen created YARN-7109: --- Summary: Extend aggregation operation for new ATS design Key: YARN-7109 URL: https://issues.apache.org/jira/browse/YARN-7109 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Updated] (YARN-7051) Avoid concurrent modification exception in FifoIntraQueuePreemptionPlugin

2017-08-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7051: -- Summary: Avoid concurrent modification exception in FifoIntraQueuePreemptionPlugin (was:

[jira] [Commented] (YARN-7109) Extend aggregation operation for new ATS design

2017-08-28 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143454#comment-16143454 ] Zian Chen commented on YARN-7109: - I would like to resolve this problem. Currently, the

[jira] [Commented] (YARN-7108) Refreshing Default Node Label Expression of a queue does not reflect for running apps

2017-08-28 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143458#comment-16143458 ] Prabhu Joseph commented on YARN-7108: - Have submitted a mapreduce job with default queue and no label

[jira] [Commented] (YARN-7051) Avoid concurrent modification exception in FifoIntraQueuePreemptionPlugin

2017-08-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143460#comment-16143460 ] Hudson commented on YARN-7051: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12253 (See

[jira] [Comment Edited] (YARN-5402) Fix NoSuchMethodError in ClusterMetricsInfo

2017-08-28 Thread yuelongsun (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16135062#comment-16135062 ] yuelongsun edited comment on YARN-5402 at 8/28/17 7:28 AM: --- I got the same

[jira] [Commented] (YARN-6877) Create an abstract log reader for extendability

2017-08-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143487#comment-16143487 ] Hadoop QA commented on YARN-6877: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7088) Fix application start time and add submit time to UIs

2017-08-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143486#comment-16143486 ] Hadoop QA commented on YARN-7088: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-5402) Fix NoSuchMethodError in ClusterMetricsInfo

2017-08-28 Thread yuelongsun (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16135062#comment-16135062 ] yuelongsun edited comment on YARN-5402 at 8/28/17 7:28 AM: --- I got the same

[jira] [Commented] (YARN-7104) Improvement of Heatmap

2017-08-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143509#comment-16143509 ] Sunil G commented on YARN-7104: --- Looks good. I ll test and update in my cluster. > Improvement of Heatmap >

[jira] [Updated] (YARN-7110) NodeManager always crash for spark shuffle service out of memory

2017-08-28 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YunFan Zhou updated YARN-7110: -- Description: NM often crash due to the Spark shuffle service, I can saw many error log messages before

[jira] [Updated] (YARN-7110) NodeManager always crash for spark shuffle service out of memory

2017-08-28 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YunFan Zhou updated YARN-7110: -- Description: NM often crash due to the Spark shuffle service, I can saw many error log messages before

[jira] [Comment Edited] (YARN-7070) some of local cache files for yarn can't be deleted

2017-08-28 Thread Changyao Ye (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143547#comment-16143547 ] Changyao Ye edited comment on YARN-7070 at 8/28/17 9:18 AM: Hi I applied the

[jira] [Commented] (YARN-7070) some of local cache files for yarn can't be deleted

2017-08-28 Thread Changyao Ye (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143547#comment-16143547 ] Changyao Ye commented on YARN-7070: --- Hi I applied the patch YARN-6846, unfortunately the problem was not

[jira] [Created] (YARN-7111) ApplicationHistoryServer webpage startTime and state are not readable

2017-08-28 Thread Prabhu Joseph (JIRA)
Prabhu Joseph created YARN-7111: --- Summary: ApplicationHistoryServer webpage startTime and state are not readable Key: YARN-7111 URL: https://issues.apache.org/jira/browse/YARN-7111 Project: Hadoop YARN

[jira] [Commented] (YARN-7110) NodeManager always crash for spark shuffle service out of memory

2017-08-28 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143834#comment-16143834 ] Jason Lowe commented on YARN-7110: -- The Spark shuffle service is not part of Hadoop but rather the Spark

[jira] [Updated] (YARN-7111) ApplicationHistoryServer webpage startTime and state are not readable

2017-08-28 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-7111: Attachment: Screen Shot 2017-08-28 at 5.24.01 PM.png > ApplicationHistoryServer webpage startTime

[jira] [Commented] (YARN-7108) Refreshing Default Node Label Expression of a queue does not reflect for running apps

2017-08-28 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143812#comment-16143812 ] Prabhu Joseph commented on YARN-7108: - Thought application will implicitly run on queue's configured

[jira] [Commented] (YARN-7070) some of local cache files for yarn can't be deleted

2017-08-28 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143813#comment-16143813 ] Jason Lowe commented on YARN-7070: -- Hmm, at this point we cannot know for sure what's going on here

[jira] [Commented] (YARN-7051) Avoid concurrent modification exception in FifoIntraQueuePreemptionPlugin

2017-08-28 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143830#comment-16143830 ] Eric Payne commented on YARN-7051: -- Thanks [~sunilg] for your help in resolving this problem. > Avoid

[jira] [Commented] (YARN-7108) Refreshing Default Node Label Expression of a queue does not reflect for running apps

2017-08-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143748#comment-16143748 ] Sunil G commented on YARN-7108: --- So if the app is not submitted to any labeled preference, current behavior

[jira] [Commented] (YARN-6894) RM Apps API returns only active apps when query parameter queue used

2017-08-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143821#comment-16143821 ] Hadoop QA commented on YARN-6894: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6894) RM Apps API returns only active apps when query parameter queue used

2017-08-28 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-6894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Novák updated YARN-6894: Attachment: YARN-6894.002.patch > RM Apps API returns only active apps when query parameter queue

[jira] [Commented] (YARN-7108) Refreshing Default Node Label Expression of a queue does not reflect for running apps

2017-08-28 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143825#comment-16143825 ] Bibin A Chundatt commented on YARN-7108: {quote} But refreshing queue's default label to a new

[jira] [Commented] (YARN-7110) NodeManager always crash for spark shuffle service out of memory

2017-08-28 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143954#comment-16143954 ] YunFan Zhou commented on YARN-7110: --- Thank [~jlowe]. Is there a plan for this issue? It seems like it

[jira] [Commented] (YARN-7112) TestAMRMProxy is failing with invalid request

2017-08-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143957#comment-16143957 ] Hadoop QA commented on YARN-7112: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7112) TestAMRMProxy is failing with invalid request

2017-08-28 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143898#comment-16143898 ] Jason Lowe commented on YARN-7112: -- This was broken by YARN-6640. After that change the response ID for

[jira] [Commented] (YARN-7091) Rename application to service in yarn-native-services

2017-08-28 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143839#comment-16143839 ] Billie Rinaldi commented on YARN-7091: -- +1, patch 04 looks good to me. > Rename application to

[jira] [Comment Edited] (YARN-7091) Rename application to service in yarn-native-services

2017-08-28 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143875#comment-16143875 ] Billie Rinaldi edited comment on YARN-7091 at 8/28/17 3:49 PM: --- I found just

[jira] [Created] (YARN-7113) Clean up packaging and dependencies for yarn-native-services

2017-08-28 Thread Billie Rinaldi (JIRA)
Billie Rinaldi created YARN-7113: Summary: Clean up packaging and dependencies for yarn-native-services Key: YARN-7113 URL: https://issues.apache.org/jira/browse/YARN-7113 Project: Hadoop YARN

[jira] [Commented] (YARN-7110) NodeManager always crash for spark shuffle service out of memory

2017-08-28 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143945#comment-16143945 ] Jason Lowe commented on YARN-7110: -- OK, if that's why this was filed in YARN instead of SPARK then this is

[jira] [Commented] (YARN-7091) Rename application to service in yarn-native-services

2017-08-28 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143875#comment-16143875 ] Billie Rinaldi commented on YARN-7091: -- I found just a couple of uses of app that were missed in the

[jira] [Commented] (YARN-7110) NodeManager always crash for spark shuffle service out of memory

2017-08-28 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143894#comment-16143894 ] YunFan Zhou commented on YARN-7110: --- [~jlowe] Thank Jason. I think this is more than just the spark

[jira] [Comment Edited] (YARN-7110) NodeManager always crash for spark shuffle service out of memory

2017-08-28 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143894#comment-16143894 ] YunFan Zhou edited comment on YARN-7110 at 8/28/17 3:26 PM: [~jlowe] Thank

[jira] [Updated] (YARN-7112) TestAMRMProxy is failing with invalid request

2017-08-28 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-7112: - Attachment: YARN-7112.001.patch Attaching a patch that changes BaseAMRMProxyE2ETest to use an initial

[jira] [Created] (YARN-7112) TestAMRMProxy is failing with invalid request

2017-08-28 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-7112: Summary: TestAMRMProxy is failing with invalid request Key: YARN-7112 URL: https://issues.apache.org/jira/browse/YARN-7112 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-7110) NodeManager always crash for spark shuffle service out of memory

2017-08-28 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YunFan Zhou updated YARN-7110: -- Description: NM often crash due to the Spark shuffle service, I can saw many error log messages before

[jira] [Comment Edited] (YARN-7110) NodeManager always crash for spark shuffle service out of memory

2017-08-28 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143894#comment-16143894 ] YunFan Zhou edited comment on YARN-7110 at 8/28/17 3:27 PM: [~jlowe] Thank

[jira] [Commented] (YARN-7109) Extend aggregation operation for new ATS design

2017-08-28 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143974#comment-16143974 ] Vrushali C commented on YARN-7109: -- Hi [~Zian Chen] Yes, we do want to add in more operations for

[jira] [Commented] (YARN-7107) add ability in Fair Scheduler to configure whether disable a queue

2017-08-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144085#comment-16144085 ] Daniel Templeton commented on YARN-7107: +1 on the need to disable queues. I was just saying last

[jira] [Assigned] (YARN-7109) Extend aggregation operation for new ATS design

2017-08-28 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu reassigned YARN-7109: --- Assignee: Zian Chen > Extend aggregation operation for new ATS design >

[jira] [Commented] (YARN-7109) Extend aggregation operation for new ATS design

2017-08-28 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144140#comment-16144140 ] Li Lu commented on YARN-7109: - BTW [~Zian Chen] you may want to find out some documentations here:

[jira] [Updated] (YARN-6709) Root privilege escalation in experimental Docker support

2017-08-28 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-6709: --- Release Note: CVE-2017-7669 / YARN's Docker support did not do enough input validation. This

[jira] [Updated] (YARN-7076) yarn application -list -appTypes is not working

2017-08-28 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7076: -- Attachment: YARN-7076.01.patch > yarn application -list -appTypes is not working >

[jira] [Updated] (YARN-6845) Variable scheduler of FSLeafQueue duplicates the one of its parent FSQueue.

2017-08-28 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-6845: --- Fix Version/s: (was: 2.9) 2.9.0 > Variable scheduler of FSLeafQueue

[jira] [Updated] (YARN-5697) Use CliParser to parse options in RMAdminCLI

2017-08-28 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-5697: --- Component/s: resourcemanager > Use CliParser to parse options in RMAdminCLI >

[jira] [Commented] (YARN-7075) [YARN-3368] Improvement of Web UI

2017-08-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144132#comment-16144132 ] Wangda Tan commented on YARN-7075: -- Thanks [~dingda6], updated UI looks definitely better than original

[jira] [Commented] (YARN-7109) Extend aggregation operation for new ATS design

2017-08-28 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144138#comment-16144138 ] Li Lu commented on YARN-7109: - Thanks for the proposal [~Zian Chen]! I've already added you to the contributor

[jira] [Commented] (YARN-5219) When an export var command fails in launch_container.sh, the full container launch should fail

2017-08-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144171#comment-16144171 ] Wangda Tan commented on YARN-5219: -- Latest patch LGTM, will commit tomorrow if no opposite opinions. >

[jira] [Commented] (YARN-7076) yarn application -list -appTypes is not working

2017-08-28 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144176#comment-16144176 ] Jian He commented on YARN-7076: --- attached a patch which makes ClientRMService#getApplications to be case

[jira] [Commented] (YARN-7112) TestAMRMProxy is failing with invalid request

2017-08-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144118#comment-16144118 ] Wangda Tan commented on YARN-7112: -- LGTM, +1. Thanks [~jlowe]. Committing now. > TestAMRMProxy is

[jira] [Commented] (YARN-7108) Refreshing Default Node Label Expression of a queue does not reflect for running apps

2017-08-28 Thread Feng Yuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144127#comment-16144127 ] Feng Yuan commented on YARN-7108: - Agree with [~bibinchundatt], pre job ResourceRequest label is setted

[jira] [Commented] (YARN-6930) Admins should be able to explicitly enable specific LinuxContainerRuntime in the NodeManager

2017-08-28 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144155#comment-16144155 ] Shane Kumpf commented on YARN-6930: --- Thanks for the feedback [~jlowe] and [~ebadger]. I have uploaded a

[jira] [Commented] (YARN-2162) add ability in Fair Scheduler to optionally configure maxResources in terms of percentage

2017-08-28 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144156#comment-16144156 ] Yufei Gu commented on YARN-2162: [~wangda], according to the design doc in YARN-5881, the mixed

[jira] [Updated] (YARN-6959) RM may allocate wrong AM Container for new attempt

2017-08-28 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-6959: --- Target Version/s: 3.0.0-alpha4, 2.7.1, 2.8.0 (was: 2.8.0, 2.7.1, 3.0.0-alpha4)

[jira] [Created] (YARN-7114) NM can fail during shutdown with log aggregation

2017-08-28 Thread Eric Badger (JIRA)
Eric Badger created YARN-7114: - Summary: NM can fail during shutdown with log aggregation Key: YARN-7114 URL: https://issues.apache.org/jira/browse/YARN-7114 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-7104) Improvement of Heatmap

2017-08-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144133#comment-16144133 ] Wangda Tan commented on YARN-7104: -- Thanks [~dingda6], could you update title/desc to include more details

[jira] [Updated] (YARN-6930) Admins should be able to explicitly enable specific LinuxContainerRuntime in the NodeManager

2017-08-28 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-6930: -- Attachment: YARN-6930.004.patch > Admins should be able to explicitly enable specific

[jira] [Commented] (YARN-7099) ResourceHandlerModule.parseConfiguredCGroupPath only works for privileged yarn users.

2017-08-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144105#comment-16144105 ] Hudson commented on YARN-7099: -- ABORTED: Integrated in Jenkins build Hadoop-trunk-Commit #12254 (See

[jira] [Assigned] (YARN-5697) Use CliParser to parse options in RMAdminCLI

2017-08-28 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer reassigned YARN-5697: -- Assignee: Tao Jie (was: Jonathan Hung) > Use CliParser to parse options in RMAdminCLI

[jira] [Updated] (YARN-6999) Add log about how to solve Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster

2017-08-28 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-6999: --- Fix Version/s: (was: 2.9) 2.9.0 > Add log about how to solve Error:

[jira] [Updated] (YARN-6778) In ResourceWeights, weights and setWeights() should be final

2017-08-28 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-6778: --- Fix Version/s: (was: 2.9) 2.9.0 > In ResourceWeights, weights and

[jira] [Updated] (YARN-6307) Refactor FairShareComparator#compare

2017-08-28 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-6307: --- Fix Version/s: (was: 2.9) 2.9.0 > Refactor FairShareComparator#compare

[jira] [Updated] (YARN-7112) TestAMRMProxy is failing with invalid request

2017-08-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7112: - Fix Version/s: 3.0.0-beta1 2.9.0 > TestAMRMProxy is failing with invalid request >

[jira] [Updated] (YARN-6798) Fix NM startup failure with old state store due to version mismatch

2017-08-28 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-6798: --- Release Note: This fixes the LevelDB state store for the NodeManager. As of this patch, the

[jira] [Updated] (YARN-7095) Federation: routing REST invocations transparently to multiple RMs (part 3 - getNodes)

2017-08-28 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-7095: --- Attachment: YARN-7095.v1.patch > Federation: routing REST invocations

[jira] [Updated] (YARN-5816) TestDelegationTokenRenewer#testCancelWithMultipleAppSubmissions is still flakey

2017-08-28 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated YARN-5816: Attachment: YARN-5816.001.patch Like many flakey tests, this issue is due to timing. The test is

[jira] [Commented] (YARN-6930) Admins should be able to explicitly enable specific LinuxContainerRuntime in the NodeManager

2017-08-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144243#comment-16144243 ] Hadoop QA commented on YARN-6930: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7088) Fix application start time and add submit time to UIs

2017-08-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144251#comment-16144251 ] Hadoop QA commented on YARN-7088: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7066) Add ability to specify volumes to mount for DockerContainerRuntime

2017-08-28 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144290#comment-16144290 ] Shane Kumpf commented on YARN-7066: --- [~eyang] thanks for the patch. This seems to duplicate what we

[jira] [Commented] (YARN-7112) TestAMRMProxy is failing with invalid request

2017-08-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144208#comment-16144208 ] Hudson commented on YARN-7112: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12255 (See

[jira] [Updated] (YARN-6930) Admins should be able to explicitly enable specific LinuxContainerRuntime in the NodeManager

2017-08-28 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-6930: -- Attachment: YARN-6930.005.patch > Admins should be able to explicitly enable specific

[jira] [Commented] (YARN-7076) yarn application -list -appTypes is not working

2017-08-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144261#comment-16144261 ] Hadoop QA commented on YARN-7076: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7034) DefaultLinuxContainerRuntime and DockerLinuxContainerRuntime sends client environment variables to container-executor

2017-08-28 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144277#comment-16144277 ] Robert Kanter commented on YARN-7034: - We generally trust the yarn user, and the cluster admin who set

[jira] [Commented] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-08-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144207#comment-16144207 ] Wangda Tan commented on YARN-6623: -- Thanks [~vvasudev], Apologize for the delays. I haven't done any

[jira] [Assigned] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-08-28 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen reassigned YARN-4511: Assignee: Haibo Chen (was: Karthik Kambatla) > Common scheduler changes supporting

[jira] [Updated] (YARN-7088) Fix application start time and add submit time to UIs

2017-08-28 Thread Abdullah Yousufi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abdullah Yousufi updated YARN-7088: --- Attachment: YARN-7088.002.patch > Fix application start time and add submit time to UIs >

[jira] [Commented] (YARN-6930) Admins should be able to explicitly enable specific LinuxContainerRuntime in the NodeManager

2017-08-28 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144252#comment-16144252 ] Shane Kumpf commented on YARN-6930: --- I'll upload a new patch to address the checkstyle issue. The test

[jira] [Assigned] (YARN-7076) yarn application -list -appTypes is not working

2017-08-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reassigned YARN-7076: Assignee: Jian He > yarn application -list -appTypes is not working >

[jira] [Updated] (YARN-7088) Fix application start time and add submit time to UIs

2017-08-28 Thread Abdullah Yousufi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abdullah Yousufi updated YARN-7088: --- Attachment: YARN-7088.003.patch > Fix application start time and add submit time to UIs >

[jira] [Commented] (YARN-7066) Add ability to specify volumes to mount for DockerContainerRuntime

2017-08-28 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144274#comment-16144274 ] Eric Badger commented on YARN-7066: --- Is this a dup of YARN-6919? If it is, I'm fine closing that JIRA and

[jira] [Commented] (YARN-7088) Fix application start time and add submit time to UIs

2017-08-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144270#comment-16144270 ] Daniel Templeton commented on YARN-7088: I know you're working on getting the patch working still,

[jira] [Commented] (YARN-6161) YARN support for port allocation

2017-08-28 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144292#comment-16144292 ] Eric Yang commented on YARN-6161: - The current design supports host network, bridge network and fixed-cidr.

[jira] [Commented] (YARN-7112) TestAMRMProxy is failing with invalid request

2017-08-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144181#comment-16144181 ] Wangda Tan commented on YARN-7112: -- Committed trunk/branch-2, it looks like patch needs some rework for

[jira] [Updated] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-08-28 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-4511: - Attachment: YARN-4511-YARN-1011.00.patch > Common scheduler changes supporting scheduler-specific

[jira] [Commented] (YARN-4266) Allow users to enter containers as UID:GID pair instead of by username

2017-08-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144234#comment-16144234 ] Daniel Templeton commented on YARN-4266: bq. LDAP group mapping is a proof of concept module, and

[jira] [Commented] (YARN-7076) yarn application -list -appTypes is not working

2017-08-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144268#comment-16144268 ] Junping Du commented on YARN-7076: -- Thanks [~jianhe] for delivering a quick fix. The patch looks general

[jira] [Updated] (YARN-7112) TestAMRMProxy is failing with invalid request

2017-08-28 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-7112: - Attachment: YARN-7112-branch-2.8.001.patch Thanks for the review and commit, Wangda! Here's the patch for

[jira] [Updated] (YARN-7112) TestAMRMProxy is failing with invalid request

2017-08-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7112: - Fix Version/s: 2.8.2 > TestAMRMProxy is failing with invalid request >

[jira] [Commented] (YARN-7112) TestAMRMProxy is failing with invalid request

2017-08-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144429#comment-16144429 ] Wangda Tan commented on YARN-7112: -- Committed to branch-2.8 as well, thanks [~jlowe] for quick update. >

  1   2   >