[jira] [Commented] (YARN-6982) Potential issue on setting AMContainerSpec#tokenConf to null before app is completed

2017-08-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146665#comment-16146665 ] Hudson commented on YARN-6982: -- ABORTED: Integrated in Jenkins build Hadoop-trunk-Commit #12270 (See

[jira] [Commented] (YARN-7033) Add support for NM Recovery of assigned resources(GPU's, NUMA, FPGA's) to container

2017-08-29 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146663#comment-16146663 ] Devaraj K commented on YARN-7033: - Thanks [~leftnoteasy] and [~sunilg] for the confirmation, I will update

[jira] [Commented] (YARN-6877) Create an abstract log reader for extendability

2017-08-29 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146629#comment-16146629 ] Xuan Gong commented on YARN-6877: - All the failed testcases can be passed on my local environment. >

[jira] [Commented] (YARN-7127) Run yarn-native-services branch against trunk

2017-08-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146622#comment-16146622 ] Jian He commented on YARN-7127: --- A patch includes the diff between yarn-native-services branch and trunk >

[jira] [Assigned] (YARN-7127) Run yarn-native-services branch against trunk

2017-08-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He reassigned YARN-7127: - Assignee: Jian He > Run yarn-native-services branch against trunk >

[jira] [Updated] (YARN-7127) Run yarn-native-services branch against trunk

2017-08-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7127: -- Attachment: YARN-7127.01.patch > Run yarn-native-services branch against trunk >

[jira] [Commented] (YARN-7073) Rest API site documentation

2017-08-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146619#comment-16146619 ] Jian He commented on YARN-7073: --- Uploaded a new patch with updated doc and a bit of changes in ApiServer >

[jira] [Updated] (YARN-7073) Rest API site documentation

2017-08-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7073: -- Attachment: YARN-7073-yarn-native-services.003.patch > Rest API site documentation > ---

[jira] [Updated] (YARN-6721) container-executor should have stack checking

2017-08-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-6721: --- Target Version/s: 3.0.0-beta1 > container-executor should have stack checking >

[jira] [Assigned] (YARN-6721) container-executor should have stack checking

2017-08-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer reassigned YARN-6721: -- Assignee: Allen Wittenauer (was: Sunil G) > container-executor should have stack

[jira] [Updated] (YARN-6721) container-executor should have stack checking

2017-08-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-6721: --- Target Version/s: (was: 2.7.5) > container-executor should have stack checking >

[jira] [Comment Edited] (YARN-6737) Rename getApplicationAttempt to getCurrentAttempt in AbstractYarnScheduler/CapacityScheduler

2017-08-29 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146586#comment-16146586 ] Tao Yang edited comment on YARN-6737 at 8/30/17 4:33 AM: - Upload v1 patch for

[jira] [Updated] (YARN-6737) Rename getApplicationAttempt to getCurrentAttempt in AbstractYarnScheduler/CapacityScheduler

2017-08-29 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-6737: --- Attachment: YARN-6737.001.patch Upload v1 patch for trunk. Sorry to be late for this update. I have scanned

[jira] [Commented] (YARN-6756) ContainerRequest#executionTypeRequest causes NPE

2017-08-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146566#comment-16146566 ] Hudson commented on YARN-6756: -- ABORTED: Integrated in Jenkins build Hadoop-trunk-Commit #12268 (See

[jira] [Created] (YARN-7127) Run yarn-native-services branch against trunk

2017-08-29 Thread Jian He (JIRA)
Jian He created YARN-7127: - Summary: Run yarn-native-services branch against trunk Key: YARN-7127 URL: https://issues.apache.org/jira/browse/YARN-7127 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Assigned] (YARN-7100) YARN service api can not reuse json file serialized in hdfs

2017-08-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He reassigned YARN-7100: - Assignee: Eric Yang > YARN service api can not reuse json file serialized in hdfs >

[jira] [Commented] (YARN-7100) YARN service api can not reuse json file serialized in hdfs

2017-08-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146543#comment-16146543 ] Jian He commented on YARN-7100: --- Patch committed in yarn-native-services branch Thanks [~eyang] ! > YARN

[jira] [Commented] (YARN-7094) Document that server-side graceful decom is currently not recommended

2017-08-29 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146488#comment-16146488 ] Junping Du commented on YARN-7094: -- Thanks Robert for updating the patch. +1 on 002 patch. Commit pending

[jira] [Commented] (YARN-6868) Add test scope to certain entries in hadoop-yarn-server-resourcemanager pom.xml

2017-08-29 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146485#comment-16146485 ] Haibo Chen commented on YARN-6868: -- +1. Will commit it tomorrow. > Add test scope to certain entries in

[jira] [Commented] (YARN-7071) Add vcores and number of containers in web UI v2 node heat map

2017-08-29 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146473#comment-16146473 ] Sunil G commented on YARN-7071: --- Yes [~templedf] and [~leftnoteasy]. Definitely added metrics for containers

[jira] [Commented] (YARN-6839) [YARN-3368] Be able to view application / container logs on the new YARN UI.

2017-08-29 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146469#comment-16146469 ] Sunil G commented on YARN-6839: --- Yes. Updated ticket as per this understanding. > [YARN-3368] Be able to

[jira] [Commented] (YARN-7037) Optimize data transfer with zero-copy approach for containerlogs REST API in NMWebServices

2017-08-29 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146470#comment-16146470 ] Tao Yang commented on YARN-7037: Thanks [~djp] for review and commit ! > Optimize data transfer with

[jira] [Resolved] (YARN-6839) [YARN-3368] Be able to view application / container logs on the new YARN UI.

2017-08-29 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G resolved YARN-6839. --- Resolution: Duplicate > [YARN-3368] Be able to view application / container logs on the new YARN UI. >

[jira] [Commented] (YARN-6911) Graph application-level resource utilization in Web UI v2

2017-08-29 Thread Abdullah Yousufi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146467#comment-16146467 ] Abdullah Yousufi commented on YARN-6911: Thanks for the comments, [~sunilg]. I'll resolve those

[jira] [Commented] (YARN-7033) Add support for NM Recovery of assigned resources(GPU's, NUMA, FPGA's) to container

2017-08-29 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146466#comment-16146466 ] Sunil G commented on YARN-7033: --- Sigh. Thats on me. I thoughts this recovery model is only for

[jira] [Commented] (YARN-7088) Fix application start time and add submit time to UIs

2017-08-29 Thread Abdullah Yousufi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146462#comment-16146462 ] Abdullah Yousufi commented on YARN-7088: Sorry, to clarify, I meant the delta between startTime and

[jira] [Commented] (YARN-6911) Graph application-level resource utilization in Web UI v2

2017-08-29 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146461#comment-16146461 ] Sunil G commented on YARN-6911: --- Thanks [~abdullah.yousufi_impala_ff43] Overall this is very useful one and

[jira] [Commented] (YARN-5536) Multiple format support (JSON, etc.) for exclude node file in NM graceful decommission with timeout

2017-08-29 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146459#comment-16146459 ] Robert Kanter commented on YARN-5536: - Sounds like we won't have time to implement the "full version".

[jira] [Updated] (YARN-7094) Document that server-side graceful decom is currently not recommended

2017-08-29 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated YARN-7094: Attachment: YARN-7094.002.patch That's a good point. We don't want to introduce a temporary thing

[jira] [Commented] (YARN-7022) Improve click interaction in queue nodes tree in Web UI v2

2017-08-29 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146454#comment-16146454 ] Sunil G commented on YARN-7022: --- Yea. This behavior seems fine enough for now i think. > Improve click

[jira] [Commented] (YARN-7088) Fix application start time and add submit time to UIs

2017-08-29 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146452#comment-16146452 ] Sunil G commented on YARN-7088: --- bq.same as the difference between when the app is submitted and launched?

[jira] [Commented] (YARN-6877) Create an abstract log reader for extendability

2017-08-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146450#comment-16146450 ] Hadoop QA commented on YARN-6877: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-7022) Improve click interaction in queue nodes tree in Web UI v2

2017-08-29 Thread Abdullah Yousufi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16145858#comment-16145858 ] Abdullah Yousufi edited comment on YARN-7022 at 8/30/17 1:21 AM: - Hey

[jira] [Updated] (YARN-7088) Fix application start time and add submit time to UIs

2017-08-29 Thread Abdullah Yousufi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abdullah Yousufi updated YARN-7088: --- Attachment: YARN-7088.006.patch > Fix application start time and add submit time to UIs >

[jira] [Commented] (YARN-7088) Fix application start time and add submit time to UIs

2017-08-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146442#comment-16146442 ] Hadoop QA commented on YARN-7088: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7088) Fix application start time and add submit time to UIs

2017-08-29 Thread Abdullah Yousufi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abdullah Yousufi updated YARN-7088: --- Attachment: YARN-7088.005.patch > Fix application start time and add submit time to UIs >

[jira] [Commented] (YARN-7100) YARN service api can not reuse json file serialized in hdfs

2017-08-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146434#comment-16146434 ] Hadoop QA commented on YARN-7100: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6911) Graph application-level resource utilization in Web UI v2

2017-08-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146433#comment-16146433 ] Hadoop QA commented on YARN-6911: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6911) Graph application-level resource utilization in Web UI v2

2017-08-29 Thread Abdullah Yousufi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abdullah Yousufi updated YARN-6911: --- Attachment: YARN-6911.002.patch new patch with some refactored + cleaned up code > Graph

[jira] [Commented] (YARN-5536) Multiple format support (JSON, etc.) for exclude node file in NM graceful decommission with timeout

2017-08-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146427#comment-16146427 ] Andrew Wang commented on YARN-5536: --- [~rkanter] [~djp] what's our move on this JIRA? One of two blockers

[jira] [Updated] (YARN-7100) YARN service api can not reuse json file serialized in hdfs

2017-08-29 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7100: Attachment: YARN-7100.004.yarn-native-services.patch Rebase patch based on the current HEAD of

[jira] [Commented] (YARN-7100) YARN service api can not reuse json file serialized in hdfs

2017-08-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146383#comment-16146383 ] Hadoop QA commented on YARN-7100: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7100) YARN service api can not reuse json file serialized in hdfs

2017-08-29 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7100: Attachment: YARN-7100.003.yarn-native-services.patch Change the patch to use ignore annotation. Thanks for

[jira] [Commented] (YARN-6830) Support quoted strings for environment variables

2017-08-29 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146378#comment-16146378 ] Daniel Templeton commented on YARN-6830: Oops, sorry. Didn't mean to do a drive by. What about

[jira] [Commented] (YARN-7077) TestAMSimulator and TestNMSimulator fail

2017-08-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146375#comment-16146375 ] Hudson commented on YARN-7077: -- ABORTED: Integrated in Jenkins build Hadoop-trunk-Commit #12266 (See

[jira] [Commented] (YARN-6877) Create an abstract log reader for extendability

2017-08-29 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146367#comment-16146367 ] Xuan Gong commented on YARN-6877: - bq. In LogCLIHelpers.java, I saw we are mixing using err.println() and

[jira] [Updated] (YARN-6877) Create an abstract log reader for extendability

2017-08-29 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-6877: Attachment: YARN-6877-trunk.006.patch > Create an abstract log reader for extendability >

[jira] [Commented] (YARN-6091) the AppMaster register failed when use Docker on LinuxContainer

2017-08-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146345#comment-16146345 ] Hadoop QA commented on YARN-6091: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7077) TestAMSimulator and TestNMSimulator fail

2017-08-29 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146343#comment-16146343 ] Yufei Gu commented on YARN-7077: Thanks for the patch, [~ajisakaa]. Committed to trunk. Need a patch for

[jira] [Assigned] (YARN-7126) Create introductory site documentation for YARN native services

2017-08-29 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha reassigned YARN-7126: --- Assignee: Gour Saha > Create introductory site documentation for YARN native services >

[jira] [Created] (YARN-7126) Create introductory site documentation for YARN native services

2017-08-29 Thread Gour Saha (JIRA)
Gour Saha created YARN-7126: --- Summary: Create introductory site documentation for YARN native services Key: YARN-7126 URL: https://issues.apache.org/jira/browse/YARN-7126 Project: Hadoop YARN

[jira] [Commented] (YARN-5219) When an export var command fails in launch_container.sh, the full container launch should fail

2017-08-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146323#comment-16146323 ] Hudson commented on YARN-5219: -- ABORTED: Integrated in Jenkins build Hadoop-trunk-Commit #12265 (See

[jira] [Commented] (YARN-7077) TestAMSimulator and TestNMSimulator fail

2017-08-29 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146322#comment-16146322 ] Yufei Gu commented on YARN-7077: The test failures are unrelated. +1 for the second patch. >

[jira] [Commented] (YARN-7115) Move BoundedAppender to org.hadoop.yarn.util pacakge

2017-08-29 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146314#comment-16146314 ] Daniel Templeton commented on YARN-7115: Will commit shortly. > Move BoundedAppender to

[jira] [Commented] (YARN-7037) Optimize data transfer with zero-copy approach for containerlogs REST API in NMWebServices

2017-08-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146291#comment-16146291 ] Hudson commented on YARN-7037: -- ABORTED: Integrated in Jenkins build Hadoop-trunk-Commit #12264 (See

[jira] [Updated] (YARN-6091) the AppMaster register failed when use Docker on LinuxContainer

2017-08-29 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-6091: -- Attachment: YARN-6091.002.patch Rebasing patch to trunk > the AppMaster register failed when use Docker

[jira] [Commented] (YARN-7033) Add support for NM Recovery of assigned resources(GPU's, NUMA, FPGA's) to container

2017-08-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146283#comment-16146283 ] Hadoop QA commented on YARN-7033: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7115) Move BoundedAppender to org.hadoop.yarn.util pacakge

2017-08-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146271#comment-16146271 ] Jian He commented on YARN-7115: --- the test failures are not related > Move BoundedAppender to

[jira] [Commented] (YARN-7088) Fix application start time and add submit time to UIs

2017-08-29 Thread Abdullah Yousufi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146261#comment-16146261 ] Abdullah Yousufi commented on YARN-7088: Thanks [~sunilg]. Regarding your first point, this is

[jira] [Commented] (YARN-6877) Create an abstract log reader for extendability

2017-08-29 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146249#comment-16146249 ] Junping Du commented on YARN-6877: -- btw, I just commit YARN-7037 which may need a bit rebase effort here.

[jira] [Commented] (YARN-7010) Federation: routing REST invocations transparently to multiple RMs (part 2 - getApps)

2017-08-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146243#comment-16146243 ] Hudson commented on YARN-7010: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12263 (See

[jira] [Commented] (YARN-7033) Add support for NM Recovery of assigned resources(GPU's, NUMA, FPGA's) to container

2017-08-29 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146241#comment-16146241 ] Wangda Tan commented on YARN-7033: -- [~devaraj.k], Apologize I missed last comment from [~sunilg]. I

[jira] [Commented] (YARN-7100) YARN service api can not reuse json file serialized in hdfs

2017-08-29 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146236#comment-16146236 ] Gour Saha commented on YARN-7100: - We should just mark the method with @JsonIgnore annotation so that it

[jira] [Issue Comment Deleted] (YARN-4757) [Umbrella] Simplified discovery of services via DNS mechanisms

2017-08-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-4757: -- Comment: was deleted (was: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime ||

[jira] [Issue Comment Deleted] (YARN-4757) [Umbrella] Simplified discovery of services via DNS mechanisms

2017-08-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-4757: -- Comment: was deleted (was: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime ||

[jira] [Commented] (YARN-7115) Move BoundedAppender to org.hadoop.yarn.util pacakge

2017-08-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146233#comment-16146233 ] Hadoop QA commented on YARN-7115: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6269) Pull into native services SLIDER-1185 - container/application diagnostics for enhanced debugging

2017-08-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6269: -- Parent Issue: YARN-7054 (was: YARN-4793) > Pull into native services SLIDER-1185 - container/application

[jira] [Commented] (YARN-4757) [Umbrella] Simplified discovery of services via DNS mechanisms

2017-08-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146217#comment-16146217 ] Hadoop QA commented on YARN-4757: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4933) Evaluate parent-slave DNS options to assess deployment options for DNS service

2017-08-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-4933: -- Parent Issue: YARN-7054 (was: YARN-4793) > Evaluate parent-slave DNS options to assess deployment options for

[jira] [Commented] (YARN-7117) Capacity Scheduler: Support Auto Creation of Leaf Queues While Doing Queue Mapping

2017-08-29 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146216#comment-16146216 ] Wangda Tan commented on YARN-7117: -- Thanks [~jlowe], Regarding to zero capacity queue: Apologize that I

[jira] [Updated] (YARN-4933) Evaluate parent-slave DNS options to assess deployment options for DNS service

2017-08-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-4933: -- Parent Issue: YARN-4793 (was: YARN-4757) > Evaluate parent-slave DNS options to assess deployment options for

[jira] [Commented] (YARN-7010) Federation: routing REST invocations transparently to multiple RMs (part 2 - getApps)

2017-08-29 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146210#comment-16146210 ] Carlo Curino commented on YARN-7010: Thanks [~giovanni.fumarola] for the contribution. I fixed while

[jira] [Updated] (YARN-7033) Add support for NM Recovery of assigned resources(GPU's, NUMA, FPGA's) to container

2017-08-29 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj K updated YARN-7033: Attachment: YARN-7033-v2.patch > Add support for NM Recovery of assigned resources(GPU's, NUMA, FPGA's) to

[jira] [Updated] (YARN-4952) need configuration mechanism for specifying per-host network interface

2017-08-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-4952: -- Parent Issue: YARN-7054 (was: YARN-4757) > need configuration mechanism for specifying per-host network

[jira] [Commented] (YARN-6830) Support quoted strings for environment variables

2017-08-29 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146192#comment-16146192 ] Shane Kumpf commented on YARN-6830: --- [~templedf] - hoping you might have time to take another look.

[jira] [Commented] (YARN-7125) Revisit deleteService call once YARN is able to do post clean up for an app

2017-08-29 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146190#comment-16146190 ] Gour Saha commented on YARN-7125: - Revisit once YARN-2261 is done > Revisit deleteService call once YARN

[jira] [Commented] (YARN-6877) Create an abstract log reader for extendability

2017-08-29 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146181#comment-16146181 ] Junping Du commented on YARN-6877: -- Thanks [~xgong] for working on a patch. The patch is huge. However,

[jira] [Commented] (YARN-5855) DELETE call sometimes returns success when app is not deleted

2017-08-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146178#comment-16146178 ] Jian He commented on YARN-5855: --- Sounds good. I opened YARN-7125 for the followup. Closet this > DELETE call

[jira] [Resolved] (YARN-5855) DELETE call sometimes returns success when app is not deleted

2017-08-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He resolved YARN-5855. --- Resolution: Fixed > DELETE call sometimes returns success when app is not deleted >

[jira] [Created] (YARN-7125) Revisit deleteService call once YARN is able to do post clean up for an app

2017-08-29 Thread Jian He (JIRA)
Jian He created YARN-7125: - Summary: Revisit deleteService call once YARN is able to do post clean up for an app Key: YARN-7125 URL: https://issues.apache.org/jira/browse/YARN-7125 Project: Hadoop YARN

[jira] [Commented] (YARN-7115) Move BoundedAppender to org.hadoop.yarn.util pacakge

2017-08-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146176#comment-16146176 ] Hadoop QA commented on YARN-7115: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Resolved] (YARN-5791) [YARN Native Service] Build application specific UI on top of data posted to timeline service V.2

2017-08-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He resolved YARN-5791. --- Resolution: Duplicate this is done in YARN-6398 > [YARN Native Service] Build application specific UI on top

[jira] [Resolved] (YARN-5780) [YARN-5079] Allowing YARN native services to post data to timeline service V.2

2017-08-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He resolved YARN-5780. --- Resolution: Duplicate this is done in YARN-6395 > [YARN-5079] Allowing YARN native services to post data to

[jira] [Commented] (YARN-6669) Kerberos support for native service AM with the service REST API

2017-08-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146168#comment-16146168 ] Hadoop QA commented on YARN-6669: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6023) Allow multiple IPs in native services container ServiceRecord

2017-08-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6023: -- Parent Issue: YARN-7054 (was: YARN-5079) > Allow multiple IPs in native services container ServiceRecord >

[jira] [Updated] (YARN-6744) Recover component information on YARN native services AM restart

2017-08-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6744: -- Parent Issue: YARN-7054 (was: YARN-5079) > Recover component information on YARN native services AM restart >

[jira] [Resolved] (YARN-6397) Support kerberos deployment for yarn-native-service

2017-08-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He resolved YARN-6397. --- Resolution: Duplicate > Support kerberos deployment for yarn-native-service >

[jira] [Updated] (YARN-6669) Kerberos support for native service AM with the service REST API

2017-08-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6669: -- Parent Issue: YARN-7054 (was: YARN-5079) > Kerberos support for native service AM with the service REST API >

[jira] [Resolved] (YARN-6696) SliderAppMaster gets an NPE when creating UnregisterComponentInstance

2017-08-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He resolved YARN-6696. --- Resolution: Invalid this code is changed after YARN-6903. close this > SliderAppMaster gets an NPE when

[jira] [Updated] (YARN-6601) Allow service to be started as System Services during serviceapi start up

2017-08-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6601: -- Parent Issue: YARN-7054 (was: YARN-5079) > Allow service to be started as System Services during serviceapi

[jira] [Updated] (YARN-6496) Rethink on configurations published into ATSv2

2017-08-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6496: -- Parent Issue: YARN-7054 (was: YARN-5079) > Rethink on configurations published into ATSv2 >

[jira] [Resolved] (YARN-6422) Service REST API should have a way to specify YARN related params

2017-08-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He resolved YARN-6422. --- Resolution: Duplicate > Service REST API should have a way to specify YARN related params >

[jira] [Updated] (YARN-6394) Support specifying YARN related params in the service REST API

2017-08-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6394: -- Parent Issue: YARN-7054 (was: YARN-5079) > Support specifying YARN related params in the service REST API >

[jira] [Updated] (YARN-6422) Service REST API should have a way to specify YARN related params

2017-08-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6422: -- Parent Issue: YARN-7054 (was: YARN-5079) > Service REST API should have a way to specify YARN related params >

[jira] [Updated] (YARN-6397) Support kerberos deployment for yarn-native-service

2017-08-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6397: -- Parent Issue: YARN-7054 (was: YARN-5079) > Support kerberos deployment for yarn-native-service >

[jira] [Commented] (YARN-5855) DELETE call sometimes returns success when app is not deleted

2017-08-29 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146138#comment-16146138 ] Gour Saha commented on YARN-5855: - Yup, and as we discussed let's leave DELETE as it is now. No need to

[jira] [Updated] (YARN-6393) Create a API class for yarn-native-service user-facing constants

2017-08-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6393: -- Parent Issue: YARN-7054 (was: YARN-5079) > Create a API class for yarn-native-service user-facing constants >

[jira] [Updated] (YARN-6391) Support specifying extra options from yarn-native-service CLI

2017-08-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6391: -- Parent Issue: YARN-7054 (was: YARN-5079) > Support specifying extra options from yarn-native-service CLI >

[jira] [Updated] (YARN-6161) YARN support for port allocation

2017-08-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6161: -- Parent Issue: YARN-7054 (was: YARN-5079) > YARN support for port allocation >

[jira] [Commented] (YARN-5855) DELETE call sometimes returns success when app is not deleted

2017-08-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146130#comment-16146130 ] Jian He commented on YARN-5855: --- Talked with Gour, if we have YARN-2261 or YARN-5759, then the DELETE can be

  1   2   3   >