[jira] [Commented] (YARN-5596) TestDockerContainerRuntime fails on OS X

2016-08-30 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449935#comment-15449935 ] Daniel Templeton commented on YARN-5596: Patch looks good. Does the path constant need to be

[jira] [Commented] (YARN-5596) TestDockerContainerRuntime fails on OS X

2016-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449968#comment-15449968 ] Hadoop QA commented on YARN-5596: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5596) TestDockerContainerRuntime fails on OS X

2016-08-30 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449971#comment-15449971 ] Sidharta Seethana commented on YARN-5596: - Thanks, [~templedf]. I'll upload a new patch with the

[jira] [Commented] (YARN-5388) MAPREDUCE-6719 requires changes to DockerContainerExecutor

2016-08-30 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449978#comment-15449978 ] Daniel Templeton commented on YARN-5388: [~sidharta-s], any comments? > MAPREDUCE-6719 requires

[jira] [Commented] (YARN-5567) Fix script exit code checking in NodeHealthScriptRunner#reportHealthStatus

2016-08-30 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449979#comment-15449979 ] Yufei Gu commented on YARN-5567: Thanks [~wilfreds] for pointing out. Nice catch. My bad to miss the part

[jira] [Updated] (YARN-5596) TestDockerContainerRuntime fails on OS X

2016-08-30 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sidharta Seethana updated YARN-5596: Attachment: YARN-5596.002.patch Uploaded a new patch with proposed change. >

[jira] [Commented] (YARN-5596) TestDockerContainerRuntime fails on OS X

2016-08-30 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449995#comment-15449995 ] Daniel Templeton commented on YARN-5596: +1 (non-binding). Thanks, [~sidharta-s]! >

[jira] [Commented] (YARN-4997) Update fair scheduler to use pluggable auth provider

2016-08-30 Thread Tao Jie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449165#comment-15449165 ] Tao Jie commented on YARN-4997: --- Thank you [~templedf] for your review! [~kasha], could you please give it a

[jira] [Comment Edited] (YARN-3926) Extend the YARN resource model for easier resource-type management and profiles

2016-08-30 Thread Lei Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449183#comment-15449183 ] Lei Guo edited comment on YARN-3926 at 8/30/16 2:37 PM: [~vvasudev], some thoughts

[jira] [Updated] (YARN-4870) Changes in RM to lease and track Allocations instead of Containers

2016-08-30 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-4870: -- Parent Issue: YARN-5593 (was: YARN-4726) > Changes in RM to lease and track Allocations instead of

[jira] [Updated] (YARN-5503) [YARN-3368] Add missing hidden files in webapp folder for deployment

2016-08-30 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-5503: -- Summary: [YARN-3368] Add missing hidden files in webapp folder for deployment (was: [YARN-3368] Add missing

[jira] [Updated] (YARN-5594) Handle old data format while recovering RM

2016-08-30 Thread Tatyana But (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tatyana But updated YARN-5594: -- Attachment: YARN-5594.001.patch > Handle old data format while recovering RM >

[jira] [Updated] (YARN-5594) Handle old data format while recovering RM

2016-08-30 Thread Tatyana But (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tatyana But updated YARN-5594: -- Description: We've got that error after upgrade cluster from v.2.5.1 to 2.7.0. {noformat} 2016-08-25

[jira] [Commented] (YARN-4793) [Umbrella] Simplified API layer for services and beyond

2016-08-30 Thread Lei Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449102#comment-15449102 ] Lei Guo commented on YARN-4793: --- As this Jira targets to build a unified interface, I'd like to share some

[jira] [Created] (YARN-5586) Update the Resources class to consider all resource types

2016-08-30 Thread Varun Vasudev (JIRA)
Varun Vasudev created YARN-5586: --- Summary: Update the Resources class to consider all resource types Key: YARN-5586 URL: https://issues.apache.org/jira/browse/YARN-5586 Project: Hadoop YARN

[jira] [Created] (YARN-5592) Add support for dynamic resource updates with multiple resource types

2016-08-30 Thread Varun Vasudev (JIRA)
Varun Vasudev created YARN-5592: --- Summary: Add support for dynamic resource updates with multiple resource types Key: YARN-5592 URL: https://issues.apache.org/jira/browse/YARN-5592 Project: Hadoop YARN

[jira] [Created] (YARN-5593) [Umbrella] Add support for YARN Allocation composed of multiple containers/processes

2016-08-30 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-5593: - Summary: [Umbrella] Add support for YARN Allocation composed of multiple containers/processes Key: YARN-5593 URL: https://issues.apache.org/jira/browse/YARN-5593 Project:

[jira] [Updated] (YARN-4872) [API] Extend ContainerManagementProtocol to use Allocations in addition to containers

2016-08-30 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-4872: -- Parent Issue: YARN-5593 (was: YARN-4726) > [API] Extend ContainerManagementProtocol to use Allocations

[jira] [Updated] (YARN-4871) [API] Extend ApplicationMasterProtocol to use Allocations in addition to Containers

2016-08-30 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-4871: -- Parent Issue: YARN-5593 (was: YARN-4726) > [API] Extend ApplicationMasterProtocol to use Allocations in

[jira] [Updated] (YARN-4873) Introduce AllocationManager in the NodeManager to handle Allocations

2016-08-30 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-4873: -- Parent Issue: YARN-5593 (was: YARN-4726) > Introduce AllocationManager in the NodeManager to handle

[jira] [Commented] (YARN-5576) Core change to localize resource while container is running

2016-08-30 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449258#comment-15449258 ] Jian He commented on YARN-5576: --- Thanks for the review, Varun bq. Can we move this logic into the

[jira] [Comment Edited] (YARN-5576) Core change to localize resource while container is running

2016-08-30 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449258#comment-15449258 ] Jian He edited comment on YARN-5576 at 8/30/16 3:05 PM: Thanks for the review,

[jira] [Updated] (YARN-5503) [YARN-3368] Add missing hidden files in webapp folder

2016-08-30 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-5503: -- Attachment: YARN-5503-YARN-3368.0006.patch Patch looks good to me. Attaching same patch with correct version

[jira] [Updated] (YARN-4868) [API] Distinguish Allocation from the container/process/task in the public YARN records

2016-08-30 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-4868: -- Parent Issue: YARN-5593 (was: YARN-4726) > [API] Distinguish Allocation from the container/process/task

[jira] [Created] (YARN-5594) Handle old data format while recovering RM

2016-08-30 Thread Tatyana But (JIRA)
Tatyana But created YARN-5594: - Summary: Handle old data format while recovering RM Key: YARN-5594 URL: https://issues.apache.org/jira/browse/YARN-5594 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-4869) Create RMAllocation and associated state machine

2016-08-30 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-4869: -- Parent Issue: YARN-5593 (was: YARN-4726) > Create RMAllocation and associated state machine >

[jira] [Created] (YARN-5590) Add support for increase and decrease of container resources with resource profiles

2016-08-30 Thread Varun Vasudev (JIRA)
Varun Vasudev created YARN-5590: --- Summary: Add support for increase and decrease of container resources with resource profiles Key: YARN-5590 URL: https://issues.apache.org/jira/browse/YARN-5590

[jira] [Created] (YARN-5591) Update web UIs to reflect multiple resource types

2016-08-30 Thread Varun Vasudev (JIRA)
Varun Vasudev created YARN-5591: --- Summary: Update web UIs to reflect multiple resource types Key: YARN-5591 URL: https://issues.apache.org/jira/browse/YARN-5591 Project: Hadoop YARN Issue

[jira] [Created] (YARN-5589) Update CapacitySchedulerConfiguration minimum and maximum calculations to consider all resource types

2016-08-30 Thread Varun Vasudev (JIRA)
Varun Vasudev created YARN-5589: --- Summary: Update CapacitySchedulerConfiguration minimum and maximum calculations to consider all resource types Key: YARN-5589 URL: https://issues.apache.org/jira/browse/YARN-5589

[jira] [Commented] (YARN-3926) Extend the YARN resource model for easier resource-type management and profiles

2016-08-30 Thread Lei Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449183#comment-15449183 ] Lei Guo commented on YARN-3926: --- [~vvasudev], some thoughts I just commented in Yarn-4793. As this Jira

[jira] [Updated] (YARN-5583) [YARN-3368] Fix wrong paths in .gitignore

2016-08-30 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-5583: -- Summary: [YARN-3368] Fix wrong paths in .gitignore (was: [YARN-3368] Fix paths in .gitignore) > [YARN-3368]

[jira] [Created] (YARN-5587) Add support for resource profiles

2016-08-30 Thread Varun Vasudev (JIRA)
Varun Vasudev created YARN-5587: --- Summary: Add support for resource profiles Key: YARN-5587 URL: https://issues.apache.org/jira/browse/YARN-5587 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Created] (YARN-5588) Add support for resource profiles in distributed shell and MapReduce

2016-08-30 Thread Varun Vasudev (JIRA)
Varun Vasudev created YARN-5588: --- Summary: Add support for resource profiles in distributed shell and MapReduce Key: YARN-5588 URL: https://issues.apache.org/jira/browse/YARN-5588 Project: Hadoop YARN

[jira] [Commented] (YARN-5503) [YARN-3368] Add missing hidden files in webapp folder

2016-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449278#comment-15449278 ] Hadoop QA commented on YARN-5503: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5594) Handle old data format while recovering RM

2016-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449540#comment-15449540 ] Hadoop QA commented on YARN-5594: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5221) Expose UpdateResourceRequest API to allow AM to request for change in container properties

2016-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449417#comment-15449417 ] Hadoop QA commented on YARN-5221: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5549) AMLauncher.createAMContainerLaunchContext() should not log the command to be launched indiscriminately

2016-08-30 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449515#comment-15449515 ] Daniel Templeton commented on YARN-5549: I would still argue to keep the config param. There are

[jira] [Commented] (YARN-5593) [Umbrella] Add support for YARN Allocation composed of multiple containers/processes

2016-08-30 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449450#comment-15449450 ] Arun Suresh commented on YARN-5593: --- Moved a bunch of tasks over from YARN-4726. > [Umbrella] Add

[jira] [Commented] (YARN-5594) Handle old data format while recovering RM

2016-08-30 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449501#comment-15449501 ] Daniel Templeton commented on YARN-5594: Thanks for the patch, [~Tatyana But]. It seems to me like

[jira] [Commented] (YARN-5567) Fix script exit code checking in NodeHealthScriptRunner#reportHealthStatus

2016-08-30 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449561#comment-15449561 ] Ray Chiang commented on YARN-5567: -- Thanks [~wilfreds] for that. For incompatible changes, I'd prefer to

[jira] [Assigned] (YARN-5451) Container localizers that hang are not cleaned up

2016-08-30 Thread luhuichun (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luhuichun reassigned YARN-5451: --- Assignee: luhuichun > Container localizers that hang are not cleaned up >

[jira] [Created] (YARN-5595) Update documentation and Javadoc to match change to NodeHealthScriptRunner#reportHealthStatus

2016-08-30 Thread Ray Chiang (JIRA)
Ray Chiang created YARN-5595: Summary: Update documentation and Javadoc to match change to NodeHealthScriptRunner#reportHealthStatus Key: YARN-5595 URL: https://issues.apache.org/jira/browse/YARN-5595

[jira] [Assigned] (YARN-5555) Scheduler UI: "% of Queue" is inaccurate if leaf queue is hierarchically nested.

2016-08-30 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reassigned YARN-: Assignee: Eric Payne > Scheduler UI: "% of Queue" is inaccurate if leaf queue is hierarchically >

[jira] [Updated] (YARN-5595) Update documentation and Javadoc to match change to NodeHealthScriptRunner#reportHealthStatus

2016-08-30 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-5595: - Assignee: Yufei Gu > Update documentation and Javadoc to match change to >

[jira] [Commented] (YARN-5221) Expose UpdateResourceRequest API to allow AM to request for change in container properties

2016-08-30 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449757#comment-15449757 ] Wangda Tan commented on YARN-5221: -- Looks good, +1, thanks [~asuresh]. And if you plan to commit this

[jira] [Commented] (YARN-5451) Container localizers that hang are not cleaned up

2016-08-30 Thread luhuichun (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449601#comment-15449601 ] luhuichun commented on YARN-5451: - @Varun Vasudev hi Varun, I am reading localizer code recently, maybe I

[jira] [Commented] (YARN-5567) Fix script exit code checking in NodeHealthScriptRunner#reportHealthStatus

2016-08-30 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449735#comment-15449735 ] Ray Chiang commented on YARN-5567: -- One point of clarification. While this *is* an incompatible change, I

[jira] [Updated] (YARN-4876) [Phase 1] Decoupled Init / Destroy of Containers from Start / Stop

2016-08-30 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-4876: -- Attachment: YARN-4876.003.patch Rebasing against trunk.. > [Phase 1] Decoupled Init / Destroy of

[jira] [Updated] (YARN-5428) Allow for specifying the docker client configuration directory

2016-08-30 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-5428: -- Attachment: YARN-5428Allowforspecifyingthedockerclientconfigurationdirectory.pdf > Allow for specifying

[jira] [Commented] (YARN-5596) TestDockerContainerRuntime fails on the mac

2016-08-30 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449822#comment-15449822 ] Sidharta Seethana commented on YARN-5596: - I'll take a look at this. Patch coming up. >

[jira] [Commented] (YARN-5566) client-side NM graceful decom doesn't trigger when jobs finish

2016-08-30 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449826#comment-15449826 ] Karthik Kambatla commented on YARN-5566: Patch makes sense to me. Minor comments: # RMNodeImpl: Nit

[jira] [Created] (YARN-5596) TestDockerContainerRuntime fails on the mac

2016-08-30 Thread Sidharta Seethana (JIRA)
Sidharta Seethana created YARN-5596: --- Summary: TestDockerContainerRuntime fails on the mac Key: YARN-5596 URL: https://issues.apache.org/jira/browse/YARN-5596 Project: Hadoop YARN Issue

[jira] [Resolved] (YARN-3665) Federation subcluster membership mechanisms

2016-08-30 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan resolved YARN-3665. -- Resolution: Implemented Hadoop Flags: Reviewed Closing this as YARN-3671 includes this

[jira] [Updated] (YARN-5566) client-side NM graceful decom doesn't trigger when jobs finish

2016-08-30 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated YARN-5566: Attachment: YARN-5566.004.patch The 004 patch addresses [~kasha]'s feedback. (I assume by

[jira] [Comment Edited] (YARN-5566) client-side NM graceful decom doesn't trigger when jobs finish

2016-08-30 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449870#comment-15449870 ] Robert Kanter edited comment on YARN-5566 at 8/30/16 7:15 PM: -- Thanks [~kasha]

[jira] [Updated] (YARN-5596) TestDockerContainerRuntime fails on OS X

2016-08-30 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sidharta Seethana updated YARN-5596: Attachment: YARN-5596.001.patch Uploading a patch that fixes the tests. >

[jira] [Commented] (YARN-3981) support timeline clients not associated with an application

2016-08-30 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449912#comment-15449912 ] Li Lu commented on YARN-3981: - Thanks [~rohithsharma]! bq. As part of NM daemon, start new service same as

[jira] [Commented] (YARN-5428) Allow for specifying the docker client configuration directory

2016-08-30 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449804#comment-15449804 ] Shane Kumpf commented on YARN-5428: --- Sorry for the delay here. [~aw], [~tangzhankun] - Thank you for the

[jira] [Updated] (YARN-5596) TestDockerContainerRuntime fails on OS X

2016-08-30 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sidharta Seethana updated YARN-5596: Summary: TestDockerContainerRuntime fails on OS X (was: TestDockerContainerRuntime fails on

[jira] [Updated] (YARN-5596) TestDockerContainerRuntime fails on the mac

2016-08-30 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sidharta Seethana updated YARN-5596: Description: /sys/fs/cgroup doesn't exist on Mac OS X. And the tests seem to fail because of

[jira] [Commented] (YARN-3671) Integrate Federation services with ResourceManager

2016-08-30 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449846#comment-15449846 ] Subru Krishnan commented on YARN-3671: -- Thanks [~jianhe] for the thoughtful review. > Integrate

[jira] [Created] (YARN-5598) [YARN-3368] Fix create-release to be able to generate bits for the new yarn-ui

2016-08-30 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-5598: Summary: [YARN-3368] Fix create-release to be able to generate bits for the new yarn-ui Key: YARN-5598 URL: https://issues.apache.org/jira/browse/YARN-5598 Project: Hadoop

[jira] [Updated] (YARN-5555) Scheduler UI: "% of Queue" is inaccurate if leaf queue is hierarchically nested.

2016-08-30 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-: - Attachment: YARN-.001.patch > Scheduler UI: "% of Queue" is inaccurate if leaf queue is hierarchically

[jira] [Commented] (YARN-5561) [Atsv2] : Support for ability to retrieve apps/app-attempt/containers and entities via REST

2016-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450303#comment-15450303 ] Hadoop QA commented on YARN-5561: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-5601) Make the RM epoch base value configurable

2016-08-30 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-5601: Summary: Make the RM epoch base value configurable Key: YARN-5601 URL: https://issues.apache.org/jira/browse/YARN-5601 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-5264) Use FSQueue to store queue-specific information

2016-08-30 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450332#comment-15450332 ] Daniel Templeton commented on YARN-5264: Per our offline discussion, this patch is a step forwards

[jira] [Commented] (YARN-5596) TestDockerContainerRuntime fails on OS X

2016-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450074#comment-15450074 ] Hadoop QA commented on YARN-5596: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5567) Fix script exit code checking in NodeHealthScriptRunner#reportHealthStatus

2016-08-30 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450114#comment-15450114 ] Ray Chiang commented on YARN-5567: -- So, that's two votes for trunk only. [~wilfreds] or [~Naganarasimha],

[jira] [Reopened] (YARN-4849) [YARN-3368] cleanup code base, integrate web UI related build to mvn, and fix licenses.

2016-08-30 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reopened YARN-4849: -- > [YARN-3368] cleanup code base, integrate web UI related build to mvn, and fix > licenses. >

[jira] [Commented] (YARN-5561) [Atsv2] : Support for ability to retrieve apps/app-attempt/containers and entities via REST

2016-08-30 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450294#comment-15450294 ] Li Lu commented on YARN-5561: - Thanks [~rohithsharma]! I took a deeper look into the patch. The overall

[jira] [Commented] (YARN-4220) [Storage implementation] Support getEntities with only Application id but no userId

2016-08-30 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450357#comment-15450357 ] Li Lu commented on YARN-4220: - Folks sorry for the delay... I think I may need some time to catch up with my

[jira] [Updated] (YARN-3660) Federation Global Policy Generator (load balancing)

2016-08-30 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-3660: - Parent Issue: YARN-5597 (was: YARN-2915) > Federation Global Policy Generator (load balancing) >

[jira] [Created] (YARN-5597) YARN Federation phase 2

2016-08-30 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-5597: Summary: YARN Federation phase 2 Key: YARN-5597 URL: https://issues.apache.org/jira/browse/YARN-5597 Project: Hadoop YARN Issue Type: Improvement

[jira] [Updated] (YARN-3657) Federation maintenance mechanisms (simple CLI and command propagation)

2016-08-30 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-3657: - Parent Issue: YARN-5597 (was: YARN-2915) > Federation maintenance mechanisms (simple CLI and

[jira] [Commented] (YARN-4876) [Phase 1] Decoupled Init / Destroy of Containers from Start / Stop

2016-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450152#comment-15450152 ] Hadoop QA commented on YARN-4876: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4849) [YARN-3368] cleanup code base, integrate web UI related build to mvn, and fix licenses.

2016-08-30 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4849: - Attachment: YARN-4849-YARN-3368.rat-fix-08302016.1.patch Attached addendum fix for rat warnings. >

[jira] [Updated] (YARN-5264) Use FSQueue to store queue-specific information

2016-08-30 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-5264: --- Attachment: YARN-5264.004.patch > Use FSQueue to store queue-specific information >

[jira] [Commented] (YARN-5549) AMLauncher.createAMContainerLaunchContext() should not log the command to be launched indiscriminately

2016-08-30 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450299#comment-15450299 ] Daniel Templeton commented on YARN-5549: I just created YARN-5599 and YARN-5600 to help with

[jira] [Updated] (YARN-5601) Make the RM epoch base value configurable

2016-08-30 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-5601: - Attachment: YARN-5601-YARN-2915-v1.patch A simple patch that reads the base epoch value from

[jira] [Commented] (YARN-5566) client-side NM graceful decom doesn't trigger when jobs finish

2016-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450025#comment-15450025 ] Hadoop QA commented on YARN-5566: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-5599) Post AM launcher artifacts to ATS

2016-08-30 Thread Daniel Templeton (JIRA)
Daniel Templeton created YARN-5599: -- Summary: Post AM launcher artifacts to ATS Key: YARN-5599 URL: https://issues.apache.org/jira/browse/YARN-5599 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-4849) [YARN-3368] cleanup code base, integrate web UI related build to mvn, and fix licenses.

2016-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450216#comment-15450216 ] Hadoop QA commented on YARN-4849: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-3658) Federation "Capacity Allocation" across sub-cluster

2016-08-30 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-3658: - Parent Issue: YARN-5597 (was: YARN-2915) > Federation "Capacity Allocation" across sub-cluster >

[jira] [Created] (YARN-5600) Add a parameter to ContainerLaunchContext to emulate yarn.nodemanager.delete.debug-delay-sec on a per-application basis

2016-08-30 Thread Daniel Templeton (JIRA)
Daniel Templeton created YARN-5600: -- Summary: Add a parameter to ContainerLaunchContext to emulate yarn.nodemanager.delete.debug-delay-sec on a per-application basis Key: YARN-5600 URL:

[jira] [Commented] (YARN-5264) Use FSQueue to store queue-specific information

2016-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450368#comment-15450368 ] Hadoop QA commented on YARN-5264: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4220) [Storage implementation] Support getEntities with only Application id but no userId

2016-08-30 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15448154#comment-15448154 ] Varun Saxena commented on YARN-4220: We can simply skip retrieving flow, flowrun, app entities if a

[jira] [Updated] (YARN-5264) Use FSQueue to store queue-specific information

2016-08-30 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-5264: --- Attachment: YARN-5264.005.patch > Use FSQueue to store queue-specific information >

[jira] [Commented] (YARN-5601) Make the RM epoch base value configurable

2016-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450524#comment-15450524 ] Hadoop QA commented on YARN-5601: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-5603) Metrics for Federation entities like StateStore/Router/AMRMProxy

2016-08-30 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-5603: Summary: Metrics for Federation entities like StateStore/Router/AMRMProxy Key: YARN-5603 URL: https://issues.apache.org/jira/browse/YARN-5603 Project: Hadoop YARN

[jira] [Commented] (YARN-4133) Containers to be preempted leak in FairScheduler preemption logic.

2016-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450961#comment-15450961 ] Hadoop QA commented on YARN-4133: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-3405) FairScheduler's preemption cannot happen between sibling in some case

2016-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450959#comment-15450959 ] Hadoop QA commented on YARN-3405: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4333) Fair scheduler should support preemption within a leaf queue

2016-08-30 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4333: --- Issue Type: Bug (was: Sub-task) Parent: (was: YARN-4752) > Fair scheduler should

[jira] [Commented] (YARN-4333) Fair scheduler should support preemption within a leaf queue

2016-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450962#comment-15450962 ] Hadoop QA commented on YARN-4333: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5598) [YARN-3368] Fix create-release to be able to generate bits for the new yarn-ui

2016-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15451230#comment-15451230 ] Hadoop QA commented on YARN-5598: - (!) A patch to the testing environment has been detected. Re-executing

[jira] [Commented] (YARN-5598) [YARN-3368] Fix create-release to be able to generate bits for the new yarn-ui

2016-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15451258#comment-15451258 ] Hadoop QA commented on YARN-5598: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-5264) Use FSQueue to store queue-specific information

2016-08-30 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450391#comment-15450391 ] Yufei Gu edited comment on YARN-5264 at 8/30/16 10:54 PM: -- Hi [~templedf], thanks

[jira] [Commented] (YARN-5555) Scheduler UI: "% of Queue" is inaccurate if leaf queue is hierarchically nested.

2016-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450390#comment-15450390 ] Hadoop QA commented on YARN-: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5264) Use FSQueue to store queue-specific information

2016-08-30 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450391#comment-15450391 ] Yufei Gu commented on YARN-5264: Hi [~templedf], thanks a lot for the review. I agree with you that storing

[jira] [Commented] (YARN-5323) Policies APIs (for Router and AMRMProxy policies)

2016-08-30 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450388#comment-15450388 ] Carlo Curino commented on YARN-5323: [~wangda], I addressed 2 and 3 above... I use

[jira] [Commented] (YARN-5221) Expose UpdateResourceRequest API to allow AM to request for change in container properties

2016-08-30 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450395#comment-15450395 ] Arun Suresh commented on YARN-5221: --- Thanks for the reviews [~leftnoteasy] and [~subru]. Committed this

  1   2   >