[jira] [Commented] (YARN-4945) [Umbrella] Capacity Scheduler Preemption Within a queue

2016-08-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432961#comment-15432961 ] Sunil G commented on YARN-4945: --- Thank you [~eepayne] for the detailed explanation. bq.I want to make sure we

[jira] [Updated] (YARN-5553) [ATSv2] "metrics" for YARN_CONTAINERS are displayed as empty.

2016-08-23 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-5553: Attachment: rest-output.txt > [ATSv2] "metrics" for YARN_CONTAINERS are displayed as empty.

[jira] [Updated] (YARN-5553) [ATSv2] "metrics" for YARN_CONTAINERS are displayed as empty.

2016-08-23 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-5553: Attachment: REST-ALL-output.txt Attached REST full output file > [ATSv2] "metrics" for

[jira] [Commented] (YARN-4997) Update fair scheduler to use pluggable auth provider

2016-08-23 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433228#comment-15433228 ] Daniel Templeton commented on YARN-4997: LGTM! Except... I apologize for not seeing this earlier.

[jira] [Commented] (YARN-5388) MAPREDUCE-6719 requires changes to DockerContainerExecutor

2016-08-23 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433249#comment-15433249 ] Karthik Kambatla commented on YARN-5388: +1 to deprecating DCE in 2.x and removing it altogether in

[jira] [Commented] (YARN-5543) ResourceManager SchedulingMonitor could potentially terminate the preemption checker thread

2016-08-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433248#comment-15433248 ] Wangda Tan commented on YARN-5543: -- Thanks [~mshen] for the patch. Patch looks good. I also added you to

[jira] [Updated] (YARN-5543) ResourceManager SchedulingMonitor could potentially terminate the preemption checker thread

2016-08-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-5543: - Assignee: Min Shen > ResourceManager SchedulingMonitor could potentially terminate the preemption >

[jira] [Commented] (YARN-5553) [ATSv2] "metrics" for YARN_CONTAINERS are displayed as empty.

2016-08-23 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433061#comment-15433061 ] Rohith Sharma K S commented on YARN-5553: - Attached REST output for YARN-CONTAINERS entity types.

[jira] [Updated] (YARN-5554) MoveApplicationAcrossQueues does not check user permission on the target queue

2016-08-23 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-5554: - Component/s: resourcemanager > MoveApplicationAcrossQueues does not check user permission on the target

[jira] [Updated] (YARN-5554) MoveApplicationAcrossQueues does not check user permission on the target queue

2016-08-23 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-5554: - Affects Version/s: 2.7.2 > MoveApplicationAcrossQueues does not check user permission on the target queue

[jira] [Created] (YARN-5554) MoveApplicationAcrossQueues does not check user permission on the target queue

2016-08-23 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-5554: Summary: MoveApplicationAcrossQueues does not check user permission on the target queue Key: YARN-5554 URL: https://issues.apache.org/jira/browse/YARN-5554 Project: Hadoop

[jira] [Commented] (YARN-4889) Changes in AMRMClient for identifying resource-requests explicitly

2016-08-23 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433247#comment-15433247 ] Karthik Kambatla commented on YARN-4889: +0 on the latest patch. Can someone else who has worked on

[jira] [Commented] (YARN-4997) Update fair scheduler to use pluggable auth provider

2016-08-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433052#comment-15433052 ] Hadoop QA commented on YARN-4997: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5553) [ATSv2] "metrics" for YARN_CONTAINERS are displayed as empty.

2016-08-23 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433181#comment-15433181 ] Varun Saxena commented on YARN-5553: [~rohithsharma], thanks for filing the issue. bq. The CPU-Memory

[jira] [Comment Edited] (YARN-5553) [ATSv2] "metrics" for YARN_CONTAINERS are displayed as empty.

2016-08-23 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433181#comment-15433181 ] Varun Saxena edited comment on YARN-5553 at 8/23/16 5:00 PM: - [~rohithsharma],

[jira] [Commented] (YARN-5551) Ignore deleted file mapping from memory computation when smaps is enabled

2016-08-23 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433215#comment-15433215 ] Varun Vasudev commented on YARN-5551: - [~nroberts], [~jlowe] - do you mind reviewing the attached

[jira] [Commented] (YARN-5375) invoke MockRM#drainEvents implicitly in MockRM methods to reduce test failures

2016-08-23 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433147#comment-15433147 ] Rohith Sharma K S commented on YARN-5375: - Thanks [~sandflee] for working on this. One doubt is do

[jira] [Commented] (YARN-5553) [ATSv2] "metrics" for YARN_CONTAINERS are displayed as empty.

2016-08-23 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433223#comment-15433223 ] Varun Saxena commented on YARN-5553: Also can you attach complete REST output (specifiy fields=ALL) so

[jira] [Commented] (YARN-1503) Continuous resource-localization for YARN containers

2016-08-23 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433226#comment-15433226 ] Karthik Kambatla commented on YARN-1503: In addition to the heartbeat issue, AMs with many

[jira] [Created] (YARN-5553) [ATSv2] "metrics" for YARN_CONTAINERS are displayed as empty.

2016-08-23 Thread Rohith Sharma K S (JIRA)
Rohith Sharma K S created YARN-5553: --- Summary: [ATSv2] "metrics" for YARN_CONTAINERS are displayed as empty. Key: YARN-5553 URL: https://issues.apache.org/jira/browse/YARN-5553 Project: Hadoop YARN

[jira] [Comment Edited] (YARN-5553) [ATSv2] "metrics" for YARN_CONTAINERS are displayed as empty.

2016-08-23 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433181#comment-15433181 ] Varun Saxena edited comment on YARN-5553 at 8/23/16 4:52 PM: - [~rohithsharma],

[jira] [Updated] (YARN-2457) FairScheduler: Handle preemption to help starved parent queues

2016-08-23 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2457: --- Target Version/s: 2.9.0 (was: 2.6.5, 2.7.4) > FairScheduler: Handle preemption to help

[jira] [Commented] (YARN-4849) [YARN-3368] cleanup code base, integrate web UI related build to mvn, and fix licenses.

2016-08-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433278#comment-15433278 ] Wangda Tan commented on YARN-4849: -- For licenses: bq. ember-data v2.1.0 is duplicated 2 times Fixed bq.

[jira] [Commented] (YARN-5531) UnmanagedAM pool manager for federating application across clusters

2016-08-23 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433274#comment-15433274 ] Karthik Kambatla commented on YARN-5531: I had filed YARN-2963 at some point to expose an Unmanaged

[jira] [Commented] (YARN-5323) Policies APIs (for Router and AMRMProxy policies)

2016-08-23 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433415#comment-15433415 ] Carlo Curino commented on YARN-5323: Regarding (2) I think looking at YARN-5391 might help to get a

[jira] [Commented] (YARN-5537) Intermittent test failure of TestAMRMClient#testAMRMClientWithContainerResourceChange

2016-08-23 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433419#comment-15433419 ] Varun Saxena commented on YARN-5537: Thanks [~bibinchundatt] for the patch. Analysis is correct. The

[jira] [Commented] (YARN-5375) invoke MockRM#drainEvents implicitly in MockRM methods to reduce test failures

2016-08-23 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433344#comment-15433344 ] Varun Saxena commented on YARN-5375: Yes, refer to YARN-5548 for instance. That seems to be due to

[jira] [Commented] (YARN-5323) Policies APIs (for Router and AMRMProxy policies)

2016-08-23 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433409#comment-15433409 ] Carlo Curino commented on YARN-5323: [~wangda] thanks for reviewing. Answering your questions: # The

[jira] [Updated] (YARN-3001) RM dies because of divide by zero

2016-08-23 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-3001: --- Component/s: (was: resourcemanager) capacity scheduler > RM dies because

[jira] [Updated] (YARN-4849) [YARN-3368] cleanup code base, integrate web UI related build to mvn, and fix licenses.

2016-08-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4849: - Attachment: YARN-4849-YARN-3368.license-fix-08232016.1.patch > [YARN-3368] cleanup code base, integrate

[jira] [Commented] (YARN-5323) Policies APIs (for Router and AMRMProxy policies)

2016-08-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433346#comment-15433346 ] Wangda Tan commented on YARN-5323: -- Thanks [~curino], Some questions / comments: 1) Who will consume

[jira] [Commented] (YARN-5042) Mount /sys/fs/cgroup into Docker containers as read only mount

2016-08-23 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433449#comment-15433449 ] Varun Vasudev commented on YARN-5042: - +1 for the latest patch. [~shaneku...@gmail.com], [~sidharta-s]

[jira] [Commented] (YARN-5428) Allow for specifying the docker client configuration directory

2016-08-23 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1543#comment-1543 ] Zhankun Tang commented on YARN-5428: Exposing the admin settings in this config file seems

[jira] [Commented] (YARN-5544) TestNodeBlacklistingOnAMFailures fails on trunk

2016-08-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432231#comment-15432231 ] Hadoop QA commented on YARN-5544: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4889) Changes in AMRMClient for identifying resource-requests explicitly

2016-08-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433509#comment-15433509 ] Wangda Tan commented on YARN-4889: -- Thanks [~asuresh], some minor comments: 1) AMRMClient - Annonate

[jira] [Updated] (YARN-5555) Scheduler UI: "% of Queue" is inaccurate if leaf queue is hierarchically nested.

2016-08-23 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-: - Attachment: PctOfQueueIsInaccurate.jpg The queue structure for the attached screenshot

[jira] [Commented] (YARN-5042) Mount /sys/fs/cgroup into Docker containers as read only mount

2016-08-23 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433544#comment-15433544 ] Sidharta Seethana commented on YARN-5042: - +1 for the latest patch from me as well. Though the

[jira] [Commented] (YARN-5540) scheduler spends too much time looking at empty priorities

2016-08-23 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433534#comment-15433534 ] Arun Suresh commented on YARN-5540: --- Thanks for the patch [~jlowe] Minor nits: # you can remove the

[jira] [Commented] (YARN-4491) yarn list command to support filtering by tags

2016-08-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433557#comment-15433557 ] Hudson commented on YARN-4491: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10331 (See

[jira] [Commented] (YARN-5556) Support for deleting queues without requiring a RM restart

2016-08-23 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433577#comment-15433577 ] Naganarasimha G R commented on YARN-5556: - Hi [~xgong], We were already working on this, is it ok

[jira] [Updated] (YARN-5555) Scheduler UI: "% of Queue" is inaccurate if leaf queue is hierarchically nested.

2016-08-23 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-: - Assignee: (was: Eric Payne) > Scheduler UI: "% of Queue" is inaccurate if leaf queue is hierarchically

[jira] [Updated] (YARN-5525) Make log aggregation service class configurable

2016-08-23 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-5525: --- Attachment: YARN-5525.v1.patch > Make log aggregation service class configurable >

[jira] [Commented] (YARN-5323) Policies APIs (for Router and AMRMProxy policies)

2016-08-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433469#comment-15433469 ] Wangda Tan commented on YARN-5323: -- Thanks [~curino] for explanations, now I can better understand

[jira] [Created] (YARN-5556) Support for deleting queues without requiring a RM restart

2016-08-23 Thread Xuan Gong (JIRA)
Xuan Gong created YARN-5556: --- Summary: Support for deleting queues without requiring a RM restart Key: YARN-5556 URL: https://issues.apache.org/jira/browse/YARN-5556 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-5540) scheduler spends too much time looking at empty priorities

2016-08-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433532#comment-15433532 ] Hadoop QA commented on YARN-5540: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5546) NodeManager crashes due to SIGSEGV

2016-08-23 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433563#comment-15433563 ] Daniel Templeton commented on YARN-5546: Any details on what you were localizing when it failed?

[jira] [Commented] (YARN-5556) Support for deleting queues without requiring a RM restart

2016-08-23 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433585#comment-15433585 ] Naganarasimha G R commented on YARN-5556: - Basically we wanted to support as part of

[jira] [Commented] (YARN-4889) Changes in AMRMClient for identifying resource-requests explicitly

2016-08-23 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433719#comment-15433719 ] Subru Krishnan commented on YARN-4889: -- [~asuresh] (cc: [~leftnoteasy]/[~kasha]), I feel

[jira] [Commented] (YARN-5323) Policies APIs (for Router and AMRMProxy policies)

2016-08-23 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433721#comment-15433721 ] Carlo Curino commented on YARN-5323: No problem renaming 2, 3 as you suggest. Other than this the patch

[jira] [Comment Edited] (YARN-4889) Changes in AMRMClient for identifying resource-requests explicitly

2016-08-23 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433742#comment-15433742 ] Arun Suresh edited comment on YARN-4889 at 8/23/16 10:19 PM: - -I totally agree

[jira] [Updated] (YARN-5327) API changes required to support recurring reservations in the YARN ReservationSystem

2016-08-23 Thread Sangeetha Abdu Jyothi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangeetha Abdu Jyothi updated YARN-5327: Attachment: YARN-5327.005.patch > API changes required to support recurring

[jira] [Updated] (YARN-4889) Changes in AMRMClient for identifying resource-requests explicitly

2016-08-23 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-4889: -- Attachment: YARN-4889.004.patch Thanks for the review [~leftnoteasy] Updating patch addressing your

[jira] [Commented] (YARN-4889) Changes in AMRMClient for identifying resource-requests explicitly

2016-08-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433775#comment-15433775 ] Hadoop QA commented on YARN-4889: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5525) Make log aggregation service class configurable

2016-08-23 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-5525: --- Attachment: YARN-5525.v2.patch > Make log aggregation service class configurable >

[jira] [Commented] (YARN-3940) Application moveToQueue should check NodeLabel permission

2016-08-23 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433672#comment-15433672 ] Naganarasimha G R commented on YARN-3940: - Hi [~bibinchundatt], {code} boolean isValidrequest =

[jira] [Commented] (YARN-5525) Make log aggregation service class configurable

2016-08-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433691#comment-15433691 ] Hadoop QA commented on YARN-5525: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4889) Changes in AMRMClient for identifying resource-requests explicitly

2016-08-23 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433742#comment-15433742 ] Arun Suresh commented on YARN-4889: --- I totally agree with you... But since currently, the AMRMClient does

[jira] [Commented] (YARN-5323) Policies APIs (for Router and AMRMProxy policies)

2016-08-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433778#comment-15433778 ] Wangda Tan commented on YARN-5323: -- Yeah other than that, patch looks fine :) > Policies APIs (for Router

[jira] [Commented] (YARN-5327) API changes required to support recurring reservations in the YARN ReservationSystem

2016-08-23 Thread Sangeetha Abdu Jyothi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433823#comment-15433823 ] Sangeetha Abdu Jyothi commented on YARN-5327: - Thanks for the comments, [~subru]. REST APIs

[jira] [Commented] (YARN-3928) launch application master on specific host

2016-08-23 Thread Tobin Baker (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433835#comment-15433835 ] Tobin Baker commented on YARN-3928: --- We really need this for our application, and having to use node

[jira] [Commented] (YARN-5537) Intermittent test failure of TestAMRMClient#testAMRMClientWithContainerResourceChange

2016-08-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15434063#comment-15434063 ] Hadoop QA commented on YARN-5537: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4997) Update fair scheduler to use pluggable auth provider

2016-08-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15434090#comment-15434090 ] Hadoop QA commented on YARN-4997: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-1503) Continuous resource-localization for YARN containers

2016-08-23 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432920#comment-15432920 ] Jason Lowe commented on YARN-1503: -- Thanks for driving this, Jian! Seems reasonable overall with just one

[jira] [Commented] (YARN-5375) invoke MockRM#drainEvents implicitly in MockRM methods to reduce test failures

2016-08-23 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15434153#comment-15434153 ] Rohith Sharma K S commented on YARN-5375: - I am fine going with subclass of memoryRMStateStore and

[jira] [Commented] (YARN-5525) Make log aggregation service class configurable

2016-08-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433860#comment-15433860 ] Hadoop QA commented on YARN-5525: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5327) API changes required to support recurring reservations in the YARN ReservationSystem

2016-08-23 Thread Sean Po (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433994#comment-15433994 ] Sean Po commented on YARN-5327: --- Thanks for addressing the comments [~ajsangeetha], this patch looks good to

[jira] [Updated] (YARN-4997) Update fair scheduler to use pluggable auth provider

2016-08-23 Thread Tao Jie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Jie updated YARN-4997: -- Attachment: YARN-4997-007.patch > Update fair scheduler to use pluggable auth provider >

[jira] [Commented] (YARN-5375) invoke MockRM#drainEvents implicitly in MockRM methods to reduce test failures

2016-08-23 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15434024#comment-15434024 ] sandflee commented on YARN-5375: also see YARN-5043, if StateStore Event is not processed, more likely it

[jira] [Commented] (YARN-3318) Create Initial OrderingPolicy Framework and FifoOrderingPolicy

2016-08-23 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433848#comment-15433848 ] Jonathan Hung commented on YARN-3318: - Hi [~wangda], any chance we can get this committed to

[jira] [Updated] (YARN-5486) Update OpportunisticContainerAllocatorAMService::allocate method to handle OPPORTUNISTIC container requests

2016-08-23 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5486: -- Assignee: Konstantinos Karanasos (was: Arun Suresh) > Update

[jira] [Commented] (YARN-3928) launch application master on specific host

2016-08-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433989#comment-15433989 ] Wangda Tan commented on YARN-3928: -- I think this is a very useful feature, I remember there should have

[jira] [Updated] (YARN-5537) Intermittent test failure of TestAMRMClient#testAMRMClientWithContainerResourceChange

2016-08-23 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-5537: --- Attachment: YARN-5537.0002.patch > Intermittent test failure of >

[jira] [Commented] (YARN-5327) API changes required to support recurring reservations in the YARN ReservationSystem

2016-08-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433911#comment-15433911 ] Hadoop QA commented on YARN-5327: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (YARN-5486) Update OpportunisticContainerAllocatorAMService::allocate method to handle OPPORTUNISTIC container requests

2016-08-23 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh reassigned YARN-5486: - Assignee: Arun Suresh (was: Konstantinos Karanasos) > Update

[jira] [Commented] (YARN-5525) Make log aggregation service class configurable

2016-08-23 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433975#comment-15433975 ] Botong Huang commented on YARN-5525: I ran TestYarnConfigurationFields locally and it passes. Somehow

[jira] [Commented] (YARN-4997) Update fair scheduler to use pluggable auth provider

2016-08-23 Thread Tao Jie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15434011#comment-15434011 ] Tao Jie commented on YARN-4997: --- Oops!Fix this misspelling and update the patch. > Update fair scheduler to

[jira] [Updated] (YARN-4849) [YARN-3368] cleanup code base, integrate web UI related build to mvn, and fix licenses.

2016-08-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4849: - Attachment: YARN-4849-YARN-3368.doc-fix-08232016.1.patch Thanks [~sunilg] for reviewing doc patch. bq.

[jira] [Commented] (YARN-4849) [YARN-3368] cleanup code base, integrate web UI related build to mvn, and fix licenses.

2016-08-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433304#comment-15433304 ] Hadoop QA commented on YARN-4849: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4849) [YARN-3368] cleanup code base, integrate web UI related build to mvn, and fix licenses.

2016-08-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1546#comment-1546 ] Hadoop QA commented on YARN-4849: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-5323) Policies APIs (for Router and AMRMProxy policies)

2016-08-23 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433409#comment-15433409 ] Carlo Curino edited comment on YARN-5323 at 8/23/16 7:05 PM: - [~wangda] thanks

[jira] [Updated] (YARN-5554) MoveApplicationAcrossQueues does not check user permission on the target queue

2016-08-23 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-5554: - Attachment: yarn5554.001.patch > MoveApplicationAcrossQueues does not check user permission on the target

[jira] [Commented] (YARN-5554) MoveApplicationAcrossQueues does not check user permission on the target queue

2016-08-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15434140#comment-15434140 ] Hadoop QA commented on YARN-5554: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5553) [ATSv2] "metrics" for YARN_CONTAINERS are displayed as empty.

2016-08-23 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433316#comment-15433316 ] Varun Saxena commented on YARN-5553: Here the containers are finishing in around 3 seconds. I think

[jira] [Comment Edited] (YARN-5553) [ATSv2] "metrics" for YARN_CONTAINERS are displayed as empty.

2016-08-23 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433316#comment-15433316 ] Varun Saxena edited comment on YARN-5553 at 8/23/16 6:06 PM: - Here the

[jira] [Created] (YARN-5555) Scheduler UI: "% of Queue" is inaccurate if leaf queue is hierarchically nested.

2016-08-23 Thread Eric Payne (JIRA)
Eric Payne created YARN-: Summary: Scheduler UI: "% of Queue" is inaccurate if leaf queue is hierarchically nested. Key: YARN- URL: https://issues.apache.org/jira/browse/YARN- Project: Hadoop

[jira] [Updated] (YARN-5540) scheduler spends too much time looking at empty priorities

2016-08-23 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-5540: - Attachment: YARN-5540.001.patch The main problem is that a scheduler key is never being removed from the

[jira] [Updated] (YARN-5544) TestNodeBlacklistingOnAMFailures fails on trunk

2016-08-23 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-5544: Labels: test (was: ) Component/s: test Issue Type: Test (was: Bug) >

[jira] [Commented] (YARN-5544) TestNodeBlacklistingOnAMFailures fails on trunk

2016-08-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432484#comment-15432484 ] Hudson commented on YARN-5544: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10325 (See

[jira] [Commented] (YARN-5544) TestNodeBlacklistingOnAMFailures fails on trunk

2016-08-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432570#comment-15432570 ] Sunil G commented on YARN-5544: --- Thanks [~rohithsharma] for the review and commit! >

[jira] [Commented] (YARN-5544) TestNodeBlacklistingOnAMFailures fails on trunk

2016-08-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432440#comment-15432440 ] Hadoop QA commented on YARN-5544: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-5552) Add Builder methods for common yarn API records

2016-08-23 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-5552: - Summary: Add Builder methods for common yarn API records Key: YARN-5552 URL: https://issues.apache.org/jira/browse/YARN-5552 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-4889) Changes in AMRMClient for identifying resource-requests explicitly

2016-08-23 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-4889: -- Attachment: YARN-4889.003.patch Thanks for the review [~kasha].. Updating patch addressing some of your

[jira] [Updated] (YARN-1503) Support making additional 'LocalResources' available to running containers

2016-08-23 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-1503: -- Attachment: Continuous-resource-localization.pdf > Support making additional 'LocalResources' available to

[jira] [Updated] (YARN-1503) Continuous resource-localization for YARN containers

2016-08-23 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-1503: -- Summary: Continuous resource-localization for YARN containers (was: Support making additional 'LocalResources'

[jira] [Commented] (YARN-1503) Support making additional 'LocalResources' available to running containers

2016-08-23 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432722#comment-15432722 ] Jian He commented on YARN-1503: --- I uploaded a design doc for this and update the title / description

[jira] [Updated] (YARN-1503) Continuous resource-localization for YARN containers

2016-08-23 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-1503: -- Description: We have a use case, where additional resources (jars, libraries etc) need to be made available to

[jira] [Commented] (YARN-5505) Create an agent-less docker provider

2016-08-23 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432620#comment-15432620 ] Jian He commented on YARN-5505: --- Thanks Billie, some comments on the patch - DockerProviderService#

[jira] [Resolved] (YARN-5532) Continuous resource-localization for YARN containers

2016-08-23 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He resolved YARN-5532. --- Resolution: Duplicate > Continuous resource-localization for YARN containers >

[jira] [Assigned] (YARN-1503) Support making additional 'LocalResources' available to running containers

2016-08-23 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He reassigned YARN-1503: - Assignee: Jian He > Support making additional 'LocalResources' available to running containers >

[jira] [Commented] (YARN-5532) Continuous resource-localization for YARN containers

2016-08-23 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432630#comment-15432630 ] Jian He commented on YARN-5532: --- Yep, didn't know that was open, closed as a dup > Continuous

  1   2   >