[jira] [Updated] (YARN-7512) Support service upgrade via YARN Service API and CLI

2017-11-16 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha updated YARN-7512: Description: YARN Service API and CLI needs to support service (and containers) upgrade in line with what

[jira] [Commented] (YARN-7469) Capacity Scheduler Intra-queue preemption: User can starve if newest app is exactly at user limit

2017-11-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255631#comment-16255631 ] Hudson commented on YARN-7469: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13246 (See

[jira] [Updated] (YARN-7483) Test cases cleanup post YARN-5881

2017-11-16 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7483: -- Description: Few UT cases has to be cleaned or rewritten cleanly to consider both absolute/percentage based

[jira] [Commented] (YARN-7482) Max applications calculation per queue has to be retrospected with absolute resource support

2017-11-16 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255229#comment-16255229 ] Sunil G commented on YARN-7482: --- Test case failure is not related to this patch. Its been tracked in

[jira] [Commented] (YARN-7218) ApiServer REST API naming convention /ws/v1 is already used in Hadoop v2

2017-11-16 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255598#comment-16255598 ] Eric Yang commented on YARN-7218: - [~jianhe] Yes and no, it is related, but it is not something that we

[jira] [Created] (YARN-7512) Support service upgrade via YARN Service API and CLI

2017-11-16 Thread Gour Saha (JIRA)
Gour Saha created YARN-7512: --- Summary: Support service upgrade via YARN Service API and CLI Key: YARN-7512 URL: https://issues.apache.org/jira/browse/YARN-7512 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-7483) Test cases cleanup post YARN-5881

2017-11-16 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7483: -- Attachment: YARN-7483-YARN-5881.001.patch renamed patch to apply to YARN-5881 branch > Test cases cleanup post

[jira] [Commented] (YARN-5534) Allow whitelisted volume mounts

2017-11-16 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255612#comment-16255612 ] Eric Badger commented on YARN-5534: --- Arbitrary docker images will need to be handled separately than what

[jira] [Commented] (YARN-5534) Allow whitelisted volume mounts

2017-11-16 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255583#comment-16255583 ] Eric Yang commented on YARN-5534: - [~ebadger] [~shaneku...@gmail.com] In YARN-7430, there was mentioned how

[jira] [Updated] (YARN-7483) Test cases cleanup post YARN-5881

2017-11-16 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7483: -- Attachment: YARN-7483.001.patch Attaching patch to clean up test case issues. cc/ [~leftnoteasy] please help to

[jira] [Commented] (YARN-7483) Test cases cleanup post YARN-5881

2017-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255599#comment-16255599 ] Hadoop QA commented on YARN-7483: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7483) Test cases cleanup post YARN-5881

2017-11-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255610#comment-16255610 ] Wangda Tan commented on YARN-7483: -- Patch looks good, pending Jenkins. > Test cases cleanup post

[jira] [Assigned] (YARN-7509) AsyncScheduleThread and ResourceCommitterService are still running after RM is transitioned to standby

2017-11-16 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt reassigned YARN-7509: -- Assignee: Bibin A Chundatt (was: Tao Yang) > AsyncScheduleThread and

[jira] [Assigned] (YARN-7509) AsyncScheduleThread and ResourceCommitterService are still running after RM is transitioned to standby

2017-11-16 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt reassigned YARN-7509: -- Assignee: Tao Yang (was: Bibin A Chundatt) > AsyncScheduleThread and

[jira] [Commented] (YARN-7486) Race condition in service AM that can cause NPE

2017-11-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255545#comment-16255545 ] Hudson commented on YARN-7486: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13245 (See

[jira] [Updated] (YARN-7511) NPE in ContainerLocalizer when localization failed for running container

2017-11-16 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7511: --- Attachment: YARN-7511.001.patch Attaching v1 patch for review. > NPE in ContainerLocalizer when localization

[jira] [Commented] (YARN-7482) Max applications calculation per queue has to be retrospected with absolute resource support

2017-11-16 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255198#comment-16255198 ] Rohith Sharma K S commented on YARN-7482: - +1, will commit it soon. [~sunilg] can you confirm one

[jira] [Commented] (YARN-7469) Capacity Scheduler Intra-queue preemption: User can starve if newest app is exactly at user limit

2017-11-16 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255386#comment-16255386 ] Sunil G commented on YARN-7469: --- +1 Committing shortly. > Capacity Scheduler Intra-queue preemption: User

[jira] [Commented] (YARN-7508) NPE in FiCaSchedulerApp when debug log enabled and try to commit outdated reserved proposal in async-scheduling mode

2017-11-16 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255213#comment-16255213 ] Bibin A Chundatt commented on YARN-7508:

[jira] [Updated] (YARN-7497) Add HDFSSchedulerConfigurationStore for RM HA

2017-11-16 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7497: Attachment: YARN-7497.004.patch fix findbug error > Add HDFSSchedulerConfigurationStore for RM HA >

[jira] [Commented] (YARN-7497) Add HDFSSchedulerConfigurationStore for RM HA

2017-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255404#comment-16255404 ] Hadoop QA commented on YARN-7497: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7510) Merge work for YARN-5881

2017-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255328#comment-16255328 ] Hadoop QA commented on YARN-7510: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7213) [Umbrella] Test and validate HBase-2.0.x with Atsv2

2017-11-16 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255427#comment-16255427 ] Haibo Chen commented on YARN-7213: -- [~rohithsharma] One of the test failures, testGetEntitiesConfigFilter

[jira] [Commented] (YARN-7213) [Umbrella] Test and validate HBase-2.0.x with Atsv2

2017-11-16 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255448#comment-16255448 ] Haibo Chen commented on YARN-7213: -- [~openinx] The problem seems to be around

[jira] [Commented] (YARN-7119) yarn rmadmin -updateNodeResource should be updated for resource types

2017-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256596#comment-16256596 ] Hadoop QA commented on YARN-7119: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7448) [API] Add SchedulingRequest to the AllocateRequest

2017-11-16 Thread Panagiotis Garefalakis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255653#comment-16255653 ] Panagiotis Garefalakis commented on YARN-7448: -- [~asuresh] patch looks good to me. Some minor

[jira] [Commented] (YARN-5534) Allow whitelisted volume mounts

2017-11-16 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255681#comment-16255681 ] Shane Kumpf commented on YARN-5534: --- {code} We can check the origin of the docker image, if it comes from

[jira] [Comment Edited] (YARN-5534) Allow whitelisted volume mounts

2017-11-16 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255681#comment-16255681 ] Shane Kumpf edited comment on YARN-5534 at 11/16/17 5:45 PM: - {quote} We can

[jira] [Commented] (YARN-7505) RM REST endpoints generate malformed JSON

2017-11-16 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255682#comment-16255682 ] Eric Yang commented on YARN-7505: - Hi [~templedf], Part of Hadoop switched to com.fastxml version of

[jira] [Created] (YARN-7514) TestAggregatedLogDeletionService.testRefreshLogRetentionSettings is flaky

2017-11-16 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-7514: Summary: TestAggregatedLogDeletionService.testRefreshLogRetentionSettings is flaky Key: YARN-7514 URL: https://issues.apache.org/jira/browse/YARN-7514 Project: Hadoop YARN

[jira] [Updated] (YARN-7514) TestAggregatedLogDeletionService.testRefreshLogRetentionSettings is flaky

2017-11-16 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7514: - Description: TestAggregatedLogDeletionService.testRefreshLogRetentionSettings fails occasionally with

[jira] [Commented] (YARN-7513) FindBugs in FSAppAttempt.getWeight()

2017-11-16 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255727#comment-16255727 ] Daniel Templeton commented on YARN-7513: Are you sure it's safe to remove the lock? > FindBugs in

[jira] [Commented] (YARN-7390) All reservation related test cases failed when TestYarnClient runs against Fair Scheduler.

2017-11-16 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255783#comment-16255783 ] Yufei Gu commented on YARN-7390: Thanks [~haibo.chen] for review and commit. > All reservation related

[jira] [Updated] (YARN-7516) Security check for untrusted docker image

2017-11-16 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7516: Description: Hadoop YARN Services can support using private docker registry image or docker image from

[jira] [Commented] (YARN-7483) Test cases cleanup post YARN-5881

2017-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255813#comment-16255813 ] Hadoop QA commented on YARN-7483: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7448) [API] Add SchedulingRequest to the AllocateRequest

2017-11-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255885#comment-16255885 ] Wangda Tan commented on YARN-7448: -- Thanks [~pgaref] for working on this. In general patch looks good.

[jira] [Updated] (YARN-7448) [API] Add SchedulingRequest to the AllocateRequest

2017-11-16 Thread Panagiotis Garefalakis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Panagiotis Garefalakis updated YARN-7448: - Attachment: YARN-7448-YARN-6592.003.patch Addressing comments based on [~asuresh]

[jira] [Created] (YARN-7513) FindBugs in FSAppAttempt.getWeight()

2017-11-16 Thread Wilfred Spiegelenburg (JIRA)
Wilfred Spiegelenburg created YARN-7513: --- Summary: FindBugs in FSAppAttempt.getWeight() Key: YARN-7513 URL: https://issues.apache.org/jira/browse/YARN-7513 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-7505) RM REST endpoints generate malformed JSON

2017-11-16 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255742#comment-16255742 ] Daniel Templeton commented on YARN-7505: Good point. The two don't play together well, but it

[jira] [Created] (YARN-7516) Security check for untrusted docker image

2017-11-16 Thread Eric Yang (JIRA)
Eric Yang created YARN-7516: --- Summary: Security check for untrusted docker image Key: YARN-7516 URL: https://issues.apache.org/jira/browse/YARN-7516 Project: Hadoop YARN Issue Type: Improvement

[jira] [Commented] (YARN-7516) Security check for untrusted docker image

2017-11-16 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255816#comment-16255816 ] Eric Badger commented on YARN-7516: --- Hey [~eyang], could you open up new docker jiras as subtasks of

[jira] [Updated] (YARN-7516) Security check for untrusted docker image

2017-11-16 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-7516: -- Issue Type: Sub-task (was: Improvement) Parent: YARN-3611 > Security check for untrusted docker

[jira] [Commented] (YARN-7503) Configurable heap size / JVM opts in service AM

2017-11-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255832#comment-16255832 ] Hudson commented on YARN-7503: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13248 (See

[jira] [Updated] (YARN-7438) Additional changes to make SchedulingPlacementSet agnostic to ResourceRequest / placement algorithm

2017-11-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7438: - Attachment: YARN-7438.002.patch > Additional changes to make SchedulingPlacementSet agnostic to

[jira] [Commented] (YARN-7469) Capacity Scheduler Intra-queue preemption: User can starve if newest app is exactly at user limit

2017-11-16 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255891#comment-16255891 ] Eric Payne commented on YARN-7469: -- Thank you very much [~sunilg]. Just one concern is that this fix

[jira] [Commented] (YARN-7448) [API] Add SchedulingRequest to the AllocateRequest

2017-11-16 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255901#comment-16255901 ] Konstantinos Karanasos commented on YARN-7448: -- Thank you guys for working on this. Please

[jira] [Commented] (YARN-7390) All reservation related test cases failed when TestYarnClient runs against Fair Scheduler.

2017-11-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255806#comment-16255806 ] Hudson commented on YARN-7390: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13247 (See

[jira] [Commented] (YARN-7503) Configurable heap size / JVM opts in service AM

2017-11-16 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255846#comment-16255846 ] Jonathan Hung commented on YARN-7503: - Thanks [~jianhe]! > Configurable heap size / JVM opts in

[jira] [Commented] (YARN-5534) Allow whitelisted volume mounts

2017-11-16 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255850#comment-16255850 ] Eric Yang commented on YARN-5534: - [~shaneku...@gmail.com][~ebadger] . Thanks for the input. I open a

[jira] [Commented] (YARN-7513) FindBugs in FSAppAttempt.getWeight()

2017-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255896#comment-16255896 ] Hadoop QA commented on YARN-7513: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7330) Add support to show GPU on UI/metrics

2017-11-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7330: - Attachment: YARN-7330.011.patch Attached ver.11 patch. Reverted changes of simplyUnit. As discussed with

[jira] [Created] (YARN-7515) HA related tests fails in trunk

2017-11-16 Thread Bibin A Chundatt (JIRA)
Bibin A Chundatt created YARN-7515: -- Summary: HA related tests fails in trunk Key: YARN-7515 URL: https://issues.apache.org/jira/browse/YARN-7515 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-7505) RM REST endpoints generate malformed JSON

2017-11-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255797#comment-16255797 ] Wangda Tan commented on YARN-7505: -- [~templedf], and also, it looks like the new compatbility guide

[jira] [Commented] (YARN-7506) Overhaul the design of the Linux container-executor regarding Docker and future runtimes

2017-11-16 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255814#comment-16255814 ] Eric Badger commented on YARN-7506: --- I suppose we could move the docker portion of container-executor

[jira] [Updated] (YARN-7419) CapacityScheduler: Allow auto leaf queue creation after queue mapping

2017-11-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7419: - Summary: CapacityScheduler: Allow auto leaf queue creation after queue mapping (was: Implement Auto Queue

[jira] [Updated] (YARN-7473) Implement Framework and policy for capacity management of auto created queues

2017-11-16 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-7473: --- Attachment: YARN-7473.1.patch > Implement Framework and policy for capacity management of auto

[jira] [Commented] (YARN-7473) Implement Framework and policy for capacity management of auto created queues

2017-11-16 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255854#comment-16255854 ] Suma Shivaprasad commented on YARN-7473: Uploading initial patch for reviews > Implement Framework

[jira] [Updated] (YARN-7515) HA related tests fails in trunk

2017-11-16 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-7515: --- Affects Version/s: 3.0.0-beta1 > HA related tests fails in trunk >

[jira] [Commented] (YARN-7448) [API] Add SchedulingRequest to the AllocateRequest

2017-11-16 Thread Panagiotis Garefalakis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255864#comment-16255864 ] Panagiotis Garefalakis commented on YARN-7448: -- Thanks for assigning [~asuresh] > You mean

[jira] [Commented] (YARN-4813) TestRMWebServicesDelegationTokenAuthentication.testDoAs fails intermittently

2017-11-16 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255898#comment-16255898 ] Robert Kanter commented on YARN-4813: - If there's a system property for disabling the cache, I'd rather

[jira] [Updated] (YARN-7513) FindBugs in FSAppAttempt.getWeight()

2017-11-16 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-7513: Attachment: YARN-7513.001.patch patch to remove the locking and clean up the ported

[jira] [Commented] (YARN-7505) RM REST endpoints generate malformed JSON

2017-11-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255792#comment-16255792 ] Wangda Tan commented on YARN-7505: -- [~templedf]/[~sunilg] I'm fine with changing any fields which are not

[jira] [Commented] (YARN-7419) CapacityScheduler: Allow auto leaf queue creation after queue mapping

2017-11-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255867#comment-16255867 ] Hudson commented on YARN-7419: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13249 (See

[jira] [Comment Edited] (YARN-7448) [API] Add SchedulingRequest to the AllocateRequest

2017-11-16 Thread Panagiotis Garefalakis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255864#comment-16255864 ] Panagiotis Garefalakis edited comment on YARN-7448 at 11/16/17 7:50 PM:

[jira] [Updated] (YARN-7448) [API] Add SchedulingRequest to the AllocateRequest

2017-11-16 Thread Panagiotis Garefalakis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Panagiotis Garefalakis updated YARN-7448: - Attachment: YARN-7448-YARN-6592.004.patch > [API] Add SchedulingRequest to the

[jira] [Updated] (YARN-7487) Make sure volume includes GPU base libraries exists after created by plugin

2017-11-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7487: - Attachment: YARN-7487.003.patch Attached ver.3 patch addressed cc warnings. > Make sure volume includes

[jira] [Updated] (YARN-7515) HA related tests fails in trunk

2017-11-16 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-7515: --- Description: https://builds.apache.org/job/PreCommit-YARN-Build/18498/testReport/

[jira] [Commented] (YARN-7516) Security check for untrusted docker image

2017-11-16 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255811#comment-16255811 ] Eric Yang commented on YARN-7516: - Other possible solution is to use docker user remapping feature to

[jira] [Commented] (YARN-7516) Security check for untrusted docker image

2017-11-16 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255856#comment-16255856 ] Eric Yang commented on YARN-7516: - [~ebadger] Will do. Thanks for the advice. > Security check for

[jira] [Commented] (YARN-6483) Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned by the Resource Manager as a response to the Application Master heartbeat

2017-11-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256061#comment-16256061 ] ASF GitHub Bot commented on YARN-6483: -- Github user xslogic commented on a diff in the pull request:

[jira] [Commented] (YARN-7213) [Umbrella] Test and validate HBase-2.0.x with Atsv2

2017-11-16 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256141#comment-16256141 ] Haibo Chen commented on YARN-7213: -- [~te...@apache.org] Please hold your further investigation. Our

[jira] [Created] (YARN-7520) Queue Ordering policy changes for ordering auto created leaf queues within Managed parent Queues

2017-11-16 Thread Suma Shivaprasad (JIRA)
Suma Shivaprasad created YARN-7520: -- Summary: Queue Ordering policy changes for ordering auto created leaf queues within Managed parent Queues Key: YARN-7520 URL: https://issues.apache.org/jira/browse/YARN-7520

[jira] [Commented] (YARN-7330) Add support to show GPU on UI/metrics

2017-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256057#comment-16256057 ] Hadoop QA commented on YARN-7330: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7519) Exception during RM shutdown - "No enum constant YarnApplicationAttemptState.FINAL_SAVING"

2017-11-16 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256102#comment-16256102 ] Gour Saha commented on YARN-7519: - Not sure if it has anything to do with YARN-4587 > Exception during RM

[jira] [Updated] (YARN-7448) [API] Add SchedulingRequest to the AllocateRequest

2017-11-16 Thread Panagiotis Garefalakis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Panagiotis Garefalakis updated YARN-7448: - Attachment: YARN-7448-YARN-6592.005.patch > [API] Add SchedulingRequest to the

[jira] [Commented] (YARN-7506) Overhaul the design of the Linux container-executor regarding Docker and future runtimes

2017-11-16 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256115#comment-16256115 ] Eric Yang commented on YARN-7506: - IMO, Container-executor is essentially a light weight sudo with extra

[jira] [Commented] (YARN-5673) [Umbrella] Re-write container-executor to improve security, extensibility, and portability

2017-11-16 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256151#comment-16256151 ] Eric Yang commented on YARN-5673: - It would be safer for container-executor to follow specific workflow,

[jira] [Updated] (YARN-7520) Queue Ordering policy changes for ordering auto created leaf queues within Managed parent Queues

2017-11-16 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-7520: --- Description: Queue Ordering policy currently uses priority, utilization and absolute capacity

[jira] [Created] (YARN-7521) Add some misisng @VisibleForTesting annotations

2017-11-16 Thread Ray Chiang (JIRA)
Ray Chiang created YARN-7521: Summary: Add some misisng @VisibleForTesting annotations Key: YARN-7521 URL: https://issues.apache.org/jira/browse/YARN-7521 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-7506) Overhaul the design of the Linux container-executor regarding Docker and future runtimes

2017-11-16 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256051#comment-16256051 ] Vinod Kumar Vavilapalli commented on YARN-7506: --- This is either a dup or sub-task of

[jira] [Commented] (YARN-5464) Server-Side NM Graceful Decommissioning with RM HA

2017-11-16 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256093#comment-16256093 ] Junping Du commented on YARN-5464: -- I am working on a design doc for this, will upload for review soon. >

[jira] [Assigned] (YARN-5464) Server-Side NM Graceful Decommissioning with RM HA

2017-11-16 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reassigned YARN-5464: Assignee: Junping Du > Server-Side NM Graceful Decommissioning with RM HA >

[jira] [Created] (YARN-7519) Exception during RM shutdown - "No enum constant YarnApplicationAttemptState.FINAL_SAVING"

2017-11-16 Thread Gour Saha (JIRA)
Gour Saha created YARN-7519: --- Summary: Exception during RM shutdown - "No enum constant YarnApplicationAttemptState.FINAL_SAVING" Key: YARN-7519 URL: https://issues.apache.org/jira/browse/YARN-7519

[jira] [Commented] (YARN-914) (Umbrella) Support graceful decommission of nodemanager

2017-11-16 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256106#comment-16256106 ] Junping Du commented on YARN-914: - Client side graceful decommission work has been done together with proper

[jira] [Updated] (YARN-7473) Implement Framework and policy for capacity management of auto created queues

2017-11-16 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-7473: --- Attachment: YARN-7473.2.patch Added code changes for node label entitlement updates, fixed

[jira] [Assigned] (YARN-7520) Queue Ordering policy changes for ordering auto created leaf queues within Managed parent Queues

2017-11-16 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad reassigned YARN-7520: -- Assignee: Suma Shivaprasad > Queue Ordering policy changes for ordering auto created

[jira] [Updated] (YARN-7521) Add some misisng @VisibleForTesting annotations

2017-11-16 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-7521: - Attachment: YARN-7521.001.patch > Add some misisng @VisibleForTesting annotations >

[jira] [Updated] (YARN-6168) Restarted RM may not inform AM about all existing containers

2017-11-16 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-6168: Attachment: YARN-6168.001.patch This patch includes addition of {{containersFromPreviousAttempt}} in

[jira] [Comment Edited] (YARN-6168) Restarted RM may not inform AM about all existing containers

2017-11-16 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256169#comment-16256169 ] Chandni Singh edited comment on YARN-6168 at 11/16/17 11:43 PM: The patch 1

[jira] [Commented] (YARN-7487) Make sure volume includes GPU base libraries exists after created by plugin

2017-11-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255976#comment-16255976 ] Wangda Tan commented on YARN-7487: -- [~sunilg], could you help to review the patch? > Make sure volume

[jira] [Commented] (YARN-7448) [API] Add SchedulingRequest to the AllocateRequest

2017-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256435#comment-16256435 ] Hadoop QA commented on YARN-7448: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7525) Incorrect query parameters in cluster nodes REST API document

2017-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256449#comment-16256449 ] Hadoop QA commented on YARN-7525: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7461) DominantResourceCalculator#ratio calculation problem when right resource contains zero value

2017-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256462#comment-16256462 ] Hadoop QA commented on YARN-7461: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-7213) [Umbrella] Test and validate HBase-2.0.x with Atsv2

2017-11-16 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256466#comment-16256466 ] Haibo Chen edited comment on YARN-7213 at 11/17/17 4:42 AM: [~openinx],

[jira] [Commented] (YARN-7213) [Umbrella] Test and validate HBase-2.0.x with Atsv2

2017-11-16 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256466#comment-16256466 ] Haibo Chen commented on YARN-7213: -- [~openinx], [~te...@apache.org] Here is a test that you can add to

[jira] [Comment Edited] (YARN-7213) [Umbrella] Test and validate HBase-2.0.x with Atsv2

2017-11-16 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256466#comment-16256466 ] Haibo Chen edited comment on YARN-7213 at 11/17/17 4:44 AM: [~openinx],

[jira] [Updated] (YARN-7522) Add application tags manager implementation

2017-11-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7522: - Attachment: YARN-7522.YARN-6592.wip-001.patch Attached wip implementation which included tracking and look

[jira] [Commented] (YARN-7213) [Umbrella] Test and validate HBase-2.0.x with Atsv2

2017-11-16 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256470#comment-16256470 ] Haibo Chen commented on YARN-7213: -- cc [~varun_saxena] and [~vrushalic] on this issue. > [Umbrella] Test

[jira] [Updated] (YARN-6523) Newly retrieved security Tokens are sent as part of each heartbeat to each node from RM which is not desirable in large cluster

2017-11-16 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R updated YARN-6523: --- Attachment: YARN-6523.001.patch > Newly retrieved security Tokens are sent as part of each heartbeat

[jira] [Commented] (YARN-6523) Newly retrieved security Tokens are sent as part of each heartbeat to each node from RM which is not desirable in large cluster

2017-11-16 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256472#comment-16256472 ] Manikandan R commented on YARN-6523: Attached patch based on our earlier discussions. Thanks

  1   2   >