[jira] [Updated] (YARN-6770) [Docs] A small mistake in the example of TimelineClient

2017-07-24 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-6770: Fix Version/s: (was: 2.9) (was: 2.8.3) 2.8.2

[jira] [Updated] (YARN-6809) Fix typo in ResourceManagerHA.md

2017-07-24 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-6809: Fix Version/s: (was: 2.8.3) 2.8.2 > Fix typo in ResourceManagerHA.md >

[jira] [Updated] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-07-24 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-2113: Fix Version/s: (was: 2.8.3) 2.8.2 > Add cross-user preemption within

[jira] [Updated] (YARN-6428) Queue AM limit is not honored in CS always

2017-07-24 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-6428: Fix Version/s: (was: 2.9) (was: 2.8.3) 2.8.2

[jira] [Commented] (YARN-6844) AMRMClientImpl.checkNodeLabelExpression() has wrong error message

2017-07-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099466#comment-16099466 ] Hudson commented on YARN-6844: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12051 (See

[jira] [Commented] (YARN-6779) DominantResourceFairnessPolicy.DominantResourceFairnessComparator.calculateShares() should be @VisibleForTesting

2017-07-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099467#comment-16099467 ] Hudson commented on YARN-6779: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12051 (See

[jira] [Commented] (YARN-5146) [YARN-3368] Supports Fair Scheduler in new YARN UI

2017-07-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099457#comment-16099457 ] Hadoop QA commented on YARN-5146: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-6855) CLI Proto Modifications to support Node Attributes

2017-07-24 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099409#comment-16099409 ] Sunil G edited comment on YARN-6855 at 7/25/17 2:50 AM: Thanks

[jira] [Commented] (YARN-6855) CLI Proto Modifications to support Node Attributes

2017-07-24 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099409#comment-16099409 ] Sunil G commented on YARN-6855: --- Thanks [~naganarasimha...@apache.org] for the effort. Few comments In

[jira] [Commented] (YARN-3409) Support Node Attribute functionality

2017-07-24 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099402#comment-16099402 ] Naganarasimha G R commented on YARN-3409: - Thanks [~wangda] & [~kkaranasos] for sharing your

[jira] [Commented] (YARN-3409) Support Node Attribute functionality

2017-07-24 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099399#comment-16099399 ] Sunil G commented on YARN-3409: --- Thanks [~kkaranasos] for comments. Some quick thoughts here. bq.is the plan

[jira] [Commented] (YARN-6733) Add table for storing sub-application entities

2017-07-24 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099398#comment-16099398 ] Rohith Sharma K S commented on YARN-6733: - Thanks [~vrushalic] for detailed explanation. I am fine

[jira] [Commented] (YARN-6779) DominantResourceFairnessPolicy.DominantResourceFairnessComparator.calculateShares() should be @VisibleForTesting

2017-07-24 Thread Yeliang Cang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099391#comment-16099391 ] Yeliang Cang commented on YARN-6779: Thank you for your review, [~templedf]! >

[jira] [Updated] (YARN-6593) [API] Introduce Placement Constraint object

2017-07-24 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-6593: Target Version/s: 3.0.0-beta1 Fix Version/s: (was: 3.0.0-alpha3)

[jira] [Comment Edited] (YARN-6413) Decouple Yarn Registry API from ZK

2017-07-24 Thread Ellen Hui (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099352#comment-16099352 ] Ellen Hui edited comment on YARN-6413 at 7/25/17 1:10 AM: -- bq. looks like

[jira] [Commented] (YARN-6413) Decouple Yarn Registry API from ZK

2017-07-24 Thread Ellen Hui (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099352#comment-16099352 ] Ellen Hui commented on YARN-6413: - bq: looks like RegistryUtils#extractServiceRecords is removed. Do you

[jira] [Comment Edited] (YARN-6413) Decouple Yarn Registry API from ZK

2017-07-24 Thread Ellen Hui (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099352#comment-16099352 ] Ellen Hui edited comment on YARN-6413 at 7/25/17 1:09 AM: -- bq:looks like

[jira] [Commented] (YARN-6413) Decouple Yarn Registry API from ZK

2017-07-24 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099345#comment-16099345 ] Jian He commented on YARN-6413: --- bq. I did not remove any methods, I just didn't add the ones that exist in

[jira] [Commented] (YARN-3409) Support Node Attribute functionality

2017-07-24 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099341#comment-16099341 ] Konstantinos Karanasos commented on YARN-3409: -- Yeah, I see there are important differences

[jira] [Commented] (YARN-6802) Support view leaf queue am resource usage in RM web ui

2017-07-24 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099328#comment-16099328 ] YunFan Zhou commented on YARN-6802: --- [~yufeigu] Thank Yufei, I will add Max AM Resource in this JIRA

[jira] [Issue Comment Deleted] (YARN-6862) Nodemanager resource usage metrics sometimes are negative

2017-07-24 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YunFan Zhou updated YARN-6862: -- Comment: was deleted (was: [~jlowe] It is very likely that the process is exists, but the resource

[jira] [Commented] (YARN-6862) Nodemanager resource usage metrics sometimes are negative

2017-07-24 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099321#comment-16099321 ] YunFan Zhou commented on YARN-6862: --- [~jlowe] It is very likely that the process is exists, but the

[jira] [Updated] (YARN-6804) Allow custom hostname for docker containers in native services

2017-07-24 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-6804: - Attachment: YARN-6804-trunk.005.patch I believe the attached patch fixes the enforcer error. It

[jira] [Commented] (YARN-3409) Support Node Attribute functionality

2017-07-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099292#comment-16099292 ] Wangda Tan commented on YARN-3409: -- [~kkaranasos], Add my thoughts to your questions,

[jira] [Commented] (YARN-3409) Support Node Attribute functionality

2017-07-24 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099277#comment-16099277 ] Konstantinos Karanasos commented on YARN-3409: -- Hi guys, Nice to see you are resuming work on

[jira] [Comment Edited] (YARN-6733) Add table for storing sub-application entities

2017-07-24 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099207#comment-16099207 ] Vrushali C edited comment on YARN-6733 at 7/24/17 11:28 PM: So we thought that

[jira] [Commented] (YARN-6610) DominantResourceCalculator.getResourceAsValue() dominant param is no longer appropriate

2017-07-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099257#comment-16099257 ] Wangda Tan commented on YARN-6610: -- Thanks [~templedf] for working on the patch and comments from

[jira] [Commented] (YARN-6726) Fix issues with docker commands executed by container-executor

2017-07-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099233#comment-16099233 ] Wangda Tan commented on YARN-6726: -- Thanks [~shaneku...@gmail.com] for the patch. Discussed with Shane

[jira] [Created] (YARN-6866) Minor clean-up and fixes in anticipation of merge with trunk

2017-07-24 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-6866: Summary: Minor clean-up and fixes in anticipation of merge with trunk Key: YARN-6866 URL: https://issues.apache.org/jira/browse/YARN-6866 Project: Hadoop YARN

[jira] [Commented] (YARN-6733) Add table for storing sub-application entities

2017-07-24 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099207#comment-16099207 ] Vrushali C commented on YARN-6733: -- So we thought that it will be good to keep the column name so that sub

[jira] [Commented] (YARN-6307) Refactor FairShareComparator#compare

2017-07-24 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099195#comment-16099195 ] Yufei Gu commented on YARN-6307: The overhead of this refactoring would be 1. More check on variable

[jira] [Commented] (YARN-6852) [YARN-6223] Native code changes to support isolate GPU devices by using CGroups

2017-07-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099193#comment-16099193 ] Wangda Tan commented on YARN-6852: -- [~chris.douglas], could you help to review the approach and patch if

[jira] [Comment Edited] (YARN-6031) Application recovery has failed when node label feature is turned off during RM recovery

2017-07-24 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099180#comment-16099180 ] Jian He edited comment on YARN-6031 at 7/24/17 10:15 PM: - Ran into this patch when

[jira] [Comment Edited] (YARN-6031) Application recovery has failed when node label feature is turned off during RM recovery

2017-07-24 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099180#comment-16099180 ] Jian He edited comment on YARN-6031 at 7/24/17 10:08 PM: - Ran into this patch when

[jira] [Commented] (YARN-6031) Application recovery has failed when node label feature is turned off during RM recovery

2017-07-24 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099180#comment-16099180 ] Jian He commented on YARN-6031: --- Ran into this patch when debugging, got few questions: cc [~sunilg], [~Ying

[jira] [Commented] (YARN-6307) Refactor FairShareComparator#compare

2017-07-24 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099175#comment-16099175 ] Daniel Templeton commented on YARN-6307: LGTM. Given the frequency with which this method is

[jira] [Commented] (YARN-6307) Refactor FairShareComparator#compare

2017-07-24 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099164#comment-16099164 ] Yufei Gu commented on YARN-6307: Thanks [~templedf] for the review. Uploaded patch v3 for your comments. >

[jira] [Updated] (YARN-6307) Refactor FairShareComparator#compare

2017-07-24 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6307: --- Attachment: YARN-6307.003.patch > Refactor FairShareComparator#compare >

[jira] [Commented] (YARN-6610) DominantResourceCalculator.getResourceAsValue() dominant param is no longer appropriate

2017-07-24 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099146#comment-16099146 ] Yufei Gu commented on YARN-6610: Thanks [~templedf] for working on this. Some thoughts: # I like what you

[jira] [Commented] (YARN-3409) Support Node Attribute functionality

2017-07-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099137#comment-16099137 ] Wangda Tan commented on YARN-3409: -- Thanks [~Naganarasimha] and inputs from [~sunilg]. The latest API

[jira] [Commented] (YARN-6307) Refactor FairShareComparator#compare

2017-07-24 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099134#comment-16099134 ] Daniel Templeton commented on YARN-6307: Nice patch, [~yufeigu]. Here are my comments: # Since

[jira] [Commented] (YARN-6802) Support view leaf queue am resource usage in RM web ui

2017-07-24 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099121#comment-16099121 ] Yufei Gu commented on YARN-6802: Thank [~daemon] for working on this. It is definitely useful. I filed

[jira] [Created] (YARN-6865) FSLeafQueue.context should be final

2017-07-24 Thread Daniel Templeton (JIRA)
Daniel Templeton created YARN-6865: -- Summary: FSLeafQueue.context should be final Key: YARN-6865 URL: https://issues.apache.org/jira/browse/YARN-6865 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-6864) FSPreemptionThread cleanup for readability

2017-07-24 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-6864: --- Issue Type: Improvement (was: Bug) > FSPreemptionThread cleanup for readability >

[jira] [Commented] (YARN-6845) Variable scheduler of FSLeafQueue duplicates the one of its parent FSQueue.

2017-07-24 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099092#comment-16099092 ] Daniel Templeton commented on YARN-6845: LGTM +1 > Variable scheduler of FSLeafQueue duplicates

[jira] [Updated] (YARN-6864) FSPreemptionThread cleanup for readability

2017-07-24 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-6864: --- Attachment: YARN-6864.001.patch > FSPreemptionThread cleanup for readability >

[jira] [Created] (YARN-6864) FSPreemptionThread cleanup for readability

2017-07-24 Thread Daniel Templeton (JIRA)
Daniel Templeton created YARN-6864: -- Summary: FSPreemptionThread cleanup for readability Key: YARN-6864 URL: https://issues.apache.org/jira/browse/YARN-6864 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-6863) Fair Scheduler preemption thread should check that a container has the needed resources before adding it to the preemption list

2017-07-24 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-6863: --- Description: In {{FSPreemptionThread.identifyContainersToPreemptOnNode()}}, we add every

[jira] [Created] (YARN-6863) Fair Scheduler preemption thread should check that a container has the needed resources before adding it to the preemption list

2017-07-24 Thread Daniel Templeton (JIRA)
Daniel Templeton created YARN-6863: -- Summary: Fair Scheduler preemption thread should check that a container has the needed resources before adding it to the preemption list Key: YARN-6863 URL:

[jira] [Commented] (YARN-6788) Improve performance of resource profile branch

2017-07-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099045#comment-16099045 ] Hadoop QA commented on YARN-6788: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5146) [YARN-3368] Supports Fair Scheduler in new YARN UI

2017-07-24 Thread Abdullah Yousufi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abdullah Yousufi updated YARN-5146: --- Attachment: YARN-5146.004.patch > [YARN-3368] Supports Fair Scheduler in new YARN UI >

[jira] [Assigned] (YARN-6779) DominantResourceFairnessPolicy.DominantResourceFairnessComparator.calculateShares() should be @VisibleForTesting

2017-07-24 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton reassigned YARN-6779: -- Assignee: Yeliang Cang (was: Laura Torres) >

[jira] [Commented] (YARN-6768) Improve performance of yarn api record toString and fromString

2017-07-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16098979#comment-16098979 ] Hudson commented on YARN-6768: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12049 (See

[jira] [Commented] (YARN-5219) When an export var command fails in launch_container.sh, the full container launch should fail

2017-07-24 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16098959#comment-16098959 ] Suma Shivaprasad commented on YARN-5219: [~sunilg] Yes I meant "set -o pipefail -e" . Sorry about

[jira] [Commented] (YARN-6150) TestContainerManagerSecurity tests for Yarn Server are flakey

2017-07-24 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16098922#comment-16098922 ] Ray Chiang commented on YARN-6150: -- +1 Thanks [~ajisakaa] for digging into this. >

[jira] [Updated] (YARN-6788) Improve performance of resource profile branch

2017-07-24 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-6788: -- Attachment: YARN-6788-YARN-3926.012.patch As discussed earlier, I will be suppressing 3 findbugs warnings which

[jira] [Commented] (YARN-6413) Decouple Yarn Registry API from ZK

2017-07-24 Thread Ellen Hui (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16098902#comment-16098902 ] Ellen Hui commented on YARN-6413: - bq. In RegistryDNSServer, all the methods removed are essential to

[jira] [Commented] (YARN-5548) Use MockRMMemoryStateStore to reduce test failures

2017-07-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16098784#comment-16098784 ] Hadoop QA commented on YARN-5548: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6862) Nodemanager resource usage metrics sometimes are negative

2017-07-24 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16098634#comment-16098634 ] YunFan Zhou commented on YARN-6862: --- [~jlowe] It is very likely that the process is exists, but the

[jira] [Commented] (YARN-6862) Nodemanager resource usage metrics sometimes are negative

2017-07-24 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16098609#comment-16098609 ] Jason Lowe commented on YARN-6862: -- I believe the case of it returning -1B is when the process exited just

[jira] [Commented] (YARN-6862) Nodemanager resource usage metrics sometimes are negative

2017-07-24 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16098603#comment-16098603 ] YunFan Zhou commented on YARN-6862: --- [~sunilg] Thanks. We only can see used memory from NM logs, and

[jira] [Commented] (YARN-6842) Implement a new access type for queue

2017-07-24 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16098594#comment-16098594 ] YunFan Zhou commented on YARN-6842: --- [~bibinchundatt] Thanks bibin, But your solution can not meet our

[jira] [Commented] (YARN-6768) Improve performance of yarn api record toString and fromString

2017-07-24 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16098567#comment-16098567 ] Jason Lowe commented on YARN-6768: -- +1 for the latest patch. The unit test failures are unrelated.

[jira] [Commented] (YARN-6858) Attribute Manager to store and provide the attributes in RM

2017-07-24 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16098541#comment-16098541 ] Arun Suresh commented on YARN-6858: --- Thanks for raising these [~Naganarasimha], I was wondering if,

[jira] [Updated] (YARN-3409) Support Node Attribute functionality

2017-07-24 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-3409: Attachment: 3409-apiChanges_v2.pdf (4).pdf Attached the document for Proto, CLI & REST

[jira] [Updated] (YARN-5548) Use MockRMMemoryStateStore to reduce test failures

2017-07-24 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-5548: --- Attachment: YARN-5548.0016.patch Attaching rebase patch again .. > Use

[jira] [Updated] (YARN-6862) Nodemanager resource usage metrics sometimes are negative

2017-07-24 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-6862: - Summary: Nodemanager resource usage metrics sometimes are negative (was: There is a bug in

[jira] [Commented] (YARN-6130) [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM

2017-07-24 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16098474#comment-16098474 ] Varun Saxena commented on YARN-6130: Alternatively, we can also compare the token on every allocate

[jira] [Commented] (YARN-6842) Implement a new access type for queue

2017-07-24 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16098469#comment-16098469 ] Bibin A Chundatt commented on YARN-6842: [~daemon] During application submission we could set

[jira] [Commented] (YARN-6130) [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM

2017-07-24 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16098275#comment-16098275 ] Varun Saxena commented on YARN-6130: Thanks [~jianhe] and [~rohithsharma] for reviews. Sorry could not

[jira] [Commented] (YARN-6862) There is a bug in computing resource usage in NM.

2017-07-24 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16098249#comment-16098249 ] Sunil G commented on YARN-6862: --- [~daemon] Thanks for raising the jira. Could you please share some more

[jira] [Commented] (YARN-6102) RMActiveService context to be updated with new RMContext on failover

2017-07-24 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16098247#comment-16098247 ] Rohith Sharma K S commented on YARN-6102: - test failures are unrelated to the patch.. there are

[jira] [Commented] (YARN-3254) HealthReport should include disk full information

2017-07-24 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16098234#comment-16098234 ] Sunil G commented on YARN-3254: --- Thanks [~suma.shivaprasad] Generally patch looks fine. Few minor comments.

[jira] [Commented] (YARN-6788) Improve performance of resource profile branch

2017-07-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16098211#comment-16098211 ] Hadoop QA commented on YARN-6788: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6102) RMActiveService context to be updated with new RMContext on failover

2017-07-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16098205#comment-16098205 ] Hadoop QA commented on YARN-6102: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5219) When an export var command fails in launch_container.sh, the full container launch should fail

2017-07-24 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16098188#comment-16098188 ] Sunil G commented on YARN-5219: --- Thanks [~suma.shivaprasad] I think you meant "set -o pipefail -e". It makes

[jira] [Updated] (YARN-6862) There is a bug in computing resource usage in NM.

2017-07-24 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YunFan Zhou updated YARN-6862: -- Description: When we collect real-time metrics of resource usage in NM, we found those values sometimes

[jira] [Created] (YARN-6862) There is a bug in computing resource usage in NM.

2017-07-24 Thread YunFan Zhou (JIRA)
YunFan Zhou created YARN-6862: - Summary: There is a bug in computing resource usage in NM. Key: YARN-6862 URL: https://issues.apache.org/jira/browse/YARN-6862 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-5892) Support user-specific minimum user limit percentage in Capacity Scheduler

2017-07-24 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16098177#comment-16098177 ] Sunil G commented on YARN-5892: --- Hi [~eepayne] Thank you very much for the effort. Generally patch looks fine

[jira] [Commented] (YARN-6734) Ensure sub-application user is extracted & sent to timeline service

2017-07-24 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16098174#comment-16098174 ] Rohith Sharma K S commented on YARN-6734: - [~varun_saxena] do you have any further comments on the

[jira] [Created] (YARN-6861) Reader API for sub application entities

2017-07-24 Thread Rohith Sharma K S (JIRA)
Rohith Sharma K S created YARN-6861: --- Summary: Reader API for sub application entities Key: YARN-6861 URL: https://issues.apache.org/jira/browse/YARN-6861 Project: Hadoop YARN Issue Type:

[jira] [Resolved] (YARN-6860) TestRMRestart.testFinishedAppRemovalAfterRMRestart fails intermittently

2017-07-24 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved YARN-6860. - Resolution: Duplicate > TestRMRestart.testFinishedAppRemovalAfterRMRestart fails intermittently >

[jira] [Commented] (YARN-6860) TestRMRestart.testFinishedAppRemovalAfterRMRestart fails intermittently

2017-07-24 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16098161#comment-16098161 ] Akira Ajisaka commented on YARN-6860: - I looked YARN-5548 and probably it will fix this failure.

[jira] [Updated] (YARN-6860) TestRMRestart.testFinishedAppRemovalAfterRMRestart fails intermittently

2017-07-24 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-6860: Attachment: YARN-6860.01.patch Attaching a patch to use GenericTestUtils.waitFor. >

[jira] [Commented] (YARN-5548) Use MockRMMemoryStateStore to reduce test failures

2017-07-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16098159#comment-16098159 ] Hadoop QA commented on YARN-5548: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5548) Use MockRMMemoryStateStore to reduce test failures

2017-07-24 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16098147#comment-16098147 ] Varun Saxena commented on YARN-5548: Bibin can you rebase the patch? Sorry for missing this. > Use

[jira] [Commented] (YARN-6860) TestRMRestart.testFinishedAppRemovalAfterRMRestart fails intermittently

2017-07-24 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16098145#comment-16098145 ] Varun Saxena commented on YARN-6860: Sorry I had to get in YARN-5548. Missed it. Will get it in by

[jira] [Commented] (YARN-6860) TestRMRestart.testFinishedAppRemovalAfterRMRestart fails intermittently

2017-07-24 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16098142#comment-16098142 ] Akira Ajisaka commented on YARN-6860: - Okay, I'll check YARN-5548. >

[jira] [Commented] (YARN-6860) TestRMRestart.testFinishedAppRemovalAfterRMRestart fails intermittently

2017-07-24 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16098141#comment-16098141 ] Akira Ajisaka commented on YARN-6860: - The test fails in the following code: {code} // the first

[jira] [Commented] (YARN-6860) TestRMRestart.testFinishedAppRemovalAfterRMRestart fails intermittently

2017-07-24 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16098140#comment-16098140 ] Rohith Sharma K S commented on YARN-6860: - There is JIRA exist with for this test case failure i.e

[jira] [Commented] (YARN-6130) [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM

2017-07-24 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16098138#comment-16098138 ] Rohith Sharma K S commented on YARN-6130: - bq. The intention here is to avoid updating the token in

[jira] [Created] (YARN-6860) TestRMRestart.testFinishedAppRemovalAfterRMRestart fails intermittently

2017-07-24 Thread Akira Ajisaka (JIRA)
Akira Ajisaka created YARN-6860: --- Summary: TestRMRestart.testFinishedAppRemovalAfterRMRestart fails intermittently Key: YARN-6860 URL: https://issues.apache.org/jira/browse/YARN-6860 Project: Hadoop

[jira] [Commented] (YARN-4161) Capacity Scheduler : Assign single or multiple containers per heart beat driven by configuration

2017-07-24 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16098133#comment-16098133 ] Sunil G commented on YARN-4161: --- One doubt: I think we are not checking below condition in

[jira] [Commented] (YARN-6240) TestCapacityScheduler.testRefreshQueuesWithQueueDelete fails randomly

2017-07-24 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16098119#comment-16098119 ] Rohith Sharma K S commented on YARN-6240: - Recently it failed in branch-2

[jira] [Commented] (YARN-6678) Committer thread crashes with IllegalStateException in async-scheduling mode of CapacityScheduler

2017-07-24 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16098112#comment-16098112 ] Sunil G commented on YARN-6678: --- Thanks [~Tao Yang], I will commit the patch in a day if there are no

[jira] [Updated] (YARN-6102) RMActiveService context to be updated with new RMContext on failover

2017-07-24 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-6102: Attachment: YARN-6102-branch-2.002.patch updated branch-2 patch fixing findbugs. Test

[jira] [Updated] (YARN-6788) Improve performance of resource profile branch

2017-07-24 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-6788: -- Attachment: YARN-6788-YARN-3926.011.patch Thanks [~leftnoteasy]. Uploading a patch addressing latest comments.

[jira] [Commented] (YARN-6859) Add missing test scope to the zookeeper dependency in hadoop-yarn-server-resourcemanager test-jar

2017-07-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16098103#comment-16098103 ] Hadoop QA commented on YARN-6859: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6102) RMActiveService context to be updated with new RMContext on failover

2017-07-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16098087#comment-16098087 ] Hadoop QA commented on YARN-6102: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (YARN-6859) Add missing test scope to the zookeeper dependency in hadoop-yarn-server-resourcemanager test-jar

2017-07-24 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka reassigned YARN-6859: --- Assignee: Akira Ajisaka > Add missing test scope to the zookeeper dependency in >

  1   2   >