[jira] [Updated] (YARN-6836) [ATS1/1.5] "IllegalStateException: connect in progress" while posting entity into TimelineServer

2017-07-17 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-6836: Summary: [ATS1/1.5] "IllegalStateException: connect in progress" while posting entity into

[jira] [Commented] (YARN-6836) [ATS1/1.5] IllegalStateException while posting entity into TimelineServer

2017-07-17 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16091118#comment-16091118 ] Rohith Sharma K S commented on YARN-6836: - This behavior is seen in ResourceManager while

[jira] [Created] (YARN-6836) [ATS1/1.5] IllegalStateException while posting entity into TimelineServer

2017-07-17 Thread Rohith Sharma K S (JIRA)
Rohith Sharma K S created YARN-6836: --- Summary: [ATS1/1.5] IllegalStateException while posting entity into TimelineServer Key: YARN-6836 URL: https://issues.apache.org/jira/browse/YARN-6836 Project:

[jira] [Commented] (YARN-5892) Support user-specific minimum user limit percentage in Capacity Scheduler

2017-07-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16091110#comment-16091110 ] Hadoop QA commented on YARN-5892: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6733) Add table for storing sub-application entities

2017-07-17 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16091049#comment-16091049 ] Rohith Sharma K S commented on YARN-6733: - bq. Actually, do you recollect, we all discussed this.

[jira] [Commented] (YARN-6777) Support for ApplicationMasterService processing chain of interceptors

2017-07-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16091026#comment-16091026 ] Hadoop QA commented on YARN-6777: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5947) Create LeveldbConfigurationStore class using Leveldb as backing store

2017-07-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16091021#comment-16091021 ] Hadoop QA commented on YARN-5947: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6835) Remove runningContainers from ContainerScheduler

2017-07-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16090953#comment-16090953 ] Hadoop QA commented on YARN-6835: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5892) Support user-specific minimum user limit percentage in Capacity Scheduler

2017-07-17 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5892: - Attachment: YARN-5892.branch-2.8.018.patch bq. Replaced it with {{new

[jira] [Commented] (YARN-6612) Update fair scheduler policies to be aware of resource types

2017-07-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16090908#comment-16090908 ] Hadoop QA commented on YARN-6612: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6777) Support for ApplicationMasterService processing chain of interceptors

2017-07-17 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6777: -- Attachment: YARN-6777.004.patch Thanks for the rev [~subru]. Updated the patch based on your

[jira] [Commented] (YARN-6831) Miscellaneous refactoring changes of ContainScheduler

2017-07-17 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16090832#comment-16090832 ] Arun Suresh commented on YARN-6831: --- Do take a look at YARN-6835 where i've posted an initial patch

[jira] [Updated] (YARN-6835) Remove runningContainers from ContainerScheduler

2017-07-17 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6835: -- Attachment: YARN-6835.001.patch Attaching initial patch > Remove runningContainers from

[jira] [Updated] (YARN-6835) Remove runningContainers from ContainerScheduler

2017-07-17 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6835: -- Priority: Minor (was: Major) > Remove runningContainers from ContainerScheduler >

[jira] [Created] (YARN-6835) Remove runningContainers from ContainerScheduler

2017-07-17 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-6835: - Summary: Remove runningContainers from ContainerScheduler Key: YARN-6835 URL: https://issues.apache.org/jira/browse/YARN-6835 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-4455) Support fetching metrics by time range

2017-07-17 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16090796#comment-16090796 ] Vrushali C commented on YARN-4455: -- Yes, thanks for the patch [~varun_saxena]! bq. Primarily used to

[jira] [Updated] (YARN-6628) Unexpected jackson-core-2.2.3 dependency introduced

2017-07-17 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated YARN-6628: -- Attachment: YARN-6628.3-branch-2.8.patch > Unexpected jackson-core-2.2.3 dependency introduced >

[jira] [Commented] (YARN-6777) Support for ApplicationMasterService processing chain of interceptors

2017-07-17 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16090777#comment-16090777 ] Subru Krishnan commented on YARN-6777: -- Thanks [~asuresh] for splitting the patch, lot more

[jira] [Commented] (YARN-6798) NM startup failure with old state store due to version mismatch

2017-07-17 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16090778#comment-16090778 ] Ray Chiang commented on YARN-6798: -- +1 I'm going to commit this tomorrow unless I hear otherwise. > NM

[jira] [Comment Edited] (YARN-6831) Miscellaneous refactoring changes of ContainScheduler

2017-07-17 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16090609#comment-16090609 ] Arun Suresh edited comment on YARN-6831 at 7/17/17 10:33 PM: - Thanks for

[jira] [Updated] (YARN-6834) A container request with only racks specified and relax locality set to false is never honoured

2017-07-17 Thread Muhammad Samir Khan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Muhammad Samir Khan updated YARN-6834: -- Attachment: yarn-6834-unittest.patch > A container request with only racks specified and

[jira] [Created] (YARN-6834) A container request with only racks specified and relax locality set to false is never honoured

2017-07-17 Thread Muhammad Samir Khan (JIRA)
Muhammad Samir Khan created YARN-6834: - Summary: A container request with only racks specified and relax locality set to false is never honoured Key: YARN-6834 URL:

[jira] [Updated] (YARN-6612) Update fair scheduler policies to be aware of resource types

2017-07-17 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-6612: --- Attachment: YARN-6612.YARN-3926.001.patch Here's an initial patch. Comments welcome. >

[jira] [Commented] (YARN-6706) Refactor ContainerScheduler to make oversubscription change easier

2017-07-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16090625#comment-16090625 ] Hudson commented on YARN-6706: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12022 (See

[jira] [Commented] (YARN-6831) Miscellaneous refactoring changes of ContainScheduler

2017-07-17 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16090609#comment-16090609 ] Arun Suresh commented on YARN-6831: --- Thanks for raising this [~haibochen] / [~kasha]. Some thoughts: bq.

[jira] [Issue Comment Deleted] (YARN-6706) Refactor ContainerScheduler to make oversubscription change easier

2017-07-17 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6706: - Comment: was deleted (was: Can you also cherry-pick this into YARN-1011 branch?) > Refactor

[jira] [Commented] (YARN-6706) Refactor ContainerScheduler to make oversubscription change easier

2017-07-17 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16090593#comment-16090593 ] Haibo Chen commented on YARN-6706: -- Can you also cherry-pick this into YARN-1011 branch? > Refactor

[jira] [Updated] (YARN-6628) Unexpected jackson-core-2.2.3 dependency introduced

2017-07-17 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated YARN-6628: -- Attachment: YARN-6628.2-branch-2.8.patch > Unexpected jackson-core-2.2.3 dependency introduced >

[jira] [Updated] (YARN-6833) On branch-2 ResourceManager failed to start

2017-07-17 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-6833: - Priority: Blocker (was: Major) > On branch-2 ResourceManager failed to start >

[jira] [Commented] (YARN-6706) Refactor ContainerScheduler to make oversubscription change easier

2017-07-17 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16090587#comment-16090587 ] Haibo Chen commented on YARN-6706: -- Thanks [~asuresh] for the reviews and commit. > Refactor

[jira] [Moved] (YARN-6833) On branch-2 ResourceManager failed to start

2017-07-17 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du moved MAPREDUCE-6915 to YARN-6833: - Affects Version/s: (was: 2.9) 2.9 Target

[jira] [Commented] (YARN-6706) Refactor ContainerScheduler to make oversubscription change easier

2017-07-17 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16090580#comment-16090580 ] Arun Suresh commented on YARN-6706: --- [~kkaranasos].. Apologies, but think you send the message just as I

[jira] [Commented] (YARN-6832) Tests use assertTrue(....equals(...)) instead of assertEquals()

2017-07-17 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16090578#comment-16090578 ] Daniel Templeton commented on YARN-6832: Findbugs issues are unrelated. > Tests use

[jira] [Commented] (YARN-6832) Tests use assertTrue(....equals(...)) instead of assertEquals()

2017-07-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16090575#comment-16090575 ] Hadoop QA commented on YARN-6832: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-3254) HealthReport should include disk full information

2017-07-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16090574#comment-16090574 ] Hadoop QA commented on YARN-3254: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6706) Refactor ContainerScheduler to make oversubscription change easier

2017-07-17 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16090573#comment-16090573 ] Haibo Chen commented on YARN-6706: -- Thanks [~kkaranasos] for your coming review! FYI, I have created

[jira] [Updated] (YARN-6831) Miscellaneous refactoring changes of ContainScheduler

2017-07-17 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6831: - Description: While reviewing YARN-6706, Karthik pointed out a few issues for improvment in

[jira] [Updated] (YARN-6831) Miscellaneous refactoring changes of ContainScheduler

2017-07-17 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6831: - Description: While reviewing YARN-6706, Karthik pointed out a few issues for improvment in

[jira] [Updated] (YARN-6831) Miscellaneous refactoring changes of ContainScheduler

2017-07-17 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6831: - Description: While reviewing YARN-6706, Karthik pointed out a few issues for improvment in

[jira] [Updated] (YARN-6831) Miscellaneous refactoring changes of ContainScheduler

2017-07-17 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6831: - Description: While reviewing YARN-6706, Karthik pointed out a few issues for improvment in

[jira] [Updated] (YARN-6831) Miscellaneous refactoring changes of ContainScheduler

2017-07-17 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6831: - Description: While reviewing YARN-6706, Karthik pointed out a few issues for improvment in

[jira] [Commented] (YARN-6706) Refactor ContainerScheduler to make oversubscription change easier

2017-07-17 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16090555#comment-16090555 ] Konstantinos Karanasos commented on YARN-6706: -- Hi guys, I am back. If it is possible, please

[jira] [Commented] (YARN-6706) Refactor ContainerScheduler to make oversubscription change easier

2017-07-17 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16090544#comment-16090544 ] Arun Suresh commented on YARN-6706: --- Thanks Haibo.. +1 for the latest patch.. will check it in shortly >

[jira] [Commented] (YARN-5412) Create a proxy chain for ResourceManager REST API in the Router

2017-07-17 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16090538#comment-16090538 ] Carlo Curino commented on YARN-5412: [~giovanni.fumarola], thanks for addressing the feedback. Here

[jira] [Commented] (YARN-3254) HealthReport should include disk full information

2017-07-17 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16090508#comment-16090508 ] Suma Shivaprasad commented on YARN-3254: Attached a patch which bifurcates disks health failure

[jira] [Updated] (YARN-3254) HealthReport should include disk full information

2017-07-17 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-3254: --- Attachment: YARN-3254-003.patch > HealthReport should include disk full information >

[jira] [Commented] (YARN-6130) [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM

2017-07-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16090475#comment-16090475 ] Hadoop QA commented on YARN-6130: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6818) User limit per partition is not honored in branch-2.7 >=

2017-07-17 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated YARN-6818: -- Labels: (was: release-blocker) > User limit per partition is not honored in branch-2.7

[jira] [Commented] (YARN-6826) SLS NMSimulator support for Opportunistic Container Queuing

2017-07-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16090465#comment-16090465 ] Hadoop QA commented on YARN-6826: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6826) SLS NMSimulator support for Opportunistic Container Queuing

2017-07-17 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6826: -- Attachment: YARN-6826.001.patch Attaching initial patch > SLS NMSimulator support for Opportunistic

[jira] [Updated] (YARN-6826) SLS NMSimulator support for Opportunistic Container Queuing

2017-07-17 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6826: -- Description: Allow the NMSimulator to simulate Opportunistic containers. This Essentially means: #

[jira] [Commented] (YARN-6792) Incorrect XML convertion in NodeIDsInfo and LabelsToNodesInfo

2017-07-17 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16090363#comment-16090363 ] Subru Krishnan commented on YARN-6792: -- Thanks [~sunilg] for reviewing/committing and

[jira] [Commented] (YARN-5892) Support user-specific minimum user limit percentage in Capacity Scheduler

2017-07-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16090317#comment-16090317 ] Hadoop QA commented on YARN-5892: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6832) Tests use assertTrue(....equals(...)) instead of assertEquals()

2017-07-17 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-6832: --- Attachment: YARN-6832.001.patch > Tests use assertTrue(equals(...)) instead of

[jira] [Created] (YARN-6832) Tests use assertTrue(....equals(...)) instead of assertEquals()

2017-07-17 Thread Daniel Templeton (JIRA)
Daniel Templeton created YARN-6832: -- Summary: Tests use assertTrue(equals(...)) instead of assertEquals() Key: YARN-6832 URL: https://issues.apache.org/jira/browse/YARN-6832 Project: Hadoop YARN

[jira] [Commented] (YARN-5731) Preemption calculation is not accurate when reserved containers are present in queue.

2017-07-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16090259#comment-16090259 ] Hadoop QA commented on YARN-5731: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6818) User limit per partition is not honored in branch-2.7 >=

2017-07-17 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16090256#comment-16090256 ] Jonathan Hung commented on YARN-6818: - Great, thanks [~shv] for commit and [~Naganarasimha]/[~sunilg]

[jira] [Commented] (YARN-6733) Add table for storing sub-application entities

2017-07-17 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16090257#comment-16090257 ] Vrushali C commented on YARN-6733: -- bq. can you update subapplication row and column schema java doc.

[jira] [Commented] (YARN-6798) NM startup failure with old state store due to version mismatch

2017-07-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16090253#comment-16090253 ] Hadoop QA commented on YARN-6798: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5731) Preemption calculation is not accurate when reserved containers are present in queue.

2017-07-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16090236#comment-16090236 ] Hadoop QA commented on YARN-5731: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6798) NM startup failure with old state store due to version mismatch

2017-07-17 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-6798: - Attachment: YARN-6798.v2.patch Updated Botong's patch with the newer version organization. > NM startup

[jira] [Created] (YARN-6831) Miscellaneous refactoring changes of ContainScheduler

2017-07-17 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-6831: Summary: Miscellaneous refactoring changes of ContainScheduler Key: YARN-6831 URL: https://issues.apache.org/jira/browse/YARN-6831 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-5731) Preemption calculation is not accurate when reserved containers are present in queue.

2017-07-17 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16090122#comment-16090122 ] Sunil G commented on YARN-5731: --- +1 on latest addendum patch. Committing tomorrow if there are no objections.

[jira] [Updated] (YARN-5731) Preemption calculation is not accurate when reserved containers are present in queue.

2017-07-17 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-5731: - Attachment: YARN-5731.addendum.004.patch Offline suggested by [~sunilg], uploaded patch with updated

[jira] [Updated] (YARN-6794) Explicitly promote OPPORTUNISITIC containers locally at the node where they're running

2017-07-17 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6794: - Summary: Explicitly promote OPPORTUNISITIC containers locally at the node where they're running (was:

[jira] [Commented] (YARN-4455) Support fetching metrics by time range

2017-07-17 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16090103#comment-16090103 ] Rohith Sharma K S commented on YARN-4455: - +1 lgtm.. I will commit it later of day if no more

[jira] [Updated] (YARN-5731) Preemption calculation is not accurate when reserved containers are present in queue.

2017-07-17 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-5731: - Attachment: YARN-5731.addendum.003.patch Instead of making the logics to be hard coded, we discussed and

[jira] [Reopened] (YARN-5731) Preemption calculation is not accurate when reserved containers are present in queue.

2017-07-17 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reopened YARN-5731: -- > Preemption calculation is not accurate when reserved containers are present > in queue. >

[jira] [Commented] (YARN-6830) Support quoted strings for environment variables

2017-07-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16090064#comment-16090064 ] Hadoop QA commented on YARN-6830: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5892) Support user-specific minimum user limit percentage in Capacity Scheduler

2017-07-17 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5892: - Attachment: YARN-5892.branch-2.8.017.patch Uploading YARN-5892.branch-2.8.017.patch because I used

[jira] [Updated] (YARN-6830) Support quoted strings for environment variables

2017-07-17 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-6830: -- Attachment: YARN-6830.001.patch > Support quoted strings for environment variables >

[jira] [Commented] (YARN-6775) CapacityScheduler: Improvements to assignContainers, avoid unnecessary canAssignToUser/Queue calls

2017-07-17 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16089936#comment-16089936 ] Nathan Roberts commented on YARN-6775: -- Attached screenshots that show a couple of before/after

[jira] [Commented] (YARN-6130) [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM

2017-07-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16089900#comment-16089900 ] Hadoop QA commented on YARN-6130: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6775) CapacityScheduler: Improvements to assignContainers, avoid unnecessary canAssignToUser/Queue calls

2017-07-17 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan Roberts updated YARN-6775: - Attachment: rpcprocessingtimeschedulerport.png > CapacityScheduler: Improvements to

[jira] [Updated] (YARN-6775) CapacityScheduler: Improvements to assignContainers, avoid unnecessary canAssignToUser/Queue calls

2017-07-17 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan Roberts updated YARN-6775: - Attachment: rmeventprocbusy.png > CapacityScheduler: Improvements to assignContainers, avoid

[jira] [Commented] (YARN-6775) CapacityScheduler: Improvements to assignContainers, avoid unnecessary canAssignToUser/Queue calls

2017-07-17 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16089894#comment-16089894 ] Nathan Roberts commented on YARN-6775: -- [~leftnoteasy], I applied YARN-6775.branch-2.002.patch to

[jira] [Commented] (YARN-4455) Support fetching metrics by time range

2017-07-17 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16089857#comment-16089857 ] Varun Saxena commented on YARN-4455: Checkstyle issues cannot be fixed due to method params. > Support

[jira] [Commented] (YARN-4455) Support fetching metrics by time range

2017-07-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16089813#comment-16089813 ] Hadoop QA commented on YARN-4455: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6150) TestContainerManagerSecurity tests for Yarn Server are flakey

2017-07-17 Thread Sonia Garudi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16089767#comment-16089767 ] Sonia Garudi commented on YARN-6150: [~rchiang] I have tested the latest patch and the tests pass with

[jira] [Commented] (YARN-5534) Allow whitelisted volume mounts

2017-07-17 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16089762#comment-16089762 ] Daniel Templeton commented on YARN-5534: I don't see any need to restrict the mount point in the

[jira] [Commented] (YARN-6822) TestContainerManagerSecurity tests fail on trunk

2017-07-17 Thread Sonia Garudi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16089759#comment-16089759 ] Sonia Garudi commented on YARN-6822: [~rchiang] I tested the latest patch from YARN-6150 and it seems

[jira] [Commented] (YARN-5534) Allow whitelisted volume mounts

2017-07-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16089755#comment-16089755 ] Hadoop QA commented on YARN-5534: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4455) Support fetching metrics by time range

2017-07-17 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-4455: --- Attachment: YARN-4455-YARN-5355.03.patch > Support fetching metrics by time range >

[jira] [Commented] (YARN-4455) Support fetching metrics by time range

2017-07-17 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16089752#comment-16089752 ] Varun Saxena commented on YARN-4455: Thanks [~rohithsharma], will update a new patch fixing the nit

[jira] [Commented] (YARN-5534) Allow whitelisted volume mounts

2017-07-17 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16089694#comment-16089694 ] Shane Kumpf commented on YARN-5534: --- [~ebadger] - sorry for the delay here. I'm actively working on this.

[jira] [Commented] (YARN-6830) Support quoted strings for environment variables

2017-07-17 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16089675#comment-16089675 ] Shane Kumpf commented on YARN-6830: --- I've been looking into this as part of YARN-5534 and will take

[jira] [Assigned] (YARN-6830) Support quoted strings for environment variables

2017-07-17 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf reassigned YARN-6830: - Assignee: Shane Kumpf > Support quoted strings for environment variables >

[jira] [Created] (YARN-6830) Support quoted strings for environment variables

2017-07-17 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-6830: - Summary: Support quoted strings for environment variables Key: YARN-6830 URL: https://issues.apache.org/jira/browse/YARN-6830 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-4455) Support fetching metrics by time range

2017-07-17 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16089657#comment-16089657 ] Rohith Sharma K S commented on YARN-4455: - Given already other filters such as *createdtimestart*

[jira] [Commented] (YARN-6733) Add table for storing sub-application entities

2017-07-17 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16089654#comment-16089654 ] Rohith Sharma K S commented on YARN-6733: - I went through the whole patch, and overall patch is

[jira] [Commented] (YARN-6130) [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM

2017-07-17 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16089645#comment-16089645 ] Varun Saxena commented on YARN-6130: Attaching a patch after addressing comments above. > [ATSv2

[jira] [Commented] (YARN-4455) Support fetching metrics by time range

2017-07-17 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16089637#comment-16089637 ] Varun Saxena commented on YARN-4455: [~rohithsharma], your thoughts on above? > Support fetching

[jira] [Updated] (YARN-6130) [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM

2017-07-17 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-6130: --- Attachment: YARN-6130-YARN-5355.03.patch > [ATSv2 Security] Generate a delegation token for AM when

[jira] [Commented] (YARN-6825) RM quit due to ApplicationStateData exceed the limit size of znode in zk

2017-07-17 Thread Feng Yuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16089630#comment-16089630 ] Feng Yuan commented on YARN-6825: - Hi all, if we could handle this problem like YARN-5006? Do the same size

[jira] [Commented] (YARN-6678) Committer thread crashes with IllegalStateException in async-scheduling mode of CapacityScheduler

2017-07-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16089514#comment-16089514 ] Hadoop QA commented on YARN-6678: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5146) [YARN-3368] Supports Fair Scheduler in new YARN UI

2017-07-17 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16089500#comment-16089500 ] Sunil G commented on YARN-5146: --- Attaching trace. As far as I see, the construction of URL for GET query for

[jira] [Commented] (YARN-6819) Application report fails if app rejected due to nodesize

2017-07-17 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16089399#comment-16089399 ] Sunil G commented on YARN-6819: --- A minor nit. {{APP_SAVE_REJECTED}} could be named as {{APP_SAVE_FAILED}}.

[jira] [Commented] (YARN-6825) RM quit due to ApplicationStateData exceed the limit size of znode in zk

2017-07-17 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16089355#comment-16089355 ] Rohith Sharma K S commented on YARN-6825: - [~bibinchundatt] would you like to provide a patch for