[jira] [Commented] (YARN-6102) On failover RM can crash due to unregistered event to AsyncDispatcher

2017-07-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16080787#comment-16080787 ] Sunil G commented on YARN-6102: --- bq.How about recreating RMContext for each transition? I think this is a

[jira] [Updated] (YARN-6705) Add separate NM preemption thresholds for cpu and memory

2017-07-10 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6705: - Attachment: (was: YARN-6675.00.patch) > Add separate NM preemption thresholds for cpu and memory >

[jira] [Commented] (YARN-6706) Refactor ContainerScheduler to make oversubscription change easier

2017-07-10 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16080835#comment-16080835 ] Haibo Chen commented on YARN-6706: -- Would appreciate reviews from [~arun.sur...@gmail.com] and

[jira] [Commented] (YARN-5412) Create a proxy chain for ResourceManager REST API in the Router

2017-07-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16080940#comment-16080940 ] Hadoop QA commented on YARN-5412: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6705) Add separate NM preemption thresholds for cpu and memory

2017-07-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16080987#comment-16080987 ] Hadoop QA commented on YARN-6705: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-6797) TimelineWriter does not fully consume the post response

2017-07-10 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-6797: Summary: TimelineWriter does not fully consume the post response Key: YARN-6797 URL: https://issues.apache.org/jira/browse/YARN-6797 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-6705) Add separate NM preemption thresholds for cpu and memory

2017-07-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081343#comment-16081343 ] Hadoop QA commented on YARN-6705: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-1014) Configure OOM Killer to kill OPPORTUNISTIC containers first

2017-07-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081342#comment-16081342 ] Hadoop QA commented on YARN-1014: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6378) Negative usedResources memory in CapacityScheduler

2017-07-10 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated YARN-6378: --- Affects Version/s: (was: 2.7.2) 2.6.0 > Negative usedResources memory in

[jira] [Comment Edited] (YARN-6378) Negative usedResources memory in CapacityScheduler

2017-07-10 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081355#comment-16081355 ] Ravi Prakash edited comment on YARN-6378 at 7/10/17 11:43 PM: -- Hi Filipp!

[jira] [Commented] (YARN-6378) Negative usedResources memory in CapacityScheduler

2017-07-10 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081355#comment-16081355 ] Ravi Prakash commented on YARN-6378: Hi Filipp! Thanks for your report. Is the occurrence of the first

[jira] [Commented] (YARN-5412) Create a proxy chain for ResourceManager REST API in the Router

2017-07-10 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081358#comment-16081358 ] Carlo Curino commented on YARN-5412: Giovanni, thanks for the contribution. Please find below a

[jira] [Commented] (YARN-6706) Refactor ContainerScheduler to make oversubscription change easier

2017-07-10 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16080813#comment-16080813 ] Karthik Kambatla commented on YARN-6706: I feel we should get this into trunk directly instead of

[jira] [Commented] (YARN-6788) Improve performance of resource profile branch

2017-07-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16080868#comment-16080868 ] Wangda Tan commented on YARN-6788: -- Thanks [~sunilg], comments: Resource: - {{public abstract Integer

[jira] [Commented] (YARN-1014) Configure OOM Killer to kill OPPORTUNISTIC containers first

2017-07-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081290#comment-16081290 ] Hadoop QA commented on YARN-1014: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6777) Support for ApplicationMasterService processing chain of interceptors

2017-07-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081351#comment-16081351 ] Hadoop QA commented on YARN-6777: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5731) Preemption does not work in few corner cases when reservations are placed

2017-07-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081357#comment-16081357 ] Hadoop QA commented on YARN-5731: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-6593) [API] Introduce Placement Constraint object

2017-07-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081175#comment-16081175 ] Wangda Tan edited comment on YARN-6593 at 7/10/17 11:48 PM: Thanks

[jira] [Updated] (YARN-6705) Add separate NM preemption thresholds for cpu and memory

2017-07-10 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6705: - Attachment: YARN-6705-YARN-1011.01.patch New patch to address the checkstyle issue. Findbug warnings are

[jira] [Commented] (YARN-6776) Refactor ApplicaitonMasterService to move actual processing logic to a separate class

2017-07-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081239#comment-16081239 ] Hudson commented on YARN-6776: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11983 (See

[jira] [Assigned] (YARN-6798) NM startup failure with old state store due to version mismatch

2017-07-10 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang reassigned YARN-6798: Assignee: Ray Chiang > NM startup failure with old state store due to version mismatch >

[jira] [Commented] (YARN-6706) Refactor ContainerScheduler to make oversubscription change easier

2017-07-10 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081275#comment-16081275 ] Haibo Chen commented on YARN-6706: -- bq. Not sure if startPendingContainers() before and after en-queuing

[jira] [Updated] (YARN-1014) Configure OOM Killer to kill OPPORTUNISTIC containers first

2017-07-10 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-1014: - Attachment: YARN-1014.01.patch Update the patch to address the checkstyle issue. Findbug warnings are

[jira] [Commented] (YARN-6594) [API] Introduce SchedulingRequest object

2017-07-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081309#comment-16081309 ] Wangda Tan commented on YARN-6594: -- [~arun.sur...@gmail.com] Agree with most of your points. Regarding to

[jira] [Updated] (YARN-1014) Configure OOM Killer to kill OPPORTUNISTIC containers first

2017-07-10 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-1014: - Attachment: YARN-1014.02.patch Patch updated to fix the unit test failure > Configure OOM Killer to kill

[jira] [Updated] (YARN-6788) Improve performance of resource profile branch

2017-07-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-6788: -- Priority: Blocker (was: Major) > Improve performance of resource profile branch >

[jira] [Created] (YARN-6790) Yarn : Exception from container-launch : Container failed with state: EXITED_WITH_FAILURE

2017-07-10 Thread saurab (JIRA)
saurab created YARN-6790: Summary: Yarn : Exception from container-launch : Container failed with state: EXITED_WITH_FAILURE Key: YARN-6790 URL: https://issues.apache.org/jira/browse/YARN-6790 Project:

[jira] [Commented] (YARN-6102) On failover RM can crash due to unregistered event to AsyncDispatcher

2017-07-10 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16080048#comment-16080048 ] Rohith Sharma K S commented on YARN-6102: - I think there are 2 solution to solve this issue. #

[jira] [Commented] (YARN-6761) Fix build for YARN-3926 branch

2017-07-10 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16080013#comment-16080013 ] Daniel Templeton commented on YARN-6761: Thanks for getting the patch in, [~sunilg]. Sorry I

[jira] [Resolved] (YARN-6785) Resource.SimpleResource does not implement the new Resource methods

2017-07-10 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton resolved YARN-6785. Resolution: Duplicate > Resource.SimpleResource does not implement the new Resource methods

[jira] [Commented] (YARN-6761) Fix build for YARN-3926 branch

2017-07-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16080016#comment-16080016 ] Sunil G commented on YARN-6761: --- Thanks [~templedf] Yes, you are correct. In YARN-6788, I made a single

[jira] [Commented] (YARN-5655) TestContainerManagerSecurity#testNMTokens is asserting

2017-07-10 Thread Sonia Garudi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16079964#comment-16079964 ] Sonia Garudi commented on YARN-5655: Any update on this ? I am seeing this error in trunk . >

[jira] [Updated] (YARN-6771) Use classloader inside configuration class to make new classes

2017-07-10 Thread Jongyoul Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jongyoul Lee updated YARN-6771: --- Affects Version/s: 3.0.0-alpha4 > Use classloader inside configuration class to make new classes >

[jira] [Commented] (YARN-5412) Create a proxy chain for ResourceManager REST API in the Router

2017-07-10 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16080700#comment-16080700 ] Giovanni Matteo Fumarola commented on YARN-5412: Attached v1 - with some fixed checkstyle

[jira] [Updated] (YARN-6675) Add NM support to launch opportunistic containers based on oversubscription

2017-07-10 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6675: - Attachment: YARN-6675.00.patch Attached a patch that is built on top of YARN-6706-YARN-1011.01.patch >

[jira] [Updated] (YARN-6793) Duplicated reservation in Fair Scheduler preemption

2017-07-10 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6793: --- Description: There is a delay between preemption happen and containers are killed. If some resources released

[jira] [Updated] (YARN-6706) Refactor ContainerScheduler to make oversubscription change easier

2017-07-10 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6706: - Attachment: YARN-6706.01.patch Upload a patch against trunk, which is the same as

[jira] [Updated] (YARN-6705) Add separate NM preemption thresholds for cpu and memory

2017-07-10 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6705: - Attachment: YARN-6675.00.patch > Add separate NM preemption thresholds for cpu and memory >

[jira] [Commented] (YARN-6706) Refactor ContainerScheduler to make oversubscription change easier

2017-07-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16080916#comment-16080916 ] Hadoop QA commented on YARN-6706: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5892) Support user-specific minimum user limit percentage in Capacity Scheduler

2017-07-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16080842#comment-16080842 ] Sunil G commented on YARN-5892: --- bq.I tried backporting YARN-3140 to branch-2.8, but I had several deadlock

[jira] [Updated] (YARN-6705) Add separate NM preemption thresholds for cpu and memory

2017-07-10 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6705: - Attachment: YARN-6705-YARN-1011.00.patch > Add separate NM preemption thresholds for cpu and memory >

[jira] [Commented] (YARN-5892) Support user-specific minimum user limit percentage in Capacity Scheduler

2017-07-10 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16080811#comment-16080811 ] Eric Payne commented on YARN-5892: -- Thanks [~sunilg] bq. YARN-3140 is something i would like to see in

[jira] [Updated] (YARN-6776) Refactor ApplicaitonMasterService to move actual processing logic to a separate class

2017-07-10 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6776: -- Attachment: YARN-6776.004.patch Updating patch to fix unused import. The testcase failures are

[jira] [Updated] (YARN-6792) Incorrect XML convertion in NodeIDsInfo and LabelsToNodesInfo

2017-07-10 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-6792: --- Attachment: YARN-6792.v1.patch > Incorrect XML convertion in NodeIDsInfo and

[jira] [Updated] (YARN-6771) Use classloader inside configuration class to make new classes

2017-07-10 Thread Jongyoul Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jongyoul Lee updated YARN-6771: --- Target Version/s: 3.0.0-alpha4, 2.8.2 (was: 2.8.2) > Use classloader inside configuration class to

[jira] [Commented] (YARN-5892) Support user-specific minimum user limit percentage in Capacity Scheduler

2017-07-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16080777#comment-16080777 ] Sunil G commented on YARN-5892: --- Thanks [~eepayne] YARN-3140 is something i would like to see in branch-2.8

[jira] [Commented] (YARN-6792) Incorrect XML convertion in NodeIDsInfo and LabelsToNodesInfo

2017-07-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16080695#comment-16080695 ] Hadoop QA commented on YARN-6792: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-6795) Add per-node max allocation threshold with respect to its capacity

2017-07-10 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-6795: Summary: Add per-node max allocation threshold with respect to its capacity Key: YARN-6795 URL: https://issues.apache.org/jira/browse/YARN-6795 Project: Hadoop YARN

[jira] [Created] (YARN-6796) Add unit test for NM to launch OPPORTUNISTIC container for oversubscription

2017-07-10 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-6796: Summary: Add unit test for NM to launch OPPORTUNISTIC container for oversubscription Key: YARN-6796 URL: https://issues.apache.org/jira/browse/YARN-6796 Project: Hadoop YARN

[jira] [Updated] (YARN-5412) Create a proxy chain for ResourceManager REST API in the Router

2017-07-10 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-5412: --- Attachment: YARN-5412-YARN-2915.1.patch > Create a proxy chain for

[jira] [Updated] (YARN-6793) Duplicated reservation in Fair Scheduler preemption

2017-07-10 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6793: --- Description: There is a delay between preemption happen and containers are killed. If some resources released

[jira] [Updated] (YARN-6793) Duplicated reservation in Fair Scheduler preemption

2017-07-10 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6793: --- Description: There is a delay between preemption happen and containers are killed. If some resources released

[jira] [Created] (YARN-6793) Duplicated reservation in Fair Scheduler preemption

2017-07-10 Thread Yufei Gu (JIRA)
Yufei Gu created YARN-6793: -- Summary: Duplicated reservation in Fair Scheduler preemption Key: YARN-6793 URL: https://issues.apache.org/jira/browse/YARN-6793 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-6796) Add unit test for NM to launch OPPORTUNISTIC container for oversubscription

2017-07-10 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6796: - Issue Type: Sub-task (was: Bug) Parent: YARN-1011 > Add unit test for NM to launch OPPORTUNISTIC

[jira] [Assigned] (YARN-6505) Define the strings used in SLS JSON input file format

2017-07-10 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-6505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Novák reassigned YARN-6505: --- Assignee: Gergely Novák > Define the strings used in SLS JSON input file format >

[jira] [Created] (YARN-6792) Incorrect XML convertion in NodeIDsInfo and LabelsToNodesInfo

2017-07-10 Thread Giovanni Matteo Fumarola (JIRA)
Giovanni Matteo Fumarola created YARN-6792: -- Summary: Incorrect XML convertion in NodeIDsInfo and LabelsToNodesInfo Key: YARN-6792 URL: https://issues.apache.org/jira/browse/YARN-6792

[jira] [Updated] (YARN-5412) Create a proxy chain for ResourceManager REST API in the Router

2017-07-10 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-5412: --- Attachment: YARN-5412-YARN-2915.1.patch > Create a proxy chain for

[jira] [Updated] (YARN-6793) Duplicated reservation in Fair Scheduler preemption

2017-07-10 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6793: --- Description: There is a delay between preemption happen and containers are killed. If resources released from

[jira] [Created] (YARN-6794) promote OPPORTUNISITC containers locally at the node where they're running

2017-07-10 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-6794: Summary: promote OPPORTUNISITC containers locally at the node where they're running Key: YARN-6794 URL: https://issues.apache.org/jira/browse/YARN-6794 Project: Hadoop YARN

[jira] [Updated] (YARN-6793) Duplicated reservation in Fair Scheduler preemption

2017-07-10 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6793: --- Description: There is a delay between preemption happen and containers are killed. If resources released from

[jira] [Commented] (YARN-4767) Network issues can cause persistent RM UI outage

2017-07-10 Thread Sergey Bahchissaraitsev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16080459#comment-16080459 ] Sergey Bahchissaraitsev commented on YARN-4767: --- [~templedf] Can I ask why it was not applied

[jira] [Updated] (YARN-6794) promote OPPORTUNISITC containers locally at the node where they're running

2017-07-10 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6794: - Issue Type: Sub-task (was: Bug) Parent: YARN-1011 > promote OPPORTUNISITC containers locally at

[jira] [Commented] (YARN-6792) Incorrect XML convertion in NodeIDsInfo and LabelsToNodesInfo

2017-07-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16080617#comment-16080617 ] Sunil G commented on YARN-6792: --- I guess we need to add some more test cases here as well. > Incorrect XML

[jira] [Commented] (YARN-6505) Define the strings used in SLS JSON input file format

2017-07-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16080519#comment-16080519 ] Hadoop QA commented on YARN-6505: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6670) Add separate NM overallocation thresholds for cpu and memory

2017-07-10 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6670: - Fix Version/s: YARN-1011 > Add separate NM overallocation thresholds for cpu and memory >

[jira] [Updated] (YARN-6670) Add separate NM overallocation thresholds for cpu and memory

2017-07-10 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6670: - Target Version/s: YARN-1011 (was: 3.0.0-beta1) > Add separate NM overallocation thresholds for cpu and

[jira] [Updated] (YARN-6788) Improve performance of resource profile branch

2017-07-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-6788: -- Attachment: YARN-6788-YARN-3926.001.patch A first cut to improve performance and some cleanup. Few early calls:

[jira] [Updated] (YARN-5412) Create a proxy chain for ResourceManager REST API in the Router

2017-07-10 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-5412: --- Attachment: (was: YARN-5412-YARN-2915.1.patch) > Create a proxy chain for

[jira] [Commented] (YARN-6786) ResourcePBImpl imports cleanup

2017-07-10 Thread Yeliang Cang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081623#comment-16081623 ] Yeliang Cang commented on YARN-6786: Thanks, [~sunilg], for the review! > ResourcePBImpl imports

[jira] [Commented] (YARN-6492) Generate queue metrics for each partition

2017-07-10 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081657#comment-16081657 ] Manikandan R commented on YARN-6492: [~Naganarasimha], [~jhung] Thanks. Attached patch. In addition to

[jira] [Updated] (YARN-6492) Generate queue metrics for each partition

2017-07-10 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R updated YARN-6492: --- Attachment: YARN-6492.001.patch > Generate queue metrics for each partition >

[jira] [Commented] (YARN-6801) NPE in RM while setting collectors map in NodeHeartbeatResponse

2017-07-10 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081680#comment-16081680 ] Rohith Sharma K S commented on YARN-6801: - Thanks [~vrushalic] for working on this issue. +1 LGTM.

[jira] [Updated] (YARN-6769) Put the no demand queue after the most in FairSharePolicy#compare

2017-07-10 Thread daemon (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] daemon updated YARN-6769: - Attachment: YARN-6769.003.patch > Put the no demand queue after the most in FairSharePolicy#compare >

[jira] [Commented] (YARN-1014) Configure OOM Killer to kill OPPORTUNISTIC containers first

2017-07-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081426#comment-16081426 ] Hadoop QA commented on YARN-1014: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-1014) Configure OOM Killer to kill OPPORTUNISTIC containers first

2017-07-10 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-1014: - Target Version/s: 3.0.0-beta1 > Configure OOM Killer to kill OPPORTUNISTIC containers first >

[jira] [Commented] (YARN-1014) Configure OOM Killer to kill OPPORTUNISTIC containers first

2017-07-10 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081456#comment-16081456 ] Haibo Chen commented on YARN-1014: -- Findbug warnings are unrelated. > Configure OOM Killer to kill

[jira] [Updated] (YARN-6800) Add opportunity to start containers while periodically checking for preemption

2017-07-10 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6800: - Issue Type: Sub-task (was: Bug) Parent: YARN-1011 > Add opportunity to start containers while

[jira] [Commented] (YARN-6801) NPE in RM while setting collectors map in NodeHeartbeatResponse

2017-07-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081566#comment-16081566 ] Hadoop QA commented on YARN-6801: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6769) Put the no demand queue after the most in FairSharePolicy#compare

2017-07-10 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081450#comment-16081450 ] Yufei Gu commented on YARN-6769: The patch looks good to me generally. Some thoughts: # The logic in

[jira] [Updated] (YARN-6801) NPE in RM while setting collectors map in NodeHeartbeatResponse

2017-07-10 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-6801: - Attachment: YARN-6801-YARN-5355.001.patch Attaching v001 > NPE in RM while setting collectors map in

[jira] [Created] (YARN-6801) NPE in RM while setting collectors map in NodeHeartbeatResponse

2017-07-10 Thread Vrushali C (JIRA)
Vrushali C created YARN-6801: Summary: NPE in RM while setting collectors map in NodeHeartbeatResponse Key: YARN-6801 URL: https://issues.apache.org/jira/browse/YARN-6801 Project: Hadoop YARN

[jira] [Created] (YARN-6800) Add opportunity to start containers while periodically checking for preemption

2017-07-10 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-6800: Summary: Add opportunity to start containers while periodically checking for preemption Key: YARN-6800 URL: https://issues.apache.org/jira/browse/YARN-6800 Project: Hadoop

[jira] [Updated] (YARN-6378) Negative usedResources memory in CapacityScheduler

2017-07-10 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated YARN-6378: --- Target Version/s: 2.8.2 (was: 2.8.1) > Negative usedResources memory in CapacityScheduler >

[jira] [Commented] (YARN-6625) yarn application -list returns a tracking URL for AM that doesn't work in secured and HA environment

2017-07-10 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081434#comment-16081434 ] Robert Kanter commented on YARN-6625: - I think the approach in the v2 patch is better and simpler.

[jira] [Commented] (YARN-6776) Refactor ApplicaitonMasterService to move actual processing logic to a separate class

2017-07-10 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081194#comment-16081194 ] Arun Suresh commented on YARN-6776: --- Thanks for the rev Subru.. Committing this shortly > Refactor

[jira] [Commented] (YARN-6594) [API] Introduce SchedulingRequest object

2017-07-10 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081225#comment-16081225 ] Arun Suresh commented on YARN-6594: --- I agree.. AMRMClient is starting to get very heavy. But

[jira] [Updated] (YARN-6797) TimelineWriter does not fully consume the POST response

2017-07-10 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-6797: - Attachment: YARN-6797.001.patch Attaching a patch that calls ClientReponse#bufferEntity so we fully

[jira] [Commented] (YARN-6776) Refactor ApplicaitonMasterService to move actual processing logic to a separate class

2017-07-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081109#comment-16081109 ] Hadoop QA commented on YARN-6776: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6706) Refactor ContainerScheduler to make oversubscription change easier

2017-07-10 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081132#comment-16081132 ] Arun Suresh commented on YARN-6706: --- Yup. Agree this can go into trunk. The patch generally looks good.

[jira] [Updated] (YARN-5731) Preemption does not work in few corner cases when reservations are placed

2017-07-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-5731: - Attachment: YARN-5731-branch-2.8.001.patch Attached patch for the fix. > Preemption does not work in few

[jira] [Commented] (YARN-6594) [API] Introduce SchedulingRequest object

2017-07-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081197#comment-16081197 ] Wangda Tan commented on YARN-6594: -- [~kkaranasos], chatted with [~jianhe] offline. I think Jian's concern

[jira] [Updated] (YARN-6413) Decouple Yarn Registry API from ZK

2017-07-10 Thread Ellen Hui (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ellen Hui updated YARN-6413: Attachment: 0002-Registry-API-v2.patch Addressed comments from [~jianhe]: * The V2 has every method used by

[jira] [Updated] (YARN-1014) Configure OOM Killer to kill OPPORTUNISTIC containers first

2017-07-10 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-1014: - Attachment: YARN-1014.00.patch > Configure OOM Killer to kill OPPORTUNISTIC containers first >

[jira] [Updated] (YARN-6797) TimelineWriter does not fully consume the POST response

2017-07-10 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-6797: - Summary: TimelineWriter does not fully consume the POST response (was: TimelineWriter does not fully

[jira] [Commented] (YARN-6794) promote OPPORTUNISITC containers locally at the node where they're running

2017-07-10 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081112#comment-16081112 ] Arun Suresh commented on YARN-6794: --- [~haibo.chen] / [~kasha] I expect some overlap between this and

[jira] [Commented] (YARN-6798) NM startup failure with old state store due to version mismatch

2017-07-10 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081105#comment-16081105 ] Ray Chiang commented on YARN-6798: -- [~kkaranasos], [~subru], [~botong], [~asuresh]. It looks like you

[jira] [Commented] (YARN-4767) Network issues can cause persistent RM UI outage

2017-07-10 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081107#comment-16081107 ] Daniel Templeton commented on YARN-4767: No reason, really. If you need it in 2.8, feel free to

[jira] [Commented] (YARN-6797) TimelineWriter does not fully consume the POST response

2017-07-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081130#comment-16081130 ] Hadoop QA commented on YARN-6797: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-1492) truly shared cache for jars (jobjar/libjar)

2017-07-10 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081151#comment-16081151 ] Chris Trezzo commented on YARN-1492: bq. Could you explain how the shared cache leverage the node

[jira] [Updated] (YARN-6799) Remove the duplicated code in CGroupsHandlerImp.java

2017-07-10 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6799: --- Issue Type: Improvement (was: Bug) > Remove the duplicated code in CGroupsHandlerImp.java >

  1   2   >