[jira] [Updated] (YARN-7742) [UI2] Duplicated containers are rendered per attempt

2018-01-24 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7742: -- Attachment: YARN-7742.003.patch > [UI2] Duplicated containers are rendered per attempt >

[jira] [Commented] (YARN-7792) Merge work for YARN-6592

2018-01-24 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16338751#comment-16338751 ] Sunil G commented on YARN-7792: --- Thanks [~asuresh]. I will keep a track of this today. > Merge work for

[jira] [Updated] (YARN-7742) [UI2] Duplicated containers are rendered per attempt

2018-01-24 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7742: -- Attachment: YARN-7742.002.patch > [UI2] Duplicated containers are rendered per attempt >

[jira] [Commented] (YARN-7742) [UI2] Duplicated containers are rendered per attempt

2018-01-24 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16337768#comment-16337768 ] Sunil G commented on YARN-7742: --- Attaching v2 patch for review. cc/[~rohithsharma] > [UI2] Duplicated

[jira] [Commented] (YARN-7795) Fix jenkins issues of YARN-6592 branch

2018-01-24 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16337441#comment-16337441 ] Sunil G commented on YARN-7795: --- Attaching an initial patch and submitting for jenkins. cc/[~cheersyang]

[jira] [Updated] (YARN-7795) Fix jenkins issues of YARN-6592 branch

2018-01-24 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7795: -- Attachment: YARN-7795-YARN-6592.001.patch > Fix jenkins issues of YARN-6592 branch >

[jira] [Updated] (YARN-7806) Distributed Shell should use timeline async api's

2018-01-24 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7806: -- Summary: Distributed Shell should use timeline async api's (was: DS will hang if ATSv2 back end is unavailable.

[jira] [Commented] (YARN-7806) DS will hang if ATSv2 back end is unavailable.

2018-01-24 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16337320#comment-16337320 ] Sunil G commented on YARN-7806: --- Committing shortly. > DS will hang if ATSv2 back end is unavailable. >

[jira] [Commented] (YARN-7806) DS will hang if ATSv2 back end is unavailable.

2018-01-24 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16337180#comment-16337180 ] Sunil G commented on YARN-7806: --- Patch looks straight forward to me. All the other timeline apis are async

[jira] [Commented] (YARN-7749) [UI2] GPU information tab in left hand side disappears when we click other tabs below

2018-01-24 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16337174#comment-16337174 ] Sunil G commented on YARN-7749: --- Quickly attaching v2 patch as we have to make sure gpu info is queried for

[jira] [Updated] (YARN-7749) [UI2] GPU information tab in left hand side disappears when we click other tabs below

2018-01-24 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7749: -- Attachment: YARN-7749.002.patch > [UI2] GPU information tab in left hand side disappears when we click other >

[jira] [Commented] (YARN-7791) Support submit intra-app placement constraint in Distributed Shell to AppPlacementAllocator

2018-01-24 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16337170#comment-16337170 ] Sunil G commented on YARN-7791: --- bq.Since by default, it is interpreted as intra-app right ? Yes. Thats

[jira] [Commented] (YARN-7790) Improve Capacity Scheduler Async Scheduling to better handle node failures

2018-01-24 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16337111#comment-16337111 ] Sunil G commented on YARN-7790: --- Thanks [~leftnoteasy] for the patch. Few comments: #

[jira] [Created] (YARN-7795) Fix jenkins issues of YARN-6592 branch

2018-01-23 Thread Sunil G (JIRA)
Sunil G created YARN-7795: - Summary: Fix jenkins issues of YARN-6592 branch Key: YARN-7795 URL: https://issues.apache.org/jira/browse/YARN-7795 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Created] (YARN-7794) SLSRunner is not loading timeline service jars causing failure

2018-01-23 Thread Sunil G (JIRA)
Sunil G created YARN-7794: - Summary: SLSRunner is not loading timeline service jars causing failure Key: YARN-7794 URL: https://issues.apache.org/jira/browse/YARN-7794 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-7779) Display allocation tags in RM web UI and expose same through REST API

2018-01-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7779: -- Summary: Display allocation tags in RM web UI and expose same through REST API (was: Display allocation tags in

[jira] [Commented] (YARN-7791) Support submit intra-app placement constraint in Distributed Shell to AppPlacementAllocator

2018-01-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335664#comment-16335664 ] Sunil G commented on YARN-7791: --- The way I see this is a bit different. We will be supporting inter_app very

[jira] [Commented] (YARN-7792) Merge work for YARN-6592

2018-01-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335589#comment-16335589 ] Sunil G commented on YARN-7792: --- rebased and attach v1 patch for jenkins (whole branch code) > Merge work

[jira] [Updated] (YARN-7792) Merge work for YARN-6592

2018-01-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7792: -- Attachment: YARN-6592.001.patch > Merge work for YARN-6592 > > > Key:

[jira] [Assigned] (YARN-7792) Merge work for YARN-6592

2018-01-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G reassigned YARN-7792: - Assignee: (was: Sunil G) > Merge work for YARN-6592 > > >

[jira] [Commented] (YARN-7792) Merge work for YARN-6592

2018-01-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335569#comment-16335569 ] Sunil G commented on YARN-7792: --- I will attach an aggregated patch to run against trunk after branch rebase.

[jira] [Assigned] (YARN-7792) Merge work for YARN-6592

2018-01-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G reassigned YARN-7792: - Assignee: Sunil G > Merge work for YARN-6592 > > > Key:

[jira] [Created] (YARN-7792) Merge work for YARN-6592

2018-01-23 Thread Sunil G (JIRA)
Sunil G created YARN-7792: - Summary: Merge work for YARN-6592 Key: YARN-7792 URL: https://issues.apache.org/jira/browse/YARN-7792 Project: Hadoop YARN Issue Type: Sub-task Reporter:

[jira] [Updated] (YARN-7791) Support submit intra-app placement constraint in Distributed Shell to AppPlacementAllocator

2018-01-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7791: -- Attachment: (was: YARN-7791.001.patch) > Support submit intra-app placement constraint in Distributed Shell

[jira] [Commented] (YARN-7791) Support submit intra-app placement constraint in Distributed Shell to AppPlacementAllocator

2018-01-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335567#comment-16335567 ] Sunil G commented on YARN-7791: --- Patch was not named correctly for branch, reattaching same > Support submit

[jira] [Updated] (YARN-7791) Support submit intra-app placement constraint in Distributed Shell to AppPlacementAllocator

2018-01-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7791: -- Attachment: YARN-7791-YARN-6592.001.patch > Support submit intra-app placement constraint in Distributed Shell

[jira] [Commented] (YARN-7789) Should fail RM if 3rd resource type is configured but RM uses DefaultResourceCalculator

2018-01-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335565#comment-16335565 ] Sunil G commented on YARN-7789: --- When DefaultResourceCalculator is configured, only Memory will work. I think

[jira] [Commented] (YARN-7791) Support submit intra-app placement constraint in Distributed Shell to AppPlacementAllocator

2018-01-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335562#comment-16335562 ] Sunil G commented on YARN-7791: --- Attaching patch to solve this. I tested this and works fine as expected when

[jira] [Commented] (YARN-7791) Support submit intra-app placement constraint in Distributed Shell to AppPlacementAllocator

2018-01-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335563#comment-16335563 ] Sunil G commented on YARN-7791: --- cc/ [~cheersyang] [~leftnoteasy] [~asuresh] > Support submit intra-app

[jira] [Updated] (YARN-7791) Support submit intra-app placement constraint in Distributed Shell to AppPlacementAllocator

2018-01-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7791: -- Attachment: YARN-7791.001.patch > Support submit intra-app placement constraint in Distributed Shell to >

[jira] [Commented] (YARN-7779) Display allocation tags in RM web UI and expose via REST API

2018-01-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335493#comment-16335493 ] Sunil G commented on YARN-7779: --- pending jenkins > Display allocation tags in RM web UI and expose via REST

[jira] [Commented] (YARN-7779) Display allocation tags in RM web UI and expose via REST API

2018-01-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335483#comment-16335483 ] Sunil G commented on YARN-7779: --- [~cheersyang] one quick help. This patch needs a rebase and one  commit

[jira] [Comment Edited] (YARN-7779) Display allocation tags in RM web UI and expose via REST API

2018-01-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335483#comment-16335483 ] Sunil G edited comment on YARN-7779 at 1/23/18 8:15 AM: [~cheersyang] one quick

[jira] [Commented] (YARN-7791) Support submit intra-app placement constraint in Distributed Shell to AppPlacementAllocator

2018-01-22 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335472#comment-16335472 ] Sunil G commented on YARN-7791: --- Yes [~cheersyang]. I am working on a patch. WIll share a patch after doing

[jira] [Assigned] (YARN-7791) Support submit intra-app placement constraint in Distributed Shell to AppPlacementAllocator

2018-01-22 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G reassigned YARN-7791: - Assignee: Sunil G > Support submit intra-app placement constraint in Distributed Shell to >

[jira] [Commented] (YARN-7779) Display allocation tags in RM web UI and expose via REST API

2018-01-22 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335320#comment-16335320 ] Sunil G commented on YARN-7779: --- +1 I ll commit shortly. > Display allocation tags in RM web UI and expose

[jira] [Commented] (YARN-7779) Display allocation tags in RM web UI and expose via REST API

2018-01-22 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333994#comment-16333994 ] Sunil G commented on YARN-7779: --- bq.Right now, get them displayed on UI will help us debugging issues and

[jira] [Commented] (YARN-7779) Display allocation tags in RM web UI and expose via REST API

2018-01-21 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333944#comment-16333944 ] Sunil G commented on YARN-7779: --- Thanks [~cheersyang]. I think this works well when no: tags are lesser in

[jira] [Commented] (YARN-7780) Documentation for Placement Constraints

2018-01-19 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333142#comment-16333142 ] Sunil G commented on YARN-7780: --- Thanks [~kkaranasos]. Such an example will really help in case of

[jira] [Commented] (YARN-7774) Miscellaneous fixes to the PlacementProcessor

2018-01-19 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333135#comment-16333135 ] Sunil G commented on YARN-7774: --- Makes sense. Sorry, I missed that one. Could you also update the exception

[jira] [Commented] (YARN-7774) Miscellaneous fixes to the PlacementProcessor

2018-01-19 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333127#comment-16333127 ] Sunil G commented on YARN-7774: --- A quick doubt. {{SingleConstraintAppPlacementAllocator}} why maxCardinality

[jira] [Comment Edited] (YARN-7745) Allow DistributedShell to take a placement specification for containers it wants to launch

2018-01-19 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16332556#comment-16332556 ] Sunil G edited comment on YARN-7745 at 1/19/18 5:10 PM: [~asuresh] is this possible

[jira] [Commented] (YARN-7745) Allow DistributedShell to take a placement specification for containers it wants to launch

2018-01-19 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16332556#comment-16332556 ] Sunil G commented on YARN-7745: --- [~asuresh] is this possible to have a test case for this? or could share

[jira] [Commented] (YARN-7723) Avoid using docker volume --format option to compatible to older docker releases

2018-01-19 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16332547#comment-16332547 ] Sunil G commented on YARN-7723: --- This patch seems fine to me to work with old version. [~ebadger], if you

[jira] [Commented] (YARN-7763) Allow Constraints specified in the SchedulingRequest to override application level constraints

2018-01-19 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16332545#comment-16332545 ] Sunil G commented on YARN-7763: --- [~cheersyang], in {{canSatisfyConstraints}} , we can see that constraint is

[jira] [Commented] (YARN-7770) Support for setting application priority for Distributed Shell jobs

2018-01-19 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16332351#comment-16332351 ] Sunil G commented on YARN-7770: --- [~charanh] DS has a property called *--priority*, could u pls check that.

[jira] [Commented] (YARN-7753) [UI2] Application logs has to be pulled from ATS 1.5 instead of ATS2

2018-01-19 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16331959#comment-16331959 ] Sunil G commented on YARN-7753: --- Updated patch after fixing v1 address fix issue. This log will now work for

[jira] [Updated] (YARN-7753) [UI2] Application logs has to be pulled from ATS 1.5 instead of ATS2

2018-01-19 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7753: -- Attachment: YARN-7753.002.patch > [UI2] Application logs has to be pulled from ATS 1.5 instead of ATS2 >

[jira] [Commented] (YARN-5094) some YARN container events have timestamp of -1

2018-01-19 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16331894#comment-16331894 ] Sunil G commented on YARN-5094: --- Container finished time is coming as -1 when new UI pulls container data

[jira] [Comment Edited] (YARN-5094) some YARN container events have timestamp of -1

2018-01-19 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16331894#comment-16331894 ] Sunil G edited comment on YARN-5094 at 1/19/18 8:25 AM: Container finished time is

[jira] [Updated] (YARN-5094) some YARN container events have timestamp of -1

2018-01-19 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-5094: -- Affects Version/s: (was: YARN-2928) 2.9.0 3.0.0 > some YARN

[jira] [Updated] (YARN-5094) some YARN container events have timestamp of -1

2018-01-19 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-5094: -- Priority: Critical (was: Major) > some YARN container events have timestamp of -1 >

[jira] [Commented] (YARN-6599) Support rich placement constraints in scheduler

2018-01-17 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16329112#comment-16329112 ] Sunil G commented on YARN-6599: --- Thanks [~leftnoteasy] for clarifying my comments. Latest patch seems fine to

[jira] [Commented] (YARN-7494) Add muti node lookup support for better placement

2018-01-17 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16329108#comment-16329108 ] Sunil G commented on YARN-7494: --- [~leftnoteasy]. I attached a new patch. However I have added a new policy to

[jira] [Updated] (YARN-7494) Add muti node lookup support for better placement

2018-01-17 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7494: -- Attachment: YARN-7494.001.patch > Add muti node lookup support for better placement >

[jira] [Updated] (YARN-7753) [UI2] Application logs has to be pulled from ATS 1.5 instead of ATS2

2018-01-17 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7753: -- Attachment: YARN-7753.001.patch > [UI2] Application logs has to be pulled from ATS 1.5 instead of ATS2 >

[jira] [Commented] (YARN-7753) [UI2] Application logs has to be pulled from ATS 1.5 instead of ATS2

2018-01-17 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16328776#comment-16328776 ] Sunil G commented on YARN-7753: --- cc/ [~rohithsharma] > [UI2] Application logs has to be pulled from ATS 1.5

[jira] [Commented] (YARN-7624) RM gives YARNFeatureNotEnabledException even when resource profile feature is not enabled

2018-01-17 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16328655#comment-16328655 ] Sunil G commented on YARN-7624: --- Thanks [~maniraj...@gmail.com]. We need  a test case too. Could you pls add

[jira] [Commented] (YARN-7764) Findbugs warning: Resource#getResources may expose internal representation

2018-01-17 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16328643#comment-16328643 ] Sunil G commented on YARN-7764: --- Resources and DominantResourceCalculator are two classes which provide basic

[jira] [Commented] (YARN-7750) Render time in the users timezone

2018-01-17 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16328531#comment-16328531 ] Sunil G commented on YARN-7750: --- [~skmvasu] *date-utils.js* needs asf license header > Render time in the

[jira] [Commented] (YARN-7757) Refactor NodeLabelsProvider to be more generic and reusable for node attributes providers

2018-01-17 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16328524#comment-16328524 ] Sunil G commented on YARN-7757: --- Thanks for working on this [~cheersyang]. I will take a look in this today

[jira] [Commented] (YARN-7728) Expose and expand container preemptions in Capacity Scheduler queue metrics

2018-01-17 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16328522#comment-16328522 ] Sunil G commented on YARN-7728: --- Sorry [~eepayne] for the delay here. Yes, it makes sense. I was looking for

[jira] [Commented] (YARN-7764) Findbugs warning: Resource#getResources may expose internal representation

2018-01-17 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16328520#comment-16328520 ] Sunil G commented on YARN-7764: --- [~cheersyang] This is not an issue. Resource#getResources gives back an map

[jira] [Reopened] (YARN-7761) [UI2]Clicking 'master container log' or 'Link' next to 'log' under application's appAttempt goes to Old UI's Log link

2018-01-16 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G reopened YARN-7761: --- > [UI2]Clicking 'master container log' or 'Link' next to 'log' under > application's appAttempt goes to Old UI's

[jira] [Comment Edited] (YARN-6856) Support CLI for Node Attributes Mapping

2018-01-16 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16328296#comment-16328296 ] Sunil G edited comment on YARN-6856 at 1/17/18 5:58 AM: Seems it worked.

[jira] [Commented] (YARN-6856) Support CLI for Node Attributes Mapping

2018-01-16 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16328296#comment-16328296 ] Sunil G commented on YARN-6856: --- Seems it worked. [~Naganarasimha], cud u pls fix other jenkins issues. >

[jira] [Commented] (YARN-6599) Support rich placement constraints in scheduler

2018-01-16 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16327451#comment-16327451 ] Sunil G commented on YARN-6599: ---  Thanks [~leftnoteasy]. Few comments. # {{public static final String

[jira] [Commented] (YARN-6856) Support CLI for Node Attributes Mapping

2018-01-16 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16326849#comment-16326849 ] Sunil G commented on YARN-6856: --- I think lets recreate YARN-3409 (caps), and cherrypick the YARN-6855 to new

[jira] [Commented] (YARN-6856) Support CLI for Node Attributes Mapping

2018-01-15 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16326777#comment-16326777 ] Sunil G commented on YARN-6856: --- It seems some issue in branch itself. > Support CLI for Node Attributes

[jira] [Created] (YARN-7753) [UI2] Application logs has to be pulled from ATS 1.5 instead of ATS2

2018-01-15 Thread Sunil G (JIRA)
Sunil G created YARN-7753: - Summary: [UI2] Application logs has to be pulled from ATS 1.5 instead of ATS2 Key: YARN-7753 URL: https://issues.apache.org/jira/browse/YARN-7753 Project: Hadoop YARN

[jira] [Updated] (YARN-6492) Generate queue metrics for each partition

2018-01-12 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-6492: -- Target Version/s: 3.1.0 > Generate queue metrics for each partition > -

[jira] [Updated] (YARN-7738) CapacityScheduler: Support refresh maximum allocation for multiple resource types

2018-01-12 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7738: -- Attachment: YARN-7738.004.patch {{fitsIn}} logic was originally correct. Reattaching the patch. >

[jira] [Assigned] (YARN-7742) [UI2] Duplicated containers are rendered per attempt

2018-01-12 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G reassigned YARN-7742: - Assignee: Vasudevan Skm > [UI2] Duplicated containers are rendered per attempt >

[jira] [Commented] (YARN-7728) Expose and expand container preemptions in Capacity Scheduler queue metrics

2018-01-12 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16323837#comment-16323837 ] Sunil G commented on YARN-7728: --- Thanks [~eepayne], this will be really helpful when preemption happens. I

[jira] [Commented] (YARN-7159) Normalize unit of resource objects in RM and avoid to do unit conversion in critical path

2018-01-12 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16323832#comment-16323832 ] Sunil G commented on YARN-7159: --- bq.Here, value has been configured as 10 with "" units, but

[jira] [Updated] (YARN-7727) Incorrect log levels in few logs with QueuePriorityContainerCandidateSelector

2018-01-12 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7727: -- Summary: Incorrect log levels in few logs with QueuePriorityContainerCandidateSelector (was: Logging issues

[jira] [Commented] (YARN-6736) Consider writing to both ats v1 & v2 from RM for smoother upgrades

2018-01-12 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16323787#comment-16323787 ] Sunil G commented on YARN-6736: --- Thanks [~agresch] and [~rohithsharma]. This makes sense to have it can where

[jira] [Updated] (YARN-7738) CapacityScheduler: Support refresh maximum allocation for multiple resource types

2018-01-12 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7738: -- Attachment: YARN-7738.003.patch attaching patch for jenkins. > CapacityScheduler: Support refresh maximum

[jira] [Commented] (YARN-7624) RM gives YARNFeatureNotEnabledException even when resource profile feature is not enabled

2018-01-12 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16323745#comment-16323745 ] Sunil G commented on YARN-7624: --- [~maniraj...@gmail.com], could u pls share a patch based on your analysis. I

[jira] [Commented] (YARN-7738) CapacityScheduler: Support refresh maximum allocation for multiple resource types

2018-01-12 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16323743#comment-16323743 ] Sunil G commented on YARN-7738: --- Thanks [~leftnoteasy]. Fix seems fine to me Few comments: #

[jira] [Updated] (YARN-7722) Rename variables in MockNM, MockRM for better clarity

2018-01-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7722: -- Target Version/s: 3.1.0 (was: 3.0.0) > Rename variables in MockNM, MockRM for better clarity >

[jira] [Updated] (YARN-7722) Rename variables in MockNM, MockRM for better clarity

2018-01-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7722: -- Summary: Rename variables in MockNM, MockRM for better clarity (was: Correcting the capability in MockNM,

[jira] [Updated] (YARN-7722) Correcting the capability in MockNM, MockRM test classes

2018-01-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7722: -- Priority: Trivial (was: Minor) > Correcting the capability in MockNM, MockRM test classes >

[jira] [Commented] (YARN-7727) Logging issues with QueuePriorityContainerCandidateSelector

2018-01-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319884#comment-16319884 ] Sunil G commented on YARN-7727: --- Patch looks fine. Committing later today if no objections. > Logging issues

[jira] [Commented] (YARN-7159) Normalize unit of resource objects in RM and avoid to do unit conversion in critical path

2018-01-09 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319777#comment-16319777 ] Sunil G commented on YARN-7159: --- [~maniraj...@gmail.com] {{TestResourceUtils}} failures are related. >

[jira] [Commented] (YARN-7722) Correcting the capability in MockNM, MockRM test classes

2018-01-09 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319772#comment-16319772 ] Sunil G commented on YARN-7722: --- Looks straight forward. Committing shortly. Thanks [~lovekesh.bansal] >

[jira] [Commented] (YARN-7727) Logging issues with QueuePriorityContainerCandidateSelector

2018-01-09 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319728#comment-16319728 ] Sunil G commented on YARN-7727: --- Yes [~Prabhu Joseph] Let us convert {{intializePriorityDigraph}}'s logs

[jira] [Commented] (YARN-7159) Normalize unit of resource objects in RM and avoid to do unit conversion in critical path

2018-01-09 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16318702#comment-16318702 ] Sunil G commented on YARN-7159: --- Failures related? cc/[~maniraj...@gmail.com] > Normalize unit of resource

[jira] [Commented] (YARN-7159) Normalize unit of resource objects in RM and avoid to do unit conversion in critical path

2018-01-09 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16318423#comment-16318423 ] Sunil G commented on YARN-7159: --- kicking jenkins again. > Normalize unit of resource objects in RM and avoid

[jira] [Assigned] (YARN-7718) DistributedShell failed to specify resource other than memory/vcores from container_resources

2018-01-09 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G reassigned YARN-7718: - Assignee: Wangda Tan > DistributedShell failed to specify resource other than memory/vcores from >

[jira] [Commented] (YARN-7718) DistributedShell failed to specify resource other than memory/vcores from container_resources

2018-01-09 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16318143#comment-16318143 ] Sunil G commented on YARN-7718: --- Its working fine. Committing shortly > DistributedShell failed to specify

[jira] [Commented] (YARN-7718) DistributedShell failed to specify resource other than memory/vcores from container_resources

2018-01-08 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16317625#comment-16317625 ] Sunil G commented on YARN-7718: --- Thanks [~leftnoteasy]. Makes sense. I ll try some tests and ll commit today.

[jira] [Commented] (YARN-7711) YARN UI2 should redirect into Active RM in HA

2018-01-08 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16315860#comment-16315860 ] Sunil G commented on YARN-7711: --- Thanks [~rohithsharma] [~naganarasimha...@apache.org] UI2 is based on js

[jira] [Updated] (YARN-7242) Support to specify values of different resource types in DistributedShell for easier testing

2018-01-07 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7242: -- Summary: Support to specify values of different resource types in DistributedShell for easier testing (was:

[jira] [Updated] (YARN-7699) queueUsagePercentage is coming as INF for getApp REST api call

2018-01-07 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7699: -- Attachment: YARN-7699-branch-3.0.001.patch Thanks [~rohithsharma] This patch could be applied in branch-3.0,

[jira] [Commented] (YARN-7242) Support specify values of different resource types in DistributedShell for easier testing

2018-01-05 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16314417#comment-16314417 ] Sunil G commented on YARN-7242: --- +1. Committing shortly. I already reviewed this earlier but somehow missed

[jira] [Commented] (YARN-6599) Support rich placement constraints in scheduler

2018-01-05 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16313734#comment-16313734 ] Sunil G commented on YARN-6599: --- Thanks [~leftnoteasy] I think latest patch seems fine. If there are no

[jira] [Commented] (YARN-5151) [YARN-3368] Support kill application from new YARN UI

2018-01-05 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16312893#comment-16312893 ] Sunil G commented on YARN-5151: --- Thanks [~GergelyNovak]. No issues. I ll take care of it while committing.

[jira] [Updated] (YARN-7619) Max AM Resource value in Capacity Scheduler UI has to be refreshed for every user

2018-01-05 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7619: -- Summary: Max AM Resource value in Capacity Scheduler UI has to be refreshed for every user (was: Max AM

[jira] [Updated] (YARN-7619) Max AM Resource value in Capacity Scheduler UI is different for every user

2018-01-05 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7619: -- Summary: Max AM Resource value in Capacity Scheduler UI is different for every user (was: Max AM Resource value

<    2   3   4   5   6   7   8   9   10   11   >