[jira] [Updated] (YARN-5888) [YARN-3368] Improve unit tests for YARN UI

2018-04-16 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-5888: -- Attachment: YARN-5888.003.patch > [YARN-3368] Improve unit tests for YARN UI > --

[jira] [Assigned] (YARN-8125) YARNUIV2 does not failover from standby to active endpoint like previous YARN UI

2018-04-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G reassigned YARN-8125: - Assignee: Sunil G > YARNUIV2 does not failover from standby to active endpoint like previous YARN > UI >

[jira] [Commented] (YARN-7574) Add support for Node Labels on Auto Created Leaf Queue Template

2018-04-09 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16430234#comment-16430234 ] Sunil G commented on YARN-7574: --- +1 Committing shortly > Add support for Node Labels on Auto

[jira] [Commented] (YARN-4781) Support intra-queue preemption for fairness ordering policy.

2018-04-07 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16429269#comment-16429269 ] Sunil G commented on YARN-4781: --- Thanks [~eepayne].   {quote}I'm not seeing the {{FairOrderi

[jira] [Commented] (YARN-7574) Add support for Node Labels on Auto Created Leaf Queue Template

2018-04-06 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16428606#comment-16428606 ] Sunil G commented on YARN-7574: --- Hi [~suma.shivaprasad] Thanks for the patch. Few comments.

[jira] [Updated] (YARN-8083) [UI2] All YARN related configurations are paged together in conf page

2018-04-06 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-8083: -- Fix Version/s: (was: 3.0.3) 3.1.1 > [UI2] All YARN related configurations are paged togeth

[jira] [Commented] (YARN-5888) [YARN-3368] Improve unit tests for YARN UI

2018-04-06 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16428291#comment-16428291 ] Sunil G commented on YARN-5888: --- [~akhilpb] Thanks for the patch. This seems to be fine with

[jira] [Commented] (YARN-4518) [YARN-3368] Support rendering statistic-by-node-label for queues/apps page

2018-04-06 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16428289#comment-16428289 ] Sunil G commented on YARN-4518: --- This needs to be revisited based on new Nodes page layout ch

[jira] [Commented] (YARN-8083) RM/UI2: all configurations are paged together

2018-04-06 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16428123#comment-16428123 ] Sunil G commented on YARN-8083: --- +1 on the patch. Committing shortly. > RM/UI2: all configu

[jira] [Updated] (YARN-8083) [UI2] All YARN related configurations are paged together in conf page

2018-04-06 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-8083: -- Summary: [UI2] All YARN related configurations are paged together in conf page (was: RM/UI2: all configurations

[jira] [Updated] (YARN-7875) Node Attribute store for storing and recovering attributes

2018-04-05 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7875: -- Summary: Node Attribute store for storing and recovering attributes (was: AttributeStore for store and recover a

[jira] [Commented] (YARN-8119) [UI2] Timeline Server address' url scheme should be removed while accessing via KNOX

2018-04-05 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16427836#comment-16427836 ] Sunil G commented on YARN-8119: --- Thank you [~rohithsharma] . > [UI2] Timeline Server address

[jira] [Commented] (YARN-8119) [UI2] Timeline Server address' url scheme should be removed while accessing via KNOX

2018-04-05 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16426971#comment-16426971 ] Sunil G commented on YARN-8119: --- [~rohithsharma] Could u pls help to check this patch. Thanks

[jira] [Updated] (YARN-8119) [UI2] Timeline Server address' url scheme should be removed while accessing via KNOX

2018-04-05 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-8119: -- Attachment: YARN-8119.001.patch > [UI2] Timeline Server address' url scheme should be removed while accessing >

[jira] [Created] (YARN-8119) [UI2] Timeline Server address' url scheme should be removed while accessing via KNOX

2018-04-05 Thread Sunil G (JIRA)
Sunil G created YARN-8119: - Summary: [UI2] Timeline Server address' url scheme should be removed while accessing via KNOX Key: YARN-8119 URL: https://issues.apache.org/jira/browse/YARN-8119 Project: Hadoop YA

[jira] [Commented] (YARN-8117) Fix TestRMWebServicesNodes test failure

2018-04-05 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16426594#comment-16426594 ] Sunil G commented on YARN-8117: --- Yes. This has happened post rebase. Some additional items a

[jira] [Comment Edited] (YARN-8117) Fix TestRMWebServicesNodes test failure

2018-04-05 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16426538#comment-16426538 ] Sunil G edited comment on YARN-8117 at 4/5/18 7:45 AM: --- Its still int

[jira] [Commented] (YARN-7875) AttributeStore for store and recover attributes

2018-04-05 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16426540#comment-16426540 ] Sunil G commented on YARN-7875: --- Thanks [~bibinchundatt] I also wanted to check the jenkins,

[jira] [Commented] (YARN-8117) Fix TestRMWebServicesNodes test failure

2018-04-04 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16426538#comment-16426538 ] Sunil G commented on YARN-8117: --- Its still interesting why YARN-8092 is not failing any test

[jira] [Updated] (YARN-8115) [UI2] URL data like nodeHTTPAddress must be encoded in UI before using to access NM

2018-04-04 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-8115: -- Summary: [UI2] URL data like nodeHTTPAddress must be encoded in UI before using to access NM (was: [UI2] URL dat

[jira] [Updated] (YARN-8115) [UI2] URL data like nodeHTTPAddress must be encoded in UI before using for NM

2018-04-04 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-8115: -- Summary: [UI2] URL data like nodeHTTPAddress must be encoded in UI before using for NM (was: [UI2] URL data like

[jira] [Commented] (YARN-7875) AttributeStore for store and recover attributes

2018-04-04 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16425706#comment-16425706 ] Sunil G commented on YARN-7875: --- Yes. Pls hold on for a while > AttributeStore for store and

[jira] [Commented] (YARN-8115) [UI2] URL data like nodeHTTPAddress must be encoded in UI before using for NM/ATS

2018-04-04 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16425646#comment-16425646 ] Sunil G commented on YARN-8115: --- Thanks [~Sreenath], patch looks good. pending jenkins. > [U

[jira] [Created] (YARN-8115) [UI2] URL data like nodeHTTPAddress must be encoded in UI before using for NM/ATS

2018-04-04 Thread Sunil G (JIRA)
Sunil G created YARN-8115: - Summary: [UI2] URL data like nodeHTTPAddress must be encoded in UI before using for NM/ATS Key: YARN-8115 URL: https://issues.apache.org/jira/browse/YARN-8115 Project: Hadoop YARN

[jira] [Commented] (YARN-7875) AttributeStore for store and recover attributes

2018-04-04 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16425503#comment-16425503 ] Sunil G commented on YARN-7875: --- Its interesting that YARN-8092 doesnt have that test failure

[jira] [Commented] (YARN-7764) Findbugs warning: Resource#getResources may expose internal representation

2018-04-03 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16424946#comment-16424946 ] Sunil G commented on YARN-7764: --- Thanks [~leftnoteasy]. Committing shortly. > Findbugs warni

[jira] [Commented] (YARN-7764) Findbugs warning: Resource#getResources may expose internal representation

2018-04-03 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16423979#comment-16423979 ] Sunil G commented on YARN-7764: --- Thank you weiwei. Looks fine. I ll wait for Wangda also. >

[jira] [Commented] (YARN-7764) Findbugs warning: Resource#getResources may expose internal representation

2018-04-03 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16423913#comment-16423913 ] Sunil G commented on YARN-7764: --- Yup. There is a dip in performance. Around 8 to 10%. This is

[jira] [Commented] (YARN-7764) Findbugs warning: Resource#getResources may expose internal representation

2018-04-03 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16423802#comment-16423802 ] Sunil G commented on YARN-7764: --- Hi [~cheersyang] Unfortunately this wil have an impact on p

[jira] [Commented] (YARN-8102) Retrospect on having enable and disable flag for Node Attribute

2018-04-02 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16422028#comment-16422028 ] Sunil G commented on YARN-8102: --- resource-profiles works had two parts. resource-types and pr

[jira] [Updated] (YARN-7494) Add muti node lookup support for better placement

2018-04-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7494: -- Attachment: YARN-7494.006.patch > Add muti node lookup support for better placement > ---

[jira] [Commented] (YARN-8100) Support API interface for node attribute query

2018-04-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16421672#comment-16421672 ] Sunil G commented on YARN-8100: --- Thanks [~bibinchundatt]. One major point to discuss is abou

[jira] [Commented] (YARN-7875) AttributeStore for store and recover attributes

2018-04-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16421658#comment-16421658 ] Sunil G commented on YARN-7875: --- Latest patch seems fine to me. I could commit this patch to

[jira] [Updated] (YARN-8092) Expose Node Attributes info via RM nodes REST API

2018-04-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-8092: -- Summary: Expose Node Attributes info via RM nodes REST API (was: Expose node-attributes info via RM nodes REST A

[jira] [Commented] (YARN-8033) CLI Integration with NodeAttributesManagerImpl

2018-04-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16421641#comment-16421641 ] Sunil G commented on YARN-8033: --- +1 > CLI Integration with NodeAttributesManagerImpl > -

[jira] [Commented] (YARN-7875) AttributeStore for store and recover attributes

2018-03-31 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16421589#comment-16421589 ] Sunil G commented on YARN-7875: --- Thanks [~bibinchundatt]. Few more minor nits. # I think jav

[jira] [Commented] (YARN-8092) Expose node-attributes info via RM nodes REST API

2018-03-31 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16421587#comment-16421587 ] Sunil G commented on YARN-8092: --- Looks good. Committing shortly. > Expose node-attributes in

[jira] [Commented] (YARN-8092) Expose node-attributes info via RM nodes REST API

2018-03-31 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16421344#comment-16421344 ] Sunil G commented on YARN-8092: --- bq.Regarding #3, since the change is pretty straightforward

[jira] [Commented] (YARN-8094) Support configuration based Node Attribute provider

2018-03-31 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16421343#comment-16421343 ] Sunil G commented on YARN-8094: --- Thanks [~cheersyang]. Committed to branch. > Support config

[jira] [Updated] (YARN-8094) Support configuration based Node Attribute provider

2018-03-31 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-8094: -- Summary: Support configuration based Node Attribute provider (was: Support configuration based node attribute pr

[jira] [Commented] (YARN-8094) Support configuration based node attribute provider

2018-03-30 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16421147#comment-16421147 ] Sunil G commented on YARN-8094: --- Thanks [~cheersyang]. Lates patch seems fine to me. Pending

[jira] [Commented] (YARN-7875) AttributeStore for store and recover attributes

2018-03-30 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16420710#comment-16420710 ] Sunil G commented on YARN-7875: --- Thanks [~bibinchundatt]. Few comments. # Test case failure

[jira] [Commented] (YARN-8092) Expose node-attributes info via RM nodes REST API

2018-03-30 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16420704#comment-16420704 ] Sunil G commented on YARN-8092: --- Thanks [~cheersyang] Some doubts # We have not used *defau

[jira] [Commented] (YARN-8094) Support configuration based node attribute provider

2018-03-30 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16420700#comment-16420700 ] Sunil G commented on YARN-8094: --- [~cheersyang] Thanks for the patch. Patch looks straight fo

[jira] [Commented] (YARN-8091) Revisit checkUserAccessToQueue RM REST API

2018-03-29 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16420123#comment-16420123 ] Sunil G commented on YARN-8091: --- +1 on patch. Thanks [~sershe] for confirming. Committing sh

[jira] [Commented] (YARN-8087) Allow YARN ATSv2 ACLs to be disabled

2018-03-29 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16420063#comment-16420063 ] Sunil G commented on YARN-8087: --- Hi [~haibochen] We have a yarn level acl toggling controlle

[jira] [Commented] (YARN-7494) Add muti node lookup support for better placement

2018-03-29 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16419342#comment-16419342 ] Sunil G commented on YARN-7494: --- [~cheersyang] Thanks for the update. I also discussed with [

[jira] [Comment Edited] (YARN-8085) ResourceProfilesManager should be set in RMActiveServiceContext

2018-03-29 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16419271#comment-16419271 ] Sunil G edited comment on YARN-8085 at 3/29/18 4:19 PM: Thanks [~Ta

[jira] [Commented] (YARN-8085) ResourceProfilesManager should be set in RMActiveServiceContext

2018-03-29 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16419271#comment-16419271 ] Sunil G commented on YARN-8085: --- Thanks [~Tao Yang]. > ResourceProfilesManager should be set

[jira] [Updated] (YARN-8085) ResourceProfilesManager should be set in RMActiveServiceContext

2018-03-29 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-8085: -- Summary: ResourceProfilesManager should be set in RMActiveServiceContext (was: RMContext#resourceProfilesManager

[jira] [Commented] (YARN-8085) RMContext#resourceProfilesManager is lost after RM went standby then back to active

2018-03-29 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16419056#comment-16419056 ] Sunil G commented on YARN-8085: --- Test case is passing locally. Committing shortly. > RMCont

[jira] [Commented] (YARN-7494) Add muti node lookup support for better placement

2018-03-29 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16418907#comment-16418907 ] Sunil G commented on YARN-7494: --- Thanks [~cheersyang] For known policies like resource-usage

[jira] [Commented] (YARN-8033) CLI Integration with NodeAttributesManagerImpl

2018-03-29 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16418848#comment-16418848 ] Sunil G commented on YARN-8033: --- Thanks [~Naganarasimha] for the patch. Approach seems fine

[jira] [Updated] (YARN-7988) Refactor FSNodeLabelStore code for Node Attributes store support

2018-03-29 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7988: -- Summary: Refactor FSNodeLabelStore code for Node Attributes store support (was: Refactor FSNodeLabelStore code f

[jira] [Commented] (YARN-7988) Refactor FSNodeLabelStore code for attributes store support

2018-03-29 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16418796#comment-16418796 ] Sunil G commented on YARN-7988: --- Except java doc, jenkins seems fine. I ll take care of that

[jira] [Commented] (YARN-4781) Support intra-queue preemption for fairness ordering policy.

2018-03-29 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16418792#comment-16418792 ] Sunil G commented on YARN-4781: --- Thanks [~eepayne] I think changes are fine in top level. Fe

[jira] [Commented] (YARN-7159) Normalize unit of resource objects in RM and avoid to do unit conversion in critical path

2018-03-29 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16418756#comment-16418756 ] Sunil G commented on YARN-7159: --- [~maniraj...@gmail.com] pls rebase the patch if needed. Its

[jira] [Commented] (YARN-8085) RMContext#resourceProfilesManager is lost after RM went standby then back to active

2018-03-29 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16418656#comment-16418656 ] Sunil G commented on YARN-8085: --- v4 patch looks good. > RMContext#resourceProfilesManager is

[jira] [Commented] (YARN-8085) RMContext#resourceProfilesManager is lost after RM went standby then back to active

2018-03-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16418496#comment-16418496 ] Sunil G commented on YARN-8085: --- This should be part of activeServiceContext. Same reason giv

[jira] [Commented] (YARN-7494) Add muti node lookup support for better placement

2018-03-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16417590#comment-16417590 ] Sunil G commented on YARN-7494: --- Thanks [~cheersyang] and [~leftnoteasy] bq.Maintaining a se

[jira] [Commented] (YARN-7988) Refactor FSNodeLabelStore code for attributes store support

2018-03-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16417503#comment-16417503 ] Sunil G commented on YARN-7988: --- pending jenkins. +1 on latest patch.  > Refactor FSNodeLab

[jira] [Commented] (YARN-6257) CapacityScheduler REST API produces incorrect JSON - JSON object operationsInfo contains deplicate key

2018-03-27 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16416921#comment-16416921 ] Sunil G commented on YARN-6257: --- Thanks [~Tao Yang] {{the health metrics of capacity schedul

[jira] [Updated] (YARN-8075) DShell does not fail when we ask more GPUs than available even though AM throws 'InvalidResourceRequestException'

2018-03-27 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-8075: -- Summary: DShell does not fail when we ask more GPUs than available even though AM throws 'InvalidResourceRequestE

[jira] [Commented] (YARN-7494) Add muti node lookup support for better placement

2018-03-27 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16415435#comment-16415435 ] Sunil G commented on YARN-7494: --- Thanks [~cheersyang] # Removed NodeSortingAlgorithm to make

[jira] [Updated] (YARN-7494) Add muti node lookup support for better placement

2018-03-27 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7494: -- Attachment: YARN-7494.005.patch > Add muti node lookup support for better placement > ---

[jira] [Updated] (YARN-7494) Add muti node lookup support for better placement

2018-03-27 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7494: -- Attachment: (was: YARN-7494.005.patch) > Add muti node lookup support for better placement >

[jira] [Updated] (YARN-7494) Add muti node lookup support for better placement

2018-03-27 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7494: -- Attachment: YARN-7494.005.patch > Add muti node lookup support for better placement > ---

[jira] [Commented] (YARN-8075) DShell does not Fail when we ask more GPUs than available even though AM throws 'InvalidResourceRequestException'

2018-03-27 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16415178#comment-16415178 ] Sunil G commented on YARN-8075: --- Looks straight forward. Committing shortly.   > DShell do

[jira] [Commented] (YARN-8076) Support to specify application tags in distributed shell

2018-03-27 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16415177#comment-16415177 ] Sunil G commented on YARN-8076: --- +1.  Patch looks good. I will commit shortly. > Support to

[jira] [Commented] (YARN-8066) RM/UI2: doughnut chart mis-rendering

2018-03-26 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16413538#comment-16413538 ] Sunil G commented on YARN-8066: --- +1. Committing shortly. > RM/UI2: doughnut chart mis-render

[jira] [Commented] (YARN-7988) Refactor FSNodeLabelStore code for attributes store support

2018-03-26 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16413536#comment-16413536 ] Sunil G commented on YARN-7988: --- Thanks [~bibinchundatt]    Few comments # *public abstrac

[jira] [Commented] (YARN-8068) Upgrading apps from Hadoop 2.7 based clients to 2.8+ cause NPE in app timeline publish

2018-03-24 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16412507#comment-16412507 ] Sunil G commented on YARN-8068: --- Thanks [~leftnoteasy] for the thoughts. I also was in simil

[jira] [Commented] (YARN-8066) RM/UI2: doughnut chart mis-rendering

2018-03-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16411893#comment-16411893 ] Sunil G commented on YARN-8066: --- This looks like browser dependent. cc [~Sreenath] Thoughts?

[jira] [Commented] (YARN-8068) Upgrading apps from Hadoop 2.7 based clients to 2.8+ cause NPE in app timeline publish

2018-03-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16411876#comment-16411876 ] Sunil G commented on YARN-8068: --- [~leftnoteasy], could u pls help to check this. Usually for

[jira] [Updated] (YARN-8068) Upgrading apps from Hadoop 2.7 based clients to 2.8+ cause NPE in app timeline publish

2018-03-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-8068: -- Priority: Blocker (was: Major) > Upgrading apps from Hadoop 2.7 based clients to 2.8+ cause NPE in app > timeli

[jira] [Updated] (YARN-8068) Upgrading apps from Hadoop 2.7 based clients to 2.8+ cause NPE in app timeline publish

2018-03-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-8068: -- Target Version/s: 3.1.1 (was: 3.1.0) > Upgrading apps from Hadoop 2.7 based clients to 2.8+ cause NPE in app >

[jira] [Updated] (YARN-8068) Upgrading apps from Hadoop 2.7 based clients to 2.8+ cause NPE in app timeline publish

2018-03-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-8068: -- Attachment: YARN-8068.001.patch > Upgrading apps from Hadoop 2.7 based clients to 2.8+ cause NPE in app > timeli

[jira] [Created] (YARN-8068) Upgrading apps from Hadoop 2.7 based clients to 2.8+ cause NPE in app timeline publish

2018-03-23 Thread Sunil G (JIRA)
Sunil G created YARN-8068: - Summary: Upgrading apps from Hadoop 2.7 based clients to 2.8+ cause NPE in app timeline publish Key: YARN-8068 URL: https://issues.apache.org/jira/browse/YARN-8068 Project: Hadoop

[jira] [Comment Edited] (YARN-8062) yarn rmadmin -getGroups returns group from which the user has been removed

2018-03-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16411650#comment-16411650 ] Sunil G edited comment on YARN-8062 at 3/23/18 4:29 PM: In the late

[jira] [Commented] (YARN-8062) yarn rmadmin -getGroups returns group from which the user has been removed

2018-03-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16411650#comment-16411650 ] Sunil G commented on YARN-8062: --- In the latest patch, we will still do refresh from RM#init,

[jira] [Updated] (YARN-8062) yarn rmadmin -getGroups returns group from which the user has been removed

2018-03-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-8062: -- Attachment: YARN-8062.004.patch > yarn rmadmin -getGroups returns group from which the user has been removed > --

[jira] [Commented] (YARN-8062) yarn rmadmin -getGroups returns group from which the user has been removed

2018-03-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16411044#comment-16411044 ] Sunil G commented on YARN-8062: --- Fixing test case. > yarn rmadmin -getGroups returns group f

[jira] [Updated] (YARN-8062) yarn rmadmin -getGroups returns group from which the user has been removed

2018-03-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-8062: -- Attachment: YARN-8062.003.patch > yarn rmadmin -getGroups returns group from which the user has been removed > --

[jira] [Comment Edited] (YARN-8062) yarn rmadmin -getGroups returns group from which the user has been removed

2018-03-22 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16409368#comment-16409368 ] Sunil G edited comment on YARN-8062 at 3/23/18 5:21 AM: Test steps:

[jira] [Commented] (YARN-8062) yarn rmadmin -getGroups returns group from which the user has been removed

2018-03-22 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16410820#comment-16410820 ] Sunil G commented on YARN-8062: --- Tested same test case and its working fine. > yarn rmadmin

[jira] [Commented] (YARN-8062) yarn rmadmin -getGroups returns group from which the user has been removed

2018-03-22 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16410817#comment-16410817 ] Sunil G commented on YARN-8062: --- Thanks [~leftnoteasy] . Ideally calling refresh from RM#ini

[jira] [Updated] (YARN-8062) yarn rmadmin -getGroups returns group from which the user has been removed

2018-03-22 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-8062: -- Attachment: YARN-8062.002.patch > yarn rmadmin -getGroups returns group from which the user has been removed > --

[jira] [Commented] (YARN-7956) HOME/Services/ and HOME/Services//Components refer to same page

2018-03-22 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16410718#comment-16410718 ] Sunil G commented on YARN-7956: --- Looks straight forward. +1 Committing shortly. Thank [~yesh

[jira] [Commented] (YARN-7988) Refactor FSNodeLabelStore code for attributes store support

2018-03-22 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16409928#comment-16409928 ] Sunil G commented on YARN-7988: --- [~bibinchundatt] Thanks for the patch. As discussed offline

[jira] [Comment Edited] (YARN-8062) yarn rmadmin -getGroups returns group from which the user has been removed

2018-03-22 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16409368#comment-16409368 ] Sunil G edited comment on YARN-8062 at 3/22/18 4:55 PM: Test steps:

[jira] [Comment Edited] (YARN-8062) yarn rmadmin -getGroups returns group from which the user has been removed

2018-03-22 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16409368#comment-16409368 ] Sunil G edited comment on YARN-8062 at 3/22/18 4:53 PM: Test steps:

[jira] [Commented] (YARN-8063) DistributedShellTimelinePlugin wrongly check for entityId instead of entityType

2018-03-22 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16409653#comment-16409653 ] Sunil G commented on YARN-8063: --- Changes look straight forward. +1 > DistributedShellTimelin

[jira] [Commented] (YARN-8062) yarn rmadmin -getGroups returns group from which the user has been removed

2018-03-22 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16409368#comment-16409368 ] Sunil G commented on YARN-8062: --- Test steps: {noformat} [root@ctr-e138-1518143905142-105679-0

[jira] [Updated] (YARN-8062) yarn rmadmin -getGroups returns group from which the user has been removed

2018-03-22 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-8062: -- Attachment: YARN-8062.001.patch > yarn rmadmin -getGroups returns group from which the user has been removed > --

[jira] [Moved] (YARN-8062) yarn rmadmin -getGroups returns group from which the user has been removed

2018-03-22 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G moved HADOOP-15270 to YARN-8062: Key: YARN-8062 (was: HADOOP-15270) Project: Hadoop YARN (was: Hadoop Common

[jira] [Commented] (YARN-7494) Add muti node lookup support for better placement

2018-03-19 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16405157#comment-16405157 ] Sunil G commented on YARN-7494: --- Updating patch by correct api names where each scheduler can

[jira] [Updated] (YARN-7494) Add muti node lookup support for better placement

2018-03-19 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7494: -- Attachment: YARN-7494.004.patch > Add muti node lookup support for better placement > ---

[jira] [Commented] (YARN-8040) [UI2] New YARN UI webapp does not respect current pathname for REST api

2018-03-17 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16403854#comment-16403854 ] Sunil G commented on YARN-8040: --- Thanks [~leftnoteasy]. I committed this to trunk. > [UI2]

[jira] [Updated] (YARN-8040) [UI2] New YARN UI webapp does not respect current pathname for REST api

2018-03-17 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-8040: -- Summary: [UI2] New YARN UI webapp does not respect current pathname for REST api (was: [UI2] yarn new ui web-app

[jira] [Commented] (YARN-8028) Support authorizeUserAccessToQueue in RMWebServices

2018-03-17 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16403302#comment-16403302 ] Sunil G commented on YARN-8028: --- Thanks [~leftnoteasy]. makes sense to me. I am fine with la

<    1   2   3   4   5   6   7   8   9   10   >