[jira] [Work logged] (KNOX-3444) Optimize CM discovery memory usage by only caching role configurations that ServiceModelGenerators actually use

[ASF GitHub Bot (Jira)]

     [ 
https://issues.apache.org/jira/browse/KNOX-3444?focusedWorklogId=1040852&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-1040852
 ]

ASF GitHub Bot logged work on KNOX-3444:
----------------------------------------

                Author: ASF GitHub Bot
            Created on: 11/Sep/26 07:34
            Start Date: 11/Sep/26 07:34
    Worklog Time Spent: 10m 
      Work Description: github-actions[bot] commented on PR #1392:
URL: https://github.com/apache/knox/pull/1392#issuecomment-5631055368

   ## Test Results
     4 files    4 suites   23s ⏱️
    84 tests  84 ✅ 0 💤 0 ❌
   102 runs  102 ✅ 0 💤 0 ❌
   
   Results for commit e40f7901.
   
   
[test-results]:data:application/gzip;base64,H4sIAOeuo2oC/13MSw6CMBSF4a2Qjh30lnIRN2Po4yaNQE0fI+PeLQSwOvz+k5wXIzfZyG6NvDQsZpdOmBzG5PxSKNrisqR1u8oD95i1/isP9yyFn4FGN/0EG4IPewl5WR+Bix3HY12+j5urw831n/bz7FIBs5JTP3Ag2Yt2QNmB5aisUaioRQCDBLozyN4fCxdsogIBAAA=
   




Issue Time Tracking
-------------------

    Worklog Id:     (was: 1040852)
    Time Spent: 20m  (was: 10m)

> Optimize CM discovery memory usage by only caching role configurations that 
> ServiceModelGenerators actually use
> ---------------------------------------------------------------------------------------------------------------
>
>                 Key: KNOX-3444
>                 URL: https://issues.apache.org/jira/browse/KNOX-3444
>             Project: Apache Knox
>          Issue Type: Task
>          Components: cm-discovery
>            Reporter: Tamás Marcinkovics
>            Assignee: Tamás Marcinkovics
>            Priority: Major
>          Time Spent: 20m
>  Remaining Estimate: 0h
>
> Currently CM auto discovery fetches role configurations for every service 
> role that is not explicitly excluded, using full view.
> The response role config items include a lot of metadata, such as description 
> and validation, for every role instance in the service. 
> For some role types that currently no ServiceModelGenerators use (DATANODE, 
> GATEWAY, NODEMANAGER, REGIONSERVER) the role config items list in the 
> response takes up around 200KB memory; for large clusters with 500+ nodes, 
> this will result in a heap usage of 40-100 MB per role type, and the 
> in-memory discovery cache can exceed 1GB.
> We should not cache the role config items not used by ServiceModelGenerators.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)