xianjingfeng opened a new issue, #1885:
URL: https://github.com/apache/incubator-uniffle/issues/1885

   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://www.apache.org/foundation/policies/conduct)
   
   
   ### Search before asking
   
   - [X] I have searched in the 
[issues](https://github.com/apache/incubator-uniffle/issues?q=is%3Aissue) and 
found no similar issues.
   
   
   ### What would you like to be improved?
   
   In the current implementation, `usedMemory` is released only when all 
buffers of an application are released.
   
https://github.com/apache/incubator-uniffle/blob/34b5187fdf2959e543be75b2bf82824400bba60b/server/src/main/java/org/apache/uniffle/server/buffer/ShuffleBufferManager.java#L718-L725
   If an app needs to release a lot of buffers, the buffer release time will be 
very long.  `usedMemory` will not be released in time.
   ```
   [2024-07-10 10:07:44.706] [clearResourceThread] [INFO] 
ShuffleTaskManager.removeResources - Start remove resource for 
appId[application_1710412492003_44045761_1720576106674]
   [2024-07-10 10:09:45.716] [clearResourceThread] [INFO] 
HybridStorageManager.removeResources - Start to remove resource of 
AppPurgeEvent{appId='application_1710412492003_44045761_1720576106674', 
user='root', shuffleIds=[0]}
   ```
   
   ### How should we improve?
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [X] Yes I am willing to submit a PR!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to