rhh777 opened a new issue, #859:
URL: https://github.com/apache/incubator-uniffle/issues/859

   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://www.apache.org/foundation/policies/conduct)
   
   
   ### Search before asking
   
   - [X] I have searched in the 
[issues](https://github.com/apache/incubator-uniffle/issues?q=is%3Aissue) and 
found no similar issues.
   
   
   ### What would you like to be improved?
   
   When the shuffle server is deployed in the container, the memory keeps 
soaring until it exceeds the container's memory limit, and then the container 
is OOMKill. After checking the memory usage, it is found that there are a large 
number of 64 MB memory blocks.
   Reference:
   https://github.com/prestodb/presto/issues/8993
   https://issues.apache.org/jira/browse/HADOOP-7154
   <img width="777" alt="image" 
src="https://github.com/apache/incubator-uniffle/assets/41908930/fd9aebeb-3417-483d-b55a-4d98ad38d81d";>
   
   <img width="1251" alt="image" 
src="https://github.com/apache/incubator-uniffle/assets/41908930/7cd8fe60-0fa6-4000-95c6-7c87af89152e";>
   
   
   
   ### How should we improve?
   
   In start-shuffle-server.sh,  set MALLOC_ARENA_MAX(default cpu core * 8) to 
control memory application/usage 
   
   ### Are you willing to submit PR?
   
   - [X] Yes I am willing to submit a PR!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to