zuston opened a new pull request, #2538: URL: https://github.com/apache/uniffle/pull/2538
### What changes were proposed in this pull request? Introduce the config option to activate small cache in grpc server ### Why are the changes needed? for #2537 When partition reassignment is enabled in the production environment, we observed that some Spark jobs failed due to gRPC request timeouts (DEADLINE_EXCEEDED). Upon investigating the Spark driver logs, we found severe GC events, indicating significant memory pressure on the driver process. To mitigate this issue, this PR introduces an option to configure the gRPC server to use less memory, thereby reducing GC pressure on the Spark driver and improving overall system stability under memory-constrained conditions. ### Does this PR introduce _any_ user-facing change? Yes. `rss.client.rpc.pooledByteBufAllocatorWithSmallCacheEnabled=false` ### How was this patch tested? Existing unit tests. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@uniffle.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@uniffle.apache.org For additional commands, e-mail: issues-h...@uniffle.apache.org
