Kong Wei created HUDI-7279:
------------------------------
Summary: Make the sampling rate of object size estimation
configurable
Key: HUDI-7279
URL: https://issues.apache.org/jira/browse/HUDI-7279
Project: Apache Hudi
Issue Type: Improvement
Reporter: Kong Wei
Attachments: image-2024-01-08-17-07-31-122.png
When writing data with BoundedInMemoryQueue,
As I tested, about 9% CPU is used to estimaze the object size to calculate the
queue size.
Currently the sampling rate is set to 64. If we can set the rate to 128, then
we can save 4.5% CPU theoretically.
!image-2024-01-08-17-07-31-122.png!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)