[
https://issues.apache.org/jira/browse/HUDI-7279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-7279:
---------------------------------
Labels: pull-request-available (was: )
> Make the sampling rate of object size estimation configurable
> -------------------------------------------------------------
>
> Key: HUDI-7279
> URL: https://issues.apache.org/jira/browse/HUDI-7279
> Project: Apache Hudi
> Issue Type: Improvement
> Components: writer-core
> Reporter: Kong Wei
> Assignee: Kong Wei
> Priority: Major
> Labels: pull-request-available
> Attachments: image-2024-01-08-17-07-31-122.png
>
>
> When writing data with BoundedInMemoryQueue,
> As I tested, about 9% CPU is used to estimaze the object size to calculate
> the queue size.
> Currently the sampling rate is set to 64. If we can set the rate to 128, then
> we can save 4.5% CPU theoretically.
> !image-2024-01-08-17-07-31-122.png!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)