[
https://issues.apache.org/jira/browse/HUDI-7279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17804202#comment-17804202
]
Sagar Sumit commented on HUDI-7279:
-----------------------------------
[~kongwei] +1. Should we also consider making RECORD_CACHING_LIMIT configurable
so that memory footprint can be tuned?
> Make the sampling rate of object size estimation configurable
> -------------------------------------------------------------
>
> Key: HUDI-7279
> URL: https://issues.apache.org/jira/browse/HUDI-7279
> Project: Apache Hudi
> Issue Type: Improvement
> Components: writer-core
> Reporter: Kong Wei
> Assignee: Kong Wei
> Priority: Major
> Attachments: image-2024-01-08-17-07-31-122.png
>
>
> When writing data with BoundedInMemoryQueue,
> As I tested, about 9% CPU is used to estimaze the object size to calculate
> the queue size.
> Currently the sampling rate is set to 64. If we can set the rate to 128, then
> we can save 4.5% CPU theoretically.
> !image-2024-01-08-17-07-31-122.png!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
