[
https://issues.apache.org/jira/browse/HUDI-6937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kwang updated HUDI-6937:
------------------------
Description: We upgraded Hudi from 0.12 to 0.14, and found that the offline
clustering performance dropped by half. We compared and analyzed this two
versions of flame graphs, found TypedProperties object instantiation takes too
much time. This will cause clustering performance degradation. (was: We
upgraded Hudi from 0.12 to 0.14, and found that the offline clustering
performance dropped by half. We compared and analyzed this two versions of
flame graphs, found TypedProperties object instantiation takes too much time.
This will cause clustering )
> CopyOnWriteInsertHandler#consume will cause clustering performance degradation
> ------------------------------------------------------------------------------
>
> Key: HUDI-6937
> URL: https://issues.apache.org/jira/browse/HUDI-6937
> Project: Apache Hudi
> Issue Type: Improvement
> Components: spark
> Reporter: kwang
> Priority: Major
> Fix For: 0.14.1
>
> Attachments: hudi-0.12-flamegraph.png, hudi-0.12-log.png,
> hudi-0.14-flamegraph.png, hudi-0.14-log.png
>
>
> We upgraded Hudi from 0.12 to 0.14, and found that the offline clustering
> performance dropped by half. We compared and analyzed this two versions of
> flame graphs, found TypedProperties object instantiation takes too much time.
> This will cause clustering performance degradation.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
