[
https://issues.apache.org/jira/browse/HUDI-234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16924332#comment-16924332
]
Vinoth Chandar commented on HUDI-234:
-------------------------------------
ObjectSizeCalculator is already abstracted under a `SizeEstimator` interface,
so should be easy to provide a new impl. There are two places where we use this
: SpillableMap to control how much of the hash merge map we need to retain in
memory, Controlling the buffer between shuffle read and parquet write threads.
ObjectSizeCalculator has a MemoryLayoutSpec defined and it may be possible to
provide one for IBM or other JVMs? May be we can just raise an issue against
the original repo? twitter/commons?
> Graceful degradation of ObjectSizeCalculator for non hotspot jvms
> -----------------------------------------------------------------
>
> Key: HUDI-234
> URL: https://issues.apache.org/jira/browse/HUDI-234
> Project: Apache Hudi (incubating)
> Issue Type: Bug
> Components: Write Client
> Affects Versions: 0.5.0
> Reporter: Vinoth Chandar
> Priority: Major
>
> https://github.com/apache/incubator-hudi/issues/860 bug report
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
