[
https://issues.apache.org/jira/browse/HUDI-5608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17691615#comment-17691615
]
kazdy commented on HUDI-5608:
-----------------------------
Hi [~rchertara] and [~alexey.kudinkin],
One of my teammates stumbled upon a similar issue in Hudi 0.12.1, so I wanted
to share it with you.
First write to Hudi was with DecimalType(4,0), second write with
DecimalType(2,0).
So it's not always the case with high precision.
We got the same exception as in mentioned GH issue: AvroTypeException("Cannot
encode decimal with precision 4 as max precision 2).
[~rchertara] can this be solved by adding DecimalWrapperV2 as well?
> Support decimals w/ precision > 30 in Column Stats
> --------------------------------------------------
>
> Key: HUDI-5608
> URL: https://issues.apache.org/jira/browse/HUDI-5608
> Project: Apache Hudi
> Issue Type: Bug
> Components: spark
> Affects Versions: 0.12.2
> Reporter: Alexey Kudinkin
> Priority: Critical
> Fix For: 0.13.1
>
>
> As reported in: [https://github.com/apache/hudi/issues/7732]
>
> Currently we've limited precision of the supported decimals at 30 assuming
> that this number is reasonably high to cover 99% of use-cases, but it seems
> like there's still a demand for even larger Decimals.
> The challenge is however to balance the need to support longer Decimals vs
> storage space we have to provision for each one of them.
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
