[
https://issues.apache.org/jira/browse/IMPALA-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17386962#comment-17386962
]
ASF subversion and git services commented on IMPALA-8131:
---------------------------------------------------------
Commit b3c4ac9054aabcfbf04304b315d1b3103c952228 in impala's branch
refs/heads/master from Zoltan Borok-Nagy
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=b3c4ac9 ]
IMPALA-10814: Fix crash on illegal Parquet file
In IMPALA-7087/IMPALA-8131 we allowed reading decimals with
different precision/scale than table metadata. To allow this
we relaxed some checks against the Parquet file schema.
However we should still add some sanity checks, e.g. ignoring
negative values, require that scale is not greater than precision.
This patch adds these sanity checks. Without these checks we might
hit DCHECKS in Parquet fuzz testing.
Change-Id: Ic6b06ac00e2af8f405f7b2b3c2eb952683821431
Reviewed-on: http://gerrit.cloudera.org:8080/17714
Reviewed-by: Impala Public Jenkins <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>
> Impala is unable to read Parquet decimal columns with higher scale than table
> metadata
> --------------------------------------------------------------------------------------
>
> Key: IMPALA-8131
> URL: https://issues.apache.org/jira/browse/IMPALA-8131
> Project: IMPALA
> Issue Type: Sub-task
> Components: Backend
> Reporter: Sahil Takiar
> Assignee: Zoltán Borók-Nagy
> Priority: Major
> Labels: decimal, parquet
> Fix For: Impala 4.1
>
>
> Similar to IMPALA-7087, except we should allow Impala to read Parquet data
> stored with a higher scale into a table with lower scale. The SQL Standard
> allows for this behavior, and several other databases do this as well.
> More information on this can be found in
> [this|https://issues.apache.org/jira/browse/IMPALA-7087?focusedCommentId=16688645&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-16688645]
> comment of IMPALA-7087
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
