[
https://issues.apache.org/jira/browse/IMPALA-10808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17384975#comment-17384975
]
ASF subversion and git services commented on IMPALA-10808:
----------------------------------------------------------
Commit b0d364cc5a62fcfb7ad26d52d3f492239151a3c1 in impala's branch
refs/heads/master from stiga-huang
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=b0d364c ]
IMPALA-10808: Fix crash on illegal decimal precision in parquet file schema
In IMPALA-7087, we allow parquet file schema to have decimal precision
lower than the one in table schema. However, we should check illegal
precisions like 0 or negative values. They will hit a DCHECK in
ColumnType::GetDecimalByteSize(int).
Change-Id: If84fe14740aea97461ebccedffa4c2ca393333d8
Reviewed-on: http://gerrit.cloudera.org:8080/17701
Reviewed-by: Impala Public Jenkins <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>
> Crash of illegal decimal schema in test_fuzz_decimal_tbl
> --------------------------------------------------------
>
> Key: IMPALA-10808
> URL: https://issues.apache.org/jira/browse/IMPALA-10808
> Project: IMPALA
> Issue Type: Bug
> Affects Versions: Impala 4.1
> Reporter: Quanlong Huang
> Assignee: Quanlong Huang
> Priority: Blocker
>
> Recently saw two unrelated jobs failed by the same crash:
> * [https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/14369]
> * [https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/14381]
> For example in the second job, the test that crashes impalad is {code}
> query_test/test_scanners_fuzz.py::TestScannersFuzzing::()::test_fuzz_decimal_tbl[protocol:beeswax|exec_option:{'debug_action':'-1:OPEN:[email protected]';'abort_on_error':False;'mem_limit':'512m';'num_nodes':0}|table_format:parquet/none
> {code}
> The failure is
> {code:java}
> I0720 03:34:53.168516 126039 runtime-state.cc:196]
> 8a42e69ff49106c8:d2096a7000000001] Error from query
> 8a42e69ff49106c8:d2096a7000000000: File
> 'hdfs://localhost:20500/test-warehouse/test_fuzz_decimal_tbl_4a8e12be.db/decimal_tbl/d6=1/copy1_6b48619353a75ffb-66460f7400000000_973668612_data.0.parq'
> column 'd1' does not have the decimal precision set.
> F0720 03:34:53.168567 126039 types.h:282] 8a42e69ff49106c8:d2096a7000000001]
> Check failed: precision > 0 (0 vs. 0)
> {code}
> CC [~boroknagyz] who owns the first job.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
