[
https://issues.apache.org/jira/browse/IMPALA-10814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17385175#comment-17385175
]
Quanlong Huang commented on IMPALA-10814:
-----------------------------------------
The stacktrace is
{code:java}
Thread 671 (crashed)
0 libc-2.17.so + 0x351f7
1 impalad!google::LogMessage::Flush() + 0x1eb
2 impalad!google::LogMessageFatal::~LogMessageFatal() + 0x9
3 impalad!void
impala::DecimalUtil::DecodeFromFixedLenByteArray<impala::DecimalValue<__int128>
>(unsigned char const*, int, impala::DecimalValue<__int128>*) [decimal-util.h :
129 + 0xc]
4 impalad!void impala::DecodeDecimalFixedLen<impala::DecimalValue<__int128>
>(unsigned char const*, unsigned char const*, int,
impala::DecimalValue<__int128>*) [parquet-common.h : 679 + 0x15]
5 impalad!int
impala::ParquetPlainEncoder::Decode<impala::DecimalValue<__int128>,
(parquet::Type::type)7>(unsigned char const*, unsigned char const*, int,
impala::DecimalValue<__int128>*) [parquet-common.h : 711 + 0x17]
6 impalad!int impala::DictDecoder<impala::DecimalValue<__int128>
>::Decode<(parquet::Type::type)7>(unsigned char const*, unsigned char const*,
int, impala::DecimalValue<__int128>*) [dict-encoding.h : 418 + 0x17]
7 impalad!bool impala::DictDecoder<impala::DecimalValue<__int128>
>::Reset<(parquet::Type::type)7>(unsigned char*, int, int) [dict-encoding.h :
655 + 0x1e]
8 impalad!impala::ScalarColumnReader<impala::DecimalValue<__int128>,
(parquet::Type::type)7, true>::CreateDictionaryDecoder(unsigned char*, int,
impala::DictDecoderBase**) [parquet-column-readers.cc : 157 + 0x30]
9 impalad!impala::BaseScalarColumnReader::InitDictionary()
[parquet-column-readers.cc : 1066 + 0x46]
10
impalad!impala::BaseScalarColumnReader::InitDictionaries(std::vector<impala::BaseScalarColumnReader*,
std::allocator<impala::BaseScalarColumnReader*> >) [parquet-column-readers.cc
: 1079 + 0x13]
11 impalad!impala::HdfsParquetScanner::NextRowGroup() [hdfs-parquet-scanner.cc
: 954 + 0x19]
12 impalad!impala::HdfsParquetScanner::GetNextInternal(impala::RowBatch*)
[hdfs-parquet-scanner.cc : 468 + 0x19]
13 impalad!impala::HdfsParquetScanner::ProcessSplit() [hdfs-parquet-scanner.cc
: 379 + 0x39] {code}
I think this is a similar issue with IMPALA-10808. The cause is that we removed
some checks in ParquetMetadataUtils::ValidateColumn in this patch:
https://gerrit.cloudera.org/c/17678/8/be/src/exec/parquet/parquet-metadata-utils.cc
Then illegal type_length comes in. We should still verify that{code}
schema_element.type_length > 0
{code}
> Hit DCHECK in DecimalUtil::DecodeFromFixedLenByteArray for core-s3 build
> ------------------------------------------------------------------------
>
> Key: IMPALA-10814
> URL: https://issues.apache.org/jira/browse/IMPALA-10814
> Project: IMPALA
> Issue Type: Bug
> Components: Backend
> Affects Versions: Impala 4.1
> Reporter: Wenzhe Zhou
> Priority: Major
> Labels: broken-build
>
> Saw this build failure in asf-master-core-s3 build:
> [https://master-03.jenkins.cloudera.com/job/impala-asf-master-core-s3/61/]
>
> *Error Message*
> DCHECK found in log file:
> /data/jenkins/workspace/impala-asf-master-core-s3/repos/Impala/logs/ee_tests/impalad.FATAL
> h3. Standard Error
> Log file created at: 2021/07/19 18:41:06 Running on machine:
> [impala-ec2-centos74-m5-4xlarge-ondemand-072f.vpc.cloudera.com|http://impala-ec2-centos74-m5-4xlarge-ondemand-072f.vpc.cloudera.com/]
> Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid
> [file:line|file:///line]] msg
> F0719 18:41:06.730994 4601 decimal-util.h:129]
> fb4b98709a88f345:b51bf00b00000002] Check failed: fixed_len_size > 0 (-15 vs.
> 0)
> F0719 18:41:08.161149 4711 decimal-util.h:129]
> e5432b6d3730539d:cf6c2d3100000002] Check failed: fixed_len_size > 0 (-15 vs.
> 0)
>
> From timestamp, the issue seems happened in test:
> query_test/test_scanners_fuzz.py::TestScannersFuzzing::test_fuzz_uncompressed_parquet_orc
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
