Joe McDonnell created IMPALA-9678:
-------------------------------------
Summary: Dockerised tests with USE_CDP_HIVE=true crash with
orc-metadata-utils.cc DCHECK
Key: IMPALA-9678
URL: https://issues.apache.org/jira/browse/IMPALA-9678
Project: IMPALA
Issue Type: Bug
Components: Backend
Affects Versions: Impala 4.0
Reporter: Joe McDonnell
I ran a ubuntu-16.04-dockerised-tests-cdp-hive on master, and all of the
Impalads crashed with this message during end-to-end tests:
{noformat}
F0419 03:32:48.973024 31936 orc-metadata-utils.cc:160]
444f457c178cfeff:de098d6100000001] Check failed: i == col_path.size() - 1 (0
vs. 1)
F0419 03:32:48.974320 31935 orc-metadata-utils.cc:160]
444f457c178cfeff:de098d6100000001] Check failed: i == col_path.size() - 1 (0
vs. 1)
F0419 03:32:48.974320 31935 orc-metadata-utils.cc:160]
444f457c178cfeff:de098d6100000001] Check failed: i == col_path.size() - 1 (0
vs. 1) F0419 03:32:48.981420 31937 orc-metadata-utils.cc:160]
444f457c178cfeff:de098d6100000001] Check failed: i == col_path.size() - 1 (0
vs. 1)
F0419 03:32:48.974320 31935 orc-metadata-utils.cc:160]
444f457c178cfeff:de098d6100000001] Check failed: i == col_path.size() - 1 (0
vs. 1) F0419 03:32:48.981420 31937 orc-metadata-utils.cc:160]
444f457c178cfeff:de098d6100000001] Check failed: i == col_path.size() - 1 (0
vs. 1) F0419 03:32:48.983081 31938 orc-metadata-utils.cc:160]
444f457c178cfeff:de098d6100000001] Check failed: i == col_path.size() - 1 (0
vs. 1) {noformat}
It's coming from this DCHECK:
{code:java}
if (table_col_type->type == TYPE_ARRAY) {
...
} else if (table_col_type->type == TYPE_MAP) {
...
} else if (table_col_type->type == TYPE_STRUCT) {
...
} else {
DCHECK(!table_col_type->IsComplexType());
DCHECK_EQ(i, col_path.size() - 1); <--------
RETURN_IF_ERROR(ValidateType(*table_col_type, **node));
}
{code}
[https://github.com/apache/impala/blob/master/be/src/exec/orc-metadata-utils.cc#L160]
[https://jenkins.impala.io/job/ubuntu-16.04-dockerised-tests-cdp-hive/4/]
This matches the GVO failures that we saw when trying to set USE_CDP_HIVE=true
by default ([https://gerrit.cloudera.org/#/c/15710/]). It seems to reproduce
consistently, but only on the dockerised job.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
