Csaba Ringhofer created IMPALA-10466:
----------------------------------------
Summary: Handle deprecated TWO_LEVEL Parquet arrays more gracefully
Key: IMPALA-10466
URL: https://issues.apache.org/jira/browse/IMPALA-10466
Project: IMPALA
Issue Type: Improvement
Reporter: Csaba Ringhofer
The default of PARQUET_ARRAY_RESOLUTION was changed from
TWO_LEVEL_THEN_THREE_LEVEL to THREE_LEVEL in IMPALA-4725. This solved
incorrectly detecting some ambiguous cases, but now old TWO_LEVEL Parquet lists
are not read correctly by default, replacing values with NULL without any error
message.
I would prefer a solution that:
a. detects the correct resolution when possible
b. returns a clear warning/error when resolution is not possible or ambiguous,
and points the user toward the query option that needs to be set manually
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
