[
https://issues.apache.org/jira/browse/SPARK-57746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk updated SPARK-57746:
-----------------------------
Description:
h2. What
{{_LEGACY_ERROR_TEMP_3172}} is a placeholder error class with no proper name or
SQLSTATE. Assign it a proper named error class as part of the error-class
migration (SPARK-37935).
Current definition (error-conditions.json):
{code}
"_LEGACY_ERROR_TEMP_3172": {
"message": [
"No min/max found for Parquet file <filePath>. Set SQLConf <config> to
false and execute again."
]
}
{code}
h2. Where
Thrown by {{ParquetUtils.getCurrentBlockMaxOrMin}} (sql/core) during Parquet
MIN/MAX aggregate push-down when a column chunk has no non-null values
({{!statistics.hasNonNullValue}}).
h2. Notes
Found during review of SPARK-57568 (TIME aggregate push-down). There is also a
separate, *behavioral* follow-up -- SPARK-57739 -- proposing that Parquet
return {{NULL}} for an all-null block (matching ORC) rather than throwing. If
SPARK-57739 lands first, this error may be removed from the all-null path
entirely rather than renamed; otherwise assign it a proper name here.
> Assign a name to the error class _LEGACY_ERROR_TEMP_3172
> --------------------------------------------------------
>
> Key: SPARK-57746
> URL: https://issues.apache.org/jira/browse/SPARK-57746
> Project: Spark
> Issue Type: Sub-task
> Components: SQL
> Affects Versions: 5.0.0
> Reporter: Max Gekk
> Priority: Major
>
> h2. What
> {{_LEGACY_ERROR_TEMP_3172}} is a placeholder error class with no proper name
> or SQLSTATE. Assign it a proper named error class as part of the error-class
> migration (SPARK-37935).
> Current definition (error-conditions.json):
> {code}
> "_LEGACY_ERROR_TEMP_3172": {
> "message": [
> "No min/max found for Parquet file <filePath>. Set SQLConf <config> to
> false and execute again."
> ]
> }
> {code}
> h2. Where
> Thrown by {{ParquetUtils.getCurrentBlockMaxOrMin}} (sql/core) during Parquet
> MIN/MAX aggregate push-down when a column chunk has no non-null values
> ({{!statistics.hasNonNullValue}}).
> h2. Notes
> Found during review of SPARK-57568 (TIME aggregate push-down). There is also
> a separate, *behavioral* follow-up -- SPARK-57739 -- proposing that Parquet
> return {{NULL}} for an all-null block (matching ORC) rather than throwing. If
> SPARK-57739 lands first, this error may be removed from the all-null path
> entirely rather than renamed; otherwise assign it a proper name here.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
