[
https://issues.apache.org/jira/browse/SPARK-57746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk updated SPARK-57746:
-----------------------------
Summary: Assign a name to the error conditions _LEGACY_ERROR_TEMP_3171,
3172 (was: Assign a name to the error condition _LEGACY_ERROR_TEMP_3172)
> Assign a name to the error conditions _LEGACY_ERROR_TEMP_3171, 3172
> -------------------------------------------------------------------
>
> Key: SPARK-57746
> URL: https://issues.apache.org/jira/browse/SPARK-57746
> Project: Spark
> Issue Type: Sub-task
> Components: SQL
> Affects Versions: 4.3.0
> Reporter: Max Gekk
> Priority: Major
>
> h2. What
> {{_LEGACY_ERROR_TEMP_3172}} is a placeholder error condition with no proper
> name or SQLSTATE. Assign it a proper named error class as part of the
> error-class migration (SPARK-37935).
> Current definition (error-conditions.json):
> {code}
> "_LEGACY_ERROR_TEMP_3172": {
> "message": [
> "No min/max found for Parquet file <filePath>. Set SQLConf <config> to
> false and execute again."
> ]
> }
> {code}
> h2. Where
> Thrown by {{ParquetUtils.getCurrentBlockMaxOrMin}} (sql/core) during Parquet
> MIN/MAX aggregate push-down when a column chunk has no non-null values
> ({{!statistics.hasNonNullValue}}).
> h2. Notes
> Found during review of SPARK-57568 (TIME aggregate push-down). There is also
> a separate, *behavioral* follow-up -- SPARK-57739 -- proposing that Parquet
> return {{NULL}} for an all-null block (matching ORC) rather than throwing. If
> SPARK-57739 lands first, this error may be removed from the all-null path
> entirely rather than renamed; otherwise assign it a proper name here.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]