Uros Stankovic created SPARK-48286:
--------------------------------------
Summary: Analyze 'exists' default expression instead of 'current'
default expression in structField to v2 column conversion
Key: SPARK-48286
URL: https://issues.apache.org/jira/browse/SPARK-48286
Project: Spark
Issue Type: Bug
Components: Spark Core
Affects Versions: 4.0.0
Reporter: Uros Stankovic
Fix For: 4.0.0
org.apache.spark.sql.catalyst.util.ResolveDefaultColumns#analyze method accepts
3 parameter
1) Field to analyze
2) Statement type - String
3) Metadata key - CURRENT_DEFAULT or EXISTS_DEFAULT
Method
org.apache.spark.sql.connector.catalog.CatalogV2Util#structFieldToV2Column
pass fieldToAnalyze and EXISTS_DEFAULT as second parameter, so it is not
metadata key, instead of that, it is statement type, so bad expression is
analyzed.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
