L. C. Hsieh created SPARK-53880:
-----------------------------------
Summary: Support DSv2 in PushVariantIntoScan
Key: SPARK-53880
URL: https://issues.apache.org/jira/browse/SPARK-53880
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 4.1.0
Reporter: L. C. Hsieh
This goes to add DSv2 support to the optimization rule PushVariantIntoScan. The
PushVariantIntoScan rule only supports DSv1 Parquet (ParquetFileFormat) source.
It limits the effectiveness of variant type usage on DSv2.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
