Yaohua Zhao created SPARK-37273:
-----------------------------------
Summary: Hidden File Metadata Support for Spark SQL
Key: SPARK-37273
URL: https://issues.apache.org/jira/browse/SPARK-37273
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 3.2.0
Reporter: Yaohua Zhao
Provide a new interface in Spark SQL that allows users to query the metadata of
the input files for all file formats, expose them as *built-in hidden columns*
meaning *users can only see them when they explicitly reference them* (e.g.
file path, file name)
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
