This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from 86b9592 [SPARK-37704] Update mypy version to 0.920
add 62cf4d4 [SPARK-37273][SQL] Support hidden file metadata columns in
Spark SQL
No new revisions were added by this update.
Summary of changes:
.../spark/sql/catalyst/analysis/Analyzer.scala | 2 +-
.../catalyst/expressions/namedExpressions.scala | 21 +-
.../sql/catalyst/plans/logical/LogicalPlan.scala | 7 +
.../datasources/v2/DataSourceV2Relation.scala | 4 +-
.../spark/sql/execution/DataSourceScanExec.scala | 21 +-
.../spark/sql/execution/PartitionedFileUtil.scala | 6 +-
.../sql/execution/datasources/FileFormat.scala | 25 +-
.../sql/execution/datasources/FileScanRDD.scala | 117 ++++++-
.../execution/datasources/FileSourceStrategy.scala | 29 +-
.../execution/datasources/LogicalRelation.scala | 26 +-
.../sql/execution/datasources/SchemaPruning.scala | 7 +-
.../datasources/FileMetadataStructSuite.scala | 387 +++++++++++++++++++++
.../datasources/FileSourceStrategySuite.scala | 3 +-
13 files changed, 633 insertions(+), 22 deletions(-)
create mode 100644
sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/FileMetadataStructSuite.scala
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
