This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
from 9ddd7344464 [SPARK-40740][SQL] Improve listFunctions in SessionCatalog
add 8e853933ba6 [SPARK-40667][SQL] Refactor File Data Source Options
No new revisions were added by this update.
Summary of changes:
.../org/apache/spark/sql/avro/AvroOptions.scala | 36 +++---
.../org/apache/spark/sql/avro/AvroUtils.scala | 6 +-
.../org/apache/spark/sql/avro/AvroSuite.scala | 18 ++-
.../spark/sql/catalyst/DataSourceOptions.scala | 66 ++++++++++
.../apache/spark/sql/catalyst/csv/CSVOptions.scala | 133 ++++++++++++++-------
.../spark/sql/catalyst/json/JSONOptions.scala | 99 ++++++++++-----
.../execution/datasources/FileIndexOptions.scala | 18 +--
.../datasources/PartitioningAwareFileIndex.scala | 16 +--
.../sql/execution/datasources/orc/OrcOptions.scala | 12 +-
.../datasources/parquet/ParquetOptions.scala | 18 +--
.../sql/execution/datasources/pathFilters.scala | 16 +--
.../execution/datasources/text/TextOptions.scala | 16 +--
.../execution/streaming/FileStreamOptions.scala | 4 +-
.../sql/execution/datasources/FileIndexSuite.scala | 12 ++
.../sql/execution/datasources/csv/CSVSuite.scala | 52 ++++++++
.../sql/execution/datasources/json/JsonSuite.scala | 37 ++++++
.../execution/datasources/orc/OrcSourceSuite.scala | 8 ++
.../datasources/parquet/ParquetIOSuite.scala | 10 ++
.../sql/execution/datasources/text/TextSuite.scala | 9 ++
19 files changed, 440 insertions(+), 146 deletions(-)
create mode 100644
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/DataSourceOptions.scala
copy
connector/avro/src/test/scala/org/apache/spark/sql/execution/datasources/AvroReadSchemaSuite.scala
=>
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FileIndexOptions.scala
(59%)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
