This is an automated email from the ASF dual-hosted git repository.
gurwls223 pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from 55b026a [SPARK-31504][SQL] Formatted Explain should have determined
order of Output fields
add a5ebbac [SPARK-31361][SQL] Rebase datetime in parquet/avro according
to file metadata
No new revisions were added by this update.
Summary of changes:
.../apache/spark/sql/avro/AvroDeserializer.scala | 12 ++-
.../org/apache/spark/sql/avro/AvroFileFormat.scala | 11 ++-
.../apache/spark/sql/avro/AvroOutputWriter.scala | 17 +++-
.../org/apache/spark/sql/avro/AvroSerializer.scala | 14 ++-
.../sql/v2/avro/AvroPartitionReaderFactory.scala | 10 +-
.../sql/avro/AvroCatalystDataConversionSuite.scala | 2 +-
.../org/apache/spark/sql/avro/AvroSuite.scala | 103 ++++++++++++++++-----
.../parquet/VectorizedColumnReader.java | 6 +-
.../parquet/VectorizedParquetRecordReader.java | 18 +++-
.../execution/datasources/DataSourceUtils.scala | 17 ++++
.../datasources/parquet/ParquetFileFormat.scala | 13 ++-
.../datasources/parquet/ParquetReadSupport.scala | 15 +--
.../parquet/ParquetRecordMaterializer.scala | 10 +-
.../datasources/parquet/ParquetRowConverter.scala | 10 +-
.../datasources/parquet/ParquetWriteSupport.scala | 6 +-
.../v2/parquet/ParquetPartitionReaderFactory.scala | 26 ++++--
.../main/scala/org/apache/spark/sql/package.scala | 6 ++
.../benchmark/DataSourceReadBenchmark.scala | 6 +-
.../datasources/parquet/ParquetEncodingSuite.scala | 6 +-
.../datasources/parquet/ParquetIOSuite.scala | 89 ++++++++++++++----
.../datasources/parquet/ParquetTest.scala | 7 +-
21 files changed, 299 insertions(+), 105 deletions(-)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
