This is an automated email from the ASF dual-hosted git repository.
gurwls223 pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from 7ef0b69 [SPARK-31626][SQL] Port HIVE-10415:
hive.start.cleanup.scratchdir configuration is not taking effect
add f72220b [SPARK-31606][SQL] Reduce the perf regression of vectorized
parquet reader caused by datetime rebase
No new revisions were added by this update.
Summary of changes:
.../spark/sql/catalyst/util/RebaseDateTime.scala | 4 +
.../DateTimeRebaseBenchmark-jdk11-results.txt | 104 ++++++++++-----------
.../benchmarks/DateTimeRebaseBenchmark-results.txt | 104 ++++++++++-----------
.../parquet/VectorizedColumnReader.java | 22 +----
.../parquet/VectorizedPlainValuesReader.java | 55 +++++++++++
.../parquet/VectorizedRleValuesReader.java | 85 +++++++++++++++++
.../parquet/VectorizedValuesReader.java | 2 +
.../benchmark/DateTimeRebaseBenchmark.scala | 79 ++++++++--------
8 files changed, 295 insertions(+), 160 deletions(-)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
