This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from acb79f5 [MINOR][SQL] Re-use `binaryToSQLTimestamp()` in
`ParquetRowConverter`
add ce6180c [SPARK-33154][CORE][K8S] Handle cleaned shuffles during
migration
No new revisions were added by this update.
Summary of changes:
.../spark/network/BlockTransferService.scala | 1 +
.../spark/shuffle/IndexShuffleBlockResolver.scala | 39 ++++++---
.../spark/storage/BlockManagerDecommissioner.scala | 52 ++++++++----
.../BlockManagerDecommissionUnitSuite.scala | 99 ++++++++++++++++++++--
.../k8s/integrationtest/DecommissionSuite.scala | 71 ++++++++++++++++
.../deploy/k8s/integrationtest/ProcessUtils.scala | 4 +-
.../tests/{decommissioning.py => autoscale.py} | 24 ++----
.../integration-tests/tests/decommissioning.py | 2 +-
...commissioning.py => decommissioning_cleanup.py} | 6 +-
9 files changed, 240 insertions(+), 58 deletions(-)
copy resource-managers/kubernetes/integration-tests/tests/{decommissioning.py
=> autoscale.py} (71%)
copy resource-managers/kubernetes/integration-tests/tests/{decommissioning.py
=> decommissioning_cleanup.py} (87%)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
