This is an automated email from the ASF dual-hosted git repository.
xxubai pushed a change to branch 0.9.x
in repository https://gitbox.apache.org/repos/asf/amoro.git
from 30580a3ae Merge remote-tracking branch 'origin/0.9.0-rc4' into 0.9.x
new 48735a8e3 [hotfix] Fix S3 credentials not vended when loading Lance
table (#4279)
new 25b2a8809 [AMORO-4274] Remove Roaring64Bitmap.isEmpty() check in
CombinedDelete… (#4275)
new dbd5f6ca6 [AMORO-4281]Fix cleanning process trigger issue for mixed
format tables (#4282)
new 4e09b201c [AMORO-4126][ams] Default waitAppCompletion=false for Spark
optimizer on Kubernetes (#4289)
new 5f618fb62 [AMORO-4277] imporove expire_snapshots performance (#4278)
new 0e4c6df32 [AMORO-4286]Change process status to failed when recover
from AMS restarting (#4288)
new 6c4872763 [Hotfix] Pin all external actions to the specific git hash
(#4294)
new 7a757db36 [Hotfix] Change the docker action version to match ASF
policy (#4299)
new fed7feba8 [AMORO-4297][AMS] Persist failure reasons in task quota
history (#4298)
new bb843c97c [AMORO-4300] Recover active processes after table ownership
transfer (#4304)
new f46f57d94 [AMORO-4301][ams] Fix Kubernetes executor label prefix
(#4302)
The 11 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.github/workflows/docker-images.yml | 30 +--
.../server/manager/SparkOptimizerContainer.java | 11 +-
.../amoro/server/optimizing/TaskRuntime.java | 1 +
.../persistence/mapper/TableProcessMapper.java | 6 +-
.../amoro/server/process/ProcessService.java | 223 +++++++++++++++++----
.../process/executor/TableProcessExecutor.java | 28 ++-
.../amoro/server/utils/RollingFileCleaner.java | 138 -------------
.../amoro/server/TestDefaultProcessService.java | 209 ++++++++++++++++++-
.../manager/TestSparkOptimizerContainer.java | 95 +++++++++
.../TestTaskRuntime.java} | 24 +--
.../process/TestProcessServiceMultiFormat.java | 188 +++++++++++++++++
.../process/executor/TestTableProcessExecutor.java | 152 ++++++++++++++
.../formats/iceberg/utils/RollingFileCleaner.java | 41 ++--
.../amoro/io/reader/CombinedDeleteFilter.java | 2 +-
.../java/org/apache/amoro/utils/TableFileUtil.java | 18 +-
.../iceberg/utils}/TestRollingFileCleaner.java | 3 +-
.../formats/lance/LanceDirectoryV1Catalog.java | 1 +
17 files changed, 930 insertions(+), 240 deletions(-)
delete mode 100644
amoro-ams/src/main/java/org/apache/amoro/server/utils/RollingFileCleaner.java
copy
amoro-ams/src/test/java/org/apache/amoro/server/{util/TestCompressUtil.java =>
optimizing/TestTaskRuntime.java} (63%)
create mode 100644
amoro-ams/src/test/java/org/apache/amoro/server/process/TestProcessServiceMultiFormat.java
create mode 100644
amoro-ams/src/test/java/org/apache/amoro/server/process/executor/TestTableProcessExecutor.java
rename {amoro-ams/src/test/java/org/apache/amoro/server/util =>
amoro-format-iceberg/src/test/java/org/apache/amoro/formats/iceberg/utils}/TestRollingFileCleaner.java
(95%)
