This is an automated email from the ASF dual-hosted git repository.
ashvin pushed a change to branch 348-deletion-vectors-iceberg-target
in repository https://gitbox.apache.org/repos/asf/incubator-xtable.git
from 4db9bb86 add iceberg stats when reading snapshot
add 5f4f8515 Extract Delta Lake deletion vectors
add 7786c5bd Handle optional offset information
add 92712a6b Fix spotless error, unused import
add b65080ee Add support for inline delete vectors
add 2e234ae9 Refactor: rename to clariy delete ordinal only
new 12186a9c Delete inherits data
new eb6a8c7b Handle deletion vectors in Iceberg target
The 2 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
pom.xml | 1 +
.../java/org/apache/xtable/model/TableChange.java | 4 +
.../xtable/model/storage/InternalDataFile.java | 13 +-
.../model/storage/InternalDeletionVector.java | 75 +++++
xtable-core/pom.xml | 4 +
.../apache/xtable/delta/DeltaActionsConverter.java | 67 +++-
.../apache/xtable/delta/DeltaConversionSource.java | 24 +-
.../apache/xtable/hudi/HudiFileStatsExtractor.java | 9 +-
.../xtable/iceberg/IcebergConversionTarget.java | 27 +-
.../xtable/iceberg/IcebergDataFileUpdatesSync.java | 53 +++-
.../iceberg/IcebergDeleteVectorConverter.java | 94 ++++++
.../org/apache/xtable/TestSparkDeltaTable.java | 7 +-
.../org/apache/xtable/ValidationTestHelper.java | 6 +-
.../xtable/delta/ITDeltaDeleteVectorConvert.java | 189 +++++++++--
.../xtable/delta/TestDeltaActionsConverter.java | 164 ++++++++--
.../iceberg/ITIcebergDeleteVectorConvert.java | 350 +++++++++++++++++++++
.../iceberg/TestIcebergDeleteVectorConverter.java | 95 ++++++
17 files changed, 1102 insertions(+), 80 deletions(-)
create mode 100644
xtable-api/src/main/java/org/apache/xtable/model/storage/InternalDeletionVector.java
create mode 100644
xtable-core/src/main/java/org/apache/xtable/iceberg/IcebergDeleteVectorConverter.java
create mode 100644
xtable-core/src/test/java/org/apache/xtable/iceberg/ITIcebergDeleteVectorConvert.java
create mode 100644
xtable-core/src/test/java/org/apache/xtable/iceberg/TestIcebergDeleteVectorConverter.java
