This is an automated email from the ASF dual-hosted git repository.
pvary pushed a change to branch main
in repository https://gitbox.apache.org/repos/asf/iceberg.git
from 52d6a79e93 Nit: Prefer `Preconditions` in `StandardEncryptionManager`
(#14753)
add 65280c0153 Spark: Backport move DeleteFiltering out from the
vectorized reader (#14745)
No new revisions were added by this update.
Summary of changes:
.../spark/data/vectorized/ColumnarBatchReader.java | 57 +-----------
.../data/vectorized/CometColumnarBatchReader.java | 64 +------------
.../data/vectorized/CometDeleteColumnReader.java | 29 +++---
.../data/vectorized/CometDeletedColumnVector.java | 0
.../vectorized/CometVectorizedReaderBuilder.java | 13 +--
.../spark/data/vectorized/DeletedColumnVector.java | 3 +-
.../vectorized/UpdatableDeletedColumnVector.java | 0
.../vectorized/VectorizedSparkParquetReaders.java | 32 +------
.../iceberg/spark/source/BaseBatchReader.java | 101 ++++++++++++++++++---
.../iceberg/spark/source/BatchDataReader.java | 8 +-
.../data/TestSparkParquetReadMetadataColumns.java | 71 ++++++++++++---
.../vectorized/TestParquetVectorizedReads.java | 5 +-
.../iceberg/spark/source/BatchReaderUtil.java | 0
.../spark/data/vectorized/ColumnarBatchReader.java | 57 +-----------
.../data/vectorized/CometColumnarBatchReader.java | 64 +------------
.../data/vectorized/CometDeleteColumnReader.java | 27 +++---
.../data/vectorized/CometDeletedColumnVector.java | 0
.../vectorized/CometVectorizedReaderBuilder.java | 13 +--
.../spark/data/vectorized/DeletedColumnVector.java | 3 +-
.../vectorized/UpdatableDeletedColumnVector.java | 0
.../vectorized/VectorizedSparkParquetReaders.java | 32 +------
.../iceberg/spark/source/BaseBatchReader.java | 101 ++++++++++++++++++---
.../iceberg/spark/source/BatchDataReader.java | 8 +-
.../data/TestSparkParquetReadMetadataColumns.java | 71 ++++++++++++---
...estParquetDictionaryEncodedVectorizedReads.java | 2 +-
.../parquet/TestParquetVectorizedReads.java | 5 +-
.../iceberg/spark/source/BatchReaderUtil.java | 0
27 files changed, 354 insertions(+), 412 deletions(-)
copy spark/{v4.0 =>
v3.4}/spark/src/main/java/org/apache/iceberg/spark/data/vectorized/CometDeletedColumnVector.java
(100%)
copy spark/{v4.0 =>
v3.4}/spark/src/main/java/org/apache/iceberg/spark/data/vectorized/UpdatableDeletedColumnVector.java
(100%)
copy spark/{v4.0 =>
v3.4}/spark/src/test/java/org/apache/iceberg/spark/source/BatchReaderUtil.java
(100%)
copy spark/{v4.0 =>
v3.5}/spark/src/main/java/org/apache/iceberg/spark/data/vectorized/CometDeletedColumnVector.java
(100%)
copy spark/{v4.0 =>
v3.5}/spark/src/main/java/org/apache/iceberg/spark/data/vectorized/UpdatableDeletedColumnVector.java
(100%)
copy spark/{v4.0 =>
v3.5}/spark/src/test/java/org/apache/iceberg/spark/source/BatchReaderUtil.java
(100%)