This is an automated email from the ASF dual-hosted git repository.
blue pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/iceberg.git
The following commit(s) were added to refs/heads/master by this push:
new 7798094 Spark: Fix scanAllFiles in MicroBatch.open (#2667)
7798094 is described below
commit 7798094e646ce20d67aea2b132ba079a225a1407
Author: chenliang <[email protected]>
AuthorDate: Sat Jun 19 01:05:00 2021 +0800
Spark: Fix scanAllFiles in MicroBatch.open (#2667)
Param scanAllFiles Used to check whether all the data files should be
processed, or only added files.Here we should replace scanAllFiles to
!scanAllFiles.
---
core/src/main/java/org/apache/iceberg/MicroBatches.java | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/core/src/main/java/org/apache/iceberg/MicroBatches.java
b/core/src/main/java/org/apache/iceberg/MicroBatches.java
index d97dc7f..798c337 100644
--- a/core/src/main/java/org/apache/iceberg/MicroBatches.java
+++ b/core/src/main/java/org/apache/iceberg/MicroBatches.java
@@ -242,7 +242,7 @@ public class MicroBatches {
ManifestGroup manifestGroup = new ManifestGroup(io,
ImmutableList.of(manifestFile))
.specsById(specsById)
.caseSensitive(caseSensitive);
- if (scanAllFiles) {
+ if (!scanAllFiles) {
manifestGroup = manifestGroup
.filterManifestEntries(entry ->
entry.snapshotId() == snapshot.snapshotId() && entry.status()
== ManifestEntry.Status.ADDED)