This is an automated email from the ASF dual-hosted git repository.
suvasude pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/gobblin.git
The following commit(s) were added to refs/heads/master by this push:
new f468bb0 [GOBBLIN-1499] fix the bug that compaction job hang when
there is no fix the bug that compaction job hang when there is no path match
the datasets patten (#3343)
f468bb0 is described below
commit f468bb0743a2d2f3de65abc2bd1a8cc7994c16fd
Author: Zihan Li <[email protected]>
AuthorDate: Tue Aug 3 11:46:51 2021 -0700
[GOBBLIN-1499] fix the bug that compaction job hang when there is no fix
the bug that compaction job hang when there is no path match the datasets
patten (#3343)
* [GOBBLIN-1499] fix the bug that compaction job hang when there is no path
match the datasets patten
* address comments
* revert unrelated change
---
.../main/java/org/apache/gobblin/compaction/source/CompactionSource.java | 1 +
1 file changed, 1 insertion(+)
diff --git
a/gobblin-compaction/src/main/java/org/apache/gobblin/compaction/source/CompactionSource.java
b/gobblin-compaction/src/main/java/org/apache/gobblin/compaction/source/CompactionSource.java
index ae3b124..824d7b5 100644
---
a/gobblin-compaction/src/main/java/org/apache/gobblin/compaction/source/CompactionSource.java
+++
b/gobblin-compaction/src/main/java/org/apache/gobblin/compaction/source/CompactionSource.java
@@ -119,6 +119,7 @@ public class CompactionSource implements
WorkUnitStreamSource<String, String> {
CompactionWorkUnitIterator workUnitIterator = new
CompactionWorkUnitIterator();
if (datasets.size() == 0) {
+ workUnitIterator.done();
return new BasicWorkUnitStream.Builder(workUnitIterator).build();
}