[
https://issues.apache.org/jira/browse/GOBBLIN-1968?focusedWorklogId=894886&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-894886
]
ASF GitHub Bot logged work on GOBBLIN-1968:
-------------------------------------------
Author: ASF GitHub Bot
Created on: 10/Dec/23 05:32
Start Date: 10/Dec/23 05:32
Worklog Time Spent: 10m
Work Description: Will-Lo commented on code in PR #3829:
URL: https://github.com/apache/gobblin/pull/3829#discussion_r1421687355
##########
gobblin-runtime/src/main/java/org/apache/gobblin/runtime/TaskStateCollectorService.java:
##########
@@ -259,6 +227,52 @@ public Void call() throws Exception {
this.eventBus.post(new
NewTaskCompletionEvent(ImmutableList.copyOf(taskStateQueue)));
}
+ /**
+ * Reads in a {@link FsStateStore} folder used to store Task state outputs,
and returns a queue of {@link TaskState}s
Review Comment:
It does because of the path name argument I'm passing into it but I can make
this generic instead
Issue Time Tracking
-------------------
Worklog Id: (was: 894886)
Time Spent: 2h 50m (was: 2h 40m)
> Gobblin Commit Step Runs on Temporal
> ------------------------------------
>
> Key: GOBBLIN-1968
> URL: https://issues.apache.org/jira/browse/GOBBLIN-1968
> Project: Apache Gobblin
> Issue Type: New Feature
> Components: gobblin-core
> Reporter: William Lo
> Assignee: Abhishek Tiwari
> Priority: Major
> Time Spent: 2h 50m
> Remaining Estimate: 0h
>
> Temporal is the next-gen distributed computing platform Gobblin is using to
> replace MapReduce for many of its data movement workflows. We want to
> integrate Gobblin's commit step that tracks task states and reports their
> status with Temporal
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
