[
https://issues.apache.org/jira/browse/GOBBLIN-1052?focusedWorklogId=391448&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-391448
]
ASF GitHub Bot logged work on GOBBLIN-1052:
-------------------------------------------
Author: ASF GitHub Bot
Created on: 23/Feb/20 21:42
Start Date: 23/Feb/20 21:42
Worklog Time Spent: 10m
Work Description: sv2000 commented on pull request #2892: GOBBLIN-1052:
Create a spec consumer path if it does not exist in FS …
URL: https://github.com/apache/incubator-gobblin/pull/2892#discussion_r383041046
##########
File path:
gobblin-cluster/src/main/java/org/apache/gobblin/cluster/HelixUtils.java
##########
@@ -293,6 +294,10 @@ private static void deleteStoppedHelixJob(HelixManager
helixManager, String work
Map<String, WorkflowConfig> workflowConfigMap = taskDriver.getWorkflows();
for (String workflow : workflowConfigMap.keySet()) {
WorkflowConfig workflowConfig = taskDriver.getWorkflowConfig(workflow);
+ //Filter out any stale Helix workflows which are not running.
+ if (workflowConfig.getTargetState() != TargetState.START) {
Review comment:
Thanks for this comment. The purpose of this method is two fold: 1. The
caller may want to cancel a Helix workflow given a job name and 2. The caller
may want to get the workflow id and use that to query other information such as
the workunits processed by the job. For both 1 and 2, the caller is only
interested in the active workflows. In fact, the stale workflows are
auto-pruged by Helix based on an expiry interval.
I have modified the javadoc for this method to be more explicit about which
workflows are returned.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 391448)
Time Spent: 1h (was: 50m)
> Create a spec consumer path if it does not exist in FS SpecConsumer
> -------------------------------------------------------------------
>
> Key: GOBBLIN-1052
> URL: https://issues.apache.org/jira/browse/GOBBLIN-1052
> Project: Apache Gobblin
> Issue Type: Improvement
> Components: gobblin-cluster
> Affects Versions: 0.15.0
> Reporter: Sudarshan Vasudevan
> Assignee: Hung Tran
> Priority: Major
> Fix For: 0.15.0
>
> Time Spent: 1h
> Remaining Estimate: 0h
>
> Current implementation expects the spec consumer path to already exist.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
