[
https://issues.apache.org/jira/browse/GOBBLIN-2014?focusedWorklogId=909295&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-909295
]
ASF GitHub Bot logged work on GOBBLIN-2014:
-------------------------------------------
Author: ASF GitHub Bot
Created on: 11/Mar/24 22:18
Start Date: 11/Mar/24 22:18
Worklog Time Spent: 10m
Work Description: phet commented on code in PR #3894:
URL: https://github.com/apache/gobblin/pull/3894#discussion_r1520489476
##########
gobblin-temporal/src/main/java/org/apache/gobblin/temporal/ddm/launcher/ExecuteGobblinJobLauncher.java:
##########
@@ -84,13 +87,46 @@ public void submitJob(List<WorkUnit> workunits) {
Config jobConfigWithOverrides =
applyJobLauncherOverrides(ConfigUtils.propertiesToConfig(this.jobProps));
Help.propagateGaaSFlowExecutionContext(this.jobProps);
-
- EventSubmitterContext eventSubmitterContext = new
EventSubmitterContext(this.eventSubmitter);
-
+ EventSubmitterContext eventSubmitterContext = new EventSubmitterContext(
+ addAdditionalMetadataTags(this.jobProps,
this.eventSubmitter.getTags()),
+ eventSubmitter.getNamespace()
+ );
int numWorkUnits =
workflow.execute(ConfigUtils.configToProperties(jobConfigWithOverrides),
eventSubmitterContext);
log.info("FINISHED - ExecuteGobblinWorkflow.execute = {}", numWorkUnits);
} catch (Exception e) {
throw new RuntimeException(e);
}
}
+
+ private static List<Tag<?>> addAdditionalMetadataTags(Properties jobProps,
List<Tag<?>> additionalTags) {
Review Comment:
if this be core gobblin-on-temporal stuff, how about a method of
`EventSubmitterContext`?
e.g. call as:
```
EventSubmitterContext eventSubmitterContext =
new
EventSubmitterContext(this.eventSubmitter).withAugmentedMetadata(this.jobProps);
```
(`withAugmentedMetadata` would return a new `EventSubmitterContext` that's
updated to have the new `Tag`s).
Issue Time Tracking
-------------------
Worklog Id: (was: 909295)
Time Spent: 50m (was: 40m)
> Add metadata tags for events sent from Temporal to be parseable in GaaS
> -----------------------------------------------------------------------
>
> Key: GOBBLIN-2014
> URL: https://issues.apache.org/jira/browse/GOBBLIN-2014
> Project: Apache Gobblin
> Issue Type: Bug
> Components: gobblin-service
> Reporter: William Lo
> Assignee: Abhishek Tiwari
> Priority: Major
> Time Spent: 50m
> Remaining Estimate: 0h
>
> Gobblin's Temporal workflow launches through `ExecuteGobblinJobLauncher`, but
> the eventSubmitter created in that class does not have the necessary metadata
> needed in order to send events to GaaS.
> We want to populate the additional tags to read from the job props that
> contain the information needed for these events to be readable from GaaS.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
