[
https://issues.apache.org/jira/browse/GOBBLIN-1516?focusedWorklogId=638377&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-638377
]
ASF GitHub Bot logged work on GOBBLIN-1516:
-------------------------------------------
Author: ASF GitHub Bot
Created on: 16/Aug/21 19:44
Start Date: 16/Aug/21 19:44
Worklog Time Spent: 10m
Work Description: sv2000 commented on a change in pull request #3365:
URL: https://github.com/apache/gobblin/pull/3365#discussion_r689810471
##########
File path:
gobblin-cluster/src/main/java/org/apache/gobblin/cluster/GobblinHelixTaskStateTracker.java
##########
@@ -61,7 +61,9 @@ public GobblinHelixTaskStateTracker(Properties properties) {
@Override
public void registerNewTask(Task task) {
try {
- this.scheduledReporters.put(task.getTaskId(),
scheduleTaskMetricsUpdater(new TaskMetricsUpdater(task), task));
+ if (GobblinMetrics.isEnabled(task.getTaskState().getWorkunit())) {
+ this.scheduledReporters.put(task.getTaskId(),
scheduleTaskMetricsUpdater(new TaskMetricsUpdater(task), task));
Review comment:
I think a better approach might be to not create one metrics updater per
task, and create a single updater instead, which iterates over all the tasks
and updates records/bytes written.
##########
File path:
gobblin-cluster/src/main/java/org/apache/gobblin/cluster/GobblinHelixTaskStateTracker.java
##########
@@ -61,7 +61,9 @@ public GobblinHelixTaskStateTracker(Properties properties) {
@Override
public void registerNewTask(Task task) {
try {
- this.scheduledReporters.put(task.getTaskId(),
scheduleTaskMetricsUpdater(new TaskMetricsUpdater(task), task));
+ if (GobblinMetrics.isEnabled(task.getTaskState().getWorkunit())) {
+ this.scheduledReporters.put(task.getTaskId(),
scheduleTaskMetricsUpdater(new TaskMetricsUpdater(task), task));
Review comment:
Using the global "metrics.enabled" key to turn off task metrics
reporting seems too heavy. This global config will turn off other reporting as
well, e.g. GTEs, and other metrics.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 638377)
Time Spent: 1h (was: 50m)
> Only schedule TaskMetricsUpdateder when metric-reporting is enabled by config
> -----------------------------------------------------------------------------
>
> Key: GOBBLIN-1516
> URL: https://issues.apache.org/jira/browse/GOBBLIN-1516
> Project: Apache Gobblin
> Issue Type: Bug
> Reporter: Lei Sun
> Priority: Major
> Time Spent: 1h
> Remaining Estimate: 0h
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
