[
https://issues.apache.org/jira/browse/BEAM-6374?focusedWorklogId=635973&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-635973
]
ASF GitHub Bot logged work on BEAM-6374:
----------------------------------------
Author: ASF GitHub Bot
Created on: 09/Aug/21 17:31
Start Date: 09/Aug/21 17:31
Worklog Time Spent: 10m
Work Description: lostluck commented on a change in pull request #15289:
URL: https://github.com/apache/beam/pull/15289#discussion_r685387873
##########
File path: sdks/go/pkg/beam/core/runtime/harness/harness.go
##########
@@ -305,7 +313,7 @@ func (c *control) handleInstruction(ctx context.Context,
req *fnpb.InstructionRe
data.Close()
state.Close()
- mons, pylds := monitoring(plan)
+ mons, pylds := monitoring(plan, store)
Review comment:
I tried only having the payloads, but Dataflow doesn't produce the
metrics at all then, so we'll keep the monitoring infos around until Dataflow
handles only payloads properly.
There might be an experiment to toggle to fix this, but there's no harm in
the SDK waiting for the default to switch (other than the wire cost of not
being exclusively on the short id requests & payload duplication).
See
https://console.cloud.google.com/dataflow/jobs/us-central1/2021-08-09_10_24_28-7240084760069835414?project=google.com:clouddfe
which has both, vs
https://console.cloud.google.com/dataflow/jobs/us-central1/2021-08-09_10_00_52-11618126016479762400?project=google.com:clouddfe
which is just the payloads
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 635973)
Time Spent: 3h (was: 2h 50m)
> "elements added" for input and output collections is always empty
> -----------------------------------------------------------------
>
> Key: BEAM-6374
> URL: https://issues.apache.org/jira/browse/BEAM-6374
> Project: Beam
> Issue Type: Bug
> Components: runner-dataflow, sdk-go
> Reporter: Andrew Brampton
> Priority: P3
> Time Spent: 3h
> Remaining Estimate: 0h
>
> The field for "Elements added" and "Estimated size" is always blank when
> running a Go binary on Dataflow. For example when running the work count
> example: https://pasteboard.co/HVf80BU.png
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
