[
https://issues.apache.org/jira/browse/BEAM-6375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16736071#comment-16736071
]
Robert Burke commented on BEAM-6375:
------------------------------------
I suspect this has to do with that ParDos don't currently communicate work
estimates and similar to the runner. IIRC [[email protected]] is intending to
work on that in the next few months as part of updating Portable Metrics
handling.
> Walltime seems incorrect with the Go SDK and Dataflow
> -----------------------------------------------------
>
> Key: BEAM-6375
> URL: https://issues.apache.org/jira/browse/BEAM-6375
> Project: Beam
> Issue Type: Bug
> Components: runner-dataflow, sdk-go
> Reporter: Andrew Brampton
> Assignee: Robert Burke
> Priority: Major
>
> The pipeline takes hours to run, but the walltime for each step is in
> seconds. For example, this pipeline took 22 hours, but no stage too more than
> 3 seconds: https://pasteboard.co/HVf8PCp.png
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
