[
https://issues.apache.org/jira/browse/BEAM-8314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16938187#comment-16938187
]
Yichi Zhang commented on BEAM-8314:
-----------------------------------
CC: [~markflyhigh] [~angoenka]
> Beam Fn Api metrics piling causes pipeline to stuck after running for a while
> -----------------------------------------------------------------------------
>
> Key: BEAM-8314
> URL: https://issues.apache.org/jira/browse/BEAM-8314
> Project: Beam
> Issue Type: Bug
> Components: runner-dataflow
> Reporter: Yichi Zhang
> Priority: Blocker
> Fix For: 2.16.0
>
>
> Seems that in StreamingDataflowWorker we are not able to update the metrics
> fast enough to dataflow service, the piling metrics causes memory usage to
> increase and eventually leads to excessive memory thrashing/GC. And it will
> almost stop the pipeline from processing new items.
>
> https://pantheon.corp.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-09-25_17_47_17-1934265625846707281?project=google.com:clouddfe
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
