Etienne Chauchot created BEAM-9065:
--------------------------------------
Summary: metrics are not reset upon init
Key: BEAM-9065
URL: https://issues.apache.org/jira/browse/BEAM-9065
Project: Beam
Issue Type: Bug
Components: runner-spark
Reporter: Etienne Chauchot
Assignee: Etienne Chauchot
When pipeline.run() is called, MetricsAccumulator (wrapper of
MetricsContainerStepMap spark accumulator) is initialized. Spark needs this
class to be a singleton for failover. The problem is that when several
pipelines are run inside the same JVM, the initialization of MetricsAccumulator
singleton does not reset the underlying spark accumulator causing metrics to
be accumulated between runs.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
