Kyle Weaver created BEAM-10681:
----------------------------------
Summary: Spark portable runner should mark metrics supported
Key: BEAM-10681
URL: https://issues.apache.org/jira/browse/BEAM-10681
Project: Beam
Issue Type: Improvement
Components: runner-spark
Reporter: Kyle Weaver
For some reason, the Spark portable runner marks metrics as not enabled, even
though metrics are actually supported [1]. This field is not widely used, but
it does affect whether TestPipeline checks the number of PAsserts that
succeeded [2].
[1]
https://github.com/apache/beam/blob/56193a66fd17e3d8e40d486ee113201c2661070d/runners/spark/src/main/java/org/apache/beam/runners/spark/SparkPipelineRunner.java#L113
[2]
https://github.com/apache/beam/blob/ef533ee9ff2511d37563e01f0430de0ec1e61004/sdks/java/core/src/main/java/org/apache/beam/sdk/testing/TestPipeline.java#L495
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
