[
https://issues.apache.org/jira/browse/BEAM-10681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kyle Weaver updated BEAM-10681:
-------------------------------
Fix Version/s: Not applicable
Resolution: Fixed
Status: Resolved (was: Resolved)
> Spark portable runner should mark metrics supported
> ---------------------------------------------------
>
> Key: BEAM-10681
> URL: https://issues.apache.org/jira/browse/BEAM-10681
> Project: Beam
> Issue Type: Improvement
> Components: runner-spark
> Reporter: Kyle Weaver
> Assignee: Kyle Weaver
> Priority: P2
> Labels: portability-spark
> Fix For: Not applicable
>
> Time Spent: 50m
> Remaining Estimate: 0h
>
> For some reason, the Spark portable runner marks metrics as not enabled, even
> though metrics are actually supported [1]. This field is not widely used, but
> it does affect whether TestPipeline checks the number of PAsserts that
> succeeded [2].
> [1]
> https://github.com/apache/beam/blob/56193a66fd17e3d8e40d486ee113201c2661070d/runners/spark/src/main/java/org/apache/beam/runners/spark/SparkPipelineRunner.java#L113
> [2]
> https://github.com/apache/beam/blob/ef533ee9ff2511d37563e01f0430de0ec1e61004/sdks/java/core/src/main/java/org/apache/beam/sdk/testing/TestPipeline.java#L495
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
