[
https://issues.apache.org/jira/browse/BEAM-5212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17547274#comment-17547274
]
Kenneth Knowles commented on BEAM-5212:
---------------------------------------
This issue has been migrated to https://github.com/apache/beam/issues/19042
> Update native spark metrics
> ---------------------------
>
> Key: BEAM-5212
> URL: https://issues.apache.org/jira/browse/BEAM-5212
> Project: Beam
> Issue Type: Improvement
> Components: runner-spark
> Reporter: Etienne Chauchot
> Priority: P3
>
> Native engine metrics are updated on {{finishBundle}} by DoFnRunners. Spark
> uses {{SimpleDoFnRunner}} that is in runner-core and thus contains nothing
> spark native. It might be good to extend {{SimpleDoFnRunner}} to add native
> metrics support just like it was done in Flink with {{DoFnRunnerWithMetrics}}
> class.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
