[
https://issues.apache.org/jira/browse/BEAM-12401?focusedWorklogId=609376&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609376
]
ASF GitHub Bot logged work on BEAM-12401:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 09/Jun/21 20:29
Start Date: 09/Jun/21 20:29
Worklog Time Spent: 10m
Work Description: ibzib commented on pull request #14978:
URL: https://github.com/apache/beam/pull/14978#issuecomment-858079273
We rely on metrics being in JSON format so the Python SDK can
[parse](https://github.com/apache/beam/blob/fd9a6bdcfcc3377e1e6f86855a108596680291a6/sdks/python/apache_beam/runners/portability/flink_uber_jar_job_server.py#L99)
them. Can we find a way to solve BEAM-11212 so we can avoid breaking this
functionality?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 609376)
Time Spent: 50m (was: 40m)
> Beam metrics are unreadable in Flink history server
> ---------------------------------------------------
>
> Key: BEAM-12401
> URL: https://issues.apache.org/jira/browse/BEAM-12401
> Project: Beam
> Issue Type: Improvement
> Components: runner-flink
> Reporter: David Janicek
> Priority: P2
> Time Spent: 50m
> Remaining Estimate: 0h
>
> Beam metric values (payload) are not readable in Flink's web UI and Flink
> history server. Similar problem affected Spark history server and it was
> resolved in BEAM-10294.
> Beam metrics are rendered by *MetricsContainerStepMap.toString()* method as
> JSON which is created from protobuffer defined in *metrics.proto* where
> metric's value is defined as bytes.
> For example, metrics in Flink web UI used to look like:
> {code:java}
> MetricQueryResults(Counters(sets-by-key-bloomfilter/filter-by-bloom-filter/ParMultiDo(FilterByBloomFilter):org.apache.beam.sdk.extensions.sketching.BloomFilters$FilterByBloomFilterFn:filtered-out:
> 123456789)){code}
> Now they look like:
> {code:java}
> {\n \"metrics\": {\n \"attempted\": [{\n \"urn\":
> \"beam:metric:user:sum_int64:v1\",\n \"type\":
> \"beam:metrics:sum_int64:v1\",\n \"payload\": \"ip0K\",\n \"labels\": {\n
> \"NAMESPACE\": \"ImageClicksReader\",\n \"NAME\": \"filtered-out\",\n
> \"PTRANSFORM\":
> \"sets-by-key-bloomfilter/filter-by-bloom-filter/ParMultiDo(FilterByBloomFilter\"\n
> }\n } \n} \n}{code}
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
