[
https://issues.apache.org/jira/browse/BEAM-12401?focusedWorklogId=634514&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-634514
]
ASF GitHub Bot logged work on BEAM-12401:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 05/Aug/21 12:10
Start Date: 05/Aug/21 12:10
Worklog Time Spent: 10m
Work Description: dmvk closed pull request #14978:
URL: https://github.com/apache/beam/pull/14978
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 634514)
Time Spent: 1h 10m (was: 1h)
> Beam metrics are unreadable in Flink history server
> ---------------------------------------------------
>
> Key: BEAM-12401
> URL: https://issues.apache.org/jira/browse/BEAM-12401
> Project: Beam
> Issue Type: Improvement
> Components: runner-flink
> Reporter: David Janicek
> Priority: P2
> Labels: stale-P2
> Time Spent: 1h 10m
> Remaining Estimate: 0h
>
> Beam metric values (payload) are not readable in Flink's web UI and Flink
> history server. Similar problem affected Spark history server and it was
> resolved in BEAM-10294.
> Beam metrics are rendered by *MetricsContainerStepMap.toString()* method as
> JSON which is created from protobuffer defined in *metrics.proto* where
> metric's value is defined as bytes.
> For example, metrics in Flink web UI used to look like:
> {code:java}
> MetricQueryResults(Counters(sets-by-key-bloomfilter/filter-by-bloom-filter/ParMultiDo(FilterByBloomFilter):org.apache.beam.sdk.extensions.sketching.BloomFilters$FilterByBloomFilterFn:filtered-out:
> 123456789)){code}
> Now they look like:
> {code:java}
> {\n \"metrics\": {\n \"attempted\": [{\n \"urn\":
> \"beam:metric:user:sum_int64:v1\",\n \"type\":
> \"beam:metrics:sum_int64:v1\",\n \"payload\": \"ip0K\",\n \"labels\": {\n
> \"NAMESPACE\": \"ImageClicksReader\",\n \"NAME\": \"filtered-out\",\n
> \"PTRANSFORM\":
> \"sets-by-key-bloomfilter/filter-by-bloom-filter/ParMultiDo(FilterByBloomFilter\"\n
> }\n } \n} \n}{code}
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
