Ruoyun Huang created BEAM-9488:
----------------------------------
Summary: Python SDK sending unexpected MonitoringInfo
Key: BEAM-9488
URL: https://issues.apache.org/jira/browse/BEAM-9488
Project: Beam
Issue Type: Bug
Components: sdk-py-core
Reporter: Ruoyun Huang
element_count metrics is supposed to be tied with pcollection ids, but by
inspecting what is sent over by python sdk, we see there are monitoringInfo
sent wit ptransforms in it.
[Double checked the job graph, these seem to be redundant. i.e. the
corresponding pcollection does have its own MonitoringInfo reported.]
Likely a bug.
Proof:
urn: "beam:metric:element_count:v1"
type: "beam:metrics:sum_int_64"
metric {
counter_data {
int64_value: 1
}
}
labels {
key: "PTRANSFORM"
value: "start/MaybeReshuffle/Reshuffle/RemoveRandomKeys-ptransform-85"
}
labels {
key: "TAG"
value: "None"
}
timestamp {
seconds: 1583949073
nanos: 842402935
}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
