Scott Wegner created BEAM-575:
---------------------------------
Summary: "Latest String" Aggregator
Key: BEAM-575
URL: https://issues.apache.org/jira/browse/BEAM-575
Project: Beam
Issue Type: New Feature
Components: sdk-java-core
Reporter: Scott Wegner
Assignee: Scott Wegner
Beam SDK recently gained support for "display data", which is construction-time
metadata about a pipeline. Display data is limited in that it doesn't provide a
way to publish runtime metadata.
Aggregators are the current method for pipelines to publish runtime metadata,
but currently focuses on counter-type metadata. It would be valuable to expand
the support for dynamically-computed properties like "pub-sub subscription id"
or "sink export job status". This would fit nicely into the aggregators API by
providing a "Latest" combiner with String-typed data.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)