Scott Wegner created BEAM-575:
---------------------------------

             Summary: "Latest String" Aggregator
                 Key: BEAM-575
                 URL: https://issues.apache.org/jira/browse/BEAM-575
             Project: Beam
          Issue Type: New Feature
          Components: sdk-java-core
            Reporter: Scott Wegner
            Assignee: Scott Wegner


Beam SDK recently gained support for "display data", which is construction-time 
metadata about a pipeline. Display data is limited in that it doesn't provide a 
way to publish runtime metadata.

Aggregators are the current method for pipelines to publish runtime metadata, 
but currently focuses on counter-type metadata. It would be valuable to expand 
the support for dynamically-computed properties like "pub-sub subscription id" 
or "sink export job status". This would fit nicely into the aggregators API by 
providing a "Latest" combiner with String-typed data.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to