[
https://issues.apache.org/jira/browse/BEAM-3808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16471289#comment-16471289
]
Andrea Foegler commented on BEAM-3808:
--------------------------------------
For users running on Dataflow, their VM metrics are now being exported to
Stackdriver with a Label indicating the job name, which will allow us to vastly
improve the monitoring experience for these resources. Unfortunately, this
benefit will not be available to many users unless they override the default
name to meet the Label spec.
This is a Dataflow specific need, but I imagine a short, simple name might be a
requirement for other external monitoring tools and so hopefully this
shortening is valuable for non-Dataflow users as well.
> Dataflow Jobs meet Cloud Label Spec
> -----------------------------------
>
> Key: BEAM-3808
> URL: https://issues.apache.org/jira/browse/BEAM-3808
> Project: Beam
> Issue Type: Improvement
> Components: runner-dataflow
> Reporter: Andrea Foegler
> Assignee: Thomas Groh
> Priority: Major
>
> Dataflow Job Names should meet Cloud Label Specifications:
> [https://cloud.google.com/resource-manager/docs/creating-managing-labels]
> This will allow Dataflow users to organize resources according to the
> Dataflow Job using those resources. The Dataflow Service will be able to
> automatically associate accessed and consumed resources and associated
> metrics to support streamlined monitoring and analysis of these resources, in
> particular GCE instance usage metrics.
> Potential Issues: Some current users appear to encode a lot of data in their
> job names. Need to identify if applying this restriction breaks any
> necessary use cases and verify an alternative is available before proceeding.
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
