kezhenxu94 commented on issue #10525: URL: https://github.com/apache/dolphinscheduler/issues/10525#issuecomment-1168318015
> > Hi @EricGao888 , what kind of dynamic metrics do we have? You know, to fully use these metrics we need to display them and configure in Grafana, if we don't know these metrics in advance, how to configure these and use these metrics? Can you give some examples that we need dynamic metrics? > > @kezhenxu94 Thanks for the reply! > > Considering the following scenario: some user A works for a big financial company, and A chooses to use DS to schedule ETL tasks. Some of these tasks are not that important, but some are crucial, which may strongly relate to their financial business. Therefore, A wants some metrics to monitor these specific VIP tasks to avoid breaching SLAs for their customers. For example, task running duration, retry times, failover times, etc. > > To easily configure these dynamic metrics, we could name them as ds.dynamic.task.<task_id>.duration. Since A does not need to monitor dynamic metrics for every tasks, just the VIP ones, he could configure those metrics in grafana manually. > > But indeed, there is a concern that how users could get the task_id / workflow_id. Hi, task id can be added as tags and the users can filter by tags when configuring Grafana. Also, is task ID constant and won't change between different executions? If they change it's impractical to configure these constantly changing IDs. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
