Bowrna commented on PR #38400: URL: https://github.com/apache/airflow/pull/38400#issuecomment-2119179128
> > when setting the `dag_processing.processes` as gauge instead of the counter, we may need to initialize the value. > > ``` > > Gauge works in the following way: > > gaugor:333|g > > the above command sets the param `gaugor` to 333 > > gaugor:433|g > > the above command sets the param `gaugor` to 433 > > gaugor:-10|g > > the above command sets the param `gaugor` to 423 > > gaugor:+4|g > > the above command sets the param `gaugor` to 427 > > ``` > > > > > > > > > > > > > > > > > > > > > > > > So to keep increasing the process count as it starts and decrease the process count as it stops(finishes or timeouts or error outs), we first have to initialize it to zero value at the beginning. I could set the gauge to zero at the start of the `airflow scheduler` command. https://airflow.apache.org/docs/apache-airflow/stable/administration-and-deployment/scheduler.html#running-more-than-one-scheduler But there is an option to run more than one scheduler. so setting the param as zero in the beginning of the `airflow scheduler` command wouldn't be the right way. > > How do you think this case can be better handled? @potiuk @dirrao @ferruzzi @hussein-awala > > @ferruzzi I think I will need help with the above part. If we are changing `dag_processing.processes` with a different name to gauge, I have to find out about initializing to zero value. Your views on this would be helpful. > > Edit: I will need help in this part to get unblocked @ferruzzi do I have any update on this part? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
