Bowrna commented on PR #38400: URL: https://github.com/apache/airflow/pull/38400#issuecomment-2017270573
when setting the `dag_processing.processes` as gauge instead of the counter, we may need to initialize the value. Gauge works in the following way: gaugor:333|g the above command sets the param `gaugor` to 333 gaugor:433|g the above command sets the param `gaugor` to 433 gaugor:-10|g the above command sets the param `gaugor` to 423 gaugor:+4|g the above command sets the param `gaugor` to 427 So to keep increasing the process count as it starts and decrease the process count as it stops(finishes or timeouts or error outs), we first have to initialize it to zero value at the beginning. I could set the gauge to zero at the start of the `airflow scheduler` command. https://airflow.apache.org/docs/apache-airflow/stable/administration-and-deployment/scheduler.html#running-more-than-one-scheduler But there is an option to run more than one scheduler. so setting the param as zero in the beginning of the `airflow scheduler` command wouldn't be the right way. How do you think this case can be better handled? @potiuk @dirrao @ferruzzi @hussein-awala -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
