jscheffl commented on code in PR #58803:
URL: https://github.com/apache/airflow/pull/58803#discussion_r2595190936
##########
airflow-core/src/airflow/config_templates/config.yml:
##########
@@ -2324,6 +2324,15 @@ triggerer:
type: float
example: ~
default: "30"
+ max_trigger_to_select_per_loop:
+ description: |
+ Maximum number of triggers to select per loop. Set this notably lower
than ``[triggerer] capacity``
+ to keep load balanced across triggerers in HA deployments.
+ Benchmarks show that two triggerers can still claim about 1,000
triggers within one second by default.
+ version_added: 3.2.0
+ type: integer
+ example: ~
+ default: "10"
Review Comment:
How do you get to 10 as default being a good value? This would mean the
triggerer need to loop 100 times to get 1000 jobs or 5 triggerers each loop 20
times to pick-up 1000 jobs?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
