jscheffl commented on issue #49508: URL: https://github.com/apache/airflow/issues/49508#issuecomment-2863921228
As we have currently (and especially this week) also massive scheduling problems... I can say that with Celery we are atm able to make the heartbeat really slow... maybe another problem but the example to re-produce we could do easily atm. But I am coming back to this: Is it helping in the situation if you have multiple schedulers, e.g. 3 instances? Then even if the loop of one is done and until it gets back, some other scheduler in parallel will most probably come-along (no gurarantee though) and maybe exclude the one DAG that is hiding the other runs. Would this be a workaround? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
