jscheffl commented on issue #35806: URL: https://github.com/apache/airflow/issues/35806#issuecomment-1824972361
Thanks for the analysis and the details shared! This helps understanding your concerns directly. Regarding (1): I underatand Regarding (2) I believe the standard in async is really to have short living calls or IO made with async libs. Async code shall not block for IO or include sleeps or heavy crunching. Per default if debug mode is enabled, async calls are generating warnings starting with 100ms. I would not recommend setting a higher default else the effectiveness of the triggerer is reduced if "bad code" is incrementially provided. I'd rather follow (3) Regarding (3): this is reasonable. Some questions: Is a CPU limit of <=1 a strong requirement on your side? If you are not using deferred tasks, have you thought about disabling triggerer at-all? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
