dstandish commented on issue #41891: URL: https://github.com/apache/airflow/issues/41891#issuecomment-2322084734
yeah `_task_event_logs` is just a deque that is there so that the executor can pass messages for the scheduler to consume. it's there because the executor does not have access to the `session` object (somewhat surprisingly!) so it cannot write log events. so when the executor notices something that has to be logged, it dumps to the queue and the scheduler consumes the queue as part of executor processing. so it's not really a problem for hybrid executors. but anyway, i am making progress on making them inherit. nice thing about doing this is this can be fixed for customers with a provider release. but we could also look at patching the scheduler in 2.10.x 🤷 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
