cccs-seb commented on issue #23901: URL: https://github.com/apache/airflow/issues/23901#issuecomment-1136401780
Upon further investigation, it seems like running blocking code (e.g. time.sleep) in the callable will prevent the AirflowTaskTimeout error from bubbling up until the subprocess ends - which prevents execution_timeout from working as intended. I've experimented with using subprocess' poll() here https://github.com/apache/airflow/blob/1bf6dded9a5dcc22238b8943028b08741e36dfe5/airflow/utils/process_utils.py#L181, which seems to work at exiting the read process. Not sure how this would affect other parts of the code though -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
