uranusjr commented on PR #62922: URL: https://github.com/apache/airflow/pull/62922#issuecomment-5351958398
There’s an asymmetry on `execution_timeout`. Async sub-tasks enforce this with `wait_for(..., timeout=execution_timeout)`, but sync sub-task don’t since TimeoutPosix only works in the main thread. I don't think there's a clean fix, so I'd suggest (a) document it as a limitation in the IterableOperator docstring, and (b) emit a clear warning/error when a sync operator with execution_timeout is iterated, rather than relying on the generic per-execution TimeoutPosix warning. A test asserting the async path times out (and pinning the sync behavior) would keep it from silently regressing. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
