dabla commented on PR #55068: URL: https://github.com/apache/airflow/pull/55068#issuecomment-3531214885
> Thanks for the update! > > I haven't fully understood the whole fix yet, but the use the same setup (with latest commit from your PR). It results in that the mapped TI will now stuck in `running` state instead of `deferred` state. (For previous version, all the mapped TI will directly go to `fail` state) The reason why your TI's stay in running state is because of how your example is implemented, as the poke method always returns False, it will stay in in infinite loop within the worker thread until it times out. Also, start_from_trigger doesn't work with partial/expand, that's something that has to be done in another PR which was agreed with @uranusjr, so that also explains why is starts on a worker instead of directly on trigger, as the expand mechanism cannot be executed on the triggerer directly, is has to run on the worker to allow task expansion and render the templates there per TI. So to allow start_from_trigger to work directly during partial/expand, we will need to do some changes in how task expansion works in Airflow. Normally, you should get a warning in the loggings stating that start_from_trigger was enabled but not supported yet in partial/expand. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
