potiuk commented on PR #25121: URL: https://github.com/apache/airflow/pull/25121#issuecomment-1191189421
I know @jedcunningham you had reservation about putting that out now. I thought a bit about it and I added one more chapter about "experimental" status of the practice - with lots of reservations and disclaimers. If you think this is fine now @jedcunningham @BasPH - I will look at the robust solution in #25161 (and then we can think if we want to add any kind of __future__ approach. I think there is very little harm in adding the documentation about it even now with the "complex" code - as this will help some users and they will at least know that there is a possibility of such optimization. The problem is real and serious - the more dynamic dags people will use, the more similiar solution will be needed, so I prefer even to get some issues from people who tried and fail, so that we can possibly see if we can optimize it even further or maybe even add some other solutions in the future. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
