potiuk commented on issue #20974: URL: https://github.com/apache/airflow/issues/20974#issuecomment-3042335832
BTW. Now you might start to understand, why we generalized things to "arguments must be serializable" when we set some conditions on what can be passed as parameters :D It's really hard problem to have a complete and comprehensive explanation on. Big thing is to understand that you have two completely different interpreters - possibly running with completely different Python and dependency versions and you need to have object from one interpreter passed to the other interpreter. In Airflow 3 it is easier - becuase - by definition - context has to be serialized to be passed through Task SDK - we are using fast_api with Pydantic to send context from the server to the task - but it also means that context is "poorer" in Airflow 3 and some things that worked in Context of Airflow 2 do not work any more in Airflow 3. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
