Jorricks opened a new pull request #16633: URL: https://github.com/apache/airflow/pull/16633
Currently custom classes implementing BaseOperators get_serialized_fields() can be primitive types. If you try to add a complex type, it will fail on the _deserialize() step with a KeyError. However, the current serialisation is amazing and supports many complex types. This PR makes these complex types available to extra fields used by custom classes extending upon the BaseOperator or the DAG classes. Example use-case: A plugin loads the DagBag and wants to access the custom operators fields. Currently, we would still need to fully load it (without serialisation) to access these fields. This PR would improve the webserver performance a lot for views that require this. Note: This PR was copied [from #16554 but something went wrong during rebasing](https://github.com/apache/airflow/pull/16554) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
