Jorricks opened a new pull request #16554: URL: https://github.com/apache/airflow/pull/16554
Currently custom classes implementing BaseOperators `get_serialized_fields()` can be primitive types. If you try to add a complex type, it will fail on the `_deserialize()` step with a KeyError. However, the current serialisation is amazing and supports many complex types. This PR makes these complex types available to extra fields used by custom classes extending upon the BaseOperator or the DAG classes. Example use-case: A plugin loads the DagBag and wants to access the custom operators fields. Currently, we would still need to fully load it (without serialisation) to access these fields. This PR would improve the webserver performance a lot for views that require this. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
