Nataneljpwd commented on issue #61741: URL: https://github.com/apache/airflow/issues/61741#issuecomment-3887259983
I have investigated the issue and I have found the root cause, being that the serializer cannot serialize the logger, in addition to the logger, it also cannot serialize the cached template context, so both need to be removed before pickling, and even then, when it tries to unpickle and render the task, the task-sdk seems to be unavailable in the process, no matter what I tried, the solution involves either changing the BaseOperator to a serializable BaseOperator (i.e RuntimeBaseOperator) which is quite a big change to be able to serialize the task_instances, I think that if we find it as worth it, I will implement the logic to change the BaseOperator to RuntimeBaseOperator -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
