kaxil commented on PR #48517:
URL: https://github.com/apache/airflow/pull/48517#issuecomment-2762760743
> I mean okay, but what is actually using pickle in our path?
>
> What is trying to pickle the exception in the first place
It is coming from Local Executor, specifically the following block:
https://github.com/apache/airflow/blob/831f12ad7e2cff25c8007583521d664a5e9f21e6/airflow-core/src/airflow/executors/local_executor.py#L91-L97
When a task fails with an exception, the exception is put into the
r`esult_queue` as part of a tuple with the task key and state.
Later, in _read_results, the executor tries to read from this queue, and it
fails!!:
https://github.com/apache/airflow/blob/831f12ad7e2cff25c8007583521d664a5e9f21e6/airflow-core/src/airflow/executors/local_executor.py#L208-L210
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
