potiuk commented on issue #37809: URL: https://github.com/apache/airflow/issues/37809#issuecomment-1973475005
Some of your operators are storing some fields whaicah are unpicklable, but it's hard to say which ones. Unfortunately they are set in the way that does not reveal which fields they are - and which objects - you need to track which tasks / operators are doing it and find out what "unpicklable" objects they set. Unfortunately - this is Python so if someone has custom DAG code and operators that set a state that cannot be pickled. this might happen. You must look for it i the code of your DAGs, I am afraid. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
