rawwar commented on issue #35529:
URL: https://github.com/apache/airflow/issues/35529#issuecomment-1925613706
I was able to identify what objects are causing the import issue with dill.
We are using dill to dump `args` and `kwargs` given to the
`PythonVirtualEnvOperator`. And, when doing this, in the `kwargs`, there are
three objects `dag_run`, `task` and `dag` which are failing to get imported
with `dill` as they are being imported from `unusual_prefix_{sha1 of file
path}_{original module name}` . I am still trying to figure about what exact
object inside the mentioned three objects is referring to the modified module
name. Not sure how useful this information is. But, I think, if I can identify
it, probably during the `dill.dump` we can try to copy the original dag module
to the venv folder with the modified file name.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
