[
https://issues.apache.org/jira/browse/ARROW-8059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17056251#comment-17056251
]
Joris Van den Bossche commented on ARROW-8059:
----------------------------------------------
Specifically for dask's usecase, it might also make sense for them to send just
a string path to their workers, in case of a local file system.
But in general, I think one would assume that it is deserialized on the same
machine (so the path references the same file).
> [Python] Make FileSystem objects serializable
> ---------------------------------------------
>
> Key: ARROW-8059
> URL: https://issues.apache.org/jira/browse/ARROW-8059
> Project: Apache Arrow
> Issue Type: Improvement
> Components: Python
> Reporter: Joris Van den Bossche
> Priority: Major
> Fix For: 0.17.0
>
>
> It would be good to be able to pickle {{pyarrow.fs.FileSystem}} objects (eg
> for use in dask.distributed)
> cc [~apitrou]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
