[
https://issues.apache.org/jira/browse/ARROW-11103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17257291#comment-17257291
]
GANG LIAO edited comment on ARROW-11103 at 1/2/21, 5:11 AM:
------------------------------------------------------------
I found that Arrow’s data type and schema both support serialization into JSON
([https://github.com/apache/arrow/pull/3016/files]). Can the community also
support the physical plan serialization? Or are there other challenges?
If datafusion does not support serialization, we can only extend it externally
via this post:
[https://serde.rs/deserialize-struct.html#manually-implementing-deserialize-for-a-struct]
was (Author: gangliao):
I found that Arrow’s data type and schema both support serialization into JSON
([https://github.com/apache/arrow/pull/3016/files]). Can the community also
support the physical plan serialization? Or are there other challenges?
If datafusion does not support serialization, we can only extend it externally
via this post: [https://serde.rs/impl-serializer.html#implementing-a-serializer]
> [Rust] [DataFusion] serialize and deserialize physical plan by serde
> --------------------------------------------------------------------
>
> Key: ARROW-11103
> URL: https://issues.apache.org/jira/browse/ARROW-11103
> Project: Apache Arrow
> Issue Type: Wish
> Reporter: GANG LIAO
> Priority: Critical
>
> It is important to send part of the generated physical plan to other servers
> over the network for distributed computation.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
