carols10cents opened a new issue #1832: URL: https://github.com/apache/arrow-datafusion/issues/1832
Hi, over in [influxdb_iox](https://github.com/influxdata/influxdb_iox), we have a need to serialize a data structure containing `datafusion::logical_plan::Expr`s using protobuf. [We have a solution](https://github.com/influxdata/influxdb_iox/pull/3707) inspired by the serialization in ballista. We don't currently depend on ballista, though, and the datafusion-specific serialization might be useful to other projects besides IOx. Also, I see recent commits to the serialization here, and it makes more sense for this logic to live with datafusion rather than have us try to chase datafusion out of tree. **Describe the solution you'd like** - A crate named something like `datafusion-serialization` that implements serialization of `datafusion::logical_plan::Expr` data structures to and from protobuf, that both ballista and other projects could use. **Describe alternatives you've considered** - IOx and other projects maintain their own serialization logic - Depend on all of ballista to only use the protobuf serialization implementations **Additional context** I think this would fit in nicely with the currently ongoing efforts to split datafusion into smaller crates! I'm planning on working on a PR for this, but I wanted to open the issue in the meantime in case anyone has any concerns or discussion! cc @alamb -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
