avantgardnerio commented on PR #3955: URL: https://github.com/apache/arrow-datafusion/pull/3955#issuecomment-1290797135
> with spawn blocking. This is [the PR](https://github.com/delta-io/delta-rs/pull/892) in question. This is the [deserialization line of code](https://github.com/spaceandtimelabs/delta-rs/blob/9c6918f73f8f67e03a8f7db6ae002e786c867c0c/rust/src/delta_datafusion.rs#L832) that calls the [async method](https://github.com/spaceandtimelabs/delta-rs/blob/9c6918f73f8f67e03a8f7db6ae002e786c867c0c/rust/src/delta_datafusion.rs#L858). If you know another way to do this, I would be open to specific recommendations. I don't understand how spawn blocking would help, but I am open to it. The only other option I was able to think of is to serialize the whole state of the `DeltaTable` including the `ObjectStore` config and the JSON history of the delta log. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
