eitsupi commented on issue #331: URL: https://github.com/apache/arrow-nanoarrow/issues/331#issuecomment-2120623415
Thanks for your reply. I imagined that in Apache Arrow's documentation it would recommend the use of certain attributes. That is, objects that can export Streams at low cost (such as arrow Table and polars DataFrame) have such an attribute. I was thinking about this because I was wondering if I should allow the conversion from `data.frame` to `nanoarrow_array_stream` in the following place. (Search for the name in the query of GlareDB from within the environment, convert it to a memory table of DataFusion, register it, and then execute the query.) https://github.com/eitsupi/r-glaredb/blob/142bcc1d3a91229a6cd3fda7711ac3732f34c1bb/src/rust/src/environment.rs#L68-L92 Given that duckdb on Python does a conversion from `polars.LazyFrame` to `pyarrow.Table` when the name of the LazyFrame instance is in the query (which can obviously take a long time), it may not be a problem to allow this, though. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
