alamb commented on issue #11736: URL: https://github.com/apache/datafusion/issues/11736#issuecomment-2263962014
> I think we could. But serializing exprs seems cheaper as the generated record batch might be large. In the other hand, many Exprs may be expensive too -- I bet that for small/medium sized values `Expr` would be better as the overhead of a `RecordBatch` will be non trivial. But then as the number of rows increases at some point serializing the RecordBatch would be better I bet it would be straightforward to test using https://docs.rs/arrow-ipc/52.2.0/arrow_ipc/writer/struct.StreamWriter.html to write to a `vec` (I was hoping for a nice example but seems like the docs aren't great yet) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
