alamb commented on issue #11413: URL: https://github.com/apache/datafusion/issues/11413#issuecomment-2232894441
> Btw... the `ColumnarValue` introduced into datafusion 2 years ago. Considering: > > * `ColumnarValue` are always paired use with `SchemaRef` > * RecordBatches are one or more `ColumnarValues` with schema. > > Will it be better to use RecordBatches instead of ColumnValues in PhysicalExpr evaluate function? It will provide finely integrations with arrow-rs eco system. One thing that ColumnarValue does well is represent single values efficiently (aka `ScalarValue`) which is a very important optimization for performance I don't see any fundamental reason we couldn't use RecordBatch if we figured out a better way to represent single row -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org