alamb opened a new pull request #8359: URL: https://github.com/apache/arrow/pull/8359
NOTE: this builds on #8333 and #8340 and #8346 so leaving as a draft until those are merged This PR adds basic physical expression / casting support to DataFusion. Right now, it will cause all DictionaryArray data to be unpacked into a `StringArray` for operations. Ideally, DataFusion would support direct comparison / operation on DictionaryArrays, however, there isn't the necessary support in the arrow kernels yet to do so (e.g. there is no Dictionary equality comparison kernel I could find https://github.com/apache/arrow/blob/master/rust/arrow/src/compute/kernels/comparison.rs However, this PR gets the basic queries running and I hope to contribute further optimizations as time allows and our project needs dictate. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
