parthchandra opened a new pull request, #1034: URL: https://github.com/apache/datafusion-comet/pull/1034
## Which issue does this PR close? Closes #708 ## Rationale for this change Columnar to row operation is really slow and this attempts to speed it up. ## What changes are included in this PR? Implements a native columnar to row operation for integer and floating point types. Variable length types can be added later. The implementation allocates an off-heap buffer large enough to hold an entire batch of `UnsafeRow`s, passes it in to the native layer which converts the Arrow vectors into `UnsafeRow`s and puts them into the allocated buffer. The JVM code then simply points its `UnsafeRow`s to the underlying buffer. The native conversion copies the data from the arrow vector into the UnsafeRows. This is currently the performance bottleneck. ## How are these changes tested? Additional unit test. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
