paleolimbot commented on issue #936: URL: https://github.com/apache/datafusion-python/issues/936#issuecomment-2916913205
Just two things I was involved in that may be useful here: - `cudf::from_arrow()`: https://github.com/rapidsai/cudf/blob/2789fa83d943649b982493d68bbba852f848d82c/cpp/include/cudf/interop.hpp#L677-L698 - https://github.com/apache/arrow-nanoarrow/blob/fe0e3a2745952c7bd415fdf09bda2a869bf1390a/src/nanoarrow/nanoarrow_device.h#L278-L288 Probably integrating at a higher level than those makes sense (e.g., converting expressions), since the trick of optimizing data transfer to/from the GPU is sort of insane. The nanoarrow version also includes a (probably oudated) Apple Metal backend, which is potentially easier to integrate because you can use the same memory addresses space for the buffers (or I could, the last time I tried this). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
