GregoryKimball commented on PR #33925: URL: https://github.com/apache/arrow/pull/33925#issuecomment-1435117456
Thank you @jorisvandenbossche for your reply. Yes, in libcudf we only have a variable-length List type. It's expensive for us to introduce a new type, so our first step to support the proposed fixed-length Tensor type would be to convert to variable-length List type. Thank you for confirming that you expect the elements could be used zero-copy. Also, thank you for your idea to use flat lists (e.g. `LIST<INT32>`) instead of nested lists to represent tensors. Unless I'm mistaken, libcudf algorithms for joins, aggregations, stream compaction, etc would all correctly operate on flattened tensors. Thank you @rok for highlighting the variable-shape Tensor type proposal. I'll take a closer look at #24858 🙏 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
