paleolimbot commented on issue #27499: URL: https://github.com/apache/arrow/issues/27499#issuecomment-1495885584
> I would have to add some redundant metadata such as putting it in a 1-column, 1-row table which I don't particularly want to do It is true, that's what the tradeoff is. In memory and in an IPC/feather file it's still just a bunch of memory-mapped bytes, and with the extension type version you would also have the ability to zero-copy ship it to Python/Rust/Java/Whatever (whereas that's not supported and will may never be supported). You could start a PR with the prototype I linked above...the final version is still in review but at the R level it will still be an R6 class with the same methods as the C++ class ( https://github.com/apache/arrow/pull/8510/files#diff-2961e877000b1d44dd785688a0bda16061d7536facc15d762d412ea18875609d ). The final version might look more like the `FixedSizeListType` class: https://github.com/apache/arrow/blob/main/r/R/type.R#L683-L699 ; however, the "convert from R matrix/array" and "convert to R matrix/array" can (and maybe should) be implemented in R. We will also need tests, and with an R prototype we can write those tests so that when the C++ version is merged we're ready to go. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
