nealrichardson commented on pull request #11369: URL: https://github.com/apache/arrow/pull/11369#issuecomment-942745047
> The downside here is that `Array$create(x)` might have to deal with the situation of `x` being an altrep backed by a `ChunkedArray` of n chunks, but it wants to create an `Array` so in that case a concatenation is done (this should not happen much). Right, and in the cases where this might happen (e.g. you've done `read_parquet()` and get a data.frame of altrep vectors backed by ChunkedArrays, and then somehow you choose to turn that data.frame into a RecordBatch), you otherwise would have done that concatenation already when you made the data.frame. So this doesn't concern me. > Perhaps we could have some R visible function that would either make an `Array` or a `ChunkedArray`. I'm not sure how useful that would be. There was/is a part of the pyarrow converter that could return either Array or ChunkedArray (I think this was with strings, and instead of promoting to LargeString they were chunking), and I believe this caused lots of headaches. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
