klin333 commented on issue #822: URL: https://github.com/apache/arrow-nanoarrow/issues/822#issuecomment-3514883918
ok, so now i think we have two viable solutions to my initial github issue of slow `as.data.frame(nanoarrow_array_stream)`, ie slow `convert_array_stream`: 1. collect array stream to batches of arrays in R, then nanoarrow_c_convert_array, then bind rows in R 2. calculate array stream total length and restream both in C in order to avoid crossing the C/R boundary, then nanoarrow_c_convert_array_stream with calculated total length Both methods avoid the `.Call(nanoarrow_c_basic_array_stream, batches)` which blows up gc(). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
