paleolimbot commented on PR #13650: URL: https://github.com/apache/arrow/pull/13650#issuecomment-1192866612
It is a bit alarming...it's because some exec plans that end in `head()` rely on an R-level RecordBatchReader where the ExecPlan is executing stuff in the background. The user-defined functions PR only works when we evaluate the whole plan into a table (so that we can guarantee all the R function calls have happened before we hop out of the event loop). I have ARROW-17178 for the follow-up to fix it, but it sounds like it would be best to add a `lazy` argument with a default that mirrors the current behaviour so that users can opt-in to the even *more* experimental behaviour. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
