edrevo opened a new pull request #535:
URL: https://github.com/apache/arrow-datafusion/pull/535
# Which issue does this PR close?
Closes #534.
# Rationale for this change
The collect implementation in BallistaContext is bringing all of the
contents in memory even though there is no need for it.
# What changes are included in this PR?
Collect will now use streams all the way to avoid hogging memory
# Are there any user-facing changes?
No
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
