mingmwang commented on issue #342: URL: https://github.com/apache/arrow-ballista/issues/342#issuecomment-1276435343
One quick question regarding this, after those dataset are copied to each work, should they kept in-memory or spilled to disk, if keep them in memory for a while, memory usage might be a concern. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
