bkmgit edited a comment on issue #1273: URL: https://github.com/apache/arrow-datafusion/issues/1273#issuecomment-963446873
- What has been learned from running in a distributed context? - How does DataFusion with Ballista differ from other distributed databases and what could it offer to people who might adopt it? - There is interest in distributed memory processing using MPI/UCX (GRPC can also be used for this, but has lower performance though somewhat greater flexibility), but this may target Arrow directly rather than through DataFusion. - One issue that may arise in both settings is fault tolerance and replication. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org