BubbaJoe opened a new issue, #702: URL: https://github.com/apache/arrow-ballista/issues/702
Hello, I am very new to rust so please bare with me. So I would like to make a query on a large amount of data (50 GB of Parquet files) across multiple executors. But I am wondering how ballista handles this. Does it executed heavy loads like this because the node running it will only have 16 GB of nodes. 1. How can I determine the memory required for an execution plan? 2. Does ballista execute a single query on multiple executors? If not, how can I optimize this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
