mcvsubbu commented on issue #5627: URL: https://github.com/apache/incubator-pinot/issues/5627#issuecomment-657731387
Using off-heap (mmap) memory for query processing may be a good first step to take. This will be at the cost of performance, so it may need to be configurable. The max memory used for processing query can then be indicated to the broker in the response back from the server. The brokers can, over time, tune themselves so that they can either ask servers to limit the number of threads used, and/or limit the memory used or even reject the query up front if there is no capacity. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
