gianm opened a new pull request, #17917: URL: https://github.com/apache/druid/pull/17917
Borrowing from the algorithm used by MSQ, SeekableStreamIndexTask now also automatically determines maxColumnsToMerge when it is set to -1 (the default). The algorithm uses the minimum of: - A figure derived from heap memory, assuming an equal amount of memory is devoted to indexing as to merging. (This is also assumed when computing the setting of maxBytesInMemory.) - A figure derived from offheap memory, assuming we can use what isn't used for processing buffers. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
