leventov opened a new issue #6827: DruidSchema and SystemSchema should avoid creating temprorary collections of the cardinality of all segments URL: https://github.com/apache/incubator-druid/issues/6827 It happens in `DruidSchema.getSegmentMetadata()` and `SystemSchema.scan()`. Creating such collections means allocating gigabytes of data, if there are millions of segments in the system. It should be done only if there is really no other way. Avoiding allocations in `DruidSchema.getSegmentMetadata()` and `SystemSchema.scan()` is not very easy without introducing concurrency bugs, but I believe should be possible.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
