Eshcar commented on issue #263: Theta sketch - Concurrent union implementation URL: https://github.com/apache/incubator-datasketches-java/issues/263#issuecomment-508989480 Background threads are daemon threads that can be managed in a limited size pool. I can imagine large sketches are at the tail end of a power law distribution. But if in some scenarios these large sketches are responsible for tail latency (both in ingestion and in queries) then this could be a good motivation for giving them special care. Are you aware of high latency queries due to long merge/union operations that can be accelerated with parallelism? BTW - in the mixed workload benchmarks I ran for concurrent theta sketches, I only used read threads as "background" noise, with some sleeping time every few queries. Do you have an estimate on the rate of queries against real-time index in Druid?
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
