himanshug commented on issue #263: Theta sketch - Concurrent union implementation URL: https://github.com/apache/incubator-datasketches-java/issues/263#issuecomment-508654506 > When considering single writer thread in small sketches indeed the overhead of managing local buffers and shared sketch offsets the benefit of removing the lock, but from a certain size (number of uniques) the improvement outweighs the overhead. from what I have seen, sketch size typically follows the power law with large sketches being at the tail end. in any case, I would be slightly worried about background threads getting introduced that require extra thinking about who spawns them, how many are spawned, are they daemon threads, who kills them etc . also, https://github.com/apache/incubator-druid/issues/8031 will hopefully remove synchronization usage at non-realtime data query(and other single thread access places such as batch indexing) altogether for all complex aggregator implementations in Druid.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
