himanshug commented on issue #263: Theta sketch - Concurrent union implementation URL: https://github.com/apache/incubator-datasketches-java/issues/263#issuecomment-509373302 unfortunately it is very difficult to have answers for "expected query rate at real-time index" etc because it heavily depends on cluster to cluster. that said, even on realtime indexing process, IncrementalIndex (only place with concurrency) is persisted to a disk based structure periodically(or hitting memory/row thresholds) because disk based structure is highly optimized for read/queries (not just aggregations but it has other things like bitmap indexes for filtering, takes relatively less memory backed by disk so not counted as "anonymous memory" on linux) . "on most clusters", I wouldn't expect a large number or large sketch queries happening on IncrementalIndex .
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
