jihoonson commented on issue #7838: Improve IncrementalIndex concurrency scalability URL: https://github.com/apache/incubator-druid/pull/7838#issuecomment-502268573 Hi @eranmeir, thanks for your contribution! It looks that the PDF you attached shows we can gain some performance benefit with this PR when multiple threads write into the same incremental index. But, I'm wondering if we need that kind of performance benefit. Currently, the most common use case is serving multiple queries from different threads while building an incremental index with a single thread. So, it's like the single write and multiple reads case. Also, in indexing, the most expensive part is I think segment merge rather than building incremental indexes. Would you elaborate more on your plan regarding this point of view? More specifically, do you see something we can do better when multiple threads write into the same incremental index?
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
