liran-funaro commented on issue #5698: URL: https://github.com/apache/druid/issues/5698#issuecomment-639114314
Our new and improved `OakIncrementalIndex` significantly reduces Druid's memory consumption during the ingestion process. We have conducted [system-level experiments](https://github.com/liran-funaro/druid/wiki/Evaluation) per the community request, which shows that `OakIncrementalIndex` uses **60%** less memory compared with `OnheapIncrementalIndex` to achieve the same performance. Alternatively, if the user has a fixed memory budget, `OakIncrementalIndex` nearly **doubles** the system's ingestion-throughput. Please check it out: [#9967](https://github.com/apache/druid/issues/9967). ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
