[
https://issues.apache.org/jira/browse/AMBARI-22191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16200993#comment-16200993
]
Nishant Bangarwa commented on AMBARI-22191:
-------------------------------------------
committed to trunk and branch-2.6.
> Druid stack advisor for memory does not account number of merge buffers while
> calculating processing buffer size
> ----------------------------------------------------------------------------------------------------------------
>
> Key: AMBARI-22191
> URL: https://issues.apache.org/jira/browse/AMBARI-22191
> Project: Ambari
> Issue Type: Bug
> Reporter: Nishant Bangarwa
> Assignee: Nishant Bangarwa
> Priority: Critical
> Fix For: trunk, 2.6.0
>
> Attachments: AMBARI-22191.patch
>
>
> This is leading to OOME with default configs on a 16 core machine with 16G of
> ram.
> {code}
> 5) Error in custom provider, java.lang.OutOfMemoryError
> at
> io.druid.guice.DruidProcessingModule.getMergeBufferPool(DruidProcessingModule.java:124)
> (via modules: com.google.inject.util.Modules$OverrideModule ->
> com.google.inject.util.Modules$OverrideModule ->
> io.druid.guice.DruidProcessingModule)
> at
> io.druid.guice.DruidProcessingModule.getMergeBufferPool(DruidProcessingModule.java:124)
> (via modules: com.google.inject.util.Modules$OverrideModule ->
> com.google.inject.util.Modules$OverrideModule ->
> io.druid.guice.DruidProcessingModule)
> while locating io.druid.collections.BlockingPool<java.nio.ByteBuffer>
> annotated with @io.druid.guice.annotations.Merging()
> for the 4th parameter of
> io.druid.query.groupby.strategy.GroupByStrategyV2.<init>(GroupByStrategyV2.java:97)
> while locating io.druid.query.groupby.strategy.GroupByStrategyV2
> for the 3rd parameter of
> io.druid.query.groupby.strategy.GroupByStrategySelector.<init>(GroupByStrategySelector.java:43)
> while locating io.druid.query.groupby.strategy.GroupByStrategySelector
> for the 1st parameter of
> io.druid.query.groupby.GroupByQueryQueryToolChest.<init>(GroupByQueryQueryToolChest.java:104)
> at
> io.druid.guice.QueryToolChestModule.configure(QueryToolChestModule.java:95)
> (via modules: com.google.inject.util.Modules$OverrideModule ->
> com.google.inject.util.Modules$OverrideModule ->
> io.druid.guice.QueryRunnerFactoryModule)
> while locating io.druid.query.groupby.GroupByQueryQueryToolChest
> while locating io.druid.query.QueryToolChest annotated with
> @com.google.inject.multibindings.Element(setNa
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
