Nishant Bangarwa created AMBARI-22191:
-----------------------------------------
Summary: Druid stack advisor for memory does not account number of
merge buffers while calculating processing buffer size
Key: AMBARI-22191
URL: https://issues.apache.org/jira/browse/AMBARI-22191
Project: Ambari
Issue Type: Bug
Reporter: Nishant Bangarwa
Assignee: Nishant Bangarwa
Fix For: trunk, 2.6.0
This is leading to OOME with default configs on a 16 core machine with 16G of
ram.
{code}
5) Error in custom provider, java.lang.OutOfMemoryError
at
io.druid.guice.DruidProcessingModule.getMergeBufferPool(DruidProcessingModule.java:124)
(via modules: com.google.inject.util.Modules$OverrideModule ->
com.google.inject.util.Modules$OverrideModule ->
io.druid.guice.DruidProcessingModule)
at
io.druid.guice.DruidProcessingModule.getMergeBufferPool(DruidProcessingModule.java:124)
(via modules: com.google.inject.util.Modules$OverrideModule ->
com.google.inject.util.Modules$OverrideModule ->
io.druid.guice.DruidProcessingModule)
while locating io.druid.collections.BlockingPool<java.nio.ByteBuffer>
annotated with @io.druid.guice.annotations.Merging()
for the 4th parameter of
io.druid.query.groupby.strategy.GroupByStrategyV2.<init>(GroupByStrategyV2.java:97)
while locating io.druid.query.groupby.strategy.GroupByStrategyV2
for the 3rd parameter of
io.druid.query.groupby.strategy.GroupByStrategySelector.<init>(GroupByStrategySelector.java:43)
while locating io.druid.query.groupby.strategy.GroupByStrategySelector
for the 1st parameter of
io.druid.query.groupby.GroupByQueryQueryToolChest.<init>(GroupByQueryQueryToolChest.java:104)
at
io.druid.guice.QueryToolChestModule.configure(QueryToolChestModule.java:95)
(via modules: com.google.inject.util.Modules$OverrideModule ->
com.google.inject.util.Modules$OverrideModule ->
io.druid.guice.QueryRunnerFactoryModule)
while locating io.druid.query.groupby.GroupByQueryQueryToolChest
while locating io.druid.query.QueryToolChest annotated with
@com.google.inject.multibindings.Element(setNa
{code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
