Jihoon Son created TAJO-1582:
--------------------------------
Summary: Occasional resource leak in RawFile during test
Key: TAJO-1582
URL: https://issues.apache.org/jira/browse/TAJO-1582
Project: Tajo
Issue Type: Bug
Components: storage
Reporter: Jihoon Son
It looks that ByteBuf is not released properly.
Here is the log.
{noformat}
Run: testDistinctAggregationCasebyCase11[1] Used memory: 442MBytes
2015-04-27 03:54:09,980 ERROR: io.netty.util.ResourceLeakDetector (error(527))
- LEAK: ByteBuf.release() was not called before it's garbage-collected.
Recent access records: 1
#1:
io.netty.buffer.AdvancedLeakAwareByteBuf.nioBuffer(AdvancedLeakAwareByteBuf.java:673)
org.apache.tajo.storage.RawFile$RawFileScanner.init(RawFile.java:99)
org.apache.tajo.engine.planner.physical.SeqScanExec.initScanner(SeqScanExec.java:200)
org.apache.tajo.engine.planner.physical.SeqScanExec.init(SeqScanExec.java:162)
org.apache.tajo.engine.planner.physical.UnaryPhysicalExec.init(UnaryPhysicalExec.java:53)
org.apache.tajo.engine.planner.physical.ExternalSortExec.init(ExternalSortExec.java:154)
org.apache.tajo.engine.planner.physical.UnaryPhysicalExec.init(UnaryPhysicalExec.java:53)
org.apache.tajo.engine.planner.physical.AggregationExec.init(AggregationExec.java:64)
org.apache.tajo.engine.planner.physical.DistinctGroupbySortAggregationExec.<init>(DistinctGroupbySortAggregationExec.java:71)
org.apache.tajo.engine.planner.PhysicalPlannerImpl.createSortAggregationDistinctGroupbyExec(PhysicalPlannerImpl.java:1135)
org.apache.tajo.engine.planner.PhysicalPlannerImpl.createDistinctGroupByPlan(PhysicalPlannerImpl.java:1066)
org.apache.tajo.engine.planner.PhysicalPlannerImpl.createPlanRecursive(PhysicalPlannerImpl.java:195)
org.apache.tajo.engine.planner.PhysicalPlannerImpl.createPlanRecursive(PhysicalPlannerImpl.java:158)
org.apache.tajo.engine.planner.PhysicalPlannerImpl.createPlan(PhysicalPlannerImpl.java:90)
org.apache.tajo.worker.TajoQueryEngine.createPlan(TajoQueryEngine.java:41)
org.apache.tajo.worker.Task.run(Task.java:417)
org.apache.tajo.worker.TaskRunner$1.run(TaskRunner.java:286)
java.lang.Thread.run(Thread.java:745)
Created at:
io.netty.buffer.UnpooledByteBufAllocator.newDirectBuffer(UnpooledByteBufAllocator.java:55)
io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:155)
io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:146)
org.apache.tajo.storage.BufferPool.directBuffer(BufferPool.java:99)
org.apache.tajo.storage.RawFile$RawFileScanner.init(RawFile.java:98)
org.apache.tajo.engine.planner.physical.SeqScanExec.initScanner(SeqScanExec.java:200)
org.apache.tajo.engine.planner.physical.SeqScanExec.init(SeqScanExec.java:162)
org.apache.tajo.engine.planner.physical.UnaryPhysicalExec.init(UnaryPhysicalExec.java:53)
org.apache.tajo.engine.planner.physical.ExternalSortExec.init(ExternalSortExec.java:154)
org.apache.tajo.engine.planner.physical.UnaryPhysicalExec.init(UnaryPhysicalExec.java:53)
org.apache.tajo.engine.planner.physical.AggregationExec.init(AggregationExec.java:64)
org.apache.tajo.engine.planner.physical.DistinctGroupbySortAggregationExec.<init>(DistinctGroupbySortAggregationExec.java:71)
org.apache.tajo.engine.planner.PhysicalPlannerImpl.createSortAggregationDistinctGroupbyExec(PhysicalPlannerImpl.java:1135)
org.apache.tajo.engine.planner.PhysicalPlannerImpl.createDistinctGroupByPlan(PhysicalPlannerImpl.java:1066)
org.apache.tajo.engine.planner.PhysicalPlannerImpl.createPlanRecursive(PhysicalPlannerImpl.java:195)
org.apache.tajo.engine.planner.PhysicalPlannerImpl.createPlanRecursive(PhysicalPlannerImpl.java:158)
org.apache.tajo.engine.planner.PhysicalPlannerImpl.createPlan(PhysicalPlannerImpl.java:90)
org.apache.tajo.worker.TajoQueryEngine.createPlan(TajoQueryEngine.java:41)
org.apache.tajo.worker.Task.run(Task.java:417)
org.apache.tajo.worker.TaskRunner$1.run(TaskRunner.java:286)
java.lang.Thread.run(Thread.java:745)
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
