[ 
https://issues.apache.org/jira/browse/DRILL-8485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17830261#comment-17830261
 ] 

ASF GitHub Bot commented on DRILL-8485:
---------------------------------------

shfshihuafeng opened a new pull request, #2891:
URL: https://github.com/apache/drill/pull/2891

   …n read data from InputStream
   
   # [DRILL-8485](https://issues.apache.org/jira/browse/DRILL-8485): 
HashJoinPOP memory leak is caused by an oom exception when read data from 
InputStream
   
   ## Description
   
   it is similar to 
[DRILL-8484](https://issues.apache.org/jira/browse/DRILL-8484)
   
   **exception info** 
   ```
   Caused by: org.apache.drill.exec.exception.OutOfMemoryException: Unable to 
allocate buffer of size 16384 (rounded from 15364) due to memory limit 
(41943040). Current allocation: 4337664
           at 
org.apache.drill.exec.memory.BaseAllocator.buffer(BaseAllocator.java:241)
           at 
org.apache.drill.exec.memory.BaseAllocator.buffer(BaseAllocator.java:216)
           at 
org.apache.drill.exec.memory.BaseAllocator.read(BaseAllocator.java:856)
   ```
   **leak  info**
   
   ```
     Allocator(frag:5:1) 5000000/1000000/27824128/40041943040 
(res/actual/peak/limit)
         child allocators: 1
           Allocator(op:5:1:1:HashJoinPOP) 1000000/16384/22822912/41943040 
(res/actual/peak/limit)
             child allocators: 0
             ledgers: 2
               ledger[442780] allocator: op:5:1:1:HashJoinPOP), isOwning: true, 
size: 8192, references: 2, life: 4486836603491..0, allocatorManager: [390894, 
life: 4486836601180..0] holds 4 buffers. 
                   DrillBuf[458469], udle: [390895 1024..8192]
            event log for: DrillBuf[458469]
   ```
   ## Documentation
   (Please describe user-visible changes similar to what should appear in the 
Drill documentation.)
   
   ## Testing
   The testing method for drill-8485 is the similar as for 
[DRILL-8484](https://issues.apache.org/jira/browse/DRILL-8484). we can throw 
exception  in the method readVectors
   




> HashJoinPOP memory leak is caused by an oom exception when read data from 
> InputStream
> -------------------------------------------------------------------------------------
>
>                 Key: DRILL-8485
>                 URL: https://issues.apache.org/jira/browse/DRILL-8485
>             Project: Apache Drill
>          Issue Type: Bug
>          Components:  Server
>    Affects Versions: 1.21.1
>            Reporter: shihuafeng
>            Priority: Major
>             Fix For: 1.21.1
>
>
> when traversing fieldList druing read data from InputStream, if the 
> intermediate process throw exception,we can not release previously 
> constructed vectors. it result in memory leak。
> it is similar to DRILL-8484



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to