ASF GitHub Bot commented on CARBONDATA-241:

Github user gvramana commented on a diff in the pull request:

    --- Diff: 
    @@ -129,6 +132,37 @@ private int countTheColumns(String outPath) throws 
Exception {
         return 0;
    +  private void runJob(String outPath, CarbonProjection projection, 
Expression filter)
    --- End diff --
    move back the code to original place

> OOM error during query execution in long run
> --------------------------------------------
>                 Key: CARBONDATA-241
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-241
>             Project: CarbonData
>          Issue Type: Bug
>            Reporter: kumar vishal
>            Assignee: kumar vishal
> **Problem:** During long run query execution is taking more time and it is 
> throwing out of memory issue.
> **Reason**: In compaction we are compacting segments and each segment 
> metadata is loaded in memory. So after compaction compacted segments are 
> invalid but its meta data is not removed from memory because of this 
> duplicate metadata is pile up and it is taking more memory and after few days 
> query exeution is throwing OOM
> **Solution**: Need to remove invalid blocks from memory

This message was sent by Atlassian JIRA

Reply via email to