GitHub user kumarvishal09 opened a pull request:

    [CARBONDATA-241]Fixed out of memory issue during query execution

    **Problem:** During long run query execution is taking more time and it is 
throwing out of memory issue.
    **Reason**: In compaction we are compacting segments and each segment 
metadata is loaded in memory. So after compaction compacted segments are 
invalid but its meta data is not removed from memory because of this duplicate 
metadata is pile up and it is taking more memory and after few days query 
execution is throwing OOM
    **Solution**: Need to remove invalid blocks from memory

You can merge this pull request into a Git repository by running:

    $ git pull OOMIssue

Alternatively you can review and apply these changes as the patch at:

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #158
commit 3ff39301df586597eebf3a8d92ca3c60f5eba531
Author: kumarvishal <>
Date:   2016-09-15T08:41:00Z

    Fixed out of memory issue during query execution


If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at or file a JIRA ticket
with INFRA.

Reply via email to