GitHub user kumarvishal09 opened a pull request:
https://github.com/apache/incubator-carbondata/pull/158
[CARBONDATA-241]Fixed out of memory issue during query execution
**Problem:** During long run query execution is taking more time and it is
throwing out of memory issue.
**Reason**: In compaction we are compacting segments and each segment
metadata is loaded in memory. So after compaction compacted segments are
invalid but its meta data is not removed from memory because of this duplicate
metadata is pile up and it is taking more memory and after few days query
execution is throwing OOM
**Solution**: Need to remove invalid blocks from memory
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/kumarvishal09/incubator-carbondata OOMIssue
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-carbondata/pull/158.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #158
----
commit 3ff39301df586597eebf3a8d92ca3c60f5eba531
Author: kumarvishal <[email protected]>
Date: 2016-09-15T08:41:00Z
Fixed out of memory issue during query execution
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
