GitHub user ravipesala opened a pull request:
https://github.com/apache/carbondata/pull/1377
[WIP] Fixed refresh of segments in datamap for update and partition
Currently datamap scans complete segment every time for query execution to
get all the carbonindex files. It will be slow when data/number of files are
big.
So this PR caches the content of segment and refreshes when any updation or
store changes.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/ravipesala/incubator-carbondata
datamap-refresh
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/carbondata/pull/1377.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1377
----
commit 1f0e834353946dc53ed2f5686e223951fd8c9707
Author: Ravindra Pesala <[email protected]>
Date: 2017-09-21T13:33:06Z
Fixed refersh of segments in datamap for update and partition
----
---
