GitHub user ravipesala opened a pull request:
https://github.com/apache/carbondata/pull/1075
[WIP] Datamap implementation for Blocklet.
Bypassed btree implementations and used datamap to get the pruned
blocklets. Only driver side datamap is maintained and all required information
will be send to executor.
No datamap/btree will be maintained in executor.
Implementation classes are
1. org.apache.carbondata.core.indexstore.blockletindex.BlockletTableMap
2. org.apache.carbondata.core.indexstore.blockletindex.BlockletDataMap
Here only used unsafe storage to store data.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/ravipesala/incubator-carbondata
blocklet-datamap
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/carbondata/pull/1075.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1075
----
commit e131a35063ee31180b4b4856a9b0a50508ba86b0
Author: ravipesala <[email protected]>
Date: 2017-06-17T17:23:57Z
Added blocklet index implementation in datamap
commit 5c669351b288c9fdb81b07a3a8f18b1a9c40f4fa
Author: ravipesala <[email protected]>
Date: 2017-06-22T04:49:52Z
Blocklet implementation for datamap
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
