GitHub user jackylk opened a pull request:
https://github.com/apache/carbondata/pull/987
[WIP] Use ColumnPage for measure encoding and compression
[WIP] This PR should be merged after #971
In this PR, following interfaces are added:
###ColumnPageEncoder
encoder for a ColumnPage
###EncoderStrategy, DefaultEncoderStrategy
EncoderStrategy defines the strategy to choose encoding for a ColumnPage.
DefaultEncoderStrategy is a default implementation which choose encoding
based on data type and statistics
Other changes:
1. encoder for measure will use ColumnPage
2. compression for measure will use ColumnPage
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/jackylk/incubator-carbondata encode
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/carbondata/pull/987.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #987
----
commit d8a4a2b74373f1f9b1c15780231958d176a6cf93
Author: jackylk <[email protected]>
Date: 2017-05-27T18:14:48Z
use ColumnPage in writer
commit 705469a4c5983d832b5b4e5504155dfb934425d7
Author: jackylk <[email protected]>
Date: 2017-05-27T18:22:31Z
remove WriterCompressModel
commit 418278d6e93c3d2bbfd4096893c2711e1e8ee9b8
Author: jackylk <[email protected]>
Date: 2017-05-28T14:55:29Z
add PrimitiveColumnPage
commit f2bb1267de866fb8fe72ea51aa8b117cdc2ceb4e
Author: jackylk <[email protected]>
Date: 2017-05-30T00:36:20Z
add TableSpec
commit 80bc3e4551a45d01386bbbd05d307354f5da5c25
Author: jackylk <[email protected]>
Date: 2017-05-30T10:11:21Z
add TablePageKey
commit 2ed4fbe38b98a6002cd4106d7274cdd88ef2b112
Author: jackylk <[email protected]>
Date: 2017-05-30T15:21:19Z
fix testcase
commit 0bc0bad2fe98f8719a2dfd311bf0bd379c3683de
Author: jackylk <[email protected]>
Date: 2017-05-30T17:37:38Z
fix style:
commit 224abbd9e2137ed1f16dad3c4ad737a0d3e80d37
Author: jackylk <[email protected]>
Date: 2017-05-31T08:58:16Z
make PrimitiveColumnPage generic
commit 545273ac7321f1e3c44e3c96b49083ede709a0aa
Author: jackylk <[email protected]>
Date: 2017-05-31T11:23:35Z
fix style
commit d6a60b4e500ad9a02463b7599d0caad8dff522cd
Author: jackylk <[email protected]>
Date: 2017-05-31T15:45:14Z
fix style
commit 210c9cba566b6208f65302b8d5c687ea279b7a2c
Author: jackylk <[email protected]>
Date: 2017-06-01T18:17:33Z
add ColumnPageEncoder
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---