Re: [DISCUSSION] Support new feature: bitmap encode

2017-04-17 Thread David QiangCai
Hi,

In my opinion, we need the following points as least.

1. create table ddl can specify a bitmap option

2. add a new Encoding: BITMAP



-
Best Regards
David QiangCai
--
View this message in context: 
http://apache-carbondata-mailing-list-archive.1130556.n5.nabble.com/DISCUSSION-Support-new-feature-bitmap-encode-tp10913p11210.html
Sent from the Apache CarbonData Mailing List archive mailing list archive at 
Nabble.com.


Re: [DISCUSSION] Support new feature: bitmap encode

2017-04-17 Thread simafengyun
sub-task list of  bitmap encode Feature:

1   data loading for bitmap encode columns
generate bitmap encoded data and store to data page

2   query bitmap encode data
read bitmap encode data from data page  to dataChunk2

3   apply filter query on bitmap encode column
equal / not equal filter
range filter
and / or query
include / exclude filter

Any suggestion?

Thanks
Jack  Ma



--
View this message in context: 
http://apache-carbondata-mailing-list-archive.1130556.n5.nabble.com/DISCUSSION-Support-new-feature-bitmap-encode-tp10913p11209.html
Sent from the Apache CarbonData Mailing List archive mailing list archive at 
Nabble.com.


Re: [DISCUSSION]support new feature: bitmap encode

2017-04-12 Thread simafengyun
upload the design screenshots

<http://apache-carbondata-mailing-list-archive.1130556.n5.nabble.com/file/n10912/bitmap1.jpeg>
 
<http://apache-carbondata-mailing-list-archive.1130556.n5.nabble.com/file/n10912/bitmap2.jpeg>
 
<http://apache-carbondata-mailing-list-archive.1130556.n5.nabble.com/file/n10912/bitmap3.jpeg>
 
<http://apache-carbondata-mailing-list-archive.1130556.n5.nabble.com/file/n10912/bitmap4.jpeg>
 



--
View this message in context: 
http://apache-carbondata-mailing-list-archive.1130556.n5.nabble.com/DISCUSSION-support-new-feature-bitmap-encode-tp10911p10912.html
Sent from the Apache CarbonData Mailing List archive mailing list archive at 
Nabble.com.


[DISCUSSION]support new feature: bitmap encode

2017-04-12 Thread simafengyun
Hi all, 

  
 Let's start the discussion about bitmap encode.

below is the high level design document
https://raw.githubusercontent.com/mayunSaicmotor/saic-carbondata/branch-0.2-saic/examples/src/main/resources/carbondata-bitmap-encode.xlsx

Please feel free to discuss and give your suggestion.

Thanks






--
View this message in context: 
http://apache-carbondata-mailing-list-archive.1130556.n5.nabble.com/DISCUSSION-support-new-feature-bitmap-encode-tp10911.html
Sent from the Apache CarbonData Mailing List archive mailing list archive at 
Nabble.com.