Re: [DISCUSS] Kylin Parquet storage and 4.0 plan

2020-07-24 Thread ShaoFeng Shi
Hi Cinto, Currently, it uses the native Parquet, no additional indexing; in the future, if Parquet enhances its index, Kylin can benefit from it; == "are we using any metastore (like Hive) along with this ?" I'm not sure whether I understand properly. The Cube parquet files are directly

Re:[DISCUSS] Kylin Parquet storage and 4.0 plan

2020-07-24 Thread chuxiao
Will 3.x continue to release?For example,support hbase rsgroup. At 2020-07-24 19:23:11, "ShaoFeng Shi" wrote: Hello, Kylin users, Regarding the Kylin Parquet storage, we hope to update the progress here. At present, we have completed the main development work[1], design

Re: [DISCUSS] Kylin Parquet storage and 4.0 plan

2020-07-24 Thread ShaoFeng Shi
Hi Kang, it will still be KV; If changing to relational, there is too much work to do. Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail group:

Re: [DISCUSS] Kylin Parquet storage and 4.0 plan

2020-07-24 Thread Zhou Kang
I have a question: Metadata based on MySQL, data in MySQL is KV or relational ? Thank you! > 2020年7月24日 下午7:23,ShaoFeng Shi 写道: > > Hello, Kylin users, > > Regarding the Kylin Parquet storage, we hope to update the progress here. At > present, we have completed the main development

[DISCUSS] Kylin Parquet storage and 4.0 plan

2020-07-24 Thread ShaoFeng Shi
Hello, Kylin users, Regarding the Kylin Parquet storage, we hope to update the progress here. At present, we have completed the main development work[1], design document[2], and the benchmark. With the new architecture, Kylin is going to be more efficient and be more cloud-friendly: fully on