[
https://issues.apache.org/jira/browse/KYLIN-4211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16997962#comment-16997962
]
ASF GitHub Bot commented on KYLIN-4211:
---------------------------------------
nichunen commented on pull request #904: KYLIN-4211 PartitionDesc support
custom year、month、day partitions name
URL: https://github.com/apache/kylin/pull/904
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
> PartitionDesc support custom year、month、day partitions name
> -----------------------------------------------------------
>
> Key: KYLIN-4211
> URL: https://issues.apache.org/jira/browse/KYLIN-4211
> Project: Kylin
> Issue Type: Improvement
> Reporter: chuxiao
> Priority: Major
> Fix For: v3.1.0
>
> Attachments: KYLIN-4211.master.001.patch
>
>
> YearMonthDayPartitionConditionBuilder supports partition named year, month,
> day, but can not support partition names like Y, M, D.
> Because there are user using fact table partitioned by Y, M, D, so add
> CustomYearMonthDayFieldPartitionConditionBuilder, support custom year, month,
> day partitions name.
> Partition metadata in model.json like:
> {
> "uuid" : "459d48c1-a8a6-cdf5-6ea7-e2ae48b248e9",
> "last_modified" : 1571652918478,
> "version" : "2.6.0.20500",
> "name" : "kylin_sales_ymd",
> "owner" : "admin",
> "is_draft" : false,
> "description" : "",
> "fact_table" : "BIGDATA_KYLIN.KYLIN_SALES_YMD",
> "lookups" : [ ],
> "dimensions" : [ {
> "table" : "KYLIN_SALES_YMD",
> "columns" : [ "LEAF_CATEG_ID", "TRANS_ID", "SLR_SEGMENT_CD", "SELLER_ID",
> "BUYER_ID", "OPS_USER_ID", "OPS_REGION", "Y", "M", "D" ]
> } ],
> "metrics" : [ "KYLIN_SALES_YMD.PRICE", "KYLIN_SALES_YMD.ITEM_COUNT" ],
> "filter_condition" : "",
> "partition_desc" : {
> "partition_date_column" : "KYLIN_SALES_YMD.Y, KYLIN_SALES_YMD.M,
> KYLIN_SALES_YMD.D",
> "partition_time_column" : null,
> "partition_date_start" : 0,
> "partition_date_format" : "yyyy-MM-dd",
> "partition_time_format" : "HH:mm:ss",
> "partition_type" : "APPEND",
> "partition_condition_builder" :
> "org.apache.kylin.metadata.model.PartitionDesc$CustomYearMonthDayFieldPartitionConditionBuilder"
> },
> "capacity" : "MEDIUM"
> }
> Partition_date_column is the year, month, and day partition field split by
> ','.， and Partition_condition_builder is
> org.apache.kylin.metadata.model.PartitionDesc$CustomYearMonthDayFieldPartitionConditionBuilder
> Web can create a normal model and "Edit JSON" on Kylin web
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
