[
https://issues.apache.org/jira/browse/KYLIN-1427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15152043#comment-15152043
]
liyang commented on KYLIN-1427:
-------------------------------
More info copied from discussion with customer.
What We Want
- Hourly incremental build a cube
What We Need
- A timestamp column on FACT_TABLE that Kylin can use to tell old data
from the new
- Overwriting the hive table every hour is not required
- Partitioning the hive table is not required
- The above can work but maybe slow when reading hive if hive partition
is not enabled on the timestamp column
Alternative
- Kylin to support incremental load from a date column + a time (hour)
column (KYLIN-1427), letting Hive partition be comfortably enabled on the date
column
> Enable partition date column to support date and hour as separate columns for
> increment cube build
> ---------------------------------------------------------------------------------------------------
>
> Key: KYLIN-1427
> URL: https://issues.apache.org/jira/browse/KYLIN-1427
> Project: Kylin
> Issue Type: Task
> Components: Metadata, REST Service, Web
> Reporter: qianqiaoneng
>
> There are some data table, which save date and hour at 2 columns. For this
> kind of source data, kylin currently doesn't support incrementally build the
> cube. Open this JIRA to track this feature.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
