[
https://issues.apache.org/jira/browse/KYLIN-886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14642306#comment-14642306
]
Shaofeng SHI commented on KYLIN-886:
------------------------------------
yes I have started this, but haven't added this: "Default retention option
should be controlled by kylin.properteis file", as cubes will have different
requirements, putting a default retention may cause segment be deleted
silently; So my opinion is set it only at cube level;
> Data Retention for streaming data
> ---------------------------------
>
> Key: KYLIN-886
> URL: https://issues.apache.org/jira/browse/KYLIN-886
> Project: Kylin
> Issue Type: New Feature
> Affects Versions: v0.8.1
> Reporter: Luke Han
> Assignee: Shaofeng SHI
> Fix For: v0.8.1
>
>
> Streaming data will grow very fast and consume huge storage. since queries
> are focus on recent data only in most of cases, support data retention in
> streaming data model is a critical feature to control storage size and even
> query performance.
> 1. Add one config setting option in streaming data model
> 2. User could define how long to keep data, for example, 7 days, 30 days.
> 3. This is management option which could be updated on the fly
> 4. Default retention option should be controlled by kylin.properteis file.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
