[
https://issues.apache.org/jira/browse/KYLIN-3917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16960740#comment-16960740
]
ASF GitHub Bot commented on KYLIN-3917:
---------------------------------------
nichunen commented on pull request #757: KYLIN-3917: Add max segment merge span
to cleanup intermediate data of cube building
URL: https://github.com/apache/kylin/pull/757
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
> Add max segment merge span to cleanup intermediate data of cube building
> -------------------------------------------------------------------------
>
> Key: KYLIN-3917
> URL: https://issues.apache.org/jira/browse/KYLIN-3917
> Project: Kylin
> Issue Type: Improvement
> Reporter: Shaohui Liu
> Assignee: Shaohui Liu
> Priority: Major
> Fix For: Future
>
>
> Currently the intermediate data of building cube can not be deleted for it
> maybe used for later cubing merging. But it result in double space used in
> HDFS.
> In actual scenario, we only need month-level segment span in maximum.
> So if a span of segment is larger than a month, we think it don't need be
> merged and the intermediate data can be deleted.
> So we can add a config kylin.cube.max-segment-merge.span, default is -1.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
