[jira] [Commented] (KYLIN-5748) Skip build flat table for index build job if all new created indexes can be built from existed parent index
[ https://issues.apache.org/jira/browse/KYLIN-5748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17831024#comment-17831024 ] ASF GitHub Bot commented on KYLIN-5748: --- Mrhs121 commented on PR #2162: URL: https://github.com/apache/kylin/pull/2162#issuecomment-2021131685 Your proposal will be invalid in this use case: if you add a new bitmap type metric to the model, you can build the new index separately, and the task type is also INDEX_BUIDL. If you skip building the dictionary, an error will occur when generating encoding columns for the flat table later. > Skip build flat table for index build job if all new created indexes can be > built from existed parent index > --- > > Key: KYLIN-5748 > URL: https://issues.apache.org/jira/browse/KYLIN-5748 > Project: Kylin > Issue Type: Improvement >Affects Versions: 5.0-beta >Reporter: Zhenning Zhang >Assignee: Zhenning Zhang >Priority: Major > > For an index build job, if all the new added indexes can be built from their > existed parent index. No index was built from new created flat table. > For this case, there won't be any data inconsistency across indexes. And > there is no need to build a new flat table to serve the stage of index build > by layer. > So I think we can skip stage BUILD DICT and stage GENERATE FLAT TABLE for an > index build job in condition that all new added indexes can be built from > their existed parent index -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5748) Skip build flat table for index build job if all new created indexes can be built from existed parent index
[ https://issues.apache.org/jira/browse/KYLIN-5748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17800428#comment-17800428 ] ASF GitHub Bot commented on KYLIN-5748: --- zznlime commented on PR #2162: URL: https://github.com/apache/kylin/pull/2162#issuecomment-1869324455 @hit-lacus PTAL, Thanks > Skip build flat table for index build job if all new created indexes can be > built from existed parent index > --- > > Key: KYLIN-5748 > URL: https://issues.apache.org/jira/browse/KYLIN-5748 > Project: Kylin > Issue Type: Improvement >Affects Versions: 5.0-beta >Reporter: Zhenning Zhang >Assignee: Zhenning Zhang >Priority: Major > > For an index build job, if all the new added indexes can be built from their > existed parent index. No index was built from new created flat table. > For this case, there won't be any data inconsistency across indexes. And > there is no need to build a new flat table to serve the stage of index build > by layer. > So I think we can skip stage BUILD DICT and stage GENERATE FLAT TABLE for an > index build job in condition that all new added indexes can be built from > their existed parent index -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5748) Skip build flat table for index build job if all new created indexes can be built from existed parent index
[ https://issues.apache.org/jira/browse/KYLIN-5748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17800421#comment-17800421 ] ASF GitHub Bot commented on KYLIN-5748: --- zznlime opened a new pull request, #2162: URL: https://github.com/apache/kylin/pull/2162 For an index build job, if all the new added indexes can be built from their existed parent index. No index was built from new created flat table. For this case, there won't be any data inconsistency across indexes. And there is no need to build a new flat table to serve the stage of index build by layer. So I think we can skip stage BUILD DICT and stage GENERATE FLAT TABLE for an index build job in condition that all new added indexes can be built from their existed parent index > Skip build flat table for index build job if all new created indexes can be > built from existed parent index > --- > > Key: KYLIN-5748 > URL: https://issues.apache.org/jira/browse/KYLIN-5748 > Project: Kylin > Issue Type: Improvement >Affects Versions: 5.0-beta >Reporter: Zhenning Zhang >Assignee: Zhenning Zhang >Priority: Major > > For an index build job, if all the new added indexes can be built from their > existed parent index. No index was built from new created flat table. > For this case, there won't be any data inconsistency across indexes. And > there is no need to build a new flat table to serve the stage of index build > by layer. > So I think we can skip stage BUILD DICT and stage GENERATE FLAT TABLE for an > index build job in condition that all new added indexes can be built from > their existed parent index -- This message was sent by Atlassian Jira (v8.20.10#820010)
