[
https://issues.apache.org/jira/browse/KYLIN-5527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17730795#comment-17730795
]
ASF GitHub Bot commented on KYLIN-5527:
---------------------------------------
fengguangyuan opened a new pull request, #2124:
URL: https://github.com/apache/kylin/pull/2124
## Proposed changes
https://issues.apache.org/jira/browse/KYLIN-5588
https://issues.apache.org/jira/browse/KYLIN-5587
https://issues.apache.org/jira/browse/KYLIN-5586
https://issues.apache.org/jira/browse/KYLIN-5585
https://issues.apache.org/jira/browse/KYLIN-5584
https://issues.apache.org/jira/browse/KYLIN-5583
https://issues.apache.org/jira/browse/KYLIN-5582
https://issues.apache.org/jira/browse/KYLIN-5581
https://issues.apache.org/jira/browse/KYLIN-5580
https://issues.apache.org/jira/browse/KYLIN-5579
https://issues.apache.org/jira/browse/KYLIN-5578
https://issues.apache.org/jira/browse/KYLIN-5577
https://issues.apache.org/jira/browse/KYLIN-5576
https://issues.apache.org/jira/browse/KYLIN-5575
https://issues.apache.org/jira/browse/KYLIN-5574
https://issues.apache.org/jira/browse/KYLIN-5573
https://issues.apache.org/jira/browse/KYLIN-5572
https://issues.apache.org/jira/browse/KYLIN-5571
https://issues.apache.org/jira/browse/KYLIN-5570
https://issues.apache.org/jira/browse/KYLIN-5569
https://issues.apache.org/jira/browse/KYLIN-5568
https://issues.apache.org/jira/browse/KYLIN-5567
https://issues.apache.org/jira/browse/KYLIN-5566
https://issues.apache.org/jira/browse/KYLIN-5565
https://issues.apache.org/jira/browse/KYLIN-5564
https://issues.apache.org/jira/browse/KYLIN-5563
https://issues.apache.org/jira/browse/KYLIN-5562
https://issues.apache.org/jira/browse/KYLIN-5561
https://issues.apache.org/jira/browse/KYLIN-5560
https://issues.apache.org/jira/browse/KYLIN-5559
https://issues.apache.org/jira/browse/KYLIN-5558
https://issues.apache.org/jira/browse/KYLIN-5557
https://issues.apache.org/jira/browse/KYLIN-5556
https://issues.apache.org/jira/browse/KYLIN-5555
https://issues.apache.org/jira/browse/KYLIN-5546
https://issues.apache.org/jira/browse/KYLIN-5545
https://issues.apache.org/jira/browse/KYLIN-5527
## Branch to commit
- [ ] Branch **kylin3** for v2.x to v3.x
- [ ] Branch **kylin4** for v4.x
- [x] Branch **kylin5** for v5.x
## Types of changes
What types of changes does your code introduce to Kylin?
_Put an `x` in the boxes that apply_
- [ ] Bugfix (non-breaking change which fixes an issue)
- [ ] New feature (non-breaking change which adds functionality)
- [ ] Breaking change (fix or feature that would cause existing
functionality to not work as expected)
- [ ] Documentation Update (if none of the other choices apply)
## Checklist
_Put an `x` in the boxes that apply. You can also fill these out after
creating the PR. If you're unsure about any of them, don't hesitate to ask.
We're here to help! This is simply a reminder of what we are going to look for
before merging your code._
- [ ] I have created an issue on [Kylin's
jira](https://issues.apache.org/jira/browse/KYLIN), and have described the
bug/feature there in detail
- [ ] Commit messages in my PR start with the related jira ID, like
"KYLIN-0000 Make Kylin project open-source"
- [ ] Compiling and unit tests pass locally with my changes
- [ ] I have added tests that prove my fix is effective or that my feature
works
- [ ] I have added necessary documentation (if appropriate)
- [ ] Any dependent changes have been merged
## Further comments
If this is a relatively large or complex change, kick off the discussion at
[email protected] or [email protected] by explaining why you chose the
solution you did and what alternatives you considered, etc...
> Kylin job engine adds the ability to check entries with data source(e.g. hive)
> ------------------------------------------------------------------------------
>
> Key: KYLIN-5527
> URL: https://issues.apache.org/jira/browse/KYLIN-5527
> Project: Kylin
> Issue Type: New Feature
> Components: Job Engine
> Affects Versions: 5.0-alpha
> Reporter: Yaguang Jia
> Assignee: Yaguang Jia
> Priority: Critical
> Fix For: 5.0-beta
>
> Attachments: (Chinese)KYLIN-5527 Kylin job engine adds the ability to
> check entries with data source(e.g. hive).pdf, (English) KYLIN-5527 Kylin job
> engine adds the ability to check entries with data source(e.g. hive).pdf
>
>
> After adding some new indexes in the Kylin5 model, the operation of
> completing the indexes is needed. If the previous data in the data source
> (e.g.:hive) has been deleted, then there will be a situation that the newly
> added index data is empty, which will lead to wrong query results. Here we
> need to add a new data source check function, if the data in the data source
> has been deleted, then do not fill in the data of the corresponding time
> segment to ensure the correctness of the query results.
>
> 在Kylin5的模型中新增加一些索引后，需要进行补齐索引的操作，如果数据源（如:hive）里之前的数据被删掉了，那么就会出现新补出来的索引数据为空的情况，从而导致查询结果有误。这里需要新增加一个数据源核对的功能，如果数据源中的数据已经被删掉了，那么就不去补对应时间segment的数据，保证查询结果的正确性。
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
