[jira] [Commented] (KYLIN-3392) Support NULL value in Sum, Max, Min Aggregation

2020-12-30 Thread ASF GitHub Bot (Jira)


[ 
https://issues.apache.org/jira/browse/KYLIN-3392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17256509#comment-17256509
 ] 

ASF GitHub Bot commented on KYLIN-3392:
---

hit-lacus closed pull request #1524:
URL: https://github.com/apache/kylin/pull/1524


   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


> Support NULL value in Sum, Max, Min Aggregation
> ---
>
> Key: KYLIN-3392
> URL: https://issues.apache.org/jira/browse/KYLIN-3392
> Project: Kylin
>  Issue Type: Bug
>Reporter: Yifei Wu
>Assignee: Yifei Wu
>Priority: Major
> Fix For: Future
>
> Attachments: KYLIN-3392-2.png, KYLIN-3392.png, kylin-3.0.0-alpha2.png
>
>
> It is treated as 0 when confronted with NULL value in KYLIN's basic aggregate 
> measure (like sum, max, min). However, to distinguish the NULL value with 0 
> is very necessary.
> It should be like this
> *sum(null, null) = null*
> *sum(null, 1) = 1*
> *max(null, null) = null*
> *max(null, -1) = -1*
> *min(null,  -1)= -1*
>  in accordance with Hive and SparkSQL



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (KYLIN-3392) Support NULL value in Sum, Max, Min Aggregation

2020-12-30 Thread ASF GitHub Bot (Jira)


[ 
https://issues.apache.org/jira/browse/KYLIN-3392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17256438#comment-17256438
 ] 

ASF GitHub Bot commented on KYLIN-3392:
---

lgtm-com[bot] commented on pull request #1524:
URL: https://github.com/apache/kylin/pull/1524#issuecomment-752409775


   This pull request **introduces 1 alert** when merging 
09d66680eb9bae85978ebe5afe8d8dc2a074400f into 
7cca1c27cd3c2414f7f9b7061009b8a8b55069bf - [view on 
LGTM.com](https://lgtm.com/projects/g/apache/kylin/rev/pr-b7fc08c1d7413a1327c1a607a5467bf0516efa5b)
   
   **new alerts:**
   
   * 1 for Boxed variable is never null



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


> Support NULL value in Sum, Max, Min Aggregation
> ---
>
> Key: KYLIN-3392
> URL: https://issues.apache.org/jira/browse/KYLIN-3392
> Project: Kylin
>  Issue Type: Bug
>Reporter: Yifei Wu
>Assignee: Yifei Wu
>Priority: Major
> Fix For: Future
>
> Attachments: KYLIN-3392-2.png, KYLIN-3392.png, kylin-3.0.0-alpha2.png
>
>
> It is treated as 0 when confronted with NULL value in KYLIN's basic aggregate 
> measure (like sum, max, min). However, to distinguish the NULL value with 0 
> is very necessary.
> It should be like this
> *sum(null, null) = null*
> *sum(null, 1) = 1*
> *max(null, null) = null*
> *max(null, -1) = -1*
> *min(null,  -1)= -1*
>  in accordance with Hive and SparkSQL



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (KYLIN-3392) Support NULL value in Sum, Max, Min Aggregation

2020-12-30 Thread ASF GitHub Bot (Jira)


[ 
https://issues.apache.org/jira/browse/KYLIN-3392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17256399#comment-17256399
 ] 

ASF GitHub Bot commented on KYLIN-3392:
---

lgtm-com[bot] commented on pull request #1524:
URL: https://github.com/apache/kylin/pull/1524#issuecomment-752392577


   This pull request **introduces 1 alert** when merging 
73c46e541c09d851c48f3bf937af79d325cb737f into 
7cca1c27cd3c2414f7f9b7061009b8a8b55069bf - [view on 
LGTM.com](https://lgtm.com/projects/g/apache/kylin/rev/pr-5b0e6256a8d7d6031dc814185d9ab4c7898c3e97)
   
   **new alerts:**
   
   * 1 for Boxed variable is never null



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


> Support NULL value in Sum, Max, Min Aggregation
> ---
>
> Key: KYLIN-3392
> URL: https://issues.apache.org/jira/browse/KYLIN-3392
> Project: Kylin
>  Issue Type: Bug
>Reporter: Yifei Wu
>Assignee: Yifei Wu
>Priority: Major
> Fix For: Future
>
> Attachments: KYLIN-3392-2.png, KYLIN-3392.png, kylin-3.0.0-alpha2.png
>
>
> It is treated as 0 when confronted with NULL value in KYLIN's basic aggregate 
> measure (like sum, max, min). However, to distinguish the NULL value with 0 
> is very necessary.
> It should be like this
> *sum(null, null) = null*
> *sum(null, 1) = 1*
> *max(null, null) = null*
> *max(null, -1) = -1*
> *min(null,  -1)= -1*
>  in accordance with Hive and SparkSQL



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (KYLIN-3392) Support NULL value in Sum, Max, Min Aggregation

2020-12-29 Thread ASF GitHub Bot (Jira)


[ 
https://issues.apache.org/jira/browse/KYLIN-3392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17256225#comment-17256225
 ] 

ASF GitHub Bot commented on KYLIN-3392:
---

kyotoYaho commented on pull request #1524:
URL: https://github.com/apache/kylin/pull/1524#issuecomment-752298704


   It's better to refine the generated testing data for IT to introduce nulls 
for more columns



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


> Support NULL value in Sum, Max, Min Aggregation
> ---
>
> Key: KYLIN-3392
> URL: https://issues.apache.org/jira/browse/KYLIN-3392
> Project: Kylin
>  Issue Type: Bug
>Reporter: Yifei Wu
>Assignee: Yifei Wu
>Priority: Major
> Fix For: Future
>
> Attachments: KYLIN-3392-2.png, KYLIN-3392.png, kylin-3.0.0-alpha2.png
>
>
> It is treated as 0 when confronted with NULL value in KYLIN's basic aggregate 
> measure (like sum, max, min). However, to distinguish the NULL value with 0 
> is very necessary.
> It should be like this
> *sum(null, null) = null*
> *sum(null, 1) = 1*
> *max(null, null) = null*
> *max(null, -1) = -1*
> *min(null,  -1)= -1*
>  in accordance with Hive and SparkSQL



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (KYLIN-3392) Support NULL value in Sum, Max, Min Aggregation

2020-12-29 Thread ASF GitHub Bot (Jira)


[ 
https://issues.apache.org/jira/browse/KYLIN-3392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17256223#comment-17256223
 ] 

ASF GitHub Bot commented on KYLIN-3392:
---

kyotoYaho commented on a change in pull request #1524:
URL: https://github.com/apache/kylin/pull/1524#discussion_r549907811



##
File path: 
core-metadata/src/main/java/org/apache/kylin/metadata/datatype/BigDecimalSerializer.java
##
@@ -47,8 +47,7 @@ public BigDecimalSerializer(DataType type) {
 @Override
 public void serialize(BigDecimal value, ByteBuffer out) {
 if (value == null) {
-BytesUtil.writeVInt(0, out);

Review comment:
   We cannot change the null check logic for backward compatibility





This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


> Support NULL value in Sum, Max, Min Aggregation
> ---
>
> Key: KYLIN-3392
> URL: https://issues.apache.org/jira/browse/KYLIN-3392
> Project: Kylin
>  Issue Type: Bug
>Reporter: Yifei Wu
>Assignee: Yifei Wu
>Priority: Major
> Fix For: Future
>
> Attachments: KYLIN-3392-2.png, KYLIN-3392.png, kylin-3.0.0-alpha2.png
>
>
> It is treated as 0 when confronted with NULL value in KYLIN's basic aggregate 
> measure (like sum, max, min). However, to distinguish the NULL value with 0 
> is very necessary.
> It should be like this
> *sum(null, null) = null*
> *sum(null, 1) = 1*
> *max(null, null) = null*
> *max(null, -1) = -1*
> *min(null,  -1)= -1*
>  in accordance with Hive and SparkSQL



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (KYLIN-3392) Support NULL value in Sum, Max, Min Aggregation

2020-12-29 Thread ASF GitHub Bot (Jira)


[ 
https://issues.apache.org/jira/browse/KYLIN-3392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17256039#comment-17256039
 ] 

ASF GitHub Bot commented on KYLIN-3392:
---

codecov-io commented on pull request #1524:
URL: https://github.com/apache/kylin/pull/1524#issuecomment-752141845


   # [Codecov](https://codecov.io/gh/apache/kylin/pull/1524?src=pr=h1) Report
   > Merging 
[#1524](https://codecov.io/gh/apache/kylin/pull/1524?src=pr=desc) (fe04ca8) 
into 
[master](https://codecov.io/gh/apache/kylin/commit/fe04ca8d3be6c50742246663d6fd6767a568bcf8?el=desc)
 (fe04ca8) will **not change** coverage.
   > The diff coverage is `n/a`.
   
   [![Impacted file tree 
graph](https://codecov.io/gh/apache/kylin/pull/1524/graphs/tree.svg?width=650=150=pr=JawVgbgsVo)](https://codecov.io/gh/apache/kylin/pull/1524?src=pr=tree)
   
   ```diff
   @@Coverage Diff@@
   ## master#1524   +/-   ##
   =
 Coverage 25.44%   25.44%   
 Complexity 6765 6765   
   =
 Files  1507 1507   
 Lines 9378493784   
 Branches  1313213132   
   =
 Hits  2386723867   
 Misses6753367533   
 Partials   2384 2384   
   ```
   
   
   
   --
   
   [Continue to review full report at 
Codecov](https://codecov.io/gh/apache/kylin/pull/1524?src=pr=continue).
   > **Legend** - [Click here to learn 
more](https://docs.codecov.io/docs/codecov-delta)
   > `Δ = absolute  (impact)`, `ø = not affected`, `? = missing data`
   > Powered by 
[Codecov](https://codecov.io/gh/apache/kylin/pull/1524?src=pr=footer). Last 
update 
[fe04ca8...16626be](https://codecov.io/gh/apache/kylin/pull/1524?src=pr=lastupdated).
 Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments).
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


> Support NULL value in Sum, Max, Min Aggregation
> ---
>
> Key: KYLIN-3392
> URL: https://issues.apache.org/jira/browse/KYLIN-3392
> Project: Kylin
>  Issue Type: Bug
>Reporter: Yifei Wu
>Assignee: Yifei Wu
>Priority: Major
> Fix For: Future
>
> Attachments: KYLIN-3392-2.png, KYLIN-3392.png, kylin-3.0.0-alpha2.png
>
>
> It is treated as 0 when confronted with NULL value in KYLIN's basic aggregate 
> measure (like sum, max, min). However, to distinguish the NULL value with 0 
> is very necessary.
> It should be like this
> *sum(null, null) = null*
> *sum(null, 1) = 1*
> *max(null, null) = null*
> *max(null, -1) = -1*
> *min(null,  -1)= -1*
>  in accordance with Hive and SparkSQL



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (KYLIN-3392) Support NULL value in Sum, Max, Min Aggregation

2020-12-29 Thread ASF GitHub Bot (Jira)


[ 
https://issues.apache.org/jira/browse/KYLIN-3392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17256012#comment-17256012
 ] 

ASF GitHub Bot commented on KYLIN-3392:
---

lgtm-com[bot] commented on pull request #1524:
URL: https://github.com/apache/kylin/pull/1524#issuecomment-752092530


   This pull request **introduces 1 alert** when merging 
16626beab8cef6a5d300faea2f144b1246d50645 into 
fe04ca8d3be6c50742246663d6fd6767a568bcf8 - [view on 
LGTM.com](https://lgtm.com/projects/g/apache/kylin/rev/pr-d678600f0c907af0011ba9b63bf7c447413a2d7c)
   
   **new alerts:**
   
   * 1 for Boxed variable is never null



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


> Support NULL value in Sum, Max, Min Aggregation
> ---
>
> Key: KYLIN-3392
> URL: https://issues.apache.org/jira/browse/KYLIN-3392
> Project: Kylin
>  Issue Type: Bug
>Reporter: Yifei Wu
>Assignee: Yifei Wu
>Priority: Major
> Fix For: Future
>
> Attachments: KYLIN-3392-2.png, KYLIN-3392.png, kylin-3.0.0-alpha2.png
>
>
> It is treated as 0 when confronted with NULL value in KYLIN's basic aggregate 
> measure (like sum, max, min). However, to distinguish the NULL value with 0 
> is very necessary.
> It should be like this
> *sum(null, null) = null*
> *sum(null, 1) = 1*
> *max(null, null) = null*
> *max(null, -1) = -1*
> *min(null,  -1)= -1*
>  in accordance with Hive and SparkSQL



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (KYLIN-3392) Support NULL value in Sum, Max, Min Aggregation

2020-12-29 Thread ASF GitHub Bot (Jira)


[ 
https://issues.apache.org/jira/browse/KYLIN-3392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255998#comment-17255998
 ] 

ASF GitHub Bot commented on KYLIN-3392:
---

hit-lacus opened a new pull request #1524:
URL: https://github.com/apache/kylin/pull/1524


   ## Proposed changes
   
   Describe the big picture of your changes here to communicate to the 
maintainers why we should accept this pull request. If it fixes a bug or 
resolves a feature request, be sure to link to that issue.
   
   ## Types of changes
   
   What types of changes does your code introduce to Kylin?
   _Put an `x` in the boxes that apply_
   
   - [ ] Bugfix (non-breaking change which fixes an issue)
   - [ ] New feature (non-breaking change which adds functionality)
   - [ ] Breaking change (fix or feature that would cause existing 
functionality to not work as expected)
   - [ ] Documentation Update (if none of the other choices apply)
   
   ## Checklist
   
   _Put an `x` in the boxes that apply. You can also fill these out after 
creating the PR. If you're unsure about any of them, don't hesitate to ask. 
We're here to help! This is simply a reminder of what we are going to look for 
before merging your code._
   
   - [ ] I have create an issue on [Kylin's 
jira](https://issues.apache.org/jira/browse/KYLIN), and have described the 
bug/feature there in detail
   - [ ] Commit messages in my PR start with the related jira ID, like 
"KYLIN- Make Kylin project open-source"
   - [ ] Compiling and unit tests pass locally with my changes
   - [ ] I have added tests that prove my fix is effective or that my feature 
works
   - [ ] If this change need a document change, I will prepare another pr 
against the `document` branch
   - [ ] Any dependent changes have been merged
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at 
user@kylin or dev@kylin by explaining why you chose the solution you did and 
what alternatives you considered, etc...
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


> Support NULL value in Sum, Max, Min Aggregation
> ---
>
> Key: KYLIN-3392
> URL: https://issues.apache.org/jira/browse/KYLIN-3392
> Project: Kylin
>  Issue Type: Bug
>Reporter: Yifei Wu
>Assignee: Yifei Wu
>Priority: Major
> Fix For: Future
>
> Attachments: KYLIN-3392-2.png, KYLIN-3392.png, kylin-3.0.0-alpha2.png
>
>
> It is treated as 0 when confronted with NULL value in KYLIN's basic aggregate 
> measure (like sum, max, min). However, to distinguish the NULL value with 0 
> is very necessary.
> It should be like this
> *sum(null, null) = null*
> *sum(null, 1) = 1*
> *max(null, null) = null*
> *max(null, -1) = -1*
> *min(null,  -1)= -1*
>  in accordance with Hive and SparkSQL



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (KYLIN-3392) Support NULL value in Sum, Max, Min Aggregation

2020-12-28 Thread Zhong Yanghong (Jira)


[ 
https://issues.apache.org/jira/browse/KYLIN-3392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1726#comment-1726
 ] 

Zhong Yanghong commented on KYLIN-3392:
---

Hi [~wangrupeng], I applied the patch to 3.1.0 and it works well. Could you try 
it?

> Support NULL value in Sum, Max, Min Aggregation
> ---
>
> Key: KYLIN-3392
> URL: https://issues.apache.org/jira/browse/KYLIN-3392
> Project: Kylin
>  Issue Type: Bug
>Reporter: Yifei Wu
>Assignee: Yifei Wu
>Priority: Major
> Fix For: Future
>
> Attachments: KYLIN-3392-2.png, KYLIN-3392.png, kylin-3.0.0-alpha2.png
>
>
> It is treated as 0 when confronted with NULL value in KYLIN's basic aggregate 
> measure (like sum, max, min). However, to distinguish the NULL value with 0 
> is very necessary.
> It should be like this
> *sum(null, null) = null*
> *sum(null, 1) = 1*
> *max(null, null) = null*
> *max(null, -1) = -1*
> *min(null,  -1)= -1*
>  in accordance with Hive and SparkSQL



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (KYLIN-3392) Support NULL value in Sum, Max, Min Aggregation

2019-09-20 Thread wangrupeng (Jira)


[ 
https://issues.apache.org/jira/browse/KYLIN-3392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16934404#comment-16934404
 ] 

wangrupeng commented on KYLIN-3392:
---

This pr can cause other serious problem, there are details about the problem I 
met.

when I query with aggregate function such as count, sum, max, min, etc,   if 
the column values are all NULL or the values filter by  where condition 
contains NULL , the query thread will be hang up and after about one minute it 
will throw an exception.

To reproduce this problem, I create a new hive table whose table structure is 
same as KYLIN_SALES and contains 4 rows, the column contains two NULL values is 
PRICE :

1   2013/10/19  FP-non  37831    0     13  30          3          1209
10003717ANALYST Beijing
2   2012/10/22  Others  140746  100  11   70         20         1154
10006076ADMIN   Shanghai
3   2013/10/19  FP-non  37831    0     13  NULL3           1209
10003717ANALYST Beijing
4   2012/10/22  Others  140746  100  11   NULLNULL115410006076  
  ADMIN   Shanghai

And then I build model and cube using this table named KYLIN_SALES_3392 as fact 
table and no lookup table. I compare the kylin which merged this pr with the 
one that didn't merge.

Merged this pr, like I said , when where condition filter column values 
contains NULL, it will throw an exception:
select min(price) from kylin_sales_3392 where trans_id>=1 and trans_id<=4 
!KYLIN-3392.png|width=654,height=296!


if where condition filter column values don't contain NULL, it will work 
properlyselect min(price) from kylin_sales_3392 where trans_id>=1 and 
trans_id<=2
!KYLIN-3392-2.png|width=680,height=256!


And below is the result from origin kylin version
select min(price) from kylin_sales_3392 where trans_id>=1 and trans_id<=4
!kylin-3.0.0-alpha2.png|width=668,height=215!

> Support NULL value in Sum, Max, Min Aggregation
> ---
>
> Key: KYLIN-3392
> URL: https://issues.apache.org/jira/browse/KYLIN-3392
> Project: Kylin
>  Issue Type: Bug
>Reporter: Yifei Wu
>Assignee: Yifei Wu
>Priority: Major
> Fix For: v3.0.0-beta, v2.6.4
>
> Attachments: KYLIN-3392-2.png, KYLIN-3392.png, kylin-3.0.0-alpha2.png
>
>
> It is treated as 0 when confronted with NULL value in KYLIN's basic aggregate 
> measure (like sum, max, min). However, to distinguish the NULL value with 0 
> is very necessary.
> It should be like this
> *sum(null, null) = null*
> *sum(null, 1) = 1*
> *max(null, null) = null*
> *max(null, -1) = -1*
> *min(null,  -1)= -1*
>  in accordance with Hive and SparkSQL



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (KYLIN-3392) Support NULL value in Sum, Max, Min Aggregation

2019-09-11 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/KYLIN-3392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16927599#comment-16927599
 ] 

ASF subversion and git services commented on KYLIN-3392:


Commit 1a2f779a074c1d03703eebbb7506d171ef26ce56 in kylin's branch 
refs/heads/master from Yifei Wu
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=1a2f779 ]

Kylin 3392 support sum(null)

* KYLIN-3392 support sum(null)

* KYLIN-3392 support sum(null)

* Minor, code review


> Support NULL value in Sum, Max, Min Aggregation
> ---
>
> Key: KYLIN-3392
> URL: https://issues.apache.org/jira/browse/KYLIN-3392
> Project: Kylin
>  Issue Type: Bug
>Reporter: Yifei Wu
>Assignee: Yifei Wu
>Priority: Major
> Fix For: v3.0.0, v2.6.4
>
>
> It is treated as 0 when confronted with NULL value in KYLIN's basic aggregate 
> measure (like sum, max, min). However, to distinguish the NULL value with 0 
> is very necessary.
> It should be like this
> *sum(null, null) = null*
> *sum(null, 1) = 1*
> *max(null, null) = null*
> *max(null, -1) = -1*
> *min(null,  -1)= -1*
>  in accordance with Hive and SparkSQL



--
This message was sent by Atlassian Jira
(v8.3.2#803003)


[jira] [Commented] (KYLIN-3392) Support NULL value in Sum, Max, Min Aggregation

2019-09-11 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/KYLIN-3392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16927598#comment-16927598
 ] 

ASF subversion and git services commented on KYLIN-3392:


Commit 1a2f779a074c1d03703eebbb7506d171ef26ce56 in kylin's branch 
refs/heads/master from Yifei Wu
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=1a2f779 ]

Kylin 3392 support sum(null)

* KYLIN-3392 support sum(null)

* KYLIN-3392 support sum(null)

* Minor, code review


> Support NULL value in Sum, Max, Min Aggregation
> ---
>
> Key: KYLIN-3392
> URL: https://issues.apache.org/jira/browse/KYLIN-3392
> Project: Kylin
>  Issue Type: Bug
>Reporter: Yifei Wu
>Assignee: Yifei Wu
>Priority: Major
> Fix For: v3.0.0, v2.6.4
>
>
> It is treated as 0 when confronted with NULL value in KYLIN's basic aggregate 
> measure (like sum, max, min). However, to distinguish the NULL value with 0 
> is very necessary.
> It should be like this
> *sum(null, null) = null*
> *sum(null, 1) = 1*
> *max(null, null) = null*
> *max(null, -1) = -1*
> *min(null,  -1)= -1*
>  in accordance with Hive and SparkSQL



--
This message was sent by Atlassian Jira
(v8.3.2#803003)


[jira] [Commented] (KYLIN-3392) support NULL value in Sum, Max, Min Aggregation

2019-09-02 Thread Shaofeng SHI (Jira)


[ 
https://issues.apache.org/jira/browse/KYLIN-3392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16920660#comment-16920660
 ] 

Shaofeng SHI commented on KYLIN-3392:
-

Related PR: [https://github.com/apache/kylin/pull/819]

> support NULL value in Sum, Max, Min Aggregation
> ---
>
> Key: KYLIN-3392
> URL: https://issues.apache.org/jira/browse/KYLIN-3392
> Project: Kylin
>  Issue Type: Bug
>Reporter: Yifei Wu
>Assignee: Yifei Wu
>Priority: Major
>
> It is treated as 0 when confronted with NULL value in KYLIN's basic aggregate 
> measure (like sum, max, min). However, to distinguish the NULL value with 0 
> is very necessary.
> It should be like this
> *sum(null, null) = null*
> *sum(null, 1) = 1*
> *max(null, null) = null*
> *max(null, -1) = -1*
> *min(null,  -1)= -1*
>  in accordance with Hive and SparkSQL



--
This message was sent by Atlassian Jira
(v8.3.2#803003)


[jira] [Commented] (KYLIN-3392) support NULL value in Sum, Max, Min Aggregation

2018-05-30 Thread Yifei Wu (JIRA)


[ 
https://issues.apache.org/jira/browse/KYLIN-3392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16494768#comment-16494768
 ] 

Yifei Wu commented on KYLIN-3392:
-

[~albertoramon] you mean this issue KYLIN_2049

> support NULL value in Sum, Max, Min Aggregation
> ---
>
> Key: KYLIN-3392
> URL: https://issues.apache.org/jira/browse/KYLIN-3392
> Project: Kylin
>  Issue Type: Bug
>Reporter: Yifei Wu
>Assignee: Yifei Wu
>Priority: Major
>
> It is treated as 0 when confronted with NULL value in KYLIN's basic aggregate 
> measure (like sum, max, min). However, to distinguish the NULL value with 0 
> is very necessary.
> It should be like this
> *sum(null, null) = null*
> *sum(null, 1) = 1*
> *max(null, null) = null*
> *max(null, -1) = -1*
> *min(null,  -1)= -1*
>  in accordance with Hive and SparkSQL



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (KYLIN-3392) support NULL value in Sum, Max, Min Aggregation

2018-05-29 Thread albertoramon (JIRA)


[ 
https://issues.apache.org/jira/browse/KYLIN-3392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16494209#comment-16494209
 ] 

albertoramon commented on KYLIN-3392:
-

Could be added _count(null)_ ?

I have an scenario were >50% of joins (Fact -Dim) must be nulls

 

> support NULL value in Sum, Max, Min Aggregation
> ---
>
> Key: KYLIN-3392
> URL: https://issues.apache.org/jira/browse/KYLIN-3392
> Project: Kylin
>  Issue Type: Bug
>Reporter: Yifei Wu
>Assignee: Yifei Wu
>Priority: Major
>
> It is treated as 0 when confronted with NULL value in KYLIN's basic aggregate 
> measure (like sum, max, min). However, to distinguish the NULL value with 0 
> is very necessary.
> It should be like this
> *sum(null, null) = null*
> *sum(null, 1) = 1*
> *max(null, null) = null*
> *max(null, -1) = -1*
> *min(null,  -1)= -1*
>  in accordance with Hive and SparkSQL



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (KYLIN-3392) support NULL value in Sum, Max, Min Aggregation

2018-05-29 Thread Yifei Wu (JIRA)


[ 
https://issues.apache.org/jira/browse/KYLIN-3392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16493495#comment-16493495
 ] 

Yifei Wu commented on KYLIN-3392:
-

To solve this bug, It is reasonable to add extra code for LONG.null, 
DOUBLE.null, BigDecimal.null, which will be saved in build cube.

> support NULL value in Sum, Max, Min Aggregation
> ---
>
> Key: KYLIN-3392
> URL: https://issues.apache.org/jira/browse/KYLIN-3392
> Project: Kylin
>  Issue Type: Bug
>Reporter: Yifei Wu
>Assignee: Yifei Wu
>Priority: Major
>
> It is treated as 0 when confronted with NULL value in KYLIN's basic aggregate 
> measure (like sum, max, min). However, to distinguish the NULL value with 0 
> is very necessary.
> It should be like this
> *sum(null, null) = null*
> *sum(null, 1) = 1*
> *max(null, null) = null*
> *max(null, -1) = -1*
> *min(null,  -1)= -1*
>  in accordance with Hive and SparkSQL



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)