[
https://issues.apache.org/jira/browse/HIVE-24762?focusedWorklogId=817855&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-817855
]
ASF GitHub Bot logged work on HIVE-24762:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 18/Oct/22 00:32
Start Date: 18/Oct/22 00:32
Worklog Time Spent: 10m
Work Description: github-actions[bot] closed pull request #1965:
HIVE-24762: StringValueBoundaryScanner ignores boundary which leads to
incorrect results
URL: https://github.com/apache/hive/pull/1965
Issue Time Tracking
-------------------
Worklog Id: (was: 817855)
Time Spent: 2h 40m (was: 2.5h)
> StringValueBoundaryScanner ignores boundary which leads to incorrect results
> -----------------------------------------------------------------------------
>
> Key: HIVE-24762
> URL: https://issues.apache.org/jira/browse/HIVE-24762
> Project: Hive
> Issue Type: Bug
> Reporter: László Bodor
> Assignee: László Bodor
> Priority: Major
> Labels: pull-request-available
> Time Spent: 2h 40m
> Remaining Estimate: 0h
>
> https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/udf/ptf/ValueBoundaryScanner.java#L901
> {code}
> public boolean isDistanceGreater(Object v1, Object v2, int amt) {
> ...
> return s1 != null && s2 != null && s1.compareTo(s2) > 0;
> {code}
> Like other boundary scanners, StringValueBoundaryScanner should take amt into
> account, otherwise it'll result in the same range regardless of the given
> window size. This typically affects queries where the range is defined on a
> string column:
> {code}
> select p_mfgr, p_name, p_retailprice,
> count(*) over(partition by p_mfgr order by p_name range between 1 preceding
> and current row) as cs1,
> count(*) over(partition by p_mfgr order by p_name range between 3 preceding
> and current row) as cs2
> from vector_ptf_part_simple_orc;
> {code}
> with "> 0" cs1 and cs2 will be calculated on the same window, so cs1 == cs2,
> but actually it should be different, this is the correct result (see "almond
> antique olive coral navajo"):
> {code}
> +-----------------+---------------------------------------------+------+------+
> | p_mfgr | p_name | cs1 | cs2
> |
> +-----------------+---------------------------------------------+------+------+
> | Manufacturer#1 | almond antique burnished rose metallic | 2 | 2
> |
> | Manufacturer#1 | almond antique burnished rose metallic | 2 | 2
> |
> | Manufacturer#1 | almond antique chartreuse lavender yellow | 6 | 6
> |
> | Manufacturer#1 | almond antique chartreuse lavender yellow | 6 | 6
> |
> | Manufacturer#1 | almond antique chartreuse lavender yellow | 6 | 6
> |
> | Manufacturer#1 | almond antique chartreuse lavender yellow | 6 | 6
> |
> | Manufacturer#1 | almond antique salmon chartreuse burlywood | 1 | 1
> |
> | Manufacturer#1 | almond aquamarine burnished black steel | 1 | 8
> |
> | Manufacturer#1 | almond aquamarine pink moccasin thistle | 4 | 4
> |
> | Manufacturer#1 | almond aquamarine pink moccasin thistle | 4 | 4
> |
> | Manufacturer#1 | almond aquamarine pink moccasin thistle | 4 | 4
> |
> | Manufacturer#1 | almond aquamarine pink moccasin thistle | 4 | 4
> |
> | Manufacturer#2 | almond antique violet chocolate turquoise | 1 | 1
> |
> | Manufacturer#2 | almond antique violet turquoise frosted | 3 | 3
> |
> | Manufacturer#2 | almond antique violet turquoise frosted | 3 | 3
> |
> | Manufacturer#2 | almond antique violet turquoise frosted | 3 | 3
> |
> | Manufacturer#2 | almond aquamarine midnight light salmon | 1 | 5
> |
> | Manufacturer#2 | almond aquamarine rose maroon antique | 2 | 2
> |
> | Manufacturer#2 | almond aquamarine rose maroon antique | 2 | 2
> |
> | Manufacturer#2 | almond aquamarine sandy cyan gainsboro | 3 | 3
> |
> | Manufacturer#3 | almond antique chartreuse khaki white | 1 | 1
> |
> | Manufacturer#3 | almond antique forest lavender goldenrod | 4 | 5
> |
> | Manufacturer#3 | almond antique forest lavender goldenrod | 4 | 5
> |
> | Manufacturer#3 | almond antique forest lavender goldenrod | 4 | 5
> |
> | Manufacturer#3 | almond antique forest lavender goldenrod | 4 | 5
> |
> | Manufacturer#3 | almond antique metallic orange dim | 1 | 1
> |
> | Manufacturer#3 | almond antique misty red olive | 1 | 1
> |
> | Manufacturer#3 | almond antique olive coral navajo | 1 | 3
> |
> | Manufacturer#4 | almond antique gainsboro frosted violet | 1 | 1
> |
> | Manufacturer#4 | almond antique violet mint lemon | 1 | 1
> |
> | Manufacturer#4 | almond aquamarine floral ivory bisque | 2 | 4
> |
> | Manufacturer#4 | almond aquamarine floral ivory bisque | 2 | 4
> |
> | Manufacturer#4 | almond aquamarine yellow dodger mint | 1 | 1
> |
> | Manufacturer#4 | almond azure aquamarine papaya violet | 1 | 1
> |
> | Manufacturer#5 | almond antique blue firebrick mint | 1 | 1
> |
> | Manufacturer#5 | almond antique medium spring khaki | 2 | 2
> |
> | Manufacturer#5 | almond antique medium spring khaki | 2 | 2
> |
> | Manufacturer#5 | almond antique sky peru orange | 1 | 1
> |
> | Manufacturer#5 | almond aquamarine dodger light gainsboro | 1 | 5
> |
> | Manufacturer#5 | almond azure blanched chiffon midnight | 1 | 1
> |
> +-----------------+---------------------------------------------+------+------+
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
