[
https://issues.apache.org/jira/browse/KUDU-3518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17837956#comment-17837956
]
ASF subversion and git services commented on KUDU-3518:
-------------------------------------------------------
Commit 0de168f7e0abcf0c29facefcc9c0c9e12b284140 in kudu's branch
refs/heads/branch-1.17.x from Abhishek Chennaka
[ https://gitbox.apache.org/repos/asf?p=kudu.git;h=0de168f7e ]
KUDU-3518: Fix the unexpected scan predicate
With the changes introduced in a previous patch[1], there have been
reports of errors during scan operations. This patch fixes these
scan errors.
This patch removes NON-NULL predicates on primary columns implicitly
added by ScanSpec::LiftPrimaryKeyBounds(), calling
ScanSpec::OptimizeScan() while optimizing InList scan predicates at the
DRS level. That's similar to what's done be optimizing the InList
predicates based on tablet PK bounds at a higher level.
The issue has been investigated and fixed in collaboration with Alexey
Serbin.
There will be follow-up patches to include tests of this failure.
[1] https://gerrit.cloudera.org/#/c/18434/
Change-Id: I220df7ec1b4f95726c913a19125f4647267d12b1
Reviewed-on: http://gerrit.cloudera.org:8080/21244
Reviewed-by: Alexey Serbin <[email protected]>
Tested-by: Alexey Serbin <[email protected]>
Reviewed-by: Yifan Zhang <[email protected]>
(cherry picked from commit 946acb711d722b1e6fe27af2c7de92960d724980)
Reviewed-on: http://gerrit.cloudera.org:8080/21314
> node error when impala query
> ----------------------------
>
> Key: KUDU-3518
> URL: https://issues.apache.org/jira/browse/KUDU-3518
> Project: Kudu
> Issue Type: Bug
> Components: tserver
> Affects Versions: 1.17.0
> Environment: centos7.9
> Reporter: Pain Sun
> Priority: Major
> Attachments: profile_error_1.17.txt, profile_success_1.16.txt,
> profile_success_1.17.txt
>
>
> Scan kudu with impala-4.3.0 ,there is a bug when reading a table with an
> empty string in primary key field.
> sql:
> select
> count(distinct thirdnick)
> from
> member.qyexternaluserdetailinfo_new
> where
> (
> mainshopnick = "xxx"
> and ownercorpid in ("xxx", "")
> and shoptype not in ("35", "56")
> and isDelete = 0
> and thirdnick != ""
> and thirdnick is not null
> );
>
> error:ERROR: Unable to open scanner for node with id '1' for Kudu table
> 'impala::member.qyexternaluserdetailinfo_new': Invalid argument: No such
> column: shopnick
>
> If update sql like this:
> select
> count(distinct thirdnick)
> from
> member.qyexternaluserdetailinfo_new
> where
> (
> mainshopnick = "xxx"
> and ownercorpid in ("xxx", "")
> and shopnick not in ('')
> and shoptype not in ("35", "56")
> and isDelete = 0
> and thirdnick != ""
> and thirdnick is not null
> );
> no error.
>
> this error appears in kudu-1.17.0 ,but kudu-1.16.0 is good.
>
> There is 1000000 items in this table ,280000 items where empty string.
> table schema like this:
> +----------------+-----------+---------+-------------+------------+----------+---------------+---------------+---------------------+------------+
> | name | type | comment | primary_key | key_unique | nullable
> | default_value | encoding | compression | block_size |
> +----------------+-----------+---------+-------------+------------+----------+---------------+---------------+---------------------+------------+
> | mainshopnick | string | | true | true | false
> | | AUTO_ENCODING | DEFAULT_COMPRESSION | 0 |
> | shopnick | string | | true | true | false
> | | AUTO_ENCODING | DEFAULT_COMPRESSION | 0 |
> | ownercorpid | string | | true | true | false
> | | AUTO_ENCODING | DEFAULT_COMPRESSION | 0 |
> | shoptype | string | | true | true | false
> | | AUTO_ENCODING | DEFAULT_COMPRESSION | 0 |
> | clientid | string | | true | true | false
> | | AUTO_ENCODING | DEFAULT_COMPRESSION | 0 |
> | thirdnick | string | | true | true | false
> | | AUTO_ENCODING | DEFAULT_COMPRESSION | 0 |
> | id | bigint | | true | true | false
> | | AUTO_ENCODING | DEFAULT_COMPRESSION | 0 |
> | receivermobile | string | | false | | true
> | | AUTO_ENCODING | DEFAULT_COMPRESSION | 0 |
> | thirdrealname | string | | false | | true
> | | AUTO_ENCODING | DEFAULT_COMPRESSION | 0 |
> | remark | string | | false | | true
> | | AUTO_ENCODING | DEFAULT_COMPRESSION | 0 |
> | createtime | timestamp | | false | | true
> | | AUTO_ENCODING | DEFAULT_COMPRESSION | 0 |
> | updatetime | timestamp | | false | | true
> | | AUTO_ENCODING | DEFAULT_COMPRESSION | 0 |
> | isdelete | int | | false | | true
> | 0 | AUTO_ENCODING | DEFAULT_COMPRESSION | 0 |
> | buyernick | string | | false | | true
> | | AUTO_ENCODING | DEFAULT_COMPRESSION | 0 |
> +----------------+-----------+---------+-------------+------------+----------+---------------+---------------+---------------------+------------+
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
