[
https://issues.apache.org/jira/browse/IMPALA-6812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16517426#comment-16517426
]
Thomas Tauber-Marshall commented on IMPALA-6812:
------------------------------------------------
commit 13b82624b58275469988147c33981446c86e4174 (apache/master)
Author: Thomas Tauber-Marshall <[email protected]>
Date: Wed May 23 23:11:01 2018 +0000
IMPALA-6812: Fix flaky Kudu scan tests
Many of our Kudu related tests have been flaky with the symptom that
scans appear to not return rows that were just inserted. This occurs
because our default Kudu scan level of READ_LATEST doesn't make any
consistency guarantees.
This patch adds a query option 'kudu_read_mode', which overrides the
startup flag of the same name, and then set that option to
READ_AT_SNAPSHOT for all tests with Kudu inserts and scans, which
should give us more consistent test results.
Testing:
- Passed a full exhaustive run. Does not appear to increase time to
run by any significant amount.
Change-Id: I70df84f2cbc663107f2ad029565d3c15bdfbd47c
Reviewed-on: http://gerrit.cloudera.org:8080/10503
Reviewed-by: Impala Public Jenkins <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>
> Kudu scans not returning all rows
> ---------------------------------
>
> Key: IMPALA-6812
> URL: https://issues.apache.org/jira/browse/IMPALA-6812
> Project: IMPALA
> Issue Type: Bug
> Affects Versions: Impala 3.0, Impala 2.13.0
> Reporter: Tianyi Wang
> Assignee: Thomas Tauber-Marshall
> Priority: Critical
> Labels: broken-build
> Fix For: Impala 3.1.0
>
>
> In a 2.x exhaustive build, test_column_storage_attributes failed:
> {noformat}
> Error Message
> query_test/test_kudu.py:383: in test_column_storage_attributes assert
> cursor.fetchall() == \ E assert [] == [(26, True, 0, 0, 0, 0, ...)] E
> Right contains more items, first extra item: (26, True, 0, 0, 0, 0, ...) E
> Use -v to get the full diff
> Stacktrace
> query_test/test_kudu.py:383: in test_column_storage_attributes
> assert cursor.fetchall() == \
> E assert [] == [(26, True, 0, 0, 0, 0, ...)]
> E Right contains more items, first extra item: (26, True, 0, 0, 0, 0, ...)
> E Use -v to get the full diff
> {noformat}
> The last alter column query in the log is:
> {noformat}
> alter table test_column_storage_attributes_b9040aa.storage_attrs alter
> column decimal_col
> set encoding DICT_ENCODING compression NO_COMPRESSION
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
