[ 
https://issues.apache.org/jira/browse/IMPALA-7028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16487846#comment-16487846
 ] 

Tim Armstrong commented on IMPALA-7028:
---------------------------------------

According to the profile, all of the Kudu scan nodes returned only a fraction 
of the expected rows. I don't think the profile bug applies since it's a 
successful DML, which waits for all the final status reports to be sent in.
{noformat}
18:26:14 E           KUDU_SCAN_NODE (id=0):(Total: 4.999ms, non-child: 4.999ms, 
% non-child: 100.00%)
18:26:14 E              - BytesRead: 0
18:26:14 E              - CollectionItemsRead: 0 (0)
18:26:14 E              - KuduRemoteScanTokens: 0 (0)
18:26:14 E              - NumScannerThreadsStarted: 1 (1)
18:26:14 E              - PeakMemoryUsage: 12.00 KB (12288)
18:26:14 E              - RowsRead: 10 (10)
18:26:14 E              - RowsReturned: 10 (10)
18:26:14 E              - RowsReturnedRate: 2.00 K/sec
18:26:14 E              - ScanRangesComplete: 1 (1)
18:26:14 E              - ScannerThreadsInvoluntaryContextSwitches: 4 (4)
18:26:14 E              - ScannerThreadsTotalWallClockTime: 3.999ms
18:26:14 E                - MaterializeTupleTime(*): 1.999ms
18:26:14 E                - ScannerThreadsSysTime: 0.000ns
18:26:14 E                - ScannerThreadsUserTime: 999.000us
18:26:14 E              - ScannerThreadsVoluntaryContextSwitches: 3 (3)
18:26:14 E              - TotalKuduScanRoundTrips: 1 (1)
18:26:14 E              - TotalReadThroughput: 0.00 /sec
{noformat}

[~twmarshall] this looks like another case of Kudu scans mysteriously not 
returning the expected number of rows. Are we tracking those with a single 
JIRA. I guess the rows were inserted by the previous statement, run against the 
same coordinator. 
{noformat}

18:26:14 -- executing against localhost:21000
18:26:14 insert into tdata
18:26:14 select id, string_col, float_col, bigint_col, string_col, bool_col, 
tinyint_col,
18:26:14 smallint_col, double_col, NULL, NULL, NULL from 
functional_kudu.alltypes;
18:26:14 
18:26:14 -- executing against localhost:21000
18:26:14 update tdata set vali = -1;
{noformat}

> TestKuduOperations.test_kudu_update fails due to wrong NumModifiedRows
> ----------------------------------------------------------------------
>
>                 Key: IMPALA-7028
>                 URL: https://issues.apache.org/jira/browse/IMPALA-7028
>             Project: IMPALA
>          Issue Type: Bug
>          Components: Backend
>    Affects Versions: Impala 3.1.0
>            Reporter: Joe McDonnell
>            Assignee: Tim Armstrong
>            Priority: Critical
>              Labels: broken-build, flaky
>
> Seen once on master exhaustive:
> {noformat}
> query_test/test_kudu.py:92: in test_kudu_update
>     self.run_test_case('QueryTest/kudu_update', vector, 
> use_db=unique_database)
> common/impala_test_suite.py:451: in run_test_case
>     verify_runtime_profile(test_section['RUNTIME_PROFILE'], 
> result.runtime_profile)
> common/test_result_verifier.py:590: in verify_runtime_profile
>     actual))
> E   AssertionError: Did not find matches for lines in runtime profile:
> E   EXPECTED LINES:
> E   NumModifiedRows: 7300
> ...
> # From the actual profile:
> E   Partition: Default
> E   NumModifiedRows: 32
> E   NumRowErrors: 0{noformat}
> Will add a comment with the profile.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to