[
https://issues.apache.org/jira/browse/IMPALA-13567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17901322#comment-17901322
]
ASF subversion and git services commented on IMPALA-13567:
----------------------------------------------------------
Commit 0677b8a0bab5288713d2e1a00ff5ec3123ab284c in impala's branch
refs/heads/master from Riza Suminto
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=0677b8a0b ]
IMPALA-13567: Update RowsRead counter more frequently
HdfsColumnarScanner implementation update RowsRead counter near the very
end of AssembleRows function. Ideally, RowsRead should be incremented
more frequently, every time before calling TransferScratchTuples where
conjunct and runtime filter evaluation happen. That way, RowsRead is
increased even if all rows in the scratch batch are filtered by conjunct
or runtime filter.
This patch move the counter increment just before TransferScratchTuples.
Testing:
- Pass core tests.
Change-Id: I17f1c40a0e790750ffbd4e987ca181b82cc14c40
Reviewed-on: http://gerrit.cloudera.org:8080/22102
Reviewed-by: Impala Public Jenkins <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>
> Update RowsRead counter more frequently.
> ----------------------------------------
>
> Key: IMPALA-13567
> URL: https://issues.apache.org/jira/browse/IMPALA-13567
> Project: IMPALA
> Issue Type: Improvement
> Components: Backend
> Reporter: Riza Suminto
> Assignee: Riza Suminto
> Priority: Major
> Fix For: Impala 4.5.0
>
>
> HdfsColumnarScanner implementation update RowsRead counter near the very end
> of AssembleRows function. Ideally, RowsRead should be incremented more
> frequently, every time before calling TransferScratchTuples where conjunct
> and runtime filter evaluation happen.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
