Wenzhe Zhou has uploaded this change for review. ( http://gerrit.cloudera.org:8080/20653
Change subject: IMPALA-12377: Improve count(*) performance for jdbc external table ...................................................................... IMPALA-12377: Improve count(*) performance for jdbc external table Backend function DataSourceScanNode::GetNext() handles count query inefficiently. Even there are no column data returned from external data source, it still tries to materialize rows and adds rows to RowBatch one by one up to the number of row count. It also call GetNextInputBatch() multiple times (count / batch_size), while GetNextInputBatch() invokes JNI function in external data source. This patch improves the DataSourceScanNode::GetNext() and JdbcDataSource.getNext() to avoid unnecessary function calls. Testing: - Passed core-tests. Change-Id: I9953dca949eb773022f1d6dcf48d8877857635d6 --- M be/src/exec/data-source-scan-node.cc M java/ext-data-source/jdbc/src/main/java/org/apache/impala/extdatasource/jdbc/JdbcDataSource.java 2 files changed, 32 insertions(+), 24 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/53/20653/1 -- To view, visit http://gerrit.cloudera.org:8080/20653 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newchange Gerrit-Change-Id: I9953dca949eb773022f1d6dcf48d8877857635d6 Gerrit-Change-Number: 20653 Gerrit-PatchSet: 1 Gerrit-Owner: Wenzhe Zhou <[email protected]>
