Todd Lipcon has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/9790 )
Change subject: KUDU-16 pt 2: add client-side limits on scanners ...................................................................... KUDU-16 pt 2: add client-side limits on scanners This patch adds a public API to allow the specification of per-client-side-scanner limits on the number of rows returned. Each scanner will maintain a count of the number of rows already read, and adjust the server-side limit upon sending the next scan request. A couple of tests are included to verify that the limits act as expected. I also verified that lowering the limit reduces the number of bytes read on disk (at the granularity of a single scan batch at a time). Note: this patch does not implement the behavior for scan tokens. Change-Id: Ib2d40e3d14e36f3bf1d09a4bfdb3e17a745d244d Reviewed-on: http://gerrit.cloudera.org:8080/9790 Tested-by: Kudu Jenkins Reviewed-by: Todd Lipcon <t...@apache.org> --- M src/kudu/client/client-test.cc M src/kudu/client/client.cc M src/kudu/client/client.h M src/kudu/client/scan_configuration.cc M src/kudu/client/scan_configuration.h M src/kudu/client/scanner-internal.cc M src/kudu/client/scanner-internal.h 7 files changed, 184 insertions(+), 39 deletions(-) Approvals: Kudu Jenkins: Verified Todd Lipcon: Looks good to me, approved -- To view, visit http://gerrit.cloudera.org:8080/9790 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: kudu Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: Ib2d40e3d14e36f3bf1d09a4bfdb3e17a745d244d Gerrit-Change-Number: 9790 Gerrit-PatchSet: 6 Gerrit-Owner: Andrew Wong <aw...@cloudera.com> Gerrit-Reviewer: Andrew Wong <aw...@cloudera.com> Gerrit-Reviewer: David Ribeiro Alves <davidral...@gmail.com> Gerrit-Reviewer: Kudu Jenkins Gerrit-Reviewer: Todd Lipcon <t...@apache.org>
