Sahil Takiar has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/16041 )
Change subject: IMPALA-9818: Add fetch size as option to impala shell ...................................................................... IMPALA-9818: Add fetch size as option to impala shell Adds the option --fetch_size to the Impala shell. This new option allows users to specify the fetch size used when issuing fetch RPCs to the Impala Coordinator (e.g. TFetchResultsReq and BeeswaxService.fetch). This parameter applies for all client protocols: beeswax, hs2, hs2-http. The default --fetch_size is set to 10240 (10x the default batch size). The new --fetch_size parameter is most effective when result spooling is enabled. When result spooling is disabled, Impala can only return a single row batch per fetch RPC (so 1024 rows by default). When result spooling is enabled, Impala can return up to 100 row batches per fetch request. Removes some logic in the the impala_client.py file that attempts to simulate a fetch_size. The code would issue multiple fetch requests to fullfill the given fetch_size. This logic is no longer needed now that result spooling is available. Testing: * Ran core tests * Added new tests in test_shell_client.py and test_shell_commandline.py Change-Id: I8dc7962aada6b38795241d067a99bd94fabca57b Reviewed-on: http://gerrit.cloudera.org:8080/16041 Reviewed-by: Impala Public Jenkins <[email protected]> Tested-by: Sahil Takiar <[email protected]> --- M shell/impala_client.py M shell/impala_shell.py M shell/option_parser.py M tests/custom_cluster/test_hs2_fault_injection.py A tests/shell/test_shell_client.py M tests/shell/test_shell_commandline.py 6 files changed, 141 insertions(+), 37 deletions(-) Approvals: Impala Public Jenkins: Looks good to me, approved Sahil Takiar: Verified -- To view, visit http://gerrit.cloudera.org:8080/16041 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: I8dc7962aada6b38795241d067a99bd94fabca57b Gerrit-Change-Number: 16041 Gerrit-PatchSet: 5 Gerrit-Owner: Sahil Takiar <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Sahil Takiar <[email protected]> Gerrit-Reviewer: Tim Armstrong <[email protected]>
