Impala Public Jenkins has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/19046 )
Change subject: IMPALA-11558: Ensure one Kudu client created (FE) for the specified Kudu master addresses ...................................................................... IMPALA-11558: Ensure one Kudu client created (FE) for the specified Kudu master addresses Creating Kudu clients is very expensive as each will fetch metadata from the Kudu master, so we have to ensure only one Kudu client created for a given Kudu master address. The solution is to ensure KuduUtil.getKuduClient created only one KuduClient for the specified Kudu master addresses by using 'computeIfAbsent' of the ConcurrentHashMap. Testing: - Manually ran a stress test: scan of a Kudu table, 1000 concurrent queries and verified the untracked memory - Added concurrent tests for KuduUtil.getKuduClient - Ran the full set of verifications in Impala Public Jenkins Change-Id: I1003556d3afc8e8216142cac4007a4c99046caeb Reviewed-on: http://gerrit.cloudera.org:8080/19046 Reviewed-by: Impala Public Jenkins <[email protected]> Tested-by: Impala Public Jenkins <[email protected]> --- M fe/src/main/java/org/apache/impala/util/KuduUtil.java A fe/src/test/java/org/apache/impala/util/KuduUtilTest.java 2 files changed, 88 insertions(+), 5 deletions(-) Approvals: Impala Public Jenkins: Looks good to me, approved; Verified -- To view, visit http://gerrit.cloudera.org:8080/19046 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: I1003556d3afc8e8216142cac4007a4c99046caeb Gerrit-Change-Number: 19046 Gerrit-PatchSet: 9 Gerrit-Owner: Xianqing He <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Jian Zhang <[email protected]> Gerrit-Reviewer: Wenzhe Zhou <[email protected]> Gerrit-Reviewer: Xiang Yang <[email protected]> Gerrit-Reviewer: Xianqing He <[email protected]>
