Quanlong Huang has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/19129 )
Change subject: IMPALA-11558: Ensure one Kudu client created (FE) for the specified Kudu master addresses ...................................................................... IMPALA-11558: Ensure one Kudu client created (FE) for the specified Kudu master addresses Creating Kudu clients is very expensive as each will fetch metadata from the Kudu master, so we have to ensure only one Kudu client created for a given Kudu master address. The solution is to ensure KuduUtil.getKuduClient created only one KuduClient for the specified Kudu master addresses by using 'computeIfAbsent' of the ConcurrentHashMap. Testing: - Manually ran a stress test: scan of a Kudu table, 1000 concurrent queries and verified the untracked memory - Added concurrent tests for KuduUtil.getKuduClient - Ran the full set of verifications in Impala Public Jenkins Change-Id: I1003556d3afc8e8216142cac4007a4c99046caeb Reviewed-on: http://gerrit.cloudera.org:8080/19046 Reviewed-by: Impala Public Jenkins <[email protected]> Tested-by: Impala Public Jenkins <[email protected]> Reviewed-on: http://gerrit.cloudera.org:8080/19129 Reviewed-by: Wenzhe Zhou <[email protected]> --- M fe/src/main/java/org/apache/impala/util/KuduUtil.java A fe/src/test/java/org/apache/impala/util/KuduUtilTest.java 2 files changed, 88 insertions(+), 5 deletions(-) Approvals: Impala Public Jenkins: Verified Wenzhe Zhou: Looks good to me, approved -- To view, visit http://gerrit.cloudera.org:8080/19129 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: branch-4.1.1 Gerrit-MessageType: merged Gerrit-Change-Id: I1003556d3afc8e8216142cac4007a4c99046caeb Gerrit-Change-Number: 19129 Gerrit-PatchSet: 3 Gerrit-Owner: Quanlong Huang <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Quanlong Huang <[email protected]> Gerrit-Reviewer: Wenzhe Zhou <[email protected]> Gerrit-Reviewer: Xianqing He <[email protected]>
