Bikramjeet Vig has posted comments on this change. ( http://gerrit.cloudera.org:8080/11440 )
Change subject: IMPALA-7351: Improve memory estimates for Kudu Scan Nodes ...................................................................... Patch Set 2: (5 comments) http://gerrit.cloudera.org:8080/#/c/11440/2/fe/src/main/java/org/apache/impala/planner/KuduScanNode.java File fe/src/main/java/org/apache/impala/planner/KuduScanNode.java: http://gerrit.cloudera.org:8080/#/c/11440/2/fe/src/main/java/org/apache/impala/planner/KuduScanNode.java@284 PS2, Line 284: int perHostScanRanges = (int) Math.ceil(((double) scanRangeSpecs_ > Can we factor out the per-host scan range calculation into a helper? I know That was my initial thought too but this calculation is quite different between hdfs and kudu scan nodes http://gerrit.cloudera.org:8080/#/c/11440/2/fe/src/main/java/org/apache/impala/planner/KuduScanNode.java@296 PS2, Line 296: .setMemEstimateBytes(mem_estimate_per_thread * maxScannerThreads) > This new indentation seems weird to me. Done http://gerrit.cloudera.org:8080/#/c/11440/2/fe/src/main/java/org/apache/impala/planner/ScanNode.java File fe/src/main/java/org/apache/impala/planner/ScanNode.java: http://gerrit.cloudera.org:8080/#/c/11440/2/fe/src/main/java/org/apache/impala/planner/ScanNode.java@232 PS2, Line 232: ComputeMaxNumberOfScannerThreads > Initial letter of method name should be lower-case in java. Done http://gerrit.cloudera.org:8080/#/c/11440/2/fe/src/main/java/org/apache/impala/planner/ScanNode.java@237 PS2, Line 237: maxScannerThreads = 1; > We can just return early here (and eliminate the nesting of the else branch Done http://gerrit.cloudera.org:8080/#/c/11440/2/testdata/workloads/functional-planner/queries/PlannerTest/resource-requirements.test File testdata/workloads/functional-planner/queries/PlannerTest/resource-requirements.test: http://gerrit.cloudera.org:8080/#/c/11440/2/testdata/workloads/functional-planner/queries/PlannerTest/resource-requirements.test@5256 PS2, Line 5256: select * from functional_kudu.alltypes > Can you also add a scan of a single column and a scan of count(*) and a sca Done -- To view, visit http://gerrit.cloudera.org:8080/11440 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: If9bb52530271b0bff91311a67d222a2e9fac1229 Gerrit-Change-Number: 11440 Gerrit-PatchSet: 2 Gerrit-Owner: Bikramjeet Vig <[email protected]> Gerrit-Reviewer: Bikramjeet Vig <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Tim Armstrong <[email protected]> Gerrit-Comment-Date: Mon, 24 Sep 2018 21:20:38 +0000 Gerrit-HasComments: Yes
