Wenzhe Zhou has posted comments on this change. ( http://gerrit.cloudera.org:8080/19366 )
Change subject: IMPALA-11617: Pool service should be made aware of cpu core limit ...................................................................... Patch Set 5: (1 comment) http://gerrit.cloudera.org:8080/#/c/19366/4//COMMIT_MSG Commit Message: http://gerrit.cloudera.org:8080/#/c/19366/4//COMMIT_MSG@14 PS4, Line 14: available per node and coordinator for each executor group, to the pool > There is a num_cores flag defined in src/util/cpu-info.cc. Maybe we can lev Each node in the cluster may have different memory size and number of cores. But in current design, scheduler assume all executors in an executor group have same resources, and planner assume all executor groups in an executor group set have same resource allocation. It's hard to set the core limit of pool service in runtime based on the number of cores of each nodes since the node could come and go. -- To view, visit http://gerrit.cloudera.org:8080/19366 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: Id4c5ee519ce7c329b06ac821283e215a3560f525 Gerrit-Change-Number: 19366 Gerrit-PatchSet: 5 Gerrit-Owner: Wenzhe Zhou <[email protected]> Gerrit-Reviewer: Abhishek Rawat <[email protected]> Gerrit-Reviewer: Andrew Sherman <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Kurt Deschler <[email protected]> Gerrit-Reviewer: Riza Suminto <[email protected]> Gerrit-Reviewer: Wenzhe Zhou <[email protected]> Gerrit-Comment-Date: Fri, 27 Jan 2023 19:10:19 +0000 Gerrit-HasComments: Yes
