Andrew Wong has posted comments on this change. ( http://gerrit.cloudera.org:8080/12706 )
Change subject: [known_issues] the scalability of location awareness ...................................................................... Patch Set 4: (1 comment) http://gerrit.cloudera.org:8080/#/c/12706/3/docs/known_issues.adoc File docs/known_issues.adoc: http://gerrit.cloudera.org:8080/#/c/12706/3/docs/known_issues.adoc@151 PS3, Line 151: It's not expected to happen during regular usage of small and moderate-sized : Kudu clusters > I found that just around 10K replicas total *and not so huge size of master's > address space* (under 1GB), things went south Does you mean that the 10K replicas were not contributing to a larger master address space? In any case, I still think part of the punchline is missing re: the number of tablets, and I think the multiple recommended numbers is a bit confusing (e.g. which number should I care about? 20 or 100+?). Maybe instead of: It's not expected to happen during regular usage of small and moderate-sized Kudu clusters (up to 20 nodes or so) when the number of replicas per tablet server is not greater than 1000, but it might surface during regular usage of larger clusters (100+ nodes). If that happens, it's recommended to use the following workaround: maybe tweak it as: This behavior is not expected for regular usage of moderate-sized Kudu clusters when the number of replicas per tablet server is within the node density limits, but it may surface when increasing the number of tablet servers (e.g. 100+ nodes) or as the total number of replicas created cluster-wide increases (e.g. 10K+ replicas). WDYT? Or do you think 20 nodes is a better number to pass around? -- To view, visit http://gerrit.cloudera.org:8080/12706 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: kudu Gerrit-Branch: branch-1.9.x Gerrit-MessageType: comment Gerrit-Change-Id: I04dad488a377bf4cd36534d648a69d2fb2444fea Gerrit-Change-Number: 12706 Gerrit-PatchSet: 4 Gerrit-Owner: Alexey Serbin <[email protected]> Gerrit-Reviewer: Adar Dembo <[email protected]> Gerrit-Reviewer: Alexey Serbin <[email protected]> Gerrit-Reviewer: Andrew Wong <[email protected]> Gerrit-Reviewer: Greg Solovyev <[email protected]> Gerrit-Reviewer: Kudu Jenkins (120) Gerrit-Reviewer: Will Berkeley <[email protected]> Gerrit-Comment-Date: Tue, 12 Mar 2019 02:18:34 +0000 Gerrit-HasComments: Yes
