Sailesh Mukil has posted comments on this change. ( http://gerrit.cloudera.org:8080/9635 )
Change subject: IMPALA-6662: Make stress test resilient to hangs due to client crashes ...................................................................... Patch Set 5: Code-Review+1 (1 comment) Thanks for the review! Carry +1. http://gerrit.cloudera.org:8080/#/c/9635/4/tests/stress/concurrent_select.py File tests/stress/concurrent_select.py: http://gerrit.cloudera.org:8080/#/c/9635/4/tests/stress/concurrent_select.py@528 PS4, Line 528: try: > This code looks like it'll continue to spin them up at the given rate and o According to this logic, that should be the case, but we have a different thread that runs poll_mem_usage(), which periodically throttles starting new queries and therefore query runners. Empirically, I've usually seen it stop at around ~200 runners when running with an interval of 30 mins, i.e. poll_mem_usage() tries to throttle queries every 30 mins, and therefore we hover around maximum a concurrency of ~200 runners. -- To view, visit http://gerrit.cloudera.org:8080/9635 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: I10c5dc9b8c2fffc471bac2279e348bc1d1fec3b7 Gerrit-Change-Number: 9635 Gerrit-PatchSet: 5 Gerrit-Owner: Sailesh Mukil <[email protected]> Gerrit-Reviewer: David Knupp <[email protected]> Gerrit-Reviewer: Lars Volker <[email protected]> Gerrit-Reviewer: Michael Brown <[email protected]> Gerrit-Reviewer: Sailesh Mukil <[email protected]> Gerrit-Comment-Date: Fri, 16 Mar 2018 16:58:21 +0000 Gerrit-HasComments: Yes
