Csaba Ringhofer has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/21656 )
Change subject: IMPALA-11729: Speed up start-impala-cluster.py ...................................................................... IMPALA-11729: Speed up start-impala-cluster.py The change reduces cluster startup time by 1-2 seconds. This also makes custom cluster tests a bit quicker. Most of the improvement is caused by removing unneeded sleep from wait_for_catalog() - it also slept after successful connections, while when the first coordinator is up, it is likely that all others are also up, meaning 3*0.5s extra sleep in the dev cluster. Other changes: - wait_for_catalog is cleaned up and renamed to wait_for_coordinator_services - also wait for hs2_http port to be open - decreased some sleep intervals - removed some non-informative logging - wait for hs2/beeswax/webui ports to be open before trying to actually connect to them to avoid extra logging from failed Thrift/http connections - reordered startup to first wait for coordinators to be up then wait for num_known_live_backends in each impalad - this reflects better what the cluster actually waits for (1st catalog update before starting coordinator services) Change-Id: Ic4dd8c2bc7056443373ceb256a03ce562fea38a0 Reviewed-on: http://gerrit.cloudera.org:8080/21656 Tested-by: Impala Public Jenkins <[email protected]> Reviewed-by: Michael Smith <[email protected]> Reviewed-by: Laszlo Gaal <[email protected]> --- M bin/start-impala-cluster.py M tests/common/impala_cluster.py M tests/common/impala_service.py 3 files changed, 88 insertions(+), 39 deletions(-) Approvals: Impala Public Jenkins: Verified Michael Smith: Looks good to me, but someone else must approve Laszlo Gaal: Looks good to me, approved -- To view, visit http://gerrit.cloudera.org:8080/21656 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: Ic4dd8c2bc7056443373ceb256a03ce562fea38a0 Gerrit-Change-Number: 21656 Gerrit-PatchSet: 10 Gerrit-Owner: Csaba Ringhofer <[email protected]> Gerrit-Reviewer: Csaba Ringhofer <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Laszlo Gaal <[email protected]> Gerrit-Reviewer: Michael Smith <[email protected]>
