Tim Armstrong has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/16272 )
Change subject: IMPALA-10036: schedule unpartitioned fragments on random executor ...................................................................... IMPALA-10036: schedule unpartitioned fragments on random executor Some plans have unpartitioned fragments that are not the coordinator fragment. It would be best to avoid scheduling these on a coordinator, both to reduce coordinator load and to allow using the coordinator mem estimates for these queries. Testing: Extended the dedicated coordinator admission control test with a query with an unpartitioned fragment. The test failed on master with dedicated coordinator estimates. Manually ran the repro with TPC-DS Q23, which is a more complex query with unpartitioned fragments, and confirmed that could run with low coordinator mem limits. Ran exhaustive tests. Change-Id: I1eee78f24b048968f2fdf91f0da95b78552f8d33 Reviewed-on: http://gerrit.cloudera.org:8080/16272 Reviewed-by: Tim Armstrong <[email protected]> Tested-by: Tim Armstrong <[email protected]> --- M be/src/scheduling/schedule-state.cc M be/src/scheduling/schedule-state.h M be/src/scheduling/scheduler-test-util.cc M be/src/scheduling/scheduler.cc M be/src/scheduling/scheduler.h M tests/custom_cluster/test_admission_controller.py 6 files changed, 104 insertions(+), 45 deletions(-) Approvals: Tim Armstrong: Looks good to me, approved; Verified -- To view, visit http://gerrit.cloudera.org:8080/16272 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: I1eee78f24b048968f2fdf91f0da95b78552f8d33 Gerrit-Change-Number: 16272 Gerrit-PatchSet: 7 Gerrit-Owner: Tim Armstrong <[email protected]> Gerrit-Reviewer: Bikramjeet Vig <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Tim Armstrong <[email protected]>
