Impala Public Jenkins has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/15793 )
Change subject: IMPALA-9609: Minimize Frontend activity in executor only impalads ...................................................................... IMPALA-9609: Minimize Frontend activity in executor only impalads Until now the Frontend started fully regardless of flag is_coordinator, e.g. created connections to the HMS, which is both error prone and can DoS the metastore. (note that even coordinators started to connect to HMS only in the recent past, related to local catalog mode and ACID transactions) Executor only impalads still need a JVM as queries can contain java calls (HDFS/Hbase API calls, Hive UDFs), but most of the JNI API provided by JniFrontend shouldn't be called by executors. It seems that the whole Frontend object is needed only by coordinators. Testing: - generally executor only mode doesn't seem to be well covered - ran test_coordinators.py which has some tests with executor only impalads - added new test for HBase tables (Hive UDFs and HDFS were already covered) Change-Id: I4627e5e3520175153cb49e24fd480815dfefdae1 Reviewed-on: http://gerrit.cloudera.org:8080/15793 Reviewed-by: Impala Public Jenkins <[email protected]> Tested-by: Impala Public Jenkins <[email protected]> --- M be/src/runtime/exec-env.cc M fe/src/main/java/org/apache/impala/service/Frontend.java M fe/src/main/java/org/apache/impala/service/JniFrontend.java M tests/custom_cluster/test_coordinators.py 4 files changed, 63 insertions(+), 17 deletions(-) Approvals: Impala Public Jenkins: Looks good to me, approved; Verified -- To view, visit http://gerrit.cloudera.org:8080/15793 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: I4627e5e3520175153cb49e24fd480815dfefdae1 Gerrit-Change-Number: 15793 Gerrit-PatchSet: 5 Gerrit-Owner: Csaba Ringhofer <[email protected]> Gerrit-Reviewer: Aman Sinha <[email protected]> Gerrit-Reviewer: Csaba Ringhofer <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Tim Armstrong <[email protected]>
