Quanlong Huang has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/20066 )
Change subject: IMPALA-12210: CatalogD should ignore validWriteId List if the table is external while loading a table ...................................................................... IMPALA-12210: CatalogD should ignore validWriteId List if the table is external while loading a table In external frontend mode, running queries on external tables shows an exception in the catalogd.INFO log and catalogd forwards the get_table_req() requests to HMS. For external tables, we don't need to verify the validWriteIdList. So a transactional check on the table is added in CatalogD before checking for compactionId on the table. By doing so, when the table is loaded, catalogD returns the table instead of forwarding the request to HMS. Testing: Manually verified that exception is not seen in the logs. Also, repeated execution of query, the request is not forwarded to HMS and instead returned from catalogD's cache. Testing with TPCH queries resulted in query performance improvement of ~ 0.04 to 0.07 secs. Change-Id: I28a34185c788a39aa902b0cd1ed0ba0c8c376ff1 Reviewed-on: http://gerrit.cloudera.org:8080/20066 Reviewed-by: Impala Public Jenkins <[email protected]> Tested-by: Quanlong Huang <[email protected]> --- M fe/src/main/java/org/apache/impala/catalog/CatalogServiceCatalog.java 1 file changed, 23 insertions(+), 11 deletions(-) Approvals: Impala Public Jenkins: Looks good to me, approved Quanlong Huang: Verified -- To view, visit http://gerrit.cloudera.org:8080/20066 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: I28a34185c788a39aa902b0cd1ed0ba0c8c376ff1 Gerrit-Change-Number: 20066 Gerrit-PatchSet: 5 Gerrit-Owner: Sai Hemanth Gantasala <[email protected]> Gerrit-Reviewer: Aman Sinha <[email protected]> Gerrit-Reviewer: Fang-Yu Rao <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Quanlong Huang <[email protected]> Gerrit-Reviewer: Sai Hemanth Gantasala <[email protected]> Gerrit-Reviewer: Steve Carlin <[email protected]>
