Pranay Singh has uploaded this change for review. ( http://gerrit.cloudera.org:8080/10587
Change subject: IMPALA-6994:Avoid reloading a table's HMS data for file-only operations ...................................................................... IMPALA-6994:Avoid reloading a table's HMS data for file-only operations The problem is that while inserting a new row to an unpartitioned HDFS table, or to an existing partition, the catalogd makes unecessary call to Hive Meta Store to do a getTable() and list the partitions of the table, when in fact only the file metadata for HDFS tables needs to be updated. This extra call to HMS introduces a point of failure, we need to handle for error scenario when Hive MetaStore crashes. This change removes the extra call to Hive Meta Store for the case when a row is inserted to an existing partition in HDFS table or when a row is added to unpartitioned table. Thus, an optimization as it reduces the call to Hive Meta Store during Update of Catalog. Testing: Ran core test without failure. Change-Id: I331bb0371fde287f43a85b025b4f98cb45f3eb3c --- M fe/src/main/java/org/apache/impala/catalog/HdfsTable.java M fe/src/main/java/org/apache/impala/service/CatalogOpExecutor.java 2 files changed, 34 insertions(+), 17 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/87/10587/1 -- To view, visit http://gerrit.cloudera.org:8080/10587 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newchange Gerrit-Change-Id: I331bb0371fde287f43a85b025b4f98cb45f3eb3c Gerrit-Change-Number: 10587 Gerrit-PatchSet: 1 Gerrit-Owner: Pranay Singh
