Tim Armstrong has uploaded this change for review. ( http://gerrit.cloudera.org:8080/16516
Change subject: WIP: IMPALA-10189: don't reload partitions for stat operations ...................................................................... WIP: IMPALA-10189: don't reload partitions for stat operations This patch avoids reloading partition metadata from the HMS or filesystems when partition stats are changed, either by a COMPUTE STATS command or by a DROP STATS command. bulkAlterPartitions() is modified to allow callers to control whether partitions are marked dirty (and therefore reloaded). DDLs that do not mark partitions dirty need to correctly update the in-memory state of the Partition object so that it will be the same as it would be after a reload from the HMS. In this case, numRows_ was not previously updated, but now needs to be updated. Testing: TODO * run exhaustive tests * consider adding an end-to-end test that shows the behavioural change (if there are any behavioural changes). Change-Id: I91009d6e9fdf25b3a3341fd1d29219519eb39a3d --- M fe/src/main/java/org/apache/impala/catalog/HdfsPartition.java M fe/src/main/java/org/apache/impala/catalog/HdfsTable.java M fe/src/main/java/org/apache/impala/catalog/local/LocalIcebergTable.java M fe/src/main/java/org/apache/impala/service/CatalogOpExecutor.java 4 files changed, 84 insertions(+), 36 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/16/16516/1 -- To view, visit http://gerrit.cloudera.org:8080/16516 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newchange Gerrit-Change-Id: I91009d6e9fdf25b3a3341fd1d29219519eb39a3d Gerrit-Change-Number: 16516 Gerrit-PatchSet: 1 Gerrit-Owner: Tim Armstrong <[email protected]>
