Anurag Mantripragada has uploaded a new patch set (#2). ( http://gerrit.cloudera.org:8080/13860 )
Change subject: IMPALA-8489: Partitions created by RECOVER PARTITIONS fail to create insert events with IllegalStateException. ...................................................................... IMPALA-8489: Partitions created by RECOVER PARTITIONS fail to create insert events with IllegalStateException. createInsertEvents() uses partition ids to keep track of the files added to the partitions by the insert by finding the delta of files in a partition before and after load() call. However, if partitions are marked dirty (for eg.: partitions created by RECOVER PARTITIONS), load() will drop and re-create them which will change the partition ids. createInsertEvents() then cannot find these parittions and fails with exception. In this patch, partitions are tracked by partition names instead of partition ids so drop + reload will not affect the logic. Testing: 1. Ran TestRecoverPartitions.test_post_invalidate() which was failing. 2. Ran MetastoreEventProcessorTest FE tests. Change-Id: Idef7f6aadff2868047c861ebfcc05d65f080eab9 --- M fe/src/main/java/org/apache/impala/catalog/HdfsTable.java M fe/src/main/java/org/apache/impala/service/CatalogOpExecutor.java 2 files changed, 51 insertions(+), 16 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/60/13860/2 -- To view, visit http://gerrit.cloudera.org:8080/13860 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newpatchset Gerrit-Change-Id: Idef7f6aadff2868047c861ebfcc05d65f080eab9 Gerrit-Change-Number: 13860 Gerrit-PatchSet: 2 Gerrit-Owner: Anurag Mantripragada <anu...@cloudera.com> Gerrit-Reviewer: Bharath Vissapragada <bhara...@cloudera.com> Gerrit-Reviewer: Impala Public Jenkins <impala-public-jenk...@cloudera.com> Gerrit-Reviewer: Todd Lipcon <t...@apache.org> Gerrit-Reviewer: Vihang Karajgaonkar <vih...@cloudera.com>
