[jira] [Updated] (HIVE-10595) Dropping a table can cause NPEs in the compactor
[ https://issues.apache.org/jira/browse/HIVE-10595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-10595: -- Component/s: Transactions > Dropping a table can cause NPEs in the compactor > > > Key: HIVE-10595 > URL: https://issues.apache.org/jira/browse/HIVE-10595 > Project: Hive > Issue Type: Bug > Components: Metastore, Transactions >Affects Versions: 0.14.0, 1.0.0, 1.1.0 >Reporter: Alan Gates >Assignee: Alan Gates > Fix For: 1.2.0 > > Attachments: HIVE-10595.1.patch, HIVE-10595.patch > > > Reproduction: > # start metastore with compactor off > # insert enough entries in a table to trigger a compaction > # drop the table > # stop metastore > # restart metastore with compactor on > Result: NPE in the compactor threads. I suspect this would also happen if > the inserts and drops were done in between a run of the compactor, but I > haven't proven it. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-10595) Dropping a table can cause NPEs in the compactor
[ https://issues.apache.org/jira/browse/HIVE-10595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushanth Sowmyan updated HIVE-10595: Attachment: HIVE-10595.1.patch Duplicating HIVE-10595.patch as HIVE-10595.1.patch to submit through precommit. Dropping a table can cause NPEs in the compactor Key: HIVE-10595 URL: https://issues.apache.org/jira/browse/HIVE-10595 Project: Hive Issue Type: Bug Components: Metastore Affects Versions: 0.14.0, 1.0.0, 1.1.0 Reporter: Alan Gates Assignee: Alan Gates Attachments: HIVE-10595.1.patch, HIVE-10595.patch Reproduction: # start metastore with compactor off # insert enough entries in a table to trigger a compaction # drop the table # stop metastore # restart metastore with compactor on Result: NPE in the compactor threads. I suspect this would also happen if the inserts and drops were done in between a run of the compactor, but I haven't proven it. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-10595) Dropping a table can cause NPEs in the compactor
[ https://issues.apache.org/jira/browse/HIVE-10595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-10595: -- Attachment: HIVE-10595.patch The attached patch makes the following changes: # The info message for initiator when it discovers a missing table now says that the table may have been a temp or may have been dropped. # Worker and cleaner threads now properly check for the table to be compacting being null, and give an info message saying they assume the table has been dropped. # All three threads now properly handle the case where the partition is dropped and give an info message rather than attempt to compact the table. Dropping a table can cause NPEs in the compactor Key: HIVE-10595 URL: https://issues.apache.org/jira/browse/HIVE-10595 Project: Hive Issue Type: Bug Components: Metastore Affects Versions: 0.14.0, 1.0.0, 1.1.0 Reporter: Alan Gates Assignee: Alan Gates Attachments: HIVE-10595.patch Reproduction: # start metastore with compactor off # insert enough entries in a table to trigger a compaction # drop the table # stop metastore # restart metastore with compactor on Result: NPE in the compactor threads. I suspect this would also happen if the inserts and drops were done in between a run of the compactor, but I haven't proven it. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
