[
https://issues.apache.org/jira/browse/HIVE-11388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15207886#comment-15207886
]
Wei Zheng commented on HIVE-11388:
----------------------------------
Thanks Eugene.
1. I see. It would be helpful to have a comment by the first stmt.executeQuery
since it's not explicit. I didn't realize that in the first round :)
2. I mean we do need such logic to filter out compactions cleaned by other
Cleaners. I'm saying we can have simpler code by directly using toClean. But I
just realized that we need to extract id from CompactionInfo to have a
convenient set, so never mind.
3. Agree.
Btw what's the purpose of having column MT_KEY2?
> Allow ACID Compactor components to run in multiple metastores
> -------------------------------------------------------------
>
> Key: HIVE-11388
> URL: https://issues.apache.org/jira/browse/HIVE-11388
> Project: Hive
> Issue Type: Bug
> Components: Transactions
> Affects Versions: 1.0.0
> Reporter: Eugene Koifman
> Assignee: Eugene Koifman
> Priority: Critical
> Attachments: HIVE-11388.2.patch, HIVE-11388.4.patch,
> HIVE-11388.5.patch, HIVE-11388.6.patch, HIVE-11388.7.patch, HIVE-11388.patch
>
>
> (this description is no loner accurate; see further comments)
> org.apache.hadoop.hive.ql.txn.compactor.Initiator is a thread that runs
> inside the metastore service to manage compactions of ACID tables. There
> should be exactly 1 instance of this thread (even with multiple Thrift
> services).
> This is documented in
> https://cwiki.apache.org/confluence/display/Hive/Hive+Transactions#HiveTransactions-Configuration
> but not enforced.
> Should add enforcement, since more than 1 Initiator could cause concurrent
> attempts to compact the same table/partition - which will not work.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
