[
https://issues.apache.org/jira/browse/HIVE-18773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16377278#comment-16377278
]
Eugene Koifman commented on HIVE-18773:
---------------------------------------
once HIVE-18772 is in place, whey not have the Worker itself do a clean right
after successful compaction and before stats gather. It improves parallelism
and perhaps makes stats gather more accurate since the set of files on disk is
more accurate wrt current state of the table.
> Support multiple instances of Cleaner
> -------------------------------------
>
> Key: HIVE-18773
> URL: https://issues.apache.org/jira/browse/HIVE-18773
> Project: Hive
> Issue Type: Improvement
> Components: Transactions
> Reporter: Eugene Koifman
> Priority: Major
>
> We support multiple Workers by making each Worker update the status of the
> entry in COMPACTION_QUEUE to make sure only 1 worker grabs it. Once we have
> HIVE-18772, Cleaner should not need any state we can easily have > 1 Cleaner
> instance by introducing 1 more status type "being cleaned".
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
