[
https://issues.apache.org/jira/browse/SOLR-11670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16386652#comment-16386652
]
Andrzej Bialecki commented on SOLR-11670:
------------------------------------------
[~shalinmangar] suggested another approach (thanks!) and this patch implements
it - instead of a separate component for managing the tasks it reuses the
{{ScheduledTrigger}} and custom trigger actions that implement maintenance
tasks.
This indeed simplifies the execution and management of these tasks, and reuses
familiar concepts. The (small) downside is that it's less convenient to
pre-register some tasks that we know the cluster should run by default, but
it's the same situation as with any default triggers (eg. autoAddReplicas
trigger).
{{ScheduledMaintenanceTriggerTest}} illustrates the registration and how the
{{InactiveShardCleanupAction}} works.
(The patch seems larger than before but that's due to some refactoring of
common utility methods for waiting on collection state.)
> Implement a periodic house-keeping task
> ---------------------------------------
>
> Key: SOLR-11670
> URL: https://issues.apache.org/jira/browse/SOLR-11670
> Project: Solr
> Issue Type: Sub-task
> Security Level: Public(Default Security Level. Issues are Public)
> Components: AutoScaling
> Reporter: Andrzej Bialecki
> Assignee: Andrzej Bialecki
> Priority: Major
> Attachments: SOLR-11670.patch, SOLR-11670.patch
>
>
> Some high-impact cluster changes (such as split shard) leave the original
> data and original state that is no longer actively used. This makes sense due
> to safety reasons and to make it easier to roll-back the changes.
> However, this unused data will accumulate over time, especially when actions
> like split shard are invoked automatically by the autoscaling framework. We
> need a periodic task that would clean up this kind of data after a certain
> period.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
