OurNewestMember commented on issue #13362:
URL: https://github.com/apache/druid/issues/13362#issuecomment-1327590478
Not sure if this is what others had in mind, but supporting this workflow
could be helpful:
- operator defines zero or more compaction configs per data source (like
retention rules)
- (per existing behavior) coordinator lists segments for compaction
- compaction tasks for an interval are created using the matching compaction
config (if they haven't already been compacted with that compaction spec)
Other notes
- it would help to also support a no-op compaction config so the operator
can effectively exclude intervals
- The assumption is that this could work with the existing mechanisms to
mark the segments as "already compacted" so they can be skipped subsequently
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
