pchang388 commented on issue #12898: URL: https://github.com/apache/druid/issues/12898#issuecomment-1218442629
Another issue we noticed during this week of infrastructure issues. When we bring down the historicals from one site, the others get their data loaded. We also swtiched retention period to a lower number (365 -> 90 days) to not run out of disks on the working historicals. But it appears the Coordinator will load the data first from the other historicals that were decommissioned before dropping the existing data that is now out of the new retention period:  ``` 2022-08-17T20:01:01,893 INFO [Coordinator-Exec--0] org.apache.druid.server.coordinator.rules.LoadRule - Skipping replica assignment for tier [_default_tier] 2022-08-17T20:01:01,893 INFO [Coordinator-Exec--0] org.apache.druid.server.coordinator.rules.LoadRule - Loading in progress, skipping drop until loading is complete ``` This means that the historicals will fill up first before the drop for retention goes through since it tries to load the data first. Is there any way we can avoid this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
