Raven888888 commented on issue #11906: URL: https://github.com/apache/druid/issues/11906#issuecomment-978971215
The root cause is having overlapping segments with different granularity. In my case I have: Segment A: `2021-09-01/2021-10-01` [month] Segment B: `2021-09-27/2021-10-04` [week] When there is a late data `2021-09-15` in segment A, that it causes `Could not allocate segment` error as above, I could re-compact the segment A with interval `2021-09-01/2021-10-01` and granularity month. Then, the late data will ingest fine. *However, this causes segment B to be corrupted.* If there is another late data `2021-10-02` in segment B, same `Could not allocate segment` error occurs. As you might have guessed, if I re-compact segment B, the second late data will work, but segment A will now be corrupted. Takeaway: do not have 2 overlapping segments. Period. Closing this. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
