jihoonson commented on issue #7233: Set "is_published" to false for overshadowed segments in sys.segments table URL: https://github.com/apache/incubator-druid/issues/7233#issuecomment-474639633 @leventov oh, I missed it's already there. Thanks. I talked with @gianm and @surekhasaharan offline and now it's more clear to me. Here is the _current_ behavior. - `is_available` means that a segment is served by historicals or a realtime task. Overshadowing is not considered. Updated whenever a historical or realtime task announces a new segment or unannounces an existing one. - `is_published` means that `used` is set to `true` for a segment in metadata store. Overshadowing is not considered. Updated in background (metadata store is polled every 60s). - Unpublishing segments can mean setting `used` to `false` and it sounds good to me. The issue here is that both columns are not considering overshadowing such that it makes debugging harder. Probably, in many use cases, we want to know what segments are not loaded yet and why. To figure this out, we need to know what segment is published and is not _fully overshadowed only by other segments in metadata store_. This information is not being served yet, but it looks worth to add a new column. We came up with a name of `is_active` for this property. Does this make sense?
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
