cryptoe commented on issue #13208: URL: https://github.com/apache/druid/issues/13208#issuecomment-1276148517
Thanks for reporting this. I was looking into this and the issue seems to be in how we are generating the probable time chunks for an interval. https://github.com/apache/druid/blob/master/server/src/main/java/org/apache/druid/server/coordinator/duty/NewestSegmentFirstIterator.java#L131 In this case, the interval is -infinity,+infinity because of partitioned by `ALL` When we set the segment granularity as day in the compaction spec we generate all probable day time chunks which results in a heap issue for the coordinator. Should we add a check/validation which fails the compaction, when the compaction changes the segment granularity to something other than `ALL` for a data source whose segment granularity is `ALL`. Open to ideas for another approach as well. cc @gianm @paul-rogers @maytasm -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
