pjain1 edited a comment on issue #11297: URL: https://github.com/apache/druid/issues/11297#issuecomment-847585532
Hmm, I see that `IntermediaryDataManger` will be started at middleManager and Indexer as it is injected in `ShuffleResource`. However, I also see that `IntermediaryDataManger` and `ShuffleDataSegmentPusher` are used in `Appenderator` code to push segments which runs in `peon` process so `IntermediaryDataManger` will be running the clean up code at peon process also ? This confused me. > The simplest idea I can think of is having an auto cleanup process in the coordinator (or the overlord?). This sounds like a good idea, it can be a standalone coordinator duty. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
