churromorales commented on PR #10910: URL: https://github.com/apache/druid/pull/10910#issuecomment-1213328565
> @zhangyue19921010 are you still working on this PR? Happy to help with the reviewing if needed. I am happy to pick this up. I have reviewed the code and there are a few things missing. 1. Lets make this work with k8s jobs, not pods. Let k8s manage lifecycles not the middle manager. Also simplify the configuration, I am thinking one configuration option to use this feature from a user perspective. `druid.peon.k8s.tasks=true` 2. Make the task itself push the reports.json, right now it seems to be ignored. 3. There is no checkpointing for k8s tasks. We need to have the tasks themselves be able to push checkpoints and recover from them. Just to note, this patch to make it work the same as Druid does today requires core changes. It can no longer be isolated to just an extension. If that seems like a good plan, I am happy to finish up this work and try to get it into druid. Let me know your thoughts. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
