potiuk commented on issue #17191: URL: https://github.com/apache/airflow/issues/17191#issuecomment-890598962
Yeah. I agree with @jedcunningham . I think it should be the matter of deployment (for example K8S) to take care about health of all components indepenendently from the master. The helth-check endpoint in K8S is a typical way of checking if particular endpoint is "healthy". In a way "main" process might not know how many "workers" should be available and whether there should be a specific number of those - this is something that the deployment configuration should be responsible for - in similar way as the scheduler is not responsible for "scaling" of the workers. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
