jj-ian edited a comment on issue #4083: [AIRFLOW-3211] Reattach to GCP Dataproc jobs upon Airflow restart URL: https://github.com/apache/incubator-airflow/pull/4083#issuecomment-432277828 Hi @ashb, thank you for the review. I see what you mean, but we wanted to ensure that Airflow keeps track of Dataproc jobs even if the machine that hosts Airflow restarts for reasons outside our control. Our Airflow is hosted on machines that restart regularly for system updates (specifically, [GCP App Engine Flex instances that are restarted weekly by Google to install OS updates](https://cloud.google.com/appengine/docs/flexible/python/how-instances-are-managed)).
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
