SamWheating edited a comment on issue #15652: URL: https://github.com/apache/airflow/issues/15652#issuecomment-831957893
I see you're passing `region="us-central1-a"` into your Dataproc operators. From my understanding this is a google cloud Zone, within the `us-central1` Region ([docs on GCP zones and regions](https://cloud.google.com/compute/docs/regions-zones)). Could you try passing `region="us-central1"` into your operators instead. I believe the URLs used in the dataproc client are based on the provided region https://github.com/apache/airflow/blob/32c63626845b9885c2349190ba9e44691007bbdb/airflow/providers/google/cloud/hooks/dataproc.py#L294 https://github.com/apache/airflow/blob/32c63626845b9885c2349190ba9e44691007bbdb/airflow/providers/google/cloud/hooks/dataproc.py#L214 So I think this could explain the 404 error you're seeing. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
