sgomezf opened a new issue, #31387:
URL: https://github.com/apache/airflow/issues/31387
### Apache Airflow version
2.6.1
### What happened
After upgrading to 2.6.1, GKEStartPodOperator stopped creating pods.
According with release notes we created a specific gcp connection. But
connection defaults to GKE Public endpoint (in error message masked as
XX.XX.XX.XX) instead of private IP which is best since our cluster do not have
public internet access.
[2023-05-17T07:02:33.834+0000] {connectionpool.py:812} WARNING - Retrying
(Retry(total=2, connect=None, read=None, redirect=None, status=None)) after
connection broken by 'ConnectTimeoutError(<urllib3.connection.HTTPSConnection
object at 0x7f0e47049ba0>, 'Connection to XX.XX.XX.XX timed out. (connect
timeout=None)')':
/api/v1/namespaces/airflow/pods?labelSelector=dag_id%3Dmytask%2Ckubernetes_pod_operator%3DTrue%2Crun_id%3Dscheduled__2023-05-16T0700000000-8fb0e9fa9%2Ctask_id%3Dmytask%2Calready_checked%21%3DTrue%2C%21airflow-sa
Seems like with this change "use_private_ip" has been deprecated, what would
be the workaround in this case then to connect using private endpoint?
Also doc has not been updated to reflect this change in behaviour:
https://airflow.apache.org/docs/apache-airflow-providers-google/stable/operators/cloud/kubernetes_engine.html#using-with-private-cluster
### What you think should happen instead
There should still be an option to connect using previous method with option
"--private-ip" so API calls to Kubernetes call the private endpoint of GKE
Cluster.
### How to reproduce
1. Create DAG file with GKEStartPodOperator.
2. Deploy said DAG in an environment with no access tu public internet.
### Operating System
cos_coaintainerd
### Versions of Apache Airflow Providers
apache-airflow-providers-cncf-kubernetes==5.2.2
apache-airflow-providers-google==8.11.0
### Deployment
Official Apache Airflow Helm Chart
### Deployment details
_No response_
### Anything else
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of
Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
