MarianneRay commented on issue #16176:
URL: https://github.com/apache/airflow/issues/16176#issuecomment-1299265122
I'm getting the same error.
'''
- name: Add apache helm chart
run: |-
helm repo add apache-airflow https://airflow.apache.org
- name: Update helm charts
run: |-
helm repo update
- name: Deploy to latest image cluster
run: |-
helm upgrade --install $NAMESPACE apache-airflow/airflow \
--timeout 3m30s --debug --force --namespace $NAMESPACE
--create-namespace \
--set
images.airflow.repository="$ARTIFACT_REGISTRY/gp-ops-controller-$BRANCH_NAME/$REPO_NAME/$BRANCH_NAME/$GITHUB_SHA"
\
--set images.airflow.tag=latest \
--set images.airflow.pullPolicy=Always \
--set images.airflow.pullSecretName=registry-credentials \
--set executor=CeleryExecutor \
--set pgbouncer.enabled=true \
--set airflowLocalSettings="" \
--set secret_key="$AIRFLOW__WEBSERVER__SECRET_KEY" \
--set logging.remote_logging=true \
--set
logging.remote_base_log_folder="gs://ops-controller-$BRANCH_NAME-bucket/$GITHUB_ENV/dags/logs"
'''
I added the update step after installing the apache-airflow helm chart.
My cluster has 3 bound persistent volumes.
I increased the machine type of my node pool to e2-highmem-2 and it contains
9 nodes across 3 zones.
I have 18 vCPUs in my cluster and 144GB of memory.
Not sure how to proceed. Any suggestions welcome, thank you!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
