GitHub user new-php added a comment to the discussion: Apache Airflow setup on
kubernetes using helm charts
Setting up Apache Airflow on Ubuntu 24.04 can be a bit tricky, especially if
you're new to the process. From the logs, it looks like the main issue is
related to PersistentVolumeClaims (PVCs) and storage configurations in
Kubernetes. This is a common hurdle when deploying stateful applications like
Airflow. Here are a few steps to troubleshoot and resolve the issue:
Check StorageClass Configuration: Ensure that a StorageClass is defined in
your Kubernetes cluster. If you're using a cloud provider like AWS, GCP, or
Azure, they usually provide default StorageClasses. You can check this by
running:
bash
Copy
kubectl get storageclass
If no StorageClass is available, you’ll need to create one or configure
your cluster to use dynamic provisioning.
Manually Create PersistentVolumes: If dynamic provisioning isn’t an option,
you can manually create PersistentVolumes and bind them to the PVCs. This
requires pre-allocated storage (e.g., NFS, local storage, or cloud disks).
Modify values.yaml: If you’re using the default values.yaml from the
Airflow Helm chart, you might need to customize it to specify the StorageClass
or disable persistence for certain components if they’re not required.
Check Node Availability: Ensure that your Kubernetes nodes have enough
resources (CPU, memory, and storage) to schedule the Airflow components.
For more detailed guidance on setting up Kubernetes and Helm, you might find
this guide on how to [Install Apache Airflow on Ubuntu
24.04](https://docs.vultr.com/how-to-install-apache-airflow-on-ubuntu-24-04)
helpful. It provides a step-by-step approach to getting Airflow up and running
smoothly.
Good luck with your Airflow setup! Once you get past the storage issues, it’s a
powerful tool for orchestrating workflows."
GitHub link:
https://github.com/apache/airflow/discussions/48028#discussioncomment-12592674
----
This is an automatically sent email for [email protected].
To unsubscribe, please send an email to: [email protected]
