GitHub user PraveenKumarM21 edited a discussion: Storing DAG Run Logs in Database Instead of File System
I’m looking for a way to store task logs for a DAG run in a database instead of the default file system or remote storage (e.g., S3, GCS). My current setup is: Executor: KubernetesExecutor Deployment Method: Helm chart on Kubernetes Questions: 1. Is there an existing way to store DAG run logs in a database? 2. Can we configure a custom logging_handler to achieve this? 3. Are there any community plugins or recommendations for handling log storage in a database efficiently? Any guidance or references would be greatly appreciated. GitHub link: https://github.com/apache/airflow/discussions/46994 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
