mukul-jain12 opened a new issue, #51512:
URL: https://github.com/apache/airflow/issues/51512

   ### Apache Airflow version
   
   Other Airflow 2 version (please specify below)
   
   ### If "Other Airflow 2 version" selected, which one?
   
   Airflow 3.0.0
   
   ### What happened?
   
   **Environment:**
         Airflow Version: 3.0.0
         Executor: LocalExecutor
         Database Backend: MySQL
         Python Version: 3.12
         OS: Ubuntu 22.04
         Deployment Method: VM
     
   
   **Summary:**
       1. After upgrading to Airflow 3.0.0, a specific task inside multiple 
DAGs starts failing every 2–3 days.
       2. DAG runs successfully, but the same task fails with the same error 
repeatedly.
       3. Restarting Airflow services temporarily resolves the task failure.
       4. No code change, no DAG change, no environment change between working 
and failing runs.
   
   **🧾 Error Message:**
   
   The error occurs for the entire DAG as well as for a specific task, as shown 
in the image below. While the DAG appears to execute successfully, the task 
fails with the same recurring error. PFA screenshots and error messages below:
   
   `Log message source details: sources=["Could not read served logs: Invalid 
URL 
'http://:8793/log/dag_id=BataApac_Fraud_Service/run_id=scheduled__2025-06-08T05:20:00+00:00/task_id=fraud_service/attempt=1.log':
 No host supplied"] ::group::Log message source details: sources=["Could not 
read served logs: Invalid URL 
'http://:8793/log/dag_id=BataApac_Fraud_Service/run_id=scheduled__2[0](http://20.105.2.4:8081/dags/BataApac_Fraud_Service/runs/scheduled__2025-06-08T05:20:00+00:00/tasks/fraud_service?try_number=1#0)25-06-08T05:20:00+00:00/task_id=fraud_service/attempt=1.log':
 No host supplied"]`
   
   <img width="615" alt="Image" 
src="https://github.com/user-attachments/assets/564daf6f-53a6-4ee6-bb05-9e47716d39b5";
 />
   
   <img width="552" alt="Image" 
src="https://github.com/user-attachments/assets/8a43b1e6-bc87-4e7c-a4ae-07208f092c0c";
 />
   
   **📌 Temporary Workaround**
   1. Restarting the Airflow services manually resolves the issue temporarily.
   2. After restart, DAGs resume normal execution without changes.
   
   
   🔧 Suggestions Needed
   1. Any known issue related to DAG failure loop in 3.0.0?
   2. Recommended fix or workaround?
   3. Should we downgrade or patch?
   
   ### What you think should happen instead?
   
   _No response_
   
   ### How to reproduce
   
   I’m currently unable to provide a specific reproducible case, as the issue 
occurs intermittently. However, here’s the behavior I’ve observed:
   
   After upgrading to Airflow 3.0.0, everything works fine for 2–3 days.
   
   Suddenly, some DAGs or specific tasks fail with log URL issues (No host 
supplied or invalid log path).
   
   The DAG run may complete, but a few tasks still fail and show no logs due to 
malformed log URLs (e.g., http://:8793/...).
   
   Restarting the Airflow services resolves the issue temporarily, and all DAGs 
and tasks resume normal execution.
   
   This seems to be related to Airflow’s logging system or task instance state 
management. Let me know if there’s a way I can collect more debug logs or 
configuration snapshots to help troubleshoot.
   
   ### Operating System
   
   ubuntu 22.04
   
   ### Versions of Apache Airflow Providers
   
   Providers info
   apache-airflow-providers-airbyte          | 5.0.2
   apache-airflow-providers-alibaba          | 3.0.3
   apache-airflow-providers-amazon           | 9.6.1
   apache-airflow-providers-apache-beam      | 6.0.4
   apache-airflow-providers-apache-cassandra | 3.7.2
   apache-airflow-providers-apache-drill     | 3.0.1
   apache-airflow-providers-apache-druid     | 4.1.1
   apache-airflow-providers-apache-flink     | 1.6.2
   apache-airflow-providers-apache-hdfs      | 4.8.1
   apache-airflow-providers-apache-hive      | 9.0.6
   apache-airflow-providers-apache-iceberg   | 1.2.1
   apache-airflow-providers-apache-impala    | 1.6.1
   apache-airflow-providers-apache-kafka     | 1.8.1
   apache-airflow-providers-apache-kylin     | 3.8.3
   apache-airflow-providers-apache-livy      | 4.3.2
   apache-airflow-providers-apache-pig       | 4.6.1
   apache-airflow-providers-apache-pinot     | 4.7.0
   apache-airflow-providers-apache-spark     | 5.2.1
   apache-airflow-providers-apprise          | 2.0.2
   apache-airflow-providers-arangodb         | 2.7.4
   apache-airflow-providers-asana            | 2.9.1
   apache-airflow-providers-atlassian-jira   | 3.0.2
   apache-airflow-providers-celery           | 3.10.6
   apache-airflow-providers-cloudant         | 4.1.1
   apache-airflow-providers-cncf-kubernetes  | 10.4.3
   apache-airflow-providers-cohere           | 1.4.3
   apache-airflow-providers-common-compat    | 1.6.0
   apache-airflow-providers-common-io        | 1.5.4
   apache-airflow-providers-common-messaging | 1.0.0
   apache-airflow-providers-common-sql       | 1.26.0
   apache-airflow-providers-databricks       | 7.3.2
   apache-airflow-providers-datadog          | 3.8.3
   apache-airflow-providers-dbt-cloud        | 4.3.3
   apache-airflow-providers-dingding         | 3.7.3
   apache-airflow-providers-discord          | 3.9.5
   apache-airflow-providers-docker           | 4.3.1
   apache-airflow-providers-edge3            | 1.0.0
   apache-airflow-providers-elasticsearch    | 6.2.2
   apache-airflow-providers-exasol           | 4.7.5
   apache-airflow-providers-fab              | 2.0.1
   apache-airflow-providers-facebook         | 3.7.2
   apache-airflow-providers-ftp              | 3.12.3
   apache-airflow-providers-git              | 0.0.2
   apache-airflow-providers-github           | 2.8.3
   apache-airflow-providers-google           | 15.1.0
   apache-airflow-providers-grpc             | 3.7.3
   apache-airflow-providers-hashicorp        | 4.1.1
   apache-airflow-providers-http             | 5.2.2
   apache-airflow-providers-imap             | 3.8.3
   apache-airflow-providers-influxdb         | 2.8.3
   apache-airflow-providers-jdbc             | 5.1.0
   apache-airflow-providers-jenkins          | 4.0.4
   apache-airflow-providers-microsoft-azure  | 12.3.1
   apache-airflow-providers-microsoft-mssql  | 4.2.2
   apache-airflow-providers-microsoft-psrp   | 3.0.1
   apache-airflow-providers-microsoft-winrm  | 3.9.2
   apache-airflow-providers-mongo            | 5.0.3
   apache-airflow-providers-mysql            | 4.0.2
   apache-airflow-providers-neo4j            | 3.8.2
   apache-airflow-providers-odbc             | 4.9.2
   apache-airflow-providers-openai           | 1.5.4
   apache-airflow-providers-openfaas         | 3.7.2
   apache-airflow-providers-openlineage      | 2.2.0
   apache-airflow-providers-opensearch       | 1.6.3
   apache-airflow-providers-opsgenie         | 5.8.3
   apache-airflow-providers-oracle           | 4.0.3
   apache-airflow-providers-pagerduty        | 4.0.3
   apache-airflow-providers-papermill        | 3.10.1
   apache-airflow-providers-pgvector         | 1.4.1
   apache-airflow-providers-pinecone         | 2.2.2
   apache-airflow-providers-postgres         | 6.1.3
   apache-airflow-providers-presto           | 5.8.4
   apache-airflow-providers-qdrant           | 1.3.2
   apache-airflow-providers-redis            | 4.0.2
   apache-airflow-providers-salesforce       | 5.10.1
   apache-airflow-providers-samba            | 4.9.2
   apache-airflow-providers-segment          | 3.7.2
   apache-airflow-providers-sftp             | 5.2.1
   apache-airflow-providers-singularity      | 3.7.1
   apache-airflow-providers-slack            | 9.0.5
   apache-airflow-providers-smtp             | 2.0.3
   apache-airflow-providers-snowflake        | 6.2.2
   apache-airflow-providers-sqlite           | 4.0.2
   apache-airflow-providers-ssh              | 4.0.1
   apache-airflow-providers-standard         | 1.0.0
   apache-airflow-providers-tableau          | 5.0.2
   apache-airflow-providers-telegram         | 4.7.2
   apache-airflow-providers-teradata         | 3.0.3
   apache-airflow-providers-trino            | 6.1.2
   apache-airflow-providers-vertica          | 4.0.1
   apache-airflow-providers-weaviate         | 3.0.3
   apache-airflow-providers-yandex           | 4.0.3
   apache-airflow-providers-ydb              | 2.1.1
   apache-airflow-providers-zendesk          | 4.9.1
   
   ### Deployment
   
   Official Apache Airflow Helm Chart
   
   ### Deployment details
   
   Airflow Version: 3.0.0
   Executor: LocalExecutor
   Database Backend: MySQL v8
   Python Version: 3.12
   OS: Ubuntu 22.04
   Deployment Method: VM
   
   ### Anything else?
   
   1. No changes are made in DAGs or dependencies in this period.
   2. Happens on both new and existing DAGs.
   3. Could potentially be memory/resource exhaustion or zombie DAG issue.
   
   ### Are you willing to submit PR?
   
   - [x] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [x] I agree to follow this project's [Code of 
Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Reply via email to