rahulxxarora opened a new issue, #29806:
URL: https://github.com/apache/airflow/issues/29806

   ### Apache Airflow version
   
   2.5.1
   
   ### What happened
   
   I've some dynamic DAGs in my workflow. They are generated through a JSON 
stored in the variables. There is one such dynamic DAG which takes in a list of 
tasks it needs to do. When I add multiple tasks in that list, it fails.
   
   This works fine for smaller number of tasks and fails every time for a 
bigger list. There are no errors in the Worker logs but I found a **MySQL 2006 
Operational Error - MySQL server has gone away** error in the Scheduler's DAG 
processor logs.
   
   There, I could see the **UPDATE serialized_dag ...** query being failed. My 
guess is, that this happens when there is a lot of data to be sent to the MySQL 
server only. Because of this error, the DAG processor deleted all the dynamic 
DAGs and then no such DAG is visible on the UI.
   
   ### What you think should happen instead
   
   This used to work fine in version 1.x
   
   ### How to reproduce
   
   Try writing a lot of data for you DAG which is sent to the serialized_dag 
table.
   
   ### Operating System
   
   deb11
   
   ### Versions of Apache Airflow Providers
   
   _No response_
   
   ### Deployment
   
   Other
   
   ### Deployment details
   
   _No response_
   
   ### Anything else
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to