andyjianzhou commented on issue #39332: URL: https://github.com/apache/airflow/issues/39332#issuecomment-2163911733
Hey all! So I have been trying to reproduce the error and haven't been successful. I've ran the DagProcessor Job standalone, and created 40+ test dag files, some of them having a timeout functionality within them. From my understanding, this is my workflow: I run the command -> I can view all my dags on the airflow UI. -> I add a new Dag file -> wait 5 minutes -> Refresh my page and all dag files exists. If there's a timeout error, there will be an explanation in terminal and/or on UI about an invalid DAG file or a runtime error. Wondering if you can share me what your dags/environment setup looks like? If you can be more specific on how to reproduce the issue? Some questions to consider: 1. How do you know when the Dag Processor Job has "finished" parsing all DAG files before you added a new DAG file. 2. What your DAG files look like approximately 3. More specific reproducibility steps. Thank you! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
