khalidmammadov commented on issue #18598:
URL: https://github.com/apache/airflow/issues/18598#issuecomment-930507681
Did just that. Freshly installed 2.3.1, created dag from your code with one
import with helper module and functions that reference in the dag and
duplicated Dag by 1000. The scheduler consumed all 1000 of them and I checked
from UI. But couldn't reproduce issue the issue:
```
my_dag197.py.log my_dag298.py.log my_dag399.py.log my_dag49.py.log
my_dag5.py.log my_dag700.py.log my_dag801.py.log my_dag902.py.log
my_dag198.py.log my_dag299.py.log my_dag39.py.log my_dag4.py.log
my_dag600.py.log my_dag701.py.log my_dag802.py.log my_dag903.py.log
my_dag199.py.log my_dag29.py.log my_dag3.py.log my_dag500.py.log
my_dag601.py.log my_dag702.py.log my_dag803.py.log my_dag904.py.log
my_dag19.py.log my_dag2.py.log my_dag400.py.log my_dag501.py.log
my_dag602.py.log my_dag703.py.log my_dag804.py.log my_dag905.py.log
my_dag1.py.log my_dag300.py.log my_dag401.py.log my_dag502.py.log
my_dag603.py.log my_dag704.py.log my_dag805.py.log my_dag906.py.log
(venv_airflow) air213@linux:~/airflow/logs/scheduler/latest$ ls | wc
1002 1002 16919
(venv_airflow) air213@linux:~/airflow/logs/scheduler/latest$ cat my_dag* |
grep SerializedDagNotFound
(venv_airflow) air213@linux:~/airflow/logs/scheduler/latest$ airflow version
2.1.3
(venv_airflow) air213@linux:~/airflow/logs/scheduler/latest$
```
Need some more info for further investigation.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
