mik-laj commented on issue #7510: [AIRFLOW-6887][WIP] Do not check the state of fresh DAGRun URL: https://github.com/apache/airflow/pull/7510#issuecomment-590470029 You're right. I plan to write a blogspot to describe exactly the measurement methodology. If you want to get the same numbers as in my script then you need to run it using the Python interpreter. ``` python script-name.py ``` After then you will message similar to the following: ``` ['', '/opt/airflow', '/usr/local/lib/python37.zip', '/usr/local/lib/python3.7', '/usr/local/lib/python3.7/lib-dynload', '/usr/local/lib/python3.7/site-packages', '/root/airflow/dags', '/root/airflow/config', '/root/airflow/plugins'] [2020-02-24 16:06:14,377] {dagbag.py:376} INFO - Filling up the DagBag from /files/dags/50_dag_5_dummy_tasks.py [2020-02-24 16:06:15,281] {dag.py:1478} INFO - Sync 299 DAGs Query count: 7 Retry took 1157.678 ms [2020-02-24 16:06:15,537] {dagbag.py:376} INFO - Filling up the DagBag from /files/dags/50_dag_5_dummy_tasks.py [2020-02-24 16:06:15,825] {dag.py:1478} INFO - Sync 299 DAGs Query count: 7 Retry took 473.342 ms [2020-02-24 16:06:16,004] {dagbag.py:376} INFO - Filling up the DagBag from /files/dags/50_dag_5_dummy_tasks.py [2020-02-24 16:06:16,296] {dag.py:1478} INFO - Sync 299 DAGs Query count: 7 Retry took 570.475 ms [2020-02-24 16:06:16,579] {dagbag.py:376} INFO - Filling up the DagBag from /files/dags/50_dag_5_dummy_tasks.py [2020-02-24 16:06:16,898] {dag.py:1478} INFO - Sync 299 DAGs Query count: 7 Retry took 543.631 ms [2020-02-24 16:06:17,119] {dagbag.py:376} INFO - Filling up the DagBag from /files/dags/50_dag_5_dummy_tasks.py [2020-02-24 16:06:17,404] {dag.py:1478} INFO - Sync 299 DAGs Query count: 7 Retry took 779.900 ms [2020-02-24 16:06:17,907] {dagbag.py:376} INFO - Filling up the DagBag from /files/dags/50_dag_5_dummy_tasks.py [2020-02-24 16:06:18,279] {dag.py:1478} INFO - Sync 299 DAGs Query count: 7 Retry took 572.046 ms [2020-02-24 16:06:18,473] {dagbag.py:376} INFO - Filling up the DagBag from /files/dags/50_dag_5_dummy_tasks.py [2020-02-24 16:06:18,764] {dag.py:1478} INFO - Sync 299 DAGs Query count: 7 Retry took 465.645 ms [2020-02-24 16:06:18,938] {dagbag.py:376} INFO - Filling up the DagBag from /files/dags/50_dag_5_dummy_tasks.py [2020-02-24 16:06:19,360] {dag.py:1478} INFO - Sync 299 DAGs Query count: 7 Retry took 606.974 ms [2020-02-24 16:06:19,544] {dagbag.py:376} INFO - Filling up the DagBag from /files/dags/50_dag_5_dummy_tasks.py [2020-02-24 16:06:19,886] {dag.py:1478} INFO - Sync 299 DAGs Query count: 7 Retry took 543.896 ms [2020-02-24 16:06:20,088] {dagbag.py:376} INFO - Filling up the DagBag from /files/dags/50_dag_5_dummy_tasks.py [2020-02-24 16:06:20,468] {dag.py:1478} INFO - Sync 299 DAGs Query count: 7 Retry took 573.048 ms Retry took 628.801 ms ``` The numbers seem self-explanatory except for the last value. This is the average of all try. If the script does not work then you may not have the DAG file. You should create it in the following file: /files/dags/50_dag_5_dummy_tasks.py
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
