potiuk commented on pull request #14792:
URL: https://github.com/apache/airflow/pull/14792#issuecomment-799835271


   When I run it locally (and change the expected number) I got exactly 10 
calls for the serialized_dag as expected:
   
   So somwhere, something executes one more seriaized_daag get() when the tests 
are run in parallell. Any guess? Is there a possibiliy of 
re-parsing/re-retrieving the the serialized_dag after some time ?  (we have 
max_run set to 1). I doubt it is about some side effect from other tests 
(however it is possible as well). 
   
   ```
   E           AssertionError: The expected number of db queries is 196. The 
current number is 195.
   E           
   E           Recorded query locations:
   E            
test_scheduler_job.py:test_execute_queries_count_with_harvested_dags>scheduler_job.py:_run_scheduler_loop>scheduler_job.py:adopt_or_reset_orphaned_tasks:1853:
  1
   E            
test_scheduler_job.py:test_execute_queries_count_with_harvested_dags>scheduler_job.py:_run_scheduler_loop>scheduler_job.py:adopt_or_reset_orphaned_tasks:1885:
  1
   E            
scheduler_job.py:_run_scheduler_loop>scheduler_job.py:adopt_or_reset_orphaned_tasks>taskinstance.py:__repr__:899:
       100
   E            
test_scheduler_job.py:test_execute_queries_count_with_harvested_dags>scheduler_job.py:_run_scheduler_loop>scheduler_job.py:adopt_or_reset_orphaned_tasks:1912:
  1
   E            
scheduler_job.py:_do_scheduling>retries.py:wrapped_function>scheduler_job.py:_create_dagruns_for_dags:1592:
     1
   E            
retries.py:wrapped_function>scheduler_job.py:_create_dagruns_for_dags>scheduler_job.py:_create_dag_runs:1608:
   1
   E            
dagbag.py:get_dag>dagbag.py:_add_dag_from_db>serialized_dag.py:get:229: 10
   E            
scheduler_job.py:_create_dagruns_for_dags>scheduler_job.py:_create_dag_runs>dag.py:create_dagrun:1781:
  10
   E            
dag.py:create_dagrun>dagrun.py:verify_integrity>dagrun.py:get_task_instances:329:
       10
   E            
scheduler_job.py:_create_dag_runs>dag.py:create_dagrun>dagrun.py:verify_integrity:674:
  10
   E            
scheduler_job.py:_create_dagruns_for_dags>scheduler_job.py:_create_dag_runs>scheduler_job.py:_update_dag_next_dagruns:1659:
     1
   E            
scheduler_job.py:_do_scheduling>retries.py:wrapped_function>scheduler_job.py:_create_dagruns_for_dags:1595:
     1
   E            
test_scheduler_job.py:test_execute_queries_count_with_harvested_dags>scheduler_job.py:_run_scheduler_loop>scheduler_job.py:_do_scheduling:1533:
 1
   E            
scheduler_job.py:_schedule_dag_run>scheduler_job.py:_verify_integrity_if_dag_changed>serialized_dag.py:get_latest_version_hash:285:
     10
   E            
dagrun.py:update_state>dagrun.py:task_instance_scheduling_decisions>dagrun.py:get_task_instances:329:
   10
   E            
scheduler_job.py:_do_scheduling>scheduler_job.py:_schedule_dag_run>dagrun.py:update_state:480:
  10
   E            
scheduler_job.py:_do_scheduling>scheduler_job.py:_schedule_dag_run>dagrun.py:schedule_tis:761:
  10
   E            
test_scheduler_job.py:test_execute_queries_count_with_harvested_dags>scheduler_job.py:_run_scheduler_loop>scheduler_job.py:_do_scheduling:1549:
 1
   E            
scheduler_job.py:_critical_section_execute_task_instances>scheduler_job.py:_executable_task_instances_to_queued>pool.py:slots_stats:107:
        1
   E            
scheduler_job.py:_critical_section_execute_task_instances>scheduler_job.py:_executable_task_instances_to_queued>pool.py:slots_stats:111:
        1
   E            
scheduler_job.py:_do_scheduling>scheduler_job.py:_critical_section_execute_task_instances>scheduler_job.py:_executable_task_instances_to_queued:949:
    1
   E            
scheduler_job.py:_critical_section_execute_task_instances>scheduler_job.py:_executable_task_instances_to_queued><string>:<lambda>:1:
    1
   E            
scheduler_job.py:_critical_section_execute_task_instances>scheduler_job.py:_executable_task_instances_to_queued>scheduler_job.py:__get_concurrency_maps:895:
    1
   E            
scheduler_job.py:_do_scheduling>scheduler_job.py:_critical_section_execute_task_instances>scheduler_job.py:_executable_task_instances_to_queued:1090:
   1
   ```


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[email protected]


Reply via email to