potiuk commented on pull request #14792: URL: https://github.com/apache/airflow/pull/14792#issuecomment-799695743
Yep. I believe the remnant processes from SchedulerJob would explain vast majority of the flaky tests we had in scheduler. For example changing counts of queries, wrong status of tasks and the like. I think I fixed all of them. I will run a few more tests (running full tests suite locally several times) but It looks very much like this. @ashb I'd love if you take a look and confirm my findings/see if I fixed it correctly. There is one issue (test_retry_handling_job) left - it is consistently failing so I marked it as xfail and likely it need fixing because I think it's behaviour changed now. But I think it should be taken care of separately. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
