potiuk commented on pull request #14792: URL: https://github.com/apache/airflow/pull/14792#issuecomment-801443712
Hey @ashb @kaxil . I think I nailed it finally. Last time when I run it in parallel, everything succeeded. I improved the parallel run additionally and I am running it now, but I would love to merge this now. Summarising the fixes: * we cannot use __dell__ as SchedulerJob is an SQLAlchemy managed object - and those two do not work well * I updated all tests' setUp and tearDown to "end" SchedulerJob processes. That seems to help in most cases except the one count test with 195 updates. * rather than set to 0 the "min_update/min_fetch" intervals I set it to 100 in the count test. And that finally fixed the stability of that count test I think. The problem was that the test run together with others run long enough that there was an extra "get" from serialized dags - that would normally not happen because of "min_fetch_interval" was actually too low it seems. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
