Shoryamishra61 commented on PR #74577: URL: https://github.com/apache/airflow/pull/74577#issuecomment-6140905311
Thanks @garvit-arora for pointing out the adapter concurrency concern. I've pushed follow-up fixes in 427715ee3f that limit the API-server ThreadPoolExecutor to one worker, regardless of the configured process-pool size. Scheduler events continue using the existing ProcessPoolExecutor configuration and initializer. I also added regression coverage for configured pool sizes greater than one, concurrent submissions and single client initialization, fail-open prevention, plus the relevant lifecycle/fork-safety cases (including real process fork and mutex re-initialization). Validation: - Targeted OpenLineage tests passed: 16 passed. - Full OpenLineage listener & routing test suites passed: 76 passed, 1 skipped. - Core FastAPI app lifespan tests passed: 5 passed. - Ruff lint, formatting, and mypy passed without issues. - Remote CI checks on GitHub Actions are currently running. Appreciate the review — happy to address any further concerns. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
