ashb commented on PR #68441: URL: https://github.com/apache/airflow/pull/68441#issuecomment-4691675140
> The main motivation behind this is to not have airflow in the venv. With Airflow 3, it takes significantly longer to just import than on previous version (around 8s), so we started migrating away from keeping airflow in the venvs. That is mainly because we use the google provider, which is huge, and having a 8s delay on each task just to import was way too much. Thats when I noticed the logs do not match in that case, and if you have loglevel globally set > INFO, you would not see any task execution logs. The providers you have installed or not shouldn't really matter to timing, or that's what my head says. Longer term we are working on a plan where you can install `apache-airflow-task-sdk` without needing Airflow core, which should massively help with the import time One thing you might want to know about, but that we don't want to document is this https://github.com/apache/airflow/blob/def50a9021171afe9f65d021fdebb24f6309f300/airflow-core/src/airflow/__init__.py#L75-L81 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
