melicheradam commented on PR #68441: URL: https://github.com/apache/airflow/pull/68441#issuecomment-4719706677
> The providers you have installed or not shouldn't really matter to timing, or that's what my head says. But if we have google logging setup (storage buckets), we need the google provider, and it has to be setup + imported if we want to have airflow logging in venv, right? And that google provider package is pretty big depencency chain. - But in the end it was not the root cause of the slowness. I was investigating more the slow imports, and found the root cause was we had env variable `PYTHONDONTWRITEBYTECODE=1` set 🤦. But still fetching Variables through API is overloading our apiserver. Anyway, I think it should be possible to have a "correct" way of logging even if you are not using Airflow. I have done the updates you requested, but I am not sure about this one > Needs a way to disable the parsing I think. I have clamped the parsing to check only first few characters no matter how long the line is so it does not impact long lines. Not sure if you mean adding a configuration option, this use case seems too niche for me, to have its own config entry. Let me know -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
