HadarSha commented on PR #34771: URL: https://github.com/apache/airflow/pull/34771#issuecomment-1893412609
Any chance of remedy regarding these logs? we are unable to assist @kzosabe with the points he had brought up, and this issue has been preventing us from upgrading Airflow for months now :( It seems that the sheer volume of the logs itself (we have almost 100k tasks daily) being constantly printed in mass, kills the schedulers and causes a significant memory overhead we cannot account for in the new versions. Perhaps there is a way to just suppress these specific logs somehow without fixing the underlying issue/implementation, even as a temporary flag or override? @eladkal @hussein-awala @uranusjr Thanks a lot! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
