walter9388 commented on issue #45554: URL: https://github.com/apache/airflow/issues/45554#issuecomment-3269510482
Hi @anasatzemoso, thanks for looking into this! Glad to see there is an improvement in Airflow 3.x, do you know where the improvement has come from? At my company I think it is going to be a while before we migrate to 3.x, so I would still like to understand if improvements can be made in 2.x on this matter. All of this seems slightly arbitrary to me. I feel like whether it's 20 seconds or 60 seconds, there must be some sort of polling going on internally for the logs, and it would be great to understand if we can either improve the latency to CloudWatch logs in general or parameterize the polling interval to CloudWatch logs somewhere if there is a reason it has been set at 30s, 60s etc. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
