Subham-KRLX commented on issue #67178: URL: https://github.com/apache/airflow/issues/67178#issuecomment-4505960496
> [@Subham-KRLX](https://github.com/Subham-KRLX) yes, I will raise another issue for this but this issue still remains open for us. We are still seeing for some tasks randomly after the fix you provided. We are using waiter max attempts=500 and waiter delay =60s > > ``` > Reading remote log from Cloudwatch log_group: arn:aws:logs:us-west-2:114150085555:log-group:airflow-dmoncloud-em-dev-latest-MwaaEnvironment-Task log_stream: dag_id=emdevdmcloud4xe1may15_csv_ingest_noatt/run_id=manual__2026-05-21T06_21_59.027786+00_00/task_id=ES_ES-all.emdevdmcloud4xe1may15_csv_ingest_noatt_skip_riskscoreerror/attempt=1.log > An error occurred (ResourceNotFoundException) when calling the GetLogEvents operation: The specified log stream does not exist. > ``` The task is being killed after about 16 seconds before the waiter can check status again this is a different issue than the throttling fix and looks like a task state management problem in Airflow 3.0.6. Can you check if execution_timeout is set and what your deferrable setting is. Also check MWAA metrics during failures for any CPU or memory spikes. Once you confirm this please open a separate issue for the task state termination behavior since it's a different problem from the waiter fix. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
