Re: [I] Logs disappearing for deferred CloudRunExecuteJobOperator while state is deferred [airflow]

[via GitHub]

Lee-W commented on issue #58676:
URL: https://github.com/apache/airflow/issues/58676#issuecomment-3707597521

   > Hey [@Lee-W](https://github.com/Lee-W), sorry for the late answer 
(christmas days and all),
   > 
   > I tried out the DAG you sent me. I can briefly see `pre_execute called by 
self.log`, then it disappears for the time of deferral, and then it re-appears 
after the task has finished.
   > 
   > Initial: <img alt="Image" width="962" height="131" 
src="https://private-user-images.githubusercontent.com/7646847/531440862-963084fa-aff2-48dc-93d5-d3a63798be6f.png?jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3Njc0OTkwOTMsIm5iZiI6MTc2NzQ5ODc5MywicGF0aCI6Ii83NjQ2ODQ3LzUzMTQ0MDg2Mi05NjMwODRmYS1hZmYyLTQ4ZGMtOTNkNS1kM2E2Mzc5OGJlNmYucG5nP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI2MDEwNCUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNjAxMDRUMDM1MzEzWiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9YmI3YmNjNGJkOGNiZjk0YjI1MWYzODQ1YzNjZWM3MzNiMmJhN2E4NGE1NzMzY2RiNDdlMzE5MDBmZTNmZDA1MCZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QifQ.AGcgnw2OQQ9owpEu4AUB4XLETbdcHPjXPORzxgfe9Oc";>
   > 
   > During wait: <img alt="Image" width="963" height="223" 
src="https://private-user-images.githubusercontent.com/7646847/531440931-7400175f-377b-475f-9e40-28bb45468685.png?jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3Njc0OTkwOTMsIm5iZiI6MTc2NzQ5ODc5MywicGF0aCI6Ii83NjQ2ODQ3LzUzMTQ0MDkzMS03NDAwMTc1Zi0zNzdiLTQ3NWYtOWU0MC0yOGJiNDU0Njg2ODUucG5nP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI2MDEwNCUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNjAxMDRUMDM1MzEzWiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9NDAwMDNlMDQ2ZjYxNDQwZmUyMDk1MjBjN2ZlNWE0NzEyNjc0ZWRhNjliMjEwNjkyN2UxMDJkZjI3ZWNiYmQ3MSZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QifQ.XJsiihjRpPJvZpIwBW2FpNImn58s9z8oMzpVyDZPGnE";>
   > 
   > After completion: <img alt="Image" width="963" height="207" 
src="https://private-user-images.githubusercontent.com/7646847/531440955-383fd41d-73cd-4b94-8de7-9e0097779d4a.png?jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3Njc0OTkwOTMsIm5iZiI6MTc2NzQ5ODc5MywicGF0aCI6Ii83NjQ2ODQ3LzUzMTQ0MDk1NS0zODNmZDQxZC03M2NkLTRiOTQtOGRlNy05ZTAwOTc3NzlkNGEucG5nP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI2MDEwNCUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNjAxMDRUMDM1MzEzWiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9NTMwZTNlNDJlMWEwOTRjYWM5MTE5ZGFhMmJlODcwMGQ0OTgxMDY2MzMwMDkwM2U4MWI2YjkyMTA4MTBmYjI1YiZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QifQ.PWMFoOH4oMpsry5sCxDFxhEOloOyyrqCB1VvRvLOxWQ";>
   > 
   > You can see the source in the header change from `airflow-worker-0` to 
`airflow-triggerer-0`, so that must be the issue?
   
   No worries 🙂 Yep, I think this is a valid issue. Would you mind sharing the 
airflow configuration or how you deployed Airflow? Ideally, a minimum 
step-by-step setup could be `uv pip install airflow` or a Helm chart. I've 
tried a few ways but failed to reproduce it. Thanks


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org