shahar1 opened a new pull request, #70393:
URL: https://github.com/apache/airflow/pull/70393

   ## AI Summary
   In deferrable mode, `GenAIGeminiCreateBatchJobOperator` / 
`GenAIGeminiCreateEmbeddingsBatchJobOperator` write the results file in 
`execute_complete()`, which runs in a fresh resume worker where `execute()` — 
and its `results_folder` pre-flight check (moved there by #70362) — never ran. 
A folder missing in that worker (heterogeneous workers, or a relative path 
resolved against a different CWD) surfaced as a raw `FileNotFoundError` after 
the billable batch job already succeeded.
   
   The existing check is extracted into `_validate_results_folder()` (raise 
relocated verbatim) and called both from `execute()` (unchanged fail-fast 
before creating the job) and from `_prepare_results_for_xcom()` before 
downloading, so the process that writes the file is the one that validates the 
folder.
   
   related: #70362
   
   ---
   
   ##### Was generative AI tooling used to co-author this PR?
   
   - [X] Yes — Claude Code (Fable 5)
   
   Generated-by: Claude Code (Fable 5) following [the 
guidelines](https://github.com/apache/airflow/blob/main/contributing-docs/05_pull_requests.rst#gen-ai-assisted-contributions)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to