GitHub user mallman-experian created a discussion: When is BigQueryInsertJobOperator supposed to reattach to an existing big query job?
When is BigQueryInsertJobOperator supposed to reattach to an existing big query job? Because from what I can tell there are absolutely no circumstances whatsoever that BigQueryInsertJobOperator will _ever_ successfully reattach to an existing job id. And I mean _never_, as in, under no circumstances and under no input configuration whatsoever. I believe this is unintended behavior that was introduced in this commit: https://github.com/apache/airflow/commit/d2eed7a0d6008890135c747eda8656581030f8ba Note that there is literally _no_ code path in this commit where re-attachment will succeed. It will always raise an exception, because _handle_job_error raises an exception if `job.state != "DONE"` and the last thing the reattachment strategy does is call that method with a `job.state != "DONE"`. Sorry I don't have an actual bug to report. This is just my observation from scrutinizing this source code. Cheers. GitHub link: https://github.com/apache/airflow/discussions/60243 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
