eladkal closed issue #38532: `BigQueryInsertJobOperator` sometimes fails to
acquire impersonated credentials when in deferred mode
URL: https://github.com/apache/airflow/issues/38532
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
nathadfield commented on issue #38532:
URL: https://github.com/apache/airflow/issues/38532#issuecomment-2056106149
@dondaum Looks reasonable from what I can tell. I'd suggest trying to get
some eyes on it from the committers.
--
This is an automated message from the Apache Git Service.
dondaum commented on issue #38532:
URL: https://github.com/apache/airflow/issues/38532#issuecomment-2051537676
@nathadfield Thanks. I think I got it know.
I worked on a change that adds a retry in such cases. Can you perhaps have a
look and check ?
--
This is an automated message
nathadfield commented on issue #38532:
URL: https://github.com/apache/airflow/issues/38532#issuecomment-2049607389
@dondaum Thanks but, as I mentioned, it isn't possible to replicate
consistently. The error that is returned is a 502 HTTP error from Google which
means the problem was on
dondaum commented on issue #38532:
URL: https://github.com/apache/airflow/issues/38532#issuecomment-2049580920
I tried to reproduce the exact error but with no success. I tried to
reproduce it with the following DAG:
```Python
import datetime
import os
from
nathadfield commented on issue #38532:
URL: https://github.com/apache/airflow/issues/38532#issuecomment-2044708761
> Maybe I have some time to look at it.
>
> A few questions:
>
> * What authentication method do you use? Application Default Credentials,
service account or a
dondaum commented on issue #38532:
URL: https://github.com/apache/airflow/issues/38532#issuecomment-2044639569
Maybe I have some time to look at it.
A few questions:
- What authentication method do you use? Application Default Credentials,
service account or a credential
nathadfield commented on issue #38532:
URL: https://github.com/apache/airflow/issues/38532#issuecomment-2031224269
> As a workaround, setting `force_rerun=False` and setting retries should
allow another retry to pick up and monitor the original job instead of starting
a new one.
nathadfield commented on issue #38532:
URL: https://github.com/apache/airflow/issues/38532#issuecomment-2031224735
> What `location` do you provide as an input? (checking if it might be
related to #37282)
It's EU, so I don't think it would be.
--
This is an automated message from
shahar1 commented on issue #38532:
URL: https://github.com/apache/airflow/issues/38532#issuecomment-2028185966
What `location` do you provide as an input? (checking if it might be related
to #37282)
--
This is an automated message from the Apache Git Service.
To respond to the message,
collinmcnulty commented on issue #38532:
URL: https://github.com/apache/airflow/issues/38532#issuecomment-2027685514
As a workaround, setting `force_rerun=False` and setting retries should
allow another retry to pick up and monitor the original job instead of starting
a new one.
--
This
nathadfield opened a new issue, #38532:
URL: https://github.com/apache/airflow/issues/38532
### Apache Airflow version
main (development)
### If "Other Airflow 2 version" selected, which one?
_No response_
### What happened?
Occasionally, a
12 matches
Mail list logo
