Ohashiro opened a new issue, #44618:
URL: https://github.com/apache/airflow/issues/44618

   ### Apache Airflow Provider(s)
   
   microsoft-azure
   
   ### Versions of Apache Airflow Providers
   
   apache-airflow-providers-microsoft-azure==11.1.0
   
   ### Apache Airflow version
   
   2.10.2
   
   ### Operating System
   
   linux
   
   ### Deployment
   
   Google Cloud Composer
   
   ### Deployment details
   
   _No response_
   
   ### What happened
   
   We use the operator `PowerBIDatasetRefreshOperator` to refresh our PowerBI 
datasets. Sometimes, the task quickly fails with the following error:
   ```
   airflow.exceptions.AirflowException: An error occurred: Unable to fetch the 
details of dataset refresh with Request Id: <request id>
   ```
   <img width="751" alt="image" 
src="https://github.com/user-attachments/assets/ddcff823-c2c4-456f-861e-f7a54eabd991";>
   
   
   However, on PowerBI side, the dataset is refreshed (timezone GMT+1, both the 
time in the refresh and the log are about the same):
   <img width="171" alt="image" 
src="https://github.com/user-attachments/assets/47f263b0-cf20-4b4e-803a-aee25a248d25";>
   
   
   If I understand correctly, this corresponds to an error in [this 
function](https://github.com/apache/airflow/blob/d059d4a84b526e5f975d17c6846f5c8e29adbc3a/providers/src/airflow/providers/microsoft/azure/hooks/powerbi.py#L148),
 which may mean that there was an error when trying to fetch the refresh 
status, even though the refresh was running. Maybe the error comes from the 
request to the Microsoft API, which could be improved with a retry (but we did 
not test for the moment).
   
   ### What you think should happen instead
   
   The task should succeed. (since the dataset refresh suceeded)
   
   ### How to reproduce
   
   On our side, we use the following configuration.
   
   ```python
   refresh_powerbi_dataset_success = PowerBIDatasetRefreshOperator(
           task_id="refresh_powerbi_dataset_success",
           conn_id="our-conn-id",
           dataset_id="our-dataset-id",
           group_id="our-group-id",
       )
   ```
   
   The dataset ID and group ID correspond to valid PowerBI dataset and 
workspace.
   
   ### Anything else
   
   This bug occurs about once every 3 task runs (the task fails but the refresh 
succeeds). Sometimes if fails several times in a row then works again, other 
times it works on the first run. I think this should mean that the 
configuration is good (since the operator often works fine).
   I haven't been able to identify any specific pattern.
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to