grenmester opened a new issue #17878:
URL: https://github.com/apache/airflow/issues/17878


   ### Apache Airflow version
   
   2.0.1
   
   ### Operating System
   
   5.13.12-arch1-1
   
   ### Versions of Apache Airflow Providers
   
   _No response_
   
   ### Deployment
   
   Managed Services (Astronomer, Composer, MWAA etc.)
   
   ### Deployment details
   
   _No response_
   
   ### What happened
   
   I tried using the `to_csv` method in one of my tasks created using the new 
task decorator to save a file to a GCS bucket. The task was marked as 
successful but the file did not save to the bucket.
   
   ### What you expected to happen
   
   I expected it to either fail or have the file be saved successfully but it 
was neither. I did some digging and turns out it's a permission issue. I would 
have expected the logs to show that it was a permission issue but it instead 
silently fails in the background. This is surprising to me because when I 
tested reading from a GCS bucket using `pd.read_csv`, it showed in the logs 
that it was a permission issue.
   
   ### How to reproduce
   
   ```python
   @task
   def my_task():
       df = pd.DataFrame()
       df.to_csv("gs://path-to-file")
   ```
   
   ### Anything else
   
   Airflow logs:
   
   ```
   [2021-08-27 06:10:47,306] {taskinstance.py:1160} INFO - Marking task as 
SUCCESS. dag_id=phonic_initial, task_id=fb-17.get_survey_data, 
execution_date=20210827T060936, start_date=20210827T060940, 
end_date=20210827T061047
   [2021-08-27 06:10:47,608] {local_task_job.py:187} WARNING - State of this 
instance has been externally set to success. Terminating instance.
   [2021-08-27 06:10:47,609] {process_utils.py:100} INFO - Sending 
Signals.SIGTERM to GPID 115
   [2021-08-27 06:10:47,622] {taskinstance.py:1241} ERROR - Received SIGTERM. 
Terminating subprocesses.
   [2021-08-27 06:10:47,989] {process_utils.py:66} INFO - Process 
psutil.Process(pid=115, status='terminated', exitcode=1, started='06:09:40') 
(115) terminated with exit code 1
   ```
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


Reply via email to