Fokko commented on issue #3914: [AIRFLOW-3069] Log all output of the S3 file 
transform script
URL: 
https://github.com/apache/incubator-airflow/pull/3914#issuecomment-429271091
 
 
   Thanks @sbilinski 
   
   In the past we had some issues with separate stdout and stderr. What happend 
is that when the stderr buffer would fill up, and it wasn't being consumed, 
because it was still reading the stdout as long as the process lives, it would 
freeze in the end because of the full stderr buffer. This is a known bug which 
we've fixed in the bash_operator by piping stderr to stdout: 
https://github.com/apache/incubator-airflow/blob/master/airflow/operators/bash_operator.py#L112

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to