HI all -
I am using Airflow version 1.9.0 and am seeing these random errors in my
logs. This causes Airflow to think that the task has failed, even though I can
find the process with a ps aux. Any ideas what is causing this? Don't know if
this is relevant, but this happens with processes that are fairly long-lived
(they poll every minute during the day until it's time for them to run).
[2018-07-23 16:31:53,891] {logging_mixin.py:84} WARNING - Traceback (most
recent call last):
[2018-07-23 16:31:53,892] {logging_mixin.py:84} WARNING - File
"/var/software/anaconda3/envs/statar_20180624/lib/python3.6/logging/__init__.py",
line 996, in emit
self.flush()
[2018-07-23 16:31:53,892] {logging_mixin.py:84} WARNING - File
"/var/software/anaconda3/envs/statar_20180624/lib/python3.6/logging/__init__.py",
line 976, in flush
self.stream.flush()
[2018-07-23 16:31:53,892] {logging_mixin.py:84} WARNING - BrokenPipeError:
[Errno 32] Broken pipe
Ram.