Hi Michal,
I took a quick look at your patch, does your `airflow run` process
kill itself after it receives a SIGINT? I noticed it catches the
`AirflowRetryException` but doesn't re-raise it.
Otherwise, does the log line ("WARNING - State of this instance has
been externally set to None. Taking
I think you the behavior you want may be exactly what will happen provided
that you setup your sensors to retry when they fail.
Let me describe a play-by-play of how things should happen
* sensor is running, doing its sensor thing (for this sake let's say it's
waiting for a file in HDFS to show
Hello Everyone,
our company is currently considering Airflow for the engine of a pretty big
workflow system.We use Python 3 and have some HA requirements, so we plan to
use Celery with multiple worker and scheduler nodes and RabbitMQ as message
bus. We are also using Docker containers for
