Re: Custom (mongodb) hook as a plugin

On 23 September 2016 at 15:06, Rob Goretsky wrote: > More generally, would it make sense to create an enhancement to the plugin > architecture that allows the developer of a new hook to also specify the > name of a new 'connection type' along with what fields would be

Re: Airflow Latency Between Task Scheduling and task Execution

If you want to run faster and you're only using one machine, I would recommend using the LocalExecutor instead of the CeleryExecutor. On the more general topic, Airflow is NOT designed for processing real time data. It is a workflow tool for batch processing. The sweet spot for Airflow is running

Re: Regarding installation issue

We don’t support python 2.6 . Please upgrade to at least 2.7. Bolke > Op 3 okt. 2016, om 08:23 heeft twinkle sachdeva > het volgende geschreven: > > Hi, > > I have been trying to install Airflow on one of the VMs ( Python version : > 2.6.6 and Pip Version : 7.1.0

Airflow bugs but stays running

Hi all, I use Airflow v1.7.1.3 with the local scheduler and I encounter a problem with the scheduler : For some reason, the airflow database is no more accessible so the scheduler display the OperationalError below. My problem is the scheduler does not kill itself after this error, it is running