Development flow for custom hook & operator (MongoDB)

2017-08-07 Thread Hamade, Marcel (GfK)
Dear all, I am not super experienced with python, please bear with me! Since I was not able to find an existing MongoDB-Hook and Operator for airflow I decided to take things into my own hand. I found out that I need to define a Hook which inherits from the BaseHook and implements some functions

RE: Airflow on Windows?

2018-03-06 Thread Hamade, Marcel (GfK)
Hi Praveen, We figured out a good way of running Airflow on Docker for Windows. The keyword is to use docker-machine in combination with VirtualBox, not Hyper-V, all our other tries on Windows 10 failed at some point. Best Marcel -Original Message- From: Praveen [mailto:tgpravee...@gmai

AW: Airflow & AWS Lambda Tutorials?

2018-07-11 Thread Hamade, Marcel (GfK)
The aws_lambda_hook it self uses the AWS_hook which is a wrapper arount the boto3 library(the standard way to interact with AWS via python). If you add the AWS connections correctly you can use the hook in one of your self written operators to trigger your lambda functions Ano way would be to t