Re: New book covers Airflow with PySpark: Agile Data Science 2.0 (O'Reilly, 2017) AND Airflow Meetup?

Hi Siddharth, I am Jayesh from Paypal, and at last meetup we briefly talked about hosting next one and I offered to host next Airflow meetup at Paypal office. If we can come up with some dates, I can talk to facilities and reserve space accordingly. Please let me know. Thanks Jayesh On Thu,

Re: New book covers Airflow with PySpark: Agile Data Science 2.0 (O'Reilly, 2017) AND Airflow Meetup?

Mid-March might be a good time given that we had 2 meet-ups recently. We have a wiki about Airflow meet-ups : https://cwiki.apache.org/confluence/display/AIRFLOW/Meetups. Feel free to ask this list if someone would like to host..I'd imagine interest would primarily come from other members of

Re: New book covers Airflow with PySpark: Agile Data Science 2.0 (O'Reilly, 2017) AND Airflow Meetup?

Siddharth, nice to hear from you. Great to hear! I'm just starting a consultancy called Data Syndrome around the book, and I work from home, which doesn't put me in a great position to personally host the meetup. If you need someone to organize it and to seek a venue, I can do that. How does that

New book covers Airflow with PySpark: Agile Data Science 2.0 (O'Reilly, 2017) AND Airflow Meetup?

Hello! My name is Russell Jurney. I am a relatively new Airflow user and just joined the group. I am an Azkaban refugee, and an enemy of Oozie and the tyranny of XML. I wanted to tell you about my new book, out in pre-release, called Agile Data Science 2.0

Re: Airflow 1.8.0 BETA 1

I'd like to test it on my VM with the code I am working on but I do not know how to upgrade from 1.7. Can I use pip to pull it from github? maybe someone can give me directions - i am very new to python. Also will it mess my airflow.cfg or something else I need to backup? On Wed, Jan 18, 2017 at

Re: Question - HttpHook

Thank you very much, Matt! On Wed, Jan 18, 2017 at 5:11 PM Matt Hickman wrote: > Couple things: > - You shouldn’t need to set port 443 > - Make sure the url starts with https:// in the connection settings > - To check your auth is working properly try something

How to learn more about deprecation warnings?

Hi! Is there a way to determine the rationale behind deprecation warnings? In particular I'm interested in the following: /Users/llorenz/Envs/fileflow/lib/python2.7/site-packages/airflow/models.py:1719: > PendingDeprecationWarning: Invalid arguments were passed to > DivePythonOperator. Support

Re: Good jinja templating in airflow examples

Maxime, I have a related question. Can you explain how template_dict work with PythonOperator? Documentation is very vague about it. Example would be nice. I could not find a way to use jinja template with Python operator i.e. passing templated parameters to a pythonoperator callable. Someone told