Re: Chicago Airflow user meetup group

2018-05-22 Thread Vasyl Harasymiv
Hi Trevor, Great idea! I saw you speaking at Snowflake event. We are using Airflow and are ready to offer space at ActiveCampaign in Chicago and arrange for live streaming (provided it is not booked out for a specific evening already) or join at your location (we are at 1 North Dearborn).

Re: Chicago Airflow user meetup group

2018-05-22 Thread Sid Anand
That's great news and we welcome the new Meetup. Here are a few pointers: 1. Add your new meet-up on : https://cwiki.apache.org/confluence/display/AIRFLOW/Meetups 2. Add the new Meetup to https://cwiki.apache.org/confluence/display/AIRFLOW/Announcements & follow the guidelines on

Re: Chicago Airflow user meetup group

2018-05-22 Thread Victor Noagbodji
Hey Trevor, meetup.com is the only service I used and know helps with meetups. I don't live in Chicago, so I don't know what other restrictions there are. Wish you the best! Oh, +1 for putting streams on YouTube : ) On May 22, 2018, at 12:26 AM, Trevor Beuthel

Chicago Airflow user meetup group

2018-05-22 Thread Trevor Beuthel
Hi there, My name's Trevor Beuthel and I would like to start an airflow meetup group in Chicago. I work at a company called Vibes here in Chicago, and we just rolled out a decent sized migration to airflow that took us a little under a year to complete. We use many of the built in features of

Re: Chicago Airflow user meetup group

2018-05-22 Thread Victor Noagbodji
I am curious about this one. Why should committers be added as admins? > On May 22, 2018, at 12:08 PM, Sid Anand wrote: > > That's great news and we welcome the new Meetup. Here are a few pointers: > > 1. Add your new meet-up on : >

Re: Where to put docs on configuring specific kinds of connections? (Or restructuring the docs the way Django does)

2018-05-22 Thread Tim Swast
I think the whole "Configuration" page could benefit from getting split into separate how-to guides. Basically, every sub-heading in Configuration becomes a different how-to guide. Since the configuration page is attempting to do double-duty as a tutorial right now, keep the current sequence, at

Re: Where to put docs on configuring specific kinds of connections? (Or restructuring the docs the way Django does)

2018-05-22 Thread Tim Swast
PR: https://github.com/apache/incubator-airflow/pull/3400 Jira: https://issues.apache.org/jira/browse/AIRFLOW-2509 On Tue, May 22, 2018 at 9:12 AM Tim Swast wrote: > I think the whole "Configuration" page could benefit from getting split > into separate how-to guides.

Re: kwargs usage in BaseOperator

2018-05-22 Thread Tao Feng
Ping. Anyone has any idea on the question(whether airflow will remove kwargs in BaseOperator)? On Mon, May 21, 2018 at 11:26 AM, Tao Feng wrote: > Hi, > > I have a question regarding kwargs usage in BaseOperator(https://github. >

Re: kwargs usage in BaseOperator

2018-05-22 Thread Craig Rodrigues
On Monday, May 21, 2018, Tao Feng wrote: > > I wonder whether we still have the plan to remove kwargs in airflow 2.0(do > we have the timeline for airflow 2.0?) as the warning generates too many > noises for our internal production env as well as the travis CI log. > > >

Re: Chicago Airflow user meetup group

2018-05-22 Thread Sid Anand
The 4th one is not required. You are free to add anyone you wish as admins. As a best practice, ensure there are enough admins to avoid a dead/unowned meetup. -s On Tue, May 22, 2018 at 9:13 AM, Victor Noagbodji < vnoagbo...@amplify-nation.com> wrote: > I am curious about this one. Why should

Re: Moving to Github? Re: Merging PRs, closing Jira tickets (a.k.a New Committer) guide?

2018-05-22 Thread Driesprong, Fokko
Are we moving to Gitbox? I would really like that. I see a lot of other project moving to Gitbox at the moment (Flink, Parquet). How's your schedule Ash? ;) Cheers, Fokko 2018-03-09 18:53 GMT+01:00 Bolke de Bruin : > I would love to be able to close PRs on GitHub, but

Re: Where to put docs on configuring specific kinds of connections? (Or restructuring the docs the way Django does)

2018-05-22 Thread Naik Kaxil
Hi Tim, My personal opinion is to write the docs on GCP connection down at GCP Integration page would be an ideal fit but would like to hear others opinion as well. +1 for creating separate How-To guides.

Re: celery problem: cannot override celery_broker_transport_options

2018-05-22 Thread Ash Berlin-Taylor
To use with the SQLA backend to celery you need to override the options Airflow passes to Celery. Those come from https://github.com/apache/incubator-airflow/blob/v1-10-test/airflow/config_templates/default_celery.py Since you don't want most/all of those options (and there is no way in the