Hi Siddharth, I am Jayesh from Paypal, and at last meetup we briefly talked about hosting next one and I offered to host next Airflow meetup at Paypal office.
If we can come up with some dates, I can talk to facilities and reserve space accordingly. Please let me know. Thanks Jayesh On Thu, Jan 19, 2017 at 6:58 PM, siddharth anand <san...@apache.org> wrote: > Mid-March might be a good time given that we had 2 meet-ups recently. > > We have a wiki about Airflow meet-ups : > https://cwiki.apache.org/confluence/display/AIRFLOW/Meetups. Feel free to > ask this list if someone would like to host......I'd imagine interest would > primarily come from other members of the community, but we're open to all > ideas. Since the last meet-up was in SF, it would be great if the next one > were in the South Bay. > > -s > > On Thu, Jan 19, 2017 at 6:46 PM, Russell Jurney <russell.jur...@gmail.com> > wrote: > > > Siddharth, nice to hear from you. Great to hear! > > > > I'm just starting a consultancy called Data Syndrome around the book, > and I > > work from home, which doesn't put me in a great position to personally > host > > the meetup. If you need someone to organize it and to seek a venue, I can > > do that. How does that sound? I'm sure I could find someone to host it. > > > > When would be a good date, do you think? Late February? > > > > On Thu, Jan 19, 2017 at 5:19 PM, siddharth anand <san...@apache.org> > > wrote: > > > > > Sounds like a great idea. We are looking for someone to host the next > > one.. > > > once one is announced, you can sign up as a speaker.. You are also > > welcome > > > to host a meet-up if you like. > > > -s > > > > > > On Thu, Jan 19, 2017 at 4:39 PM, Russell Jurney < > > russell.jur...@gmail.com> > > > wrote: > > > > > > > Hello! My name is Russell Jurney. I am a relatively new Airflow user > > and > > > > just joined the group. I am an Azkaban refugee, and an enemy of Oozie > > and > > > > the tyranny of XML. > > > > > > > > I wanted to tell you about my new book, out in pre-release, called > > Agile > > > > Data Science 2.0 <http://bit.ly/agile_data_science> (O'Reilly 2017). > > In > > > > the > > > > book, we use Airflow in chapter 2, Setup, in a way similar to the > > Airflow > > > > tutorial. Then, in chapter 8, Deploying Predictive Systems, we use > > > Airflow > > > > to deploy a predictive system built with PySpark and Spark MLlib. > > > > > > > > Some highlights in the code at http://github.com/rjurney/ > > > Agile_Data_Code_2 > > > > : > > > > > > > > - ch02/airflow_test.py > > > > <https://github.com/rjurney/Agile_Data_Code_2/blob/master/ > > > > ch02/airflow_test.py> > > > > is > > > > a complete Airflow/PySpark tutorial along with > > > ch02/pyspark_task_one.py > > > > <https://github.com/rjurney/Agile_Data_Code_2/blob/master/ > > > > ch02/pyspark_task_one.py> > > > > and > > > > ch02/pyspark_task_two.py > > > > <https://github.com/rjurney/Agile_Data_Code_2/blob/master/ > > > > ch02/pyspark_task_two.py> > > > > - The airflow setup for chapter 8 is at ch08/airflow/setup.py > > > > <https://github.com/rjurney/Agile_Data_Code_2/blob/master/ > > > > ch08/airflow/setup.py> > > > > . > > > > - The scripts that it operates on are in ch08/ > > > > <https://github.com/rjurney/Agile_Data_Code_2/blob/master/ch08> > and > > > > show > > > > things like how to use '{{ ds }}' and other parameters to hook > your > > > > scripts > > > > into 'airflow backfill' and other features. > > > > - ch08/make_predictions.py > > > > <https://github.com/rjurney/Agile_Data_Code_2/blob/master/ > > > > ch08/make_predictions.py> > > > > shows > > > > how to setup a PySpark environment in a script in a way that can > > work > > > > with > > > > Airflow. > > > > > > > > If there is any interest, I would love to present on something like > > > > "Building Predictive Systems with Spark and Airflow" at an upcoming > > > Airflow > > > > meetup. > > > > > > > > Thanks! > > > > -- > > > > Russell Jurney twitter.com/rjurney russell.jur...@gmail.com > relato.io > > > > > > > > > > > > > > > -- > > Russell Jurney twitter.com/rjurney russell.jur...@gmail.com relato.io > > >
