Re: Graduation resolution passed - Airflow is a TLP
Congrats everyone On Fri 21 Dec, 2018, 08:32 Deng Xiaodong Congratulations! > > XD > > On Fri, Dec 21, 2018 at 06:18 Tao Feng wrote: > > > Thanks Jakob for driving the graduation! Great news! > > > > On Thu, Dec 20, 2018 at 1:13 PM Jakob Homan wrote: > > > > > Hey all- > > >The Board minutes haven't been published yet (probably due to > > > Holiday-related slowness), but I can see through the admin tool that > > > our Graduation resolution was approved yesterday at the meeting. > > > Airflow is the 199th current active Top Level Project in Apache. > > > > > > Congrats all. > > > > > > -Jakob > > > > > >
Re: Graduation resolution passed - Airflow is a TLP
Hurrah.. Congrats to whole community.. On Fri, Dec 21, 2018, 08:32 Deng Xiaodong Congratulations! > > XD > > On Fri, Dec 21, 2018 at 06:18 Tao Feng wrote: > > > Thanks Jakob for driving the graduation! Great news! > > > > On Thu, Dec 20, 2018 at 1:13 PM Jakob Homan wrote: > > > > > Hey all- > > >The Board minutes haven't been published yet (probably due to > > > Holiday-related slowness), but I can see through the admin tool that > > > our Graduation resolution was approved yesterday at the meeting. > > > Airflow is the 199th current active Top Level Project in Apache. > > > > > > Congrats all. > > > > > > -Jakob > > > > > >
Re: Graduation resolution passed - Airflow is a TLP
Congratulations! XD On Fri, Dec 21, 2018 at 06:18 Tao Feng wrote: > Thanks Jakob for driving the graduation! Great news! > > On Thu, Dec 20, 2018 at 1:13 PM Jakob Homan wrote: > > > Hey all- > >The Board minutes haven't been published yet (probably due to > > Holiday-related slowness), but I can see through the admin tool that > > our Graduation resolution was approved yesterday at the meeting. > > Airflow is the 199th current active Top Level Project in Apache. > > > > Congrats all. > > > > -Jakob > > >
Re: Graduation resolution passed - Airflow is a TLP
"They grow up so fast!" :) This is huge! Congratulations to everyone involved. On Thu, Dec 20, 2018 at 3:53 PM Feng Lu wrote: > Fantastic news!! Congrats everyone! > > On Thu, Dec 20, 2018 at 2:18 PM Tao Feng wrote: > > > Thanks Jakob for driving the graduation! Great news! > > > > On Thu, Dec 20, 2018 at 1:13 PM Jakob Homan wrote: > > > > > Hey all- > > >The Board minutes haven't been published yet (probably due to > > > Holiday-related slowness), but I can see through the admin tool that > > > our Graduation resolution was approved yesterday at the meeting. > > > Airflow is the 199th current active Top Level Project in Apache. > > > > > > Congrats all. > > > > > > -Jakob > > > > > >
Re: timeout not working in SqlSensor?
I think it's `timeout` not `time_out`. https://airflow.apache.org/code.html#basesensoroperator On Thu, Dec 20, 2018 at 12:12 PM Scott Halgrim wrote: > Does the timeout param work the way I think it should in Airflow 1.8? My > query just pokes at the poke interval indefinitely. I want it to timeout > after a few hours and fail instead. > > The code is basically > > “”” > task_name = SqlSensor( >conn_id='redshift', >sql=( >""" > select * from this_table where date=‘2018-12-18' > """ >), >task_id=’task_name', >dag=dag, >start_date=datetime(2016, 9, 25), >poke_interval=20, >time_out=45, > “”" > So after running the query a couple of times I would expect a failure, but > that’s not what’s happening, it just keeps querying and querying every 20 > seconds. > > Thanks, > > Scott >
Re: Graduation resolution passed - Airflow is a TLP
Cheers to y'all, keep up the great work! On Thu, Dec 20, 2018, 16:13 Jakob Homan wrote: > Hey all- >The Board minutes haven't been published yet (probably due to > Holiday-related slowness), but I can see through the admin tool that > our Graduation resolution was approved yesterday at the meeting. > Airflow is the 199th current active Top Level Project in Apache. > > Congrats all. > > -Jakob >
Re: Graduation resolution passed - Airflow is a TLP
Great news!! Congratulation to all! On Thu, Dec 20, 2018 at 2:00 PM Kevin Yang wrote: > Yeaaah! Great moment to witness! > > Arthur Wiedmer 于2018年12月21日 周五上午5:58写道： > > > Amazing! > > > > Great work all! > > > > On Thu, Dec 20, 2018, 13:13 Jakob Homan > > > > Hey all- > > >The Board minutes haven't been published yet (probably due to > > > Holiday-related slowness), but I can see through the admin tool that > > > our Graduation resolution was approved yesterday at the meeting. > > > Airflow is the 199th current active Top Level Project in Apache. > > > > > > Congrats all. > > > > > > -Jakob > > > > > >
Re: Graduation resolution passed - Airflow is a TLP
Yeaaah! Great moment to witness! Arthur Wiedmer 于2018年12月21日 周五上午5:58写道： > Amazing! > > Great work all! > > On Thu, Dec 20, 2018, 13:13 Jakob Homan > > Hey all- > >The Board minutes haven't been published yet (probably due to > > Holiday-related slowness), but I can see through the admin tool that > > our Graduation resolution was approved yesterday at the meeting. > > Airflow is the 199th current active Top Level Project in Apache. > > > > Congrats all. > > > > -Jakob > > >
Re: Graduation resolution passed - Airflow is a TLP
Amazing! Great work all! On Thu, Dec 20, 2018, 13:13 Jakob Homan Hey all- >The Board minutes haven't been published yet (probably due to > Holiday-related slowness), but I can see through the admin tool that > our Graduation resolution was approved yesterday at the meeting. > Airflow is the 199th current active Top Level Project in Apache. > > Congrats all. > > -Jakob >
Re: Graduation resolution passed - Airflow is a TLP
fantastic! congrats to all. great xmas news, enjoy the holidays. Sent from my iPhone > On 20 Dec 2018, at 18:43, Kaxil Naik wrote: > > Congratulations all. > >> On Thu, Dec 20, 2018, 21:41 Driesprong, Fokko > >> Awesome! Congrats! >> >> Cheers, Fokko >> >> Op do 20 dec. 2018 om 22:40 schreef Sid Anand >> >>> YaaY! >>> >>> -s >>> On Thu, Dec 20, 2018 at 1:13 PM Jakob Homan wrote: Hey all- The Board minutes haven't been published yet (probably due to Holiday-related slowness), but I can see through the admin tool that our Graduation resolution was approved yesterday at the meeting. Airflow is the 199th current active Top Level Project in Apache. Congrats all. -Jakob >>> >>
Re: Graduation resolution passed - Airflow is a TLP
Congratulations all. On Thu, Dec 20, 2018, 21:41 Driesprong, Fokko Awesome! Congrats! > > Cheers, Fokko > > Op do 20 dec. 2018 om 22:40 schreef Sid Anand > > > YaaY! > > > > -s > > > > On Thu, Dec 20, 2018 at 1:13 PM Jakob Homan wrote: > > > > > Hey all- > > >The Board minutes haven't been published yet (probably due to > > > Holiday-related slowness), but I can see through the admin tool that > > > our Graduation resolution was approved yesterday at the meeting. > > > Airflow is the 199th current active Top Level Project in Apache. > > > > > > Congrats all. > > > > > > -Jakob > > > > > >
Re: Graduation resolution passed - Airflow is a TLP
Awesome! Congrats! Cheers, Fokko Op do 20 dec. 2018 om 22:40 schreef Sid Anand > YaaY! > > -s > > On Thu, Dec 20, 2018 at 1:13 PM Jakob Homan wrote: > > > Hey all- > >The Board minutes haven't been published yet (probably due to > > Holiday-related slowness), but I can see through the admin tool that > > our Graduation resolution was approved yesterday at the meeting. > > Airflow is the 199th current active Top Level Project in Apache. > > > > Congrats all. > > > > -Jakob > > >
Re: Graduation resolution passed - Airflow is a TLP
YaaY! -s On Thu, Dec 20, 2018 at 1:13 PM Jakob Homan wrote: > Hey all- >The Board minutes haven't been published yet (probably due to > Holiday-related slowness), but I can see through the admin tool that > our Graduation resolution was approved yesterday at the meeting. > Airflow is the 199th current active Top Level Project in Apache. > > Congrats all. > > -Jakob >
Graduation resolution passed - Airflow is a TLP
Hey all- The Board minutes haven't been published yet (probably due to Holiday-related slowness), but I can see through the admin tool that our Graduation resolution was approved yesterday at the meeting. Airflow is the 199th current active Top Level Project in Apache. Congrats all. -Jakob
latest engineering blog post on Airflow from Lyft
Hi All, We just published an engineering blog post( https://eng.lyft.com/running-apache-airflow-at-lyft-6e53bb8fccff) on how we run and monitor airflow at Lyft. Please take a look when you have time. And feel free to ping us if you want to know more of the details. Thanks, -Tao
Re: Requesting Wiki edit permission to create AIPs
Thanks Sid. Tim, I think you are good to go. On Thu, Dec 20, 2018 at 11:34 AM Sid Anand wrote: > You should be able to see your names here: > > https://www.dropbox.com/s/3zn869uvrg696dc/Screenshot%202018-12-20%2011.33.38.png?dl=0 > > -s > > On Thu, Dec 20, 2018 at 11:31 AM Sid Anand wrote: > > > Tim : Added > > Kaxil, Tao, .. and everyone .. you are all space admins and have been > > since we added you. > > > > > > > https://www.dropbox.com/s/w7tbks0eciof9c5/Screenshot%202018-12-20%2011.30.59.png?dl=0 > > > > -s > > > > > > On Thu, Dec 20, 2018 at 11:24 AM Sid Anand wrote: > > > >> one sec. let me grant access to all those that need it.. stay tuned. > >> -s > >> > >> On Thu, Dec 20, 2018 at 8:41 AM Kaxil Naik wrote: > >> > >>> Sid would probably need to grant access. > >>> > >>> > >>> > >>> On Thu, Dec 20, 2018, 05:28 Tao Feng >>> > I am not an Airflow wiki admin. Could any of the admin for wiki help > this > request? > > On Wed, Dec 19, 2018 at 5:58 PM Tim Swast > wrote: > > > Wiki ID: tswast ( > https://cwiki.apache.org/confluence/display/~tswast) > > > > Per > > > > > > https://cwiki.apache.org/confluence/display/AIRFLOW/Airflow+Improvements+Proposals > > > > * • **Tim Swast* > > * • *Software Friendliness Engineer > > * • *Google Cloud Developer Relations > > * • *Seattle, WA, USA > > > > >>> >
timeout not working in SqlSensor?
Does the timeout param work the way I think it should in Airflow 1.8? My query just pokes at the poke interval indefinitely. I want it to timeout after a few hours and fail instead. The code is basically “”” task_name = SqlSensor( conn_id='redshift', sql=( """ select * from this_table where date=‘2018-12-18' """ ), task_id=’task_name', dag=dag, start_date=datetime(2016, 9, 25), poke_interval=20, time_out=45, “”" So after running the query a couple of times I would expect a failure, but that’s not what’s happening, it just keeps querying and querying every 20 seconds. Thanks, Scott
Re: Requesting Wiki edit permission to create AIPs
You should be able to see your names here: https://www.dropbox.com/s/3zn869uvrg696dc/Screenshot%202018-12-20%2011.33.38.png?dl=0 -s On Thu, Dec 20, 2018 at 11:31 AM Sid Anand wrote: > Tim : Added > Kaxil, Tao, .. and everyone .. you are all space admins and have been > since we added you. > > > https://www.dropbox.com/s/w7tbks0eciof9c5/Screenshot%202018-12-20%2011.30.59.png?dl=0 > > -s > > > On Thu, Dec 20, 2018 at 11:24 AM Sid Anand wrote: > >> one sec. let me grant access to all those that need it.. stay tuned. >> -s >> >> On Thu, Dec 20, 2018 at 8:41 AM Kaxil Naik wrote: >> >>> Sid would probably need to grant access. >>> >>> >>> >>> On Thu, Dec 20, 2018, 05:28 Tao Feng >> I am not an Airflow wiki admin. Could any of the admin for wiki help this request? On Wed, Dec 19, 2018 at 5:58 PM Tim Swast wrote: > Wiki ID: tswast (https://cwiki.apache.org/confluence/display/~tswast) > > Per > > https://cwiki.apache.org/confluence/display/AIRFLOW/Airflow+Improvements+Proposals > > * • **Tim Swast* > * • *Software Friendliness Engineer > * • *Google Cloud Developer Relations > * • *Seattle, WA, USA > >>>
Re: Requesting Wiki edit permission to create AIPs
one sec. let me grant access to all those that need it.. stay tuned. -s On Thu, Dec 20, 2018 at 8:41 AM Kaxil Naik wrote: > Sid would probably need to grant access. > > > > On Thu, Dec 20, 2018, 05:28 Tao Feng >> I am not an Airflow wiki admin. Could any of the admin for wiki help this >> request? >> >> On Wed, Dec 19, 2018 at 5:58 PM Tim Swast >> wrote: >> >> > Wiki ID: tswast (https://cwiki.apache.org/confluence/display/~tswast) >> > >> > Per >> > >> > >> https://cwiki.apache.org/confluence/display/AIRFLOW/Airflow+Improvements+Proposals >> > >> > * • **Tim Swast* >> > * • *Software Friendliness Engineer >> > * • *Google Cloud Developer Relations >> > * • *Seattle, WA, USA >> > >> >
Re: Requesting Wiki edit permission to create AIPs
Tim : Added Kaxil, Tao, .. and everyone .. you are all space admins and have been since we added you. https://www.dropbox.com/s/w7tbks0eciof9c5/Screenshot%202018-12-20%2011.30.59.png?dl=0 -s On Thu, Dec 20, 2018 at 11:24 AM Sid Anand wrote: > one sec. let me grant access to all those that need it.. stay tuned. > -s > > On Thu, Dec 20, 2018 at 8:41 AM Kaxil Naik wrote: > >> Sid would probably need to grant access. >> >> >> >> On Thu, Dec 20, 2018, 05:28 Tao Feng > >>> I am not an Airflow wiki admin. Could any of the admin for wiki help this >>> request? >>> >>> On Wed, Dec 19, 2018 at 5:58 PM Tim Swast >>> wrote: >>> >>> > Wiki ID: tswast (https://cwiki.apache.org/confluence/display/~tswast) >>> > >>> > Per >>> > >>> > >>> https://cwiki.apache.org/confluence/display/AIRFLOW/Airflow+Improvements+Proposals >>> > >>> > * • **Tim Swast* >>> > * • *Software Friendliness Engineer >>> > * • *Google Cloud Developer Relations >>> > * • *Seattle, WA, USA >>> > >>> >>
Re: Requesting Wiki edit permission to create AIPs
Sid would probably need to grant access. On Thu, Dec 20, 2018, 05:28 Tao Feng I am not an Airflow wiki admin. Could any of the admin for wiki help this > request? > > On Wed, Dec 19, 2018 at 5:58 PM Tim Swast > wrote: > > > Wiki ID: tswast (https://cwiki.apache.org/confluence/display/~tswast) > > > > Per > > > > > https://cwiki.apache.org/confluence/display/AIRFLOW/Airflow+Improvements+Proposals > > > > * • **Tim Swast* > > * • *Software Friendliness Engineer > > * • *Google Cloud Developer Relations > > * • *Seattle, WA, USA > > >
