Re: Using large numbers of sensors, resource consumption

There have been conversations in the past around the idea of adding an `evaluation_method` argument in BaseSensor that would allow for different options: 1. the current approach which is taking up a slot and poking periodically (heavy on slot usage) 2. one approach closer to fail/retry approach, li

Re: [DISCUSS] AIP - Time for Airflow Improvement Proposals?

+1 On Sun, Jul 15, 2018, 20:12 Maxime Beauchemin wrote: > +1 > > On Tue, Jul 10, 2018 at 1:09 PM Sid Anand wrote: > > > +1 > > > > On Tue, Jul 10, 2018 at 1:02 PM George Leslie-Waksman > > wrote: > > > > > +1 > > > > > > On Tue, Jul 10, 2018 at 11:50 AM Jakob Homan > wrote: > > > > > > > Lots

Re: [DISCUSS] AIP - Time for Airflow Improvement Proposals?

+1 On Tue, Jul 10, 2018 at 1:09 PM Sid Anand wrote: > +1 > > On Tue, Jul 10, 2018 at 1:02 PM George Leslie-Waksman > wrote: > > > +1 > > > > On Tue, Jul 10, 2018 at 11:50 AM Jakob Homan wrote: > > > > > Lots of Apache projects use ?IPs - Whatever Improvement Proposal - to > > > document and ga

[VOTE] Airflow 1.10.0rc2

Hey all, I have cut Airflow 1.10.0 RC2. This email is calling a vote on the release, which will last for 72 hours. Consider this my (binding) +1. Airflow 1.10.0 RC 2 is available at: https://dist.apache.org/repos/dist/dev/incubator/airflow/1.10.0rc2/

Re: Airflow's JS code (and dependencies) manageable via npm and webpack

Glad to see this is happening! Max On Mon, Jul 9, 2018 at 6:37 AM Ash Berlin-Taylor < ash_airflowl...@firemirror.com> wrote: > Great! Thanks for doing this. I've left some review comments on your PR. > > -ash > > > On 9 Jul 2018, at 11:45, Verdan Mahmood > wrote: > > > > ​Hey Guys, ​ > > > > In

Re: [VOTE] Airflow 1.10.0rc1

Thanks Fokko, will include your PR. B. > On 15 Jul 2018, at 12:07, Driesprong, Fokko wrote: > > Hi all, > > I've did some more tests and it looks good. I was under the assumption that > the sequential executor runs within the webserver, but this was a wrong > assumption on my end. The behaviou

Re: [Proposal] Explicit re-schedule of sensors

Thanks Stefan for picking this up. The sensors are in desperate need for some redesign for the aforementioned reasons. Please note this ticket: https://issues.apache.org/jira/browse/AIRFLOW-2001 It addresses the same issue. Regarding the open question. I would be reluctant for introducing new stat

Re: [VOTE] Airflow 1.10.0rc1

Hi all, I've did some more tests and it looks good. I was under the assumption that the sequential executor runs within the webserver, but this was a wrong assumption on my end. The behaviour is still the same as in 1.9. I've did some tests on Python 2.7, 3.5 and 3.6 and it looks good. Python 3.7