Documentation Versioning

2017-05-17 Thread Andrew Chen
Hi Airflow devs, I had a quick question regarding the documentation located at https://airflow.incubator.apache.org/index.html. Would it be easy to enable versioning of the documentation? I saw that this is a feature included in ReadTheDocs. Do we use that service or is the documentation hosted

Re: Too many task instances

2017-05-17 Thread George Leslie-Waksman
We're sitting at over 2.4M task instances in our metadata db without much trouble. Have you seen substantial performance degradation or are you just worried about the future possibility? On Wed, Apr 19, 2017 at 12:23 PM Maxime Beauchemin < maximebeauche...@gmail.com> wrote: > You can archive the

Re: alembic.util.exc.CommandError: Can't locate revision identified by '8504051e801b'

2017-05-17 Thread Robin Bartholdson
Sounds like you might have database migrations past the 1.7.1.3 release What does your alembic_version table look like in your airflow db? > select * from alembic_version Does it say ‘8504051e801b’? If so, I guess you could, among other things: • upgrade everything to Airflow 1.8.1 :-) •

Re: Release Manager for 1.8.2?

2017-05-17 Thread Chris Riccomini
Guys, we have like 10+ committers. Can someone please step up to do this? :) On Wed, May 17, 2017 at 12:26 AM, Bolke de Bruin wrote: > PING. > > > > Begin forwarded message: > > > > From: Bolke de Bruin > > Subject: Release Manager for 1.8.2? > > Date: 14

Re: Simple Airflow BashOperators run but can't be scheduled or un-paused

2017-05-17 Thread Russell Jurney
I am running UTC, synchronized to Amazon time via NTP. At some point in the 3.x line, Python's datetime started returning a timezone set. This is breaking things. Bolke: Can you please direct me to that patch? I tried doing this myself, but it is complicated and time consuming to get it to work.

alembic.util.exc.CommandError: Can't locate revision identified by '8504051e801b'

2017-05-17 Thread Rafael Barbosa
Hi, I attempted to move our airflow installation from python2.7 to python3.6. As far as I can tell, that is the only change in the airflow system. I am running version 1.7.1.3. When starting the new system, I the following error thrown a couple times: `alembic.util.exc.CommandError: Can't locate

Fwd: Release Manager for 1.8.2?

2017-05-17 Thread Bolke de Bruin
PING. > Begin forwarded message: > > From: Bolke de Bruin > Subject: Release Manager for 1.8.2? > Date: 14 May 2017 at 13:44:39 GMT+2 > To: dev@airflow.incubator.apache.org > > Hi Folks, > > With 1.8.1 we have very much improved the reliability airflow, which is great >

Re: Simple Airflow BashOperators run but can't be scheduled or un-paused

2017-05-17 Thread Bolke de Bruin
We probably need to use .utcnow() at most places. There was a patch for that, but we/I hold it off due to operational implications that it might bring and it is kind of hard to test. B. > On 17 May 2017, at 02:20, Russell Jurney wrote: > > It seems that this entire