Hey Alex,

I have noticed the same, and it is also the reason why we have Alpha versions. 
For now I have noticed the following:

* Tasks can get in limbo between scheduler and executor: 
https://github.com/apache/incubator-airflow/pull/1948 
<https://github.com/apache/incubator-airflow/pull/1948>
* Try_number not increased due to reset in LocalTaskJob: 
https://github.com/apache/incubator-airflow/pull/1969 
<https://github.com/apache/incubator-airflow/pull/1969>
* one_failed trigger not executed

My idea is to move to a Samba style of releases eventually, but for now I would 
like to get master into a state that we understand and therefore not accept any 
patches that do not address any bugs.

If you (or anyone else) can review the above PRs and add your own as well then 
I can create another Alpha version. I’ll be on gitter as much as I can so we 
can speed up if needed.

- Bolke

> On 3 Jan 2017, at 08:51, Alex Van Boxel <[email protected]> wrote:
> 
> Hey Bolke,
> 
> thanks for getting this moving. But I already have some blockers, since I
> moved up master to this release (moved from end November to now) stability
> has gone down (certainly on Celary). I'm trying to identify the core
> problems and see if I can fix them.
> 
> On Sat, Dec 31, 2016 at 9:52 PM Bolke de Bruin <[email protected] 
> <mailto:[email protected]>> wrote:
> 
> Dear All,
> 
> On the verge of the New Year, I decided to be a little bit cheeky and to
> make available an Airflow 1.8.0 Alpha 1. We have been talking about it for
> a long time now and by doing this I wanted bootstrap the process. It should
> by no means be considered an Apache release yet. This is for testing
> purposes in the dev community around Airflow, nothing else.
> 
> The build is exactly the same as the state of master (git 410736d) plus the
> change to version “1.8.0.alpha1” in version.py.
> 
> I am dedicating quite some time next week and beyond to get a release out.
> Hopefully we can get some help with testing, changelog etc. To make this
> possible I would like to propose a freeze to adding new features for at
> least two weeks - say until Jan 15.
> 
> You can find the tar here: http://people.apache.org/~bolke/ <
> http://people.apache.org/~bolke/ <http://people.apache.org/~bolke/>> . It 
> isn’t signed. Following versions
> will be. SHA is available.
> 
> Lastly, Alpha 1 does not have the fix for retries yet. So we will get an
> Alpha 2 :-). @Max / @Dan / @Paul: a potential fix is in
> https://github.com/apache/incubator-airflow/pull/1948 
> <https://github.com/apache/incubator-airflow/pull/1948> <
> https://github.com/apache/incubator-airflow/pull/1948 
> <https://github.com/apache/incubator-airflow/pull/1948>> , but your feedback
> is required as it is entrenched in new processing code that you are running
> in production afaik - so I wonder what happens in your fork.
> 
> Happy New Year!
> 
> Bolke
> 
> 
> 
> -- 
>  _/
> _/ Alex Van Boxel

Reply via email to