Start date and end date

[Shubham Gupta]

Hi,

Start date and end date are present both in BaseOperator class and DAG
class. I was wondering if both are specified, which of them takes
precedence?

Also, I could not understand this comment in airflow source code in
models.py, related to start date:

>  'It is also very important
> to note that different tasks' dependencies
> need to line up in time. If task A depends on task B and their
> start_date are offset in a way that their execution_date don't line
> up, A's dependencies will never be met`

Can someone explain me what it means by an example?

Regards
Shubham Gupta

Fwd: [VOTE] Release Airflow 1.10.0 (new vote based on rc4)

[Bolke de Bruin]

Hi Folks,

If you have contacts with IPMC members that can vote binding, can you
please reach out to them and ask for help? The vote is stalled at the
moment and without 3 +1's we can't release Airflow 1.10.0

Cheers
Bolke

-- Forwarded message --
From: Bolke de Bruin 
Date: 2018-08-19 16:41 GMT+02:00
Subject: Re: [VOTE] Release Airflow 1.10.0 (new vote based on rc4)
To: gene...@incubator.apache.org


Hi,

We are 7 days into the vote and still lacking 2. Please help in reviewing
it's much appreciated!

Bolke

Sent from my iPhone

> On 15 Aug 2018, at 20:22, Bolke de Bruin  wrote:
>
> Friendly ping. We are missing 2 votes.
>
> Cheers
> Bolke
>
> Sent from my iPhone
>
>> On 14 Aug 2018, at 11:00, Justin Mclean  wrote:
>>
>> Hi,
>>
>> +1 (binding) thanks for fixing up the GPL dependancy issue.
>>
>> I checked:
>> - incubating in name
>> - signatures and hashes good
>> - DISCLAIMER exists
>> - No unexpected binary files
>> - all source files have headers
>>
>> Thanks,
>> Justin
>>
>> -
>> To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
>> For additional commands, e-mail: general-h...@incubator.apache.org
>>



-- 

--
Bolke de Bruin
bdbr...@gmail.com

Use Docker for running Airflow tests

[Driesprong, Fokko]

Hi all,

Gerardo is doing some awesome work on Dockerizing the CI pipeline. The PR
is still open here: https://github.com/apache/incubator-airflow/pull/3393

To make this work, and not store any Docker images in private repositories,
I've created a new repository which stores the Docker image which contains
a lot of the dependencies we use to test against. The repository is here:
https://github.com/apache/incubator-airflow-ci
For most of the tests, we use mocks, but sometimes we also use the actual
service, for example for some Hadoop, Kerberos, Hive functionality. The
images are build in the Dockerhub service:
https://hub.docker.com/r/airflowci/incubator-airflow-ci/builds/
I've created it for now. I'm open for another name, but Airflow was already
taken, and hyphens are not allowed.

This change will greatly decouple our dependency on Travis and will make it
much easier to test the code locally. Instead of setting up tox
environments, we can just use Docker instead. I'm really enthusiastic about
the change, and really thankful for Gerardo to put all this effort in
there.

Recently Holden Karau did a lifestream
, and did her first PR. I
think the most important learning from it was that testing was not as
trivial as it should be. Therefore I think we should see if we can merge
the PR from Gerardo soon.

Cheers, Fokko