Switching minimum support version from python 3.4 -> 3.5

Hi All, We have some issues on Travis with issues around distributed and task, these are related to Python 3.4. As Python 3.4 is not very popular (https://user-images.githubusercontent.com/306380/29750903-f891cb2a-8b15-11e7-84cc-e26ce5b1e095.png) I am switching the builds to Python 3.5 as a

Re: how to have good DAG+Kubernetes behavior on airflow crash/recovery?

When you see the task being launched again on startup of the executor, does the second launched task get killed when it tries to startup or does it actually run the `execute` task instance method (and try to launch a pod on kubernetes). I ask because the latter should not happen if postgres is

Re: Switching minimum support version from python 3.4 -> 3.5

+1 as well. On Tue, Dec 19, 2017 at 10:19 AM, Dan Davydov < dan.davy...@airbnb.com.invalid> wrote: > Sounds good to me > > On Tue, Dec 19, 2017 at 10:18 AM Chris Riccomini > wrote: > > > :thumbsup: > > > > On Tue, Dec 19, 2017 at 5:19 AM, Bolke de Bruin

Re: Airflow 2.0

> It does make sense to keep SQLite on the other hand a Docker image with all the components might just be as convenient? I formed an actual opinion. :) IMO, SQLite is very convenient and should be left in. > Dropping stuff would lessen the burden of maintenance. There is a lot of cruft that is

Overriding accept_content in DEFAULT_CELERY_CONFIG

Hello all, I'm currently setting up a prototype of Airflow with the Celery executor. When a Celery worker is run as the root user, it crashes with an error about running as root with pickling enabled being insecure, etc (reference

Re: How to bes use Google Cloud Storage for logging?

Hi Feng, Thanks for your help! Got it, will try to push on the python based logging config. I'm trying to set-up the GCS logging on airflow v1-9-stable and my logging_config.py seems to be causing a python import error, caused by 'from airflow import configuration' "Initialize database...

Backwards compability - what do we mean? when? how long?

Hi, A question came up on a github issue about what exactly we meant about backwards compatibility, and I figured we as a project should work out what we mean when we say we want to maintain compat. And most importantly document it (don't worry, I'm volunteering to do bit, so long as we reach

Re: How to bes use Google Cloud Storage for logging?

Looks like it might be related to https://github.com/apache/incubator-airflow/commit/02ff8ae35dd16e6f23d29d7b24a5fb9c09d0b7a4? Why isn't this fix on the v1-9 branches? Should I be using master instead? On Tue, Dec 19, 2017 at 5:37 PM, Kevin Lam wrote: > Hi Feng, > >

Re: Switching minimum support version from python 3.4 -> 3.5

Sounds good to me On Tue, Dec 19, 2017 at 10:18 AM Chris Riccomini wrote: > :thumbsup: > > On Tue, Dec 19, 2017 at 5:19 AM, Bolke de Bruin wrote: > > > Hi All, > > > > We have some issues on Travis with issues around distributed and task, > > these are

Re: How to bes use Google Cloud Storage for logging?

You seem to mix master and 1-9-stable. The RedirectStdHandler is only available in master. B. Verstuurd vanaf mijn iPad > Op 19 dec. 2017 om 23:37 heeft Kevin Lam het volgende > geschreven: > > Hi Feng, > > Thanks for your help! Got it, will try to push on the python

Re: How to bes use Google Cloud Storage for logging?

Both will/should work, master is just cleaner and more manageable. B. Verstuurd vanaf mijn iPad > Op 19 dec. 2017 om 23:44 heeft Kevin Lam het volgende > geschreven: > > Looks like it might be related to >

Airflow behind reverse proxy

Hello everybody, I am wondering whether Airflow uses absolute links to get its static content? I am trying to put Airflow behind a nginx proxy into a subdirectory. I get the following situations: ## Case 1: forward root directory ### nginx.conf ``` location / { proxy_pass

Re: Airflow behind reverse proxy

Take a look at this PR - https://github.com/apache/incubator-airflow/pull/2723#issuecomment-350356492 On Tue, Dec 19, 2017 at 9:49 AM Andreas Koeltringer < andreas.koeltrin...@n-fuse.co> wrote: > Hello everybody, > > I am wondering whether Airflow uses absolute links to get its static > content?

airflow slack operator

Hi, I am using slack postAPIoperator in airflow. The only information I have is the webhook url, channel, username. Every time I get the airflow.exceptions.AirflowException: Slack API call failed: (invalid_auth). In the source code, I see that there is a parameter token. How can I connect using