Evan Hlavaty created AIRFLOW-6748:
-------------------------------------
Summary: Tasks fail to run when alternate AIRFLOW_HOME is defined.
Key: AIRFLOW-6748
URL: https://issues.apache.org/jira/browse/AIRFLOW-6748
Project: Apache Airflow
Issue Type: Bug
Components: configuration, DagRun
Affects Versions: 1.10.7
Environment: ubuntu 16.04
Reporter: Evan Hlavaty
When an alternate AIRFLOW_HOME is defined via env var and a DAG is triggered
either by a schedule or manually triggered the tasks fail to execute. This
occurs because the alternate AIRFLOW_HOME is ignored and a default airflow.cfg
is generated at execution time in ~/airflow. Which contains all the incorrect
settings, causing the DAG to fail.
*My setup:*
DaskExecutor
Postgres Metadata DB
S3 remote logging
*What I see in my dask worker log:*
SequentialExecutor being used
Failed to write logs to SQLITE
*Work around:*
Copying alternate $AIRFLOW_HOME/airflow.cfg to ~/airflow/airflow.cfg
This insures a default airflow.cfg is not generated in ~/airflow with incorrect
settings...
My DAG then runs successfully
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
