Idea to check: If you're running airflow as a configured service (systemd or what), then it's possible the /etc/environment is not picked up, because it's not an interactive session.
You'd need to explicitly set the env vars you'd like to load in like this: [Service] EnvironmentFile=-/etc/environment You can try running airflow from an interactive console first to see if that fixes it, then run it as a service. Without the minus, the systemd service fails to start if the file is missing, which may be what you prefer. On Thu, Nov 9, 2017 at 9:35 AM, Somasundaram Sekar < [email protected]> wrote: > Below are the env variables configured > > AIRFLOW__CORE__SQL_ALCHEMY_CONN=mysql://XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX > AIRFLOW__CELERY__BROKER_URL=redis://XXXXXXXXXXXXXXXXXXXX/1 > AIRFLOW__CELERY__CELERY_RESULT_BACKEND=db+mysql:// > XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXx > AIRFLOW__WEBSERVER__AUTHENTICATE=True > AIRFLOW__WEBSERVER__AUTH_BACKEND=airflow.contrib.auth.backends.google_auth > AIRFLOW__GOOGLE__CLIENT_ID=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXx > AIRFLOW__GOOGLE__CLIENT_SECRET=XXXXXXXXXXXXXXXXXXxx > AIRFLOW__GOOGLE__OAUTH_CALLBACK_ROUTE=/ > AIRFLOW__GOOGLE__DOMAIN=XXXXXXXXXXXXXXXXX > > -----Original Message----- > From: Gerard Toonstra [mailto:[email protected]] > Sent: Thursday, November 9, 2017 1:59 PM > To: [email protected] > Subject: Re: Airflow configuration in environment variable not working > > What's the variable key you are using. Does it follow this convention? > > https://airflow.apache.org/configuration.html > > That's AIRFLOW (two underscores) configuration section (two underscores) > env var. > > > G> > > > On Thu, Nov 9, 2017 at 8:30 AM, Somasundaram Sekar < > [email protected]> wrote: > > > I tried using ENV variable to configure connection urls, I have an ami > > that is preconfigured with alchemy_conn and broker_url etc, I have > > written environment variables to /etc/environment in the instances > > being spun up from the amis to override the properties in airflow.cfg > > file. I was able to access the variables from python code as well. > > > > But it doesn't seem to take effect while running ariflow, tried > > restarting the process as well but didn't work, it still points to the > > one in airflow.cfg file > > > > Any help appreciated. > > > > Regards, > > > > Somasundaram S > > >
