Hi Sai, you may want to try and manage your airflow deployment via Ansible.
You can have a jinja template for your airflow.cfg, with variables specific
to the boxes that you want. The ansible script should be able to take care
of keeping all your boxes in the state you want them to be in.
Thanks!
Thats how it is supposed to work. But, as i read in stack overflow
supervisord create a subshell and it does not guarentee all env vars to be
available. We have to explicitly pass environment we might be needing in
supervisor programme config
On Thu 15 Nov, 2018, 19:07 James Meickle Just a
Just a guess, but do you need to reload supervisorctl itself before
restarting the service? If you add an env var to the supervisor config, and
then restart the supervisor-managed service, it will actually be running
with the old supervisor config file still. The supervisor daemon itself
must be
Some of env variables are not getting reflected in supervisord
environment(sometimes new variables are not available, sometimes changes to
existing variables are not reflected)
On Thu 15 Nov, 2018, 17:37 Ash Berlin-Taylor > problem with
> > this approach is these env variables wont behave
> problem with
> this approach is these env variables wont behave correctly when we
> subshells
Can you explain what you mean by this?
-ash
> On 15 Nov 2018, at 12:03, Sai Phanindhra wrote:
>
> Hi deng,
> I am currently using env variables for few airflow config variables which
> may differ
Hi deng,
I am currently using env variables for few airflow config variables which
may differ across machines(airflow folder, log folder etc..,) Problem with
this approach is these env variables wont behave correctly when we
subshells. ( I faced issues when i added airflow jobs in supervisord).
A few solutions that may address your problem:
- Specify your configurations in environment variables, so it becomes much
easier to manage across machines
- use network attached storage to save your configuration file and mount it
to all your machines (this can address DAG file sync as well)
-
