You can use the executor_config to run airflow on multiple namespaces in a
single Kubernetes clusters. The only caveat is there is a bug that will be
solved in 1.10.8 where the airflow scheduler can not delete worker pods
created in other namespaces. Other than that it should work just fine :).
On 2020/01/13 16:10:26, Jarek Potiuk <[email protected]> wrote:
> Not now as far as I know. But It would be a nice feature to contribute!>
>
> J.>
>
> On Mon, Jan 13, 2020 at 2:06 PM Lior Harel <[email protected]> wrote:>
>
> > We run Kubernetes with multiple namespaces. We use them to>
> > segregate clients' data, each namespace has the resources for a
single>
> > client.>
> > However, we want to run a single airflow cluster containing DAGs per>
> > client. Is there a way to execute each DAG's tasks on a different
namespace>
> > based on some parameter? I see the kubernetes executor has only one>
> > namespace parameter.>
> >>
> > Thanks,>
> >>
>
>
> -- >
>
> Jarek Potiuk>
> Polidea <https://www.polidea.com/> | Principal Software Engineer>
>
> M: +48 660 796 129 <+48660796129>>
> [image: Polidea] <https://www.polidea.com/>>
>
via Newton Mail
[https://cloudmagic.com/k/d/mailapp?ct=dx&cv=10.0.32&pv=10.14.5&source=email_footer_2]
