Hello Airflow community! My name is Daniel Imberman, and I have been working on behalf of Bloomberg LP to create an airflow kubernetes executor/operator. We wanted to allow for maximum throughput/scalability, while keeping a lot of the kubernetes details abstracted away from the users. Below I have a link to the WIP PR and the PDF of the initial proposal. If anyone has any comments/questions I would be glad to discuss this feature further.
Thank you, Daniel https://github.com/apache/incubator-airflow/pull/2414
