[ thanks Aizhamal for bumping up this thread ]
Yes, since I posted originally, I was pointed at @jaketf's PR -
https://github.com/apache/airflow/pull/6210 - and I have been active in
the discussions there (I'm @JonnyIncognito) along with others. @Fokko is
also helping wrt figuring out how to
Hello,
I wonder how much this PR is the solution to your problems.
https://github.com/apache/airflow/pull/6210
This PR improves the use of resources when the operation is performed remotely.
Best regards,
On Thu, Oct 31, 2019 at 2:05 AM Aizhamal Nurmamat kyzy
wrote:
>
> Is anyone able to give
Is anyone able to give useful pointers to Jon?
+Ash Berlin-Taylor +kaxiln...@gmail.com
+Driesprong, Fokko , +Jarek
Potiuk tagging you just because I know you all
and feel safe about not being judged :D
On Tue, Oct 15, 2019 at 1:41 PM Jonathan Miles wrote:
> Hi all,
>
> Posting this to dev
Hi all,
Posting this to dev instead of users because it crosses into framework
territory.
I've been using Airflow for six months or so and I'm starting to think
about how to better manage Airflow tasks that are proxies for compute
tasks running elsewhere, e.g. steps on Amazon EMR clusters.
