yegeniy commented on issue #6281: Run batches of (self-terminating) EMR JobFlows [AIRFLOW-5763] URL: https://github.com/apache/airflow/pull/6281#issuecomment-550356275 Absolutely. I do think Ash’s two suggestions in the comment in that JIRA are the way to go if you want steps submitted only after the cluster is in a READY state. (Not related to the suggestion Personally I like submitting my EMR steps when I request the cluster to get the Airflow scheduler out of the way as soon as possible - slightly reduces chance of orphaning the cluster) On Tue, Nov 5, 2019 at 8:18 AM OmerJog <[email protected]> wrote: > @yegeniy <https://github.com/yegeniy> maybe some of the code here can be > modified to fix https://issues.apache.org/jira/browse/AIRFLOW-5328 > > — > You are receiving this because you were mentioned. > Reply to this email directly, view it on GitHub > <https://github.com/apache/airflow/pull/6281?email_source=notifications&email_token=AACHPQVVWKT3J2VAHPXR2SLQSFXBVA5CNFSM4I6MYH4KYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEDCY7MQ#issuecomment-549818290>, > or unsubscribe > <https://github.com/notifications/unsubscribe-auth/AACHPQRM5T6YO6QAYGSVM33QSFXBVANCNFSM4I6MYH4A> > . >
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
