Yeah - i have: 'email_on_failure': True 'retries': 4
So i get emails on every try: e.g. Try 1 out of 5 Really what i'm most worried about is the final failures then i have a problem, whereas if it fails 3 times and then succeeds i'm ok to be unaware of that. Maybe email routing via gmail might be a good idea - so i can send the emails with "Try 5 out of 5" to a priority folder and just let the other ones come somewhere that i can check on every now and then. Cheers, Andy On Fri, Jul 28, 2017 at 5:42 PM Maxime Beauchemin < [email protected]> wrote: > Wouldn't `email_on_failure=True` work for you? > > https://airflow.incubator.apache.org/code.html?highlight=email_on_failure#baseoperator > > On Fri, Jul 28, 2017 at 9:32 AM, Andrew Maguire <[email protected]> > wrote: > > > Hey, > > > > Just wondering if anyone knows if there might be a way to only send email > > on the last failed try of a task? > > > > Could I use a callable on failure only send the mail on the last failed > > try. > > > > We are using big query and getting lots of transient errors around limit > of > > concurrent queries that usually work on 2nd or 3rd try. > > > > Else I might just use Gmail rules to filter emails accordingly. > > > > Just wondering if anyone has done anything like this before or if there > > would be an easy enough way to do this. > > > > Cheers, > > Andy > > >
