Martin Grayson created AIRFLOW-569:
--------------------------------------

             Summary: Support for non contiguous schedules
                 Key: AIRFLOW-569
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-569
             Project: Apache Airflow
          Issue Type: Bug
          Components: scheduler
    Affects Versions: Airflow 1.7.1.2
            Reporter: Martin Grayson


I've recently created a dag that I want to run hourly, with the exception of a 
maintenance window during the night.

To handle this, I use the cron syntax to specify the hours I wish to run.
{code}schedule_interval='0 6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22 * * 
*'{code}
i.e. Don't run 23:00-05:00

This works well and actually executes as desired. The only issue is with 
backfilling. 

When I initially deploy my dag, the scheduler creates the expected series of 
dag runs each hour since the start date, excluding the hours not in my 
schedule. However, when it comes to create the 06:00 execution, it simply fails 
the dag (and all subsequent) - I'm not sure why as I cant see any failure in 
the logs. The dag simply gets marked as failed.

Is this a bug or something to be expected?

Thanks,
Martin




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to