how to pass parameters to subdag operator from triggered dag

2018-01-25 Thread Brian Greene
Good evening, Here's the setup - I'm following a "trigger dag -> called(processing) dag" kind of structure. Then I set timespans, catchups, etc on the triggering dag. This allows me to separate the scheduling from the execution, and so far is working great. The triggered dag uses parameters pas

A certain date is not available for dag_run in airflow

2018-01-25 Thread manish ranjan
I have recently come across this problem in airflow 1.8 where a day is just missing from UI. When I run the query on backend airflow DB, the dag_run table also suggests the same (See screenshot attached, 21st Jan missing). In such cases, what should be the strategy? I know I can create the task for

Installation of Airflow

2018-01-25 Thread Pullagura, Kalyan
Hi Did you guys ever figure out the following or your suggestions would be much appreciated. 1. Installing Airflow application without ‘root’ user. If using root user, not to use system libraries for all the required python modules instead redirecting to a different location. 2. Installi