I see.  You may want to look at task mapping
<https://airflow.apache.org/docs/apache-airflow/2.3.0/concepts/dynamic-task-mapping.html>.
I.e. have one task find out which files there are to process, then map over
them, creating an instance of the task for each object.  I.e. instead of
creating a new dag run for each (though that can work too). I'm not sure
what you struggled to retrieve with trigger dag run op but... if you want
to give more details go ahead.

Reply via email to