MikeWallis42 commented on issue #34828: URL: https://github.com/apache/airflow/issues/34828#issuecomment-1754851547
@Bisk1 I believe that would work if we pased in Python strings but I was hoping to make use of `template_searchpath` to read in SQL files so that I didn't need to maintain it in code. The full pattern that I'm hoping to use is:- - `template_searchpath` - SQL files - dynamic task mapping - there are a variable number of items per day - Jinja templating - parameterise the SQL - Multi line SQL - so that I can set Trino session properties before running the SQL or make each mapped task idempotent by running DELETE then INSERT. The workaround would be to read the contents of each file and split it within the DAG definition which isn't recommended given it would happen on each scheduler heartbeat. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
