I am new to AirFlow, and need help with setting up how to configure the
ETLs running Redshift queries .

The approaches i am know of,

*1. Use postgress operator/hook: *
Parse the query from file, and run via hook. Use xCom to pass/set the
variables across tasks

*2. Bash Operator:*
Use this to invoke the PSQL CLI, since redshift doesnt have concept of
variables, the queries need to be dynamically generated string passed.

Both seem to be bit hard to adopt, and any other approach or options ?

Thanks
Veera
  • Setting up ETLs runnin... Veeranagouda Mukkanagoudar

Reply via email to