Peter Ring created AIRFLOW-6783: ----------------------------------- Summary: s3_to_redshift operator's usage is too limited Key: AIRFLOW-6783 URL: https://issues.apache.org/jira/browse/AIRFLOW-6783 Project: Apache Airflow Issue Type: Improvement Components: aws Affects Versions: 1.10.9 Reporter: Peter Ring
The s3_to_redshift operator has too limited usage, because the table argument is also used in the FROM part. Given: schema='public', table='table_name_in_redshift', s3_bucket="s3_bucket", s3_key="path_to_files", redshift_conn_id='redshift_connection', aws_conn_id='s3_default' This generates the following sql: COPY public.table_name_in_redshift FROM 's3://s3_bucket/path_to_files/table_name_in_redshift' with credentials 'aws_access_key_id='XXXXXXX';aws_secret_access_key='YYYYYYYYYYYY'' ; -- This message was sent by Atlassian Jira (v8.3.4#803005)