Peter Ring created AIRFLOW-6783:
-----------------------------------
Summary: s3_to_redshift operator's usage is too limited
Key: AIRFLOW-6783
URL: https://issues.apache.org/jira/browse/AIRFLOW-6783
Project: Apache Airflow
Issue Type: Improvement
Components: aws
Affects Versions: 1.10.9
Reporter: Peter Ring
The s3_to_redshift operator has too limited usage, because the table argument
is also used in the FROM part.
Given:
schema='public',
table='table_name_in_redshift',
s3_bucket="s3_bucket",
s3_key="path_to_files",
redshift_conn_id='redshift_connection',
aws_conn_id='s3_default'
This generates the following sql:
COPY public.table_name_in_redshift
FROM 's3://s3_bucket/path_to_files/table_name_in_redshift'
with credentials
'aws_access_key_id='XXXXXXX';aws_secret_access_key='YYYYYYYYYYYY''
;
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
