Bjorn Olsen created AIRFLOW-6072:
------------------------------------
Summary: aws_hook: Ability to set outbound proxy
Key: AIRFLOW-6072
URL: https://issues.apache.org/jira/browse/AIRFLOW-6072
Project: Apache Airflow
Issue Type: Improvement
Components: aws
Affects Versions: 1.10.6
Reporter: Bjorn Olsen
Assignee: Bjorn Olsen
The boto3 connection used by aws_hook does not respect outbound http_proxy
settings (even if these are set in system wide).
The way to configure a proxy is to pass a botocore.config.Config object to
boto3 when creating a client (according to this SO post).
[https://stackoverflow.com/questions/33480108/how-do-you-use-an-http-https-proxy-with-boto3]
While the aws_hook get_client_type() method is used extensively by AWS
Operators, the "config" argument is not used by any operator.
Adding a check to aws_hook for "config" in the "extra_config" of the Airflow
Connection, could allow us to pass kwargs there that build the Config object
automatically by the hook is created.
Otherwise we have to update every AWS Operator to also take a "config"
parameter.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
