melugoyal opened a new pull request, #31659:
URL: https://github.com/apache/airflow/pull/31659
allow anonymous AWS access. this allows the consumer of any AWS operator to
use the equivalent of `aws s3 cp <s3 path> . --no-sign-request`, to eg write a
DAG that reads from a public S3 bucket. to leverage this, an AWS connection can
be created as such:
```
conn = Connection(
conn_id="aws_demo",
conn_type="aws",
extra={
"config_kwargs": {
"signature_version": "unsigned",
},
},
)
```
this is necessary because botocore's `UNSIGNED` is not JSON-serializable, so
using `botocore.UNSIGNED` when instantiating the connection will cause the
connection processing to fail. instead we can use a string in the connection
instantiation and convert it to botocore's expected value later. more history
about this issue here: https://github.com/boto/botocore/issues/2442
---
**^ Add meaningful description above**
Read the **[Pull Request
Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request-guidelines)**
for more information.
In case of fundamental code changes, an Airflow Improvement Proposal
([AIP](https://cwiki.apache.org/confluence/display/AIRFLOW/Airflow+Improvement+Proposals))
is needed.
In case of a new dependency, check compliance with the [ASF 3rd Party
License Policy](https://www.apache.org/legal/resolved.html#category-x).
In case of backwards incompatible changes please leave a note in a
newsfragment file, named `{pr_number}.significant.rst` or
`{issue_number}.significant.rst`, in
[newsfragments](https://github.com/apache/airflow/tree/main/newsfragments).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
