[
https://issues.apache.org/jira/browse/HADOOP-18499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17620448#comment-17620448
]
Ahmar Suhail commented on HADOOP-18499:
---------------------------------------
In SDK V2, we construct the endpoint URI ourselves. this is different to V1,
where for eg: you would do something like
{code:java}
awsConf.setProxyHost(proxyHost);
awsConf.setProxyPort(proxyPort);{code}
see [S3A's proxy
config|https://github.com/apache/hadoop/blob/trunk/hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AUtils.java#L1325].
In V2, we're doing
{code:java}
proxyConfigBuilder.endpoint(buildURI(proxyHost, proxyPort)); {code}
where buildURI ([see in WIP
PR|https://github.com/ahmarsuhail/hadoop/pull/5/files#diff-6035eaa48c46c5ae252244cac3398d512bae06a23a67dae0ad6373e512e69e95R194])
should do
{code:java}
return new URIBuilder().setScheme(scheme).setHost(host).setPort(port).build();
{code}
where the scheme will be http or https depending on if secure connections have
been enabled or not. I will update the code to set the scheme. think that is
all we will need to do for V2?
> S3A to support setting proxy protocol
> -------------------------------------
>
> Key: HADOOP-18499
> URL: https://issues.apache.org/jira/browse/HADOOP-18499
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs/s3
> Reporter: Mehakmeet Singh
> Assignee: Mehakmeet Singh
> Priority: Major
>
> Currently, we cannot set the protocol for a proxy in S3A. The proxy protocol
> is set to "http" by default and thus we lack the support for HTTPS proxy in
> S3A.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
