[
https://issues.apache.org/jira/browse/BEAM-4814?focusedWorklogId=124573&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-124573
]
ASF GitHub Bot logged work on BEAM-4814:
----------------------------------------
Author: ASF GitHub Bot
Created on: 18/Jul/18 19:52
Start Date: 18/Jul/18 19:52
Worklog Time Spent: 10m
Work Description: JohnRudolfLewis opened a new pull request #5983:
[BEAM-4814] Add client configuration to aws options
URL: https://github.com/apache/beam/pull/5983
I want to run a Beam job in my Spark cluster that uses the S3FileSystem. My
Spark cluster is configured to require a proxy server with authentication in
order to make outbound connections. A small change is required to enable
ClientConfiguration to be added to the configuration to enable this.
This PR adds the ability to specify the four proxy related properties of
ClientConfiguration object and passes that when creating an S3 client.
Post-Commit Tests Status (on master branch)
------------------------------------------------------------------------------------------------
Lang | SDK | Apex | Dataflow | Flink | Gearpump | Samza | Spark
--- | --- | --- | --- | --- | --- | --- | ---
Go | [](https://builds.apache.org/job/beam_PostCommit_Go_GradleBuild/lastCompletedBuild/)
| --- | --- | --- | --- | --- | ---
Java | [](https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/lastCompletedBuild/)
| [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex_Gradle/lastCompletedBuild/)
| [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/lastCompletedBuild/)
| [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink_Gradle/lastCompletedBuild/)
| [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Gearpump_Gradle/lastCompletedBuild/)
| [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Samza_Gradle/lastCompletedBuild/)
| [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark_Gradle/lastCompletedBuild/)
Python | [](https://builds.apache.org/job/beam_PostCommit_Python_Verify/lastCompletedBuild/)
| --- | [](https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/lastCompletedBuild/)
</br> [](https://builds.apache.org/job/beam_PostCommit_Py_ValCont/lastCompletedBuild/)
| --- | --- | --- | ---
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 124573)
Time Spent: 10m
Remaining Estimate: 0h
> Support for S3FileSystem to work behind a proxy server
> ------------------------------------------------------
>
> Key: BEAM-4814
> URL: https://issues.apache.org/jira/browse/BEAM-4814
> Project: Beam
> Issue Type: Improvement
> Components: io-java-aws
> Reporter: John Rudolf Lewis
> Assignee: Ismaël Mejía
> Priority: Major
> Time Spent: 10m
> Remaining Estimate: 0h
>
> I want to run a Beam job in my Spark cluster that uses the S3FileSystem. My
> Spark cluster is configured to require a proxy server with authentication in
> order to make outbound connections. A small change is required to enable
> ClientConfiguration to be added to the configuration to enable this.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
