[
https://issues.apache.org/jira/browse/HADOOP-11171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14280510#comment-14280510
]
Steve Loughran commented on HADOOP-11171:
-----------------------------------------
well, the tests pass, but they take ~5 minutes
{code}
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 295.421 sec -
in org.apache.hadoop.fs.s3a.TestS3AConfiguration
Results :
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 4:57.925s
{code}
Cause? Connection retries:
{code}
java.lang.Thread.State: TIMED_WAITING (sleeping)
at java.lang.Thread.sleep(Native Method)
at
com.amazonaws.http.AmazonHttpClient.pauseBeforeNextRetry(AmazonHttpClient.java:864)
at
com.amazonaws.http.AmazonHttpClient.executeHelper(AmazonHttpClient.java:353)
at
com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:232)
at
com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:3528)
at
com.amazonaws.services.s3.AmazonS3Client.headBucket(AmazonS3Client.java:1031)
at
com.amazonaws.services.s3.AmazonS3Client.doesBucketExist(AmazonS3Client.java:994)
at
org.apache.hadoop.fs.s3a.S3AFileSystem.initialize(S3AFileSystem.java:282)
at
org.apache.hadoop.fs.s3a.S3ATestUtils.createTestFileSystem(S3ATestUtils.java:48)
at
org.apache.hadoop.fs.s3a.TestS3AConfiguration.TestAutomaticProxyPortSelection(TestS3AConfiguration.java:126)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at
org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74)
{code}
Is there a way to tune the failure policy of the AWS lib so it doesn't retry on
these test runs?
> Enable using a proxy server to connect to S3a.
> ----------------------------------------------
>
> Key: HADOOP-11171
> URL: https://issues.apache.org/jira/browse/HADOOP-11171
> Project: Hadoop Common
> Issue Type: Improvement
> Components: fs/s3
> Affects Versions: 2.4.0
> Reporter: Thomas Demoor
> Assignee: Thomas Demoor
> Labels: amazon, s3
> Attachments: HADOOP-11171-2.patch, HADOOP-11171-3.patch,
> HADOOP-11171-4.patch, HADOOP-11171-5.patch, HADOOP-11171-6.patch,
> HADOOP-11171-7.patch, HADOOP-11171-8.patch, HADOOP-11171-9.patch,
> HADOOP-11171.patch
>
>
> This exposes the AWS SDK config for a proxy (host and port) to s3a through
> config settings.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
