FrankChen021 commented on pull request #9898:
URL: https://github.com/apache/druid/pull/9898#issuecomment-650663610
Hi @jihoonson , using s3 extension with OSS, the exception is as below
I think OSS was compatible at the time the doc was created, but as the s3
SDK evolves, OSS doesn't keep the pace with it.
````
2020-06-28T00:14:03,975 ERROR [task-runner-0-priority-0]
org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner -
Encountered exception while running task.
java.util.concurrent.ExecutionException: java.lang.RuntimeException:
java.io.IOException: com.amazonaws.services.s3.model.AmazonS3Exception: A
header you provided implies functionality that is not implemented. (Service:
Amazon S3; Status Code: 400; Error Code: NotImplemented; Request ID:
5EF7E0CBAF285D3538BCFD5C; S3 Extended Request ID:
frankchen021-public.oss-cn-hangzhou-internal.aliyuncs.com), S3 Extended Request
ID: frankchen021.oss-cn-hangzhou-internal.aliyuncs.com
at
com.google.common.util.concurrent.AbstractFuture$Sync.getValue(AbstractFuture.java:299)
~[guava-16.0.1.jar:?]
at
com.google.common.util.concurrent.AbstractFuture$Sync.get(AbstractFuture.java:286)
~[guava-16.0.1.jar:?]
at
com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:116)
~[guava-16.0.1.jar:?]
at
org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner.runInternal(SeekableStreamIndexTaskRunner.java:825)
~[druid-indexing-service-0.18.1.jar:0.18.1]
at
org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner.run(SeekableStreamIndexTaskRunner.java:277)
[druid-indexing-service-0.18.1.jar:0.18.1]
at
org.apache.druid.indexing.seekablestream.SeekableStreamIndexTask.run(SeekableStreamIndexTask.java:164)
[druid-indexing-service-0.18.1.jar:0.18.1]
at
org.apache.druid.indexing.overlord.SingleTaskBackgroundRunner$SingleTaskBackgroundRunnerCallable.call(SingleTaskBackgroundRunner.java:421)
[druid-indexing-service-0.18.1.jar:0.18.1]
at
org.apache.druid.indexing.overlord.SingleTaskBackgroundRunner$SingleTaskBackgroundRunnerCallable.call(SingleTaskBackgroundRunner.java:393)
[druid-indexing-service-0.18.1.jar:0.18.1]
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[?:1.8.0_252]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[?:1.8.0_252]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[?:1.8.0_252]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_252]
Caused by: java.lang.RuntimeException: java.io.IOException:
com.amazonaws.services.s3.model.AmazonS3Exception: A header you provided
implies functionality that is not implemented. (Service: Amazon S3; Status
Code: 400; Error Code: NotImplemented; Request ID: 5EF7E0CBAF285D3538BCFD5C; S3
Extended Request ID: frankchen021.oss-cn-hangzhou-internal.aliyuncs.com), S3
Extended Request ID: frankchen021-public.oss-cn-hangzhou-internal.aliyuncs.com
at
org.apache.druid.segment.realtime.appenderator.AppenderatorImpl.mergeAndPush(AppenderatorImpl.java:822)
~[druid-server-0.18.1.jar:0.18.1]
at
org.apache.druid.segment.realtime.appenderator.AppenderatorImpl.lambda$push$1(AppenderatorImpl.java:657)
~[druid-server-0.18.1.jar:0.18.1]
at com.google.common.util.concurrent.Futures$1.apply(Futures.java:713)
~[guava-16.0.1.jar:?]
at
com.google.common.util.concurrent.Futures$ChainingListenableFuture.run(Futures.java:861)
~[guava-16.0.1.jar:?]
... 3 more
Caused by: java.io.IOException:
com.amazonaws.services.s3.model.AmazonS3Exception: A header you provided
implies functionality that is not implemented. (Service: Amazon S3; Status
Code: 400; Error Code: NotImplemented; Request ID: 5EF7E0CBAF285D3538BCFD5C; S3
Extended Request ID:
frankchen021-public.oss-cn-hangzhou-internal.aliyuncs.com), S3 Extended Request
ID: frankchen021-public.oss-cn-hangzhou-internal.aliyuncs.com
at
org.apache.druid.storage.s3.S3DataSegmentPusher.push(S3DataSegmentPusher.java:103)
~[?:?]
at
org.apache.druid.segment.realtime.appenderator.AppenderatorImpl.lambda$mergeAndPush$4(AppenderatorImpl.java:791)
~[druid-server-0.18.1.jar:0.18.1]
at
org.apache.druid.java.util.common.RetryUtils.retry(RetryUtils.java:87)
~[druid-core-0.18.1.jar:0.18.1]
at
org.apache.druid.java.util.common.RetryUtils.retry(RetryUtils.java:115)
~[druid-core-0.18.1.jar:0.18.1]
at
org.apache.druid.java.util.common.RetryUtils.retry(RetryUtils.java:105)
~[druid-core-0.18.1.jar:0.18.1]
at
org.apache.druid.segment.realtime.appenderator.AppenderatorImpl.mergeAndPush(AppenderatorImpl.java:787)
~[druid-server-0.18.1.jar:0.18.1]
at
org.apache.druid.segment.realtime.appenderator.AppenderatorImpl.lambda$push$1(AppenderatorImpl.java:657)
~[druid-server-0.18.1.jar:0.18.1]
at com.google.common.util.concurrent.Futures$1.apply(Futures.java:713)
~[guava-16.0.1.jar:?]
at
com.google.common.util.concurrent.Futures$ChainingListenableFuture.run(Futures.java:861)
~[guava-16.0.1.jar:?]
... 3 more
Caused by: com.amazonaws.services.s3.model.AmazonS3Exception: A header you
provided implies functionality that is not implemented. (Service: Amazon S3;
Status Code: 400; Error Code: NotImplemented; Request ID:
5EF7E0CBAF285D3538BCFD5C; S3 Extended Request ID:
frankchen021-public.oss-cn-hangzhou-internal.aliyuncs.com)
at
com.amazonaws.http.AmazonHttpClient$RequestExecutor.handleErrorResponse(AmazonHttpClient.java:1638)
~[aws-java-sdk-core-1.11.199.jar:?]
at
com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeOneRequest(AmazonHttpClient.java:1303)
~[aws-java-sdk-core-1.11.199.jar:?]
at
com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeHelper(AmazonHttpClient.java:1055)
~[aws-java-sdk-core-1.11.199.jar:?]
at
com.amazonaws.http.AmazonHttpClient$RequestExecutor.doExecute(AmazonHttpClient.java:743)
~[aws-java-sdk-core-1.11.199.jar:?]
at
com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeWithTimer(AmazonHttpClient.java:717)
~[aws-java-sdk-core-1.11.199.jar:?]
at
com.amazonaws.http.AmazonHttpClient$RequestExecutor.execute(AmazonHttpClient.java:699)
~[aws-java-sdk-core-1.11.199.jar:?]
at
com.amazonaws.http.AmazonHttpClient$RequestExecutor.access$500(AmazonHttpClient.java:667)
~[aws-java-sdk-core-1.11.199.jar:?]
at
com.amazonaws.http.AmazonHttpClient$RequestExecutionBuilderImpl.execute(AmazonHttpClient.java:649)
~[aws-java-sdk-core-1.11.199.jar:?]
at
com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:513)
~[aws-java-sdk-core-1.11.199.jar:?]
at
com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:4229)
~[aws-java-sdk-s3-1.11.199.jar:?]
at
com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:4176)
~[aws-java-sdk-s3-1.11.199.jar:?]
at
com.amazonaws.services.s3.AmazonS3Client.putObject(AmazonS3Client.java:1720)
~[aws-java-sdk-s3-1.11.199.jar:?]
at
org.apache.druid.storage.s3.ServerSideEncryptingAmazonS3.putObject(ServerSideEncryptingAmazonS3.java:119)
~[?:?]
at
org.apache.druid.storage.s3.S3Utils.uploadFileIfPossible(S3Utils.java:286)
~[?:?]
at
org.apache.druid.storage.s3.S3DataSegmentPusher.lambda$push$0(S3DataSegmentPusher.java:96)
~[?:?]
at
org.apache.druid.java.util.common.RetryUtils.retry(RetryUtils.java:87)
~[druid-core-0.18.1.jar:0.18.1]
at
org.apache.druid.java.util.common.RetryUtils.retry(RetryUtils.java:115)
~[druid-core-0.18.1.jar:0.18.1]
at
org.apache.druid.java.util.common.RetryUtils.retry(RetryUtils.java:105)
~[druid-core-0.18.1.jar:0.18.1]
at
org.apache.druid.storage.s3.S3Utils.retryS3Operation(S3Utils.java:91) ~[?:?]
at
org.apache.druid.storage.s3.S3DataSegmentPusher.push(S3DataSegmentPusher.java:94)
~[?:?]
at
org.apache.druid.segment.realtime.appenderator.AppenderatorImpl.lambda$mergeAndPush$4(AppenderatorImpl.java:791)
~[druid-server-0.18.1.jar:0.18.1]
at
org.apache.druid.java.util.common.RetryUtils.retry(RetryUtils.java:87)
~[druid-core-0.18.1.jar:0.18.1]
at
org.apache.druid.java.util.common.RetryUtils.retry(RetryUtils.java:115)
~[druid-core-0.18.1.jar:0.18.1]
at
org.apache.druid.java.util.common.RetryUtils.retry(RetryUtils.java:105)
~[druid-core-0.18.1.jar:0.18.1]
at
org.apache.druid.segment.realtime.appenderator.AppenderatorImpl.mergeAndPush(AppenderatorImpl.java:787)
~[druid-server-0.18.1.jar:0.18.1]
at
org.apache.druid.segment.realtime.appenderator.AppenderatorImpl.lambda$push$1(AppenderatorImpl.java:657)
~[druid-server-0.18.1.jar:0.18.1]
at com.google.common.util.concurrent.Futures$1.apply(Futures.java:713)
~[guava-16.0.1.jar:?]
at
com.google.common.util.concurrent.Futures$ChainingListenableFuture.run(Futures.java:861)
~[guava-16.0.1.jar:?]
````
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
