[
https://issues.apache.org/jira/browse/FLINK-25200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17478685#comment-17478685
]
Anton Kalashnikov commented on FLINK-25200:
-------------------------------------------
??Do you ensure that the test logic is reading local files and then write to
remote S3 instead of directly write to remote S3???
As I described above, the test doesn't read any file locally it just writes to
remote S3 from memory. It is the reason why it can reach 100MB/s. Of course, if
we reads the data from the disk, the upload case will be a little slower.
I also want to mention that I launched the test from AWS. It is also the reason
why it is fast. Local test from my machine is obviously much slower for the
upload case.
> Implement duplicating for s3 filesystem
> ---------------------------------------
>
> Key: FLINK-25200
> URL: https://issues.apache.org/jira/browse/FLINK-25200
> Project: Flink
> Issue Type: Sub-task
> Components: FileSystems
> Reporter: Dawid Wysakowicz
> Priority: Major
> Fix For: 1.15.0
>
>
> We can use https://docs.aws.amazon.com/AmazonS3/latest/API/API_CopyObject.html
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
