[
https://issues.apache.org/jira/browse/HDDS-9911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ChenXi updated HDDS-9911:
-------------------------
Description:
Improve write performance of EC type bucket.
Improve the write performance of EC type bucket, about 5 ~ 7 times for small
files, about 2 ~ 3 times for large files.
h3. Single Threaded Client
4K Write QPS: about 70 -> 360
ozone freon ommg --operation CREATE_KEY -n 100000 -t 1 --volume=s3v
--bucket=bucket-object-ec --duration 60 --size=4k
!image-2023-12-13-15-57-06-267.png!
!image-2023-12-13-15-51-03-994.png!
h3. MultiThreaded Client
4K Write QPS: about 800 -> 5500
ozone freon ommg --operation CREATE_KEY -n 100000 -t 1 --volume=s3v
--bucket=bucket-object-ec --duration 60 --size=4k
!image-2023-12-13-15-49-13-181.png!
!image-2023-12-13-15-47-39-843.png!
h3. S3G
4K Write QPS: about 800 -> 5000
warp put --host localhost:9878 --obj.size=4KiB --duration=1m --concurrent=100
--keep-data --noclear --bucket=bucket-object-ec --access-key=ozone
--secret-key=xxxxxxx
!image-2023-12-13-15-21-22-835.png!
> EC bucket Write Performance improve
> -----------------------------------
>
> Key: HDDS-9911
> URL: https://issues.apache.org/jira/browse/HDDS-9911
> Project: Apache Ozone
> Issue Type: Improvement
> Reporter: ChenXi
> Assignee: ChenXi
> Priority: Major
> Attachments: image-2023-12-13-15-21-22-835.png,
> image-2023-12-13-15-47-39-843.png, image-2023-12-13-15-49-13-181.png,
> image-2023-12-13-15-50-08-443.png, image-2023-12-13-15-50-11-970.png,
> image-2023-12-13-15-51-03-994.png, image-2023-12-13-15-57-06-267.png
>
>
> Improve write performance of EC type bucket.
> Improve the write performance of EC type bucket, about 5 ~ 7 times for small
> files, about 2 ~ 3 times for large files.
>
> h3. Single Threaded Client
> 4K Write QPS: about 70 -> 360
> ozone freon ommg --operation CREATE_KEY -n 100000 -t 1 --volume=s3v
> --bucket=bucket-object-ec --duration 60 --size=4k
> !image-2023-12-13-15-57-06-267.png!
> !image-2023-12-13-15-51-03-994.png!
>
>
> h3. MultiThreaded Client
> 4K Write QPS: about 800 -> 5500
> ozone freon ommg --operation CREATE_KEY -n 100000 -t 1 --volume=s3v
> --bucket=bucket-object-ec --duration 60 --size=4k
> !image-2023-12-13-15-49-13-181.png!
>
> !image-2023-12-13-15-47-39-843.png!
>
> h3. S3G
> 4K Write QPS: about 800 -> 5000
> warp put --host localhost:9878 --obj.size=4KiB --duration=1m --concurrent=100
> --keep-data --noclear --bucket=bucket-object-ec --access-key=ozone
> --secret-key=xxxxxxx
> !image-2023-12-13-15-21-22-835.png!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
