[
https://issues.apache.org/jira/browse/HDDS-5887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17437139#comment-17437139
]
Ritesh H Shukla edited comment on HDDS-5887 at 11/2/21, 5:12 PM:
-----------------------------------------------------------------
On a secure cluster. This patch was tested to confirm the 10x performance
improvement. Concurrency level at 20.
The HEAD/Stat performance is the best test for S3G to OM communication where we
see a 10x improvement. The first set of numbers below is the PUT and HEAD
numbers before, followed by PUT and HEAD numbers after the fix.
[root@secures3-1 ~]# ~/warp stat --bucket bucket --obj.size=1KiB
--host=secures3-1:9879
--access-key=om/[email protected]
--secret-key=aa54dc20f44335bbfd3598016889e0a43eb46a060dea63ee49d9988c75d35146
--insecure --tls
warp: Benchmark data written to "warp-stat-2021-11-01[222647]-7yCJ.csv.zst"
----------------------------------------
Operation: PUT
* Average: 0.07 MiB/s, 66.69 obj/s
Throughput, split into 149 x 1s:
* Fastest: 128.9KiB/s, 128.93 obj/s
* 50% Median: 69.4KiB/s, 69.38 obj/s
* Slowest: 7.9KiB/s, 7.92 obj/s
----------------------------------------
Operation: STAT
* Average: 115.36 obj/s
Throughput, split into 298 x 1s:
* Fastest: 318.66 obj/s
* 50% Median: 124.15 obj/s
* Slowest: 9.52 obj/s
warp: Cleanup Done.[root@secures3-1 ~]# ~/warp stat --bucket bucket
--obj.size=1KiB --host=secures3-1:9879
--access-key=om/[email protected]
--secret-key=aa54dc20f44335bbfd3598016889e0a43eb46a060dea63ee49d9988c75d35146
--insecure --tls
warp: Benchmark data written to "warp-stat-2021-11-01[224905]-7dan.csv.zst"
----------------------------------------
Operation: PUT
* Average: 0.21 MiB/s, 217.51 obj/s
Throughput, split into 45 x 1s:
* Fastest: 317.3KiB/s, 317.28 obj/s
* 50% Median: 240.5KiB/s, 240.55 obj/s
* Slowest: 58.8KiB/s, 58.78 obj/s
----------------------------------------
Operation: STAT
* Average: 1379.91 obj/s
Throughput, split into 299 x 1s:
* Fastest: 1485.17 obj/s
* 50% Median: 1397.08 obj/s
* Slowest: 750.49 obj/s
was (Author: kerneltime):
On a secure cluster. This patch was tested to confirm the 10x performance
improvement. Concurrency level at 20
[root@secures3-1 ~]# ~/warp stat --bucket bucket --obj.size=1KiB
--host=secures3-1:9879
--access-key=om/[email protected]
--secret-key=aa54dc20f44335bbfd3598016889e0a43eb46a060dea63ee49d9988c75d35146
--insecure --tls
warp: Benchmark data written to "warp-stat-2021-11-01[222647]-7yCJ.csv.zst"
----------------------------------------
Operation: PUT
* Average: 0.07 MiB/s, 66.69 obj/s
Throughput, split into 149 x 1s:
* Fastest: 128.9KiB/s, 128.93 obj/s
* 50% Median: 69.4KiB/s, 69.38 obj/s
* Slowest: 7.9KiB/s, 7.92 obj/s
----------------------------------------
Operation: STAT
* Average: 115.36 obj/s
Throughput, split into 298 x 1s:
* Fastest: 318.66 obj/s
* 50% Median: 124.15 obj/s
* Slowest: 9.52 obj/s
warp: Cleanup Done.[root@secures3-1 ~]# ~/warp stat --bucket bucket
--obj.size=1KiB --host=secures3-1:9879
--access-key=om/[email protected]
--secret-key=aa54dc20f44335bbfd3598016889e0a43eb46a060dea63ee49d9988c75d35146
--insecure --tls
warp: Benchmark data written to "warp-stat-2021-11-01[224905]-7dan.csv.zst"
----------------------------------------
Operation: PUT
* Average: 0.21 MiB/s, 217.51 obj/s
Throughput, split into 45 x 1s:
* Fastest: 317.3KiB/s, 317.28 obj/s
* 50% Median: 240.5KiB/s, 240.55 obj/s
* Slowest: 58.8KiB/s, 58.78 obj/s
----------------------------------------
Operation: STAT
* Average: 1379.91 obj/s
Throughput, split into 299 x 1s:
* Fastest: 1485.17 obj/s
* 50% Median: 1397.08 obj/s
* Slowest: 750.49 obj/s
> Measure performance for the new changes.
> ----------------------------------------
>
> Key: HDDS-5887
> URL: https://issues.apache.org/jira/browse/HDDS-5887
> Project: Apache Ozone
> Issue Type: Sub-task
> Reporter: Ritesh H Shukla
> Assignee: Ritesh H Shukla
> Priority: Major
>
> The performance for this change needs to be profiled before and after the
> change.
> The expectation is that S3G should be able to serve a large number of clients
> and have significantly better performance.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
