[
https://issues.apache.org/jira/browse/HDDS-8574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17724449#comment-17724449
]
Duong commented on HDDS-8574:
-----------------------------
Did a test in an internal cluster with NVMe in OM.
OM Config:
* 40 cores.
* 64GB heap size.
General configs:
* Block token enabled
* Ranger enabled
* Kerberos enabled
* TLS enabled except for OM Hadoop RPC
* 100 RPC handler threads in OM
h2. Test result
h3. Peak S3 Get (small objects)
{code:java}
warp get -warp-client=<around 16 hosts ip> --host=localhost:9879 --tls
--insecure --access-key=<s3 access key> --secret-key=<s3 secret key>
--obj.size=1kb --concurrent=40 --duration=20m --bucket warp-obs-bucket {code}
||Test case||Before ||After||
|Peak OPPS|*15K*|*90.6K*|
|GetKeyInfo latency|6.4 ms|800 μs |
|Block token latency|6+ ms|15 μs|
h3. Freon file Reads
{code:java}
ozone freon ockrw -n 1000000 -t 40 -v terasort -b fso -p performanceTest
--size 10024 --percentage-read 100 {code}
||Test case||Before||Before||
|Peak OPPS|*15.8K*|*99.8K*|
|GetKeyInfo latency|6.4 ms|800 μs |
|Block token latency|6+ ms|15 μs|
h3. FsPerfTest
||Size|| ||Parcel 2 RC Candidate||Upstream
(Parcel 2 + Symmetric BLock token)||
|1MB|Read throughput|1,641,823 KBps|2,056,292 KBps|
| |Mean Time to open file|2.47 ms|0.96 ms|
|10MB|Read throughput|5,142,776 KBps|5,142,532 KBps|
| |Mean Time to open file|4.50 ms|3.19 ms|
> OM perf, overall DFSIO perf, TPCDS perf with and without improvements
> ----------------------------------------------------------------------
>
> Key: HDDS-8574
> URL: https://issues.apache.org/jira/browse/HDDS-8574
> Project: Apache Ozone
> Issue Type: Sub-task
> Components: Ozone Manager
> Reporter: Ritesh Shukla
> Assignee: Ritesh Shukla
> Priority: Major
> Labels: ozone-performance
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
