ChenSammi commented on PR #6768: URL: https://github.com/apache/ozone/pull/6768#issuecomment-2146760786
Freon performance data using a local docker based 3 DN cluster. ozone freon -Dhdds.ratis.client.request.watch.type=ALL_COMMITTED rk --num-of-volumes=1 --num-of-buckets=10 --num-of-keys=5000 --replication=THREE --replication-type=RATIS // without data validation ``` ALL_COMMITTED THREE *************************************************** Status: Success Git Base Revision: Unknown Number of Volumes created: 1 Number of Buckets created: 10 Number of Keys added: 50000 Replication: RATIS/THREE Average Time spent in volume creation: 00:00:00,015 Average Time spent in bucket creation: 00:00:00,042 Average Time spent in key creation: 00:01:00,962 Average Time spent in key write: 00:00:06,289 Total bytes written: 512000000 Total Execution time: 00:04:38,732 *************************************************** MAJORITY_COMMITTED THREE *************************************************** Status: Success Git Base Revision: Unknown Number of Volumes created: 1 Number of Buckets created: 10 Number of Keys added: 50000 Replication: RATIS/THREE Average Time spent in volume creation: 00:00:00,017 Average Time spent in bucket creation: 00:00:00,049 Average Time spent in key creation: 00:00:42,525 Average Time spent in key write: 00:00:05,888 Total bytes written: 512000000 Total Execution time: 00:03:03,724 *************************************************** ``` ozone freon -Dhdds.ratis.client.request.watch.type=ALL_COMMITTED rk --num-of-volumes=1 --num-of-buckets=10 --num-of-keys=5000 --replication=THREE --replication-type=RATIS --validate-writes // with data validation ``` MAJORITY_COMMITTED THREE validation *************************************************** Status: Success Git Base Revision: Unknown Number of Volumes created: 1 Number of Buckets created: 10 Number of Keys added: 50000 Replication: RATIS/THREE Average Time spent in volume creation: 00:00:00,015 Average Time spent in bucket creation: 00:00:00,037 Average Time spent in key creation: 00:00:49,065 Average Time spent in key write: 00:00:10,035 Total bytes written: 512000000 Total number of writes validated: 50000 Writes validated: 100.0 % Successful validation: 50000 Unsuccessful validation: 0 Total Execution time: 00:05:45,658 *************************************************** ALL_COMMITTED THREE validation *************************************************** Status: Success Git Base Revision: Unknown Number of Volumes created: 1 Number of Buckets created: 10 Number of Keys added: 50000 Replication: RATIS/THREE Average Time spent in volume creation: 00:00:00,012 Average Time spent in bucket creation: 00:00:00,039 Average Time spent in key creation: 00:00:53,308 Average Time spent in key write: 00:00:08,985 Total bytes written: 512000000 Total number of writes validated: 50000 Writes validated: 100.0 % Successful validation: 50000 Unsuccessful validation: 0 Total Execution time: 00:07:00,783 *************************************************** ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
