Alexey Serbin has uploaded this change for review. (
http://gerrit.cloudera.org:8080/17105
Change subject: KUDU-2612 add perf scenario to TxnWriteOpsITest
......................................................................
KUDU-2612 add perf scenario to TxnWriteOpsITest
This patch adds TxnWriteOpPerf scenario to TxnWriteOpsITest. The new
scenario is to evaluate --tablet_max_pending_txn_write_ops setting for
tablet servers: it runs for a short time to count number of completed
Write RPCs in context of a transactional session. The scenario focuses
on single-row write operations to pinpoint the latency of processing
txn write operations when performing registration of transaction
participants. Probablty, the current locking approach for the
TxnOpDispatcher's queue while submitting the accumulated operations
isn't optimal. Apparently, the exponential back-off timing built into
the client's RPC retry logic is also an important factor.
Below are results averaged for 100 runs of the benchmark scenario with
varying --max_pending_txn_write_ops accordingly and the following
settings fixed:
--prepare_connections_to_tservers=true
--clients=8
--txn_sessions_per_client=1
--benchmark_run_time_ms=50
I used the following script to get the accumulated results:
for i in {0..99}; do
./bin/txn_write_ops-itest --gtest_filter='*TxnWriteOpPerf' \
--max_pending_txn_write_ops=<X> 2>&1 | grep 'Txn write RPCs' | \
awk '{print $9}'; done | \
awk 'BEGIN {sum=0} {sum += $0} END {print sum}'
RELEASE build:
--max_pending_txn_write_ops=0 : 442.13 Txn write RPCs
--max_pending_txn_write_ops=2 : 494.33 Txn write RPCs
--max_pending_txn_write_ops=5 : 471.90 Txn write RPCs
--max_pending_txn_write_ops=10 : 490.22 Txn write RPCs
--max_pending_txn_write_ops=20 : 469.21 Txn write RPCs
DEBUG build:
--max_pending_txn_write_ops=0 : 83.74 Txn write RPCs
--max_pending_txn_write_ops=2 : 98.18 Txn write RPCs
--max_pending_txn_write_ops=5 : 95.23 Txn write RPCs
--max_pending_txn_write_ops=10 : 98.12 Txn write RPCs
--max_pending_txn_write_ops=20 : 94.40 Txn write RPCs
Change-Id: I0370dbb289a4e1cfc154205ae92e13da510682b4
---
M src/kudu/integration-tests/txn_write_ops-itest.cc
1 file changed, 192 insertions(+), 8 deletions(-)
git pull ssh://gerrit.cloudera.org:29418/kudu refs/changes/05/17105/1
--
To view, visit http://gerrit.cloudera.org:8080/17105
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: newchange
Gerrit-Change-Id: I0370dbb289a4e1cfc154205ae92e13da510682b4
Gerrit-Change-Number: 17105
Gerrit-PatchSet: 1
Gerrit-Owner: Alexey Serbin <[email protected]>
