Hinted Handoff CF contention
----------------------------
Key: CASSANDRA-658
URL: https://issues.apache.org/jira/browse/CASSANDRA-658
Project: Cassandra
Issue Type: Bug
Components: Core
Affects Versions: 0.5
Environment: debian lenny amd64 OpenJDK 64-Bit Server VM (build
1.6.0_0-b11, mixed mode)
Reporter: Brandon Williams
Fix For: 0.9
Hinted handoff causes a lot of contention on the HH CF, causing insert speed to
massively drop. Most of the row mutation stage threads end up blocking on each
other at Memtable.resolve. This is because HH sends the hint to the closest
node, which will always be the node handling the write.
To reproduce: start a cluster with even InitialTokens, and begin a constant
stream of writes to one node, with an even key distribution. (I used 4 nodes
and stress.py in random mode.) Take a node down, and the insert rate begin to
drop, eventually settling between 100-300/s and sustaining there. Bringing the
down node back up will restore the original insert rate.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
