Re: is it my cassandra cluster ok?
Token selection and moving nodes is described here http://wiki.apache.org/cassandra/Operations Aaron On 26 Aug 2010, at 14:29, john xie wrote: > load balancing? is it means add more nodes? > > > > 2010/8/26 Ryan King > Looks like you need to do some load balancing. > > -ryan > > On Wed, Aug 25, 2010 at 12:33 AM, john xie wrote: > > /opt/apache-cassandra-0.6.4/bin/nodetool --host 192.168.123.100 ring > > Address Status Load Range > > Ring > > > > 162027259805094200094770502377853667196 > > 192.168.123.101Up 183.43 GB > > 26404162423947656621914545677405489813 |<--| > > 192.168.123.5 Up 196.18 GB > > 97646479029625162367516203572215570207 | | > > 192.168.123.100Up 302.86 GB > > 150826772797302282411816801037163789836| | > > 192.168.123.102Up 235.83 GB > > 162027259805094200094770502377853667196|-->| > > > > > > /opt/apache-cassandra-0.6.4/bin/nodetool --host 192.168.123.5 tpstats > > Pool NameActive Pending Completed > > FILEUTILS-DELETE-POOL 0 0610 > > STREAM-STAGE 0 0 0 > > RESPONSE-STAGE0 0 18879316 > > ROW-READ-STAGE0 0 0 > > LB-OPERATIONS 0 0 0 > > MESSAGE-DESERIALIZER-POOL 0 0 86925654 > > GMFD 0 0 168769 > > LB-TARGET 0 0 0 > > CONSISTENCY-MANAGER 0 0 0 > > ROW-MUTATION-STAGE0 0 66657550 > > MESSAGE-STREAMING-POOL0 0 0 > > LOAD-BALANCER-STAGE 0 0 0 > > FLUSH-SORTER-POOL 0 0 0 > > MEMTABLE-POST-FLUSHER 0 0 1125 > > FLUSH-WRITER-POOL 0 0 1125 > > AE-SERVICE-STAGE 0 0 0 > > HINTED-HANDOFF-POOL 1 4 0 > > /opt/apache-cassandra-0.6.4/bin/nodetool --host 192.168.123.5 info > > 97646479029625162367516203572215570207 > > Load : 196.01 GB > > Generation No: 1282656715 > > Uptime (seconds) : 64437 > > Heap Memory (MB) : 2245.43 / 5111.69 > > > > /opt/apache-cassandra-0.6.4/bin/nodetool --host 192.168.123.100 tpstats > > Pool NameActive Pending Completed > > FILEUTILS-DELETE-POOL 0 0950 > > STREAM-STAGE 0 0 0 > > RESPONSE-STAGE0 0 88290400 > > ROW-READ-STAGE0 0 0 > > LB-OPERATIONS 0 0 0 > > MESSAGE-DESERIALIZER-POOL 0 0 149317269 > > GMFD 0 0 187571 > > LB-TARGET 0 0 0 > > CONSISTENCY-MANAGER 0 0 0 > > ROW-MUTATION-STAGE0 0 104055920 > > MESSAGE-STREAMING-POOL0 0 0 > > LOAD-BALANCER-STAGE 0 0 0 > > FLUSH-SORTER-POOL 0 0 0 > > MEMTABLE-POST-FLUSHER 0 0 1749 > > FLUSH-WRITER-POOL 0 0 1749 > > AE-SERVICE-STAGE 0 0 0 > > HINTED-HANDOFF-POOL 1 4 17 > > /opt/apache-cassandra-0.6.4/bin/nodetool --host 192.168.123.100 info > > 150826772797302282411816801037163789836 > > Load : 302.79 GB > > Generation No: 1282656138 > > Uptime (seconds) : 65439 > > Heap Memory (MB) : 1854.20 / 6135.69 > > /opt/apache-cassandra-0.6.4/bin/nodetool --host 192.168.123.101 tpstats > > Pool NameActive Pending Completed > > FILEUTILS-DELETE-POOL 0 0594 > > STREAM-STAGE 0 0 0 > > RESPONSE-STAGE0 0 120024993 > > ROW-READ-STAGE0 0 0 > > LB-OPERATIONS 0 0 0 > > MESSAGE-DESERIALIZER-POOL 0 0 154158111 > > GMFD 0 0 193471 > > LB-TARGET 0 0 0 > > CONSISTENCY-MANAGER 0 0 0 > > ROW-MUTATION-STAGE0 0 64174075 > > MESSAGE-STREAMING-POOL0 0 0 > > LOAD-BALANCER-STAGE 0 0 0 > > FLUSH-SORTER-POOL 0 0 0 > > MEMTABLE-POST-FLUSHER 0 0 1091 > > FLUSH-WRITER-POOL 0
Re: is it my cassandra cluster ok?
No, it means manually assign tokens to evenly distribute ring range to the existing nodes. On Wed, Aug 25, 2010 at 7:29 PM, john xie wrote: > load balancing? is it means add more nodes? > > > 2010/8/26 Ryan King >> >> Looks like you need to do some load balancing. >> >> -ryan >> >> On Wed, Aug 25, 2010 at 12:33 AM, john xie wrote: >> > /opt/apache-cassandra-0.6.4/bin/nodetool --host 192.168.123.100 ring >> > Address Status Load Range >> > Ring >> > >> > 162027259805094200094770502377853667196 >> > 192.168.123.101Up 183.43 GB >> > 26404162423947656621914545677405489813 |<--| >> > 192.168.123.5 Up 196.18 GB >> > 97646479029625162367516203572215570207 | | >> > 192.168.123.100Up 302.86 GB >> > 150826772797302282411816801037163789836| | >> > 192.168.123.102Up 235.83 GB >> > 162027259805094200094770502377853667196|-->| >> > >> > >> > /opt/apache-cassandra-0.6.4/bin/nodetool --host 192.168.123.5 tpstats >> > Pool NameActive Pending Completed >> > FILEUTILS-DELETE-POOL 0 0610 >> > STREAM-STAGE 0 0 0 >> > RESPONSE-STAGE0 0 18879316 >> > ROW-READ-STAGE0 0 0 >> > LB-OPERATIONS 0 0 0 >> > MESSAGE-DESERIALIZER-POOL 0 0 86925654 >> > GMFD 0 0 168769 >> > LB-TARGET 0 0 0 >> > CONSISTENCY-MANAGER 0 0 0 >> > ROW-MUTATION-STAGE0 0 66657550 >> > MESSAGE-STREAMING-POOL0 0 0 >> > LOAD-BALANCER-STAGE 0 0 0 >> > FLUSH-SORTER-POOL 0 0 0 >> > MEMTABLE-POST-FLUSHER 0 0 1125 >> > FLUSH-WRITER-POOL 0 0 1125 >> > AE-SERVICE-STAGE 0 0 0 >> > HINTED-HANDOFF-POOL 1 4 0 >> > /opt/apache-cassandra-0.6.4/bin/nodetool --host 192.168.123.5 info >> > 97646479029625162367516203572215570207 >> > Load : 196.01 GB >> > Generation No: 1282656715 >> > Uptime (seconds) : 64437 >> > Heap Memory (MB) : 2245.43 / 5111.69 >> > >> > /opt/apache-cassandra-0.6.4/bin/nodetool --host 192.168.123.100 tpstats >> > Pool NameActive Pending Completed >> > FILEUTILS-DELETE-POOL 0 0950 >> > STREAM-STAGE 0 0 0 >> > RESPONSE-STAGE0 0 88290400 >> > ROW-READ-STAGE0 0 0 >> > LB-OPERATIONS 0 0 0 >> > MESSAGE-DESERIALIZER-POOL 0 0 149317269 >> > GMFD 0 0 187571 >> > LB-TARGET 0 0 0 >> > CONSISTENCY-MANAGER 0 0 0 >> > ROW-MUTATION-STAGE0 0 104055920 >> > MESSAGE-STREAMING-POOL0 0 0 >> > LOAD-BALANCER-STAGE 0 0 0 >> > FLUSH-SORTER-POOL 0 0 0 >> > MEMTABLE-POST-FLUSHER 0 0 1749 >> > FLUSH-WRITER-POOL 0 0 1749 >> > AE-SERVICE-STAGE 0 0 0 >> > HINTED-HANDOFF-POOL 1 4 17 >> > /opt/apache-cassandra-0.6.4/bin/nodetool --host 192.168.123.100 info >> > 150826772797302282411816801037163789836 >> > Load : 302.79 GB >> > Generation No: 1282656138 >> > Uptime (seconds) : 65439 >> > Heap Memory (MB) : 1854.20 / 6135.69 >> > /opt/apache-cassandra-0.6.4/bin/nodetool --host 192.168.123.101 tpstats >> > Pool NameActive Pending Completed >> > FILEUTILS-DELETE-POOL 0 0594 >> > STREAM-STAGE 0 0 0 >> > RESPONSE-STAGE0 0 120024993 >> > ROW-READ-STAGE0 0 0 >> > LB-OPERATIONS 0 0 0 >> > MESSAGE-DESERIALIZER-POOL 0 0 154158111 >> > GMFD 0 0 193471 >> > LB-TARGET 0 0 0 >> > CONSISTENCY-MANAGER 0 0 0 >> > ROW-MUTATION-STAGE0 0 64174075 >> > MESSAGE-STREAMING-POOL0 0 0 >> > LOAD-BALANCER-STAGE 0 0 0 >> > FLUSH-SORTER-POOL 0 0 0 >> > MEMTABLE-POST-FLUSHER
Re: is it my cassandra cluster ok?
load balancing? is it means add more nodes? 2010/8/26 Ryan King > Looks like you need to do some load balancing. > > -ryan > > On Wed, Aug 25, 2010 at 12:33 AM, john xie wrote: > > /opt/apache-cassandra-0.6.4/bin/nodetool --host 192.168.123.100 ring > > Address Status Load Range > > Ring > > > > 162027259805094200094770502377853667196 > > 192.168.123.101Up 183.43 GB > > 26404162423947656621914545677405489813 |<--| > > 192.168.123.5 Up 196.18 GB > > 97646479029625162367516203572215570207 | | > > 192.168.123.100Up 302.86 GB > > 150826772797302282411816801037163789836| | > > 192.168.123.102Up 235.83 GB > > 162027259805094200094770502377853667196|-->| > > > > > > /opt/apache-cassandra-0.6.4/bin/nodetool --host 192.168.123.5 tpstats > > Pool NameActive Pending Completed > > FILEUTILS-DELETE-POOL 0 0610 > > STREAM-STAGE 0 0 0 > > RESPONSE-STAGE0 0 18879316 > > ROW-READ-STAGE0 0 0 > > LB-OPERATIONS 0 0 0 > > MESSAGE-DESERIALIZER-POOL 0 0 86925654 > > GMFD 0 0 168769 > > LB-TARGET 0 0 0 > > CONSISTENCY-MANAGER 0 0 0 > > ROW-MUTATION-STAGE0 0 66657550 > > MESSAGE-STREAMING-POOL0 0 0 > > LOAD-BALANCER-STAGE 0 0 0 > > FLUSH-SORTER-POOL 0 0 0 > > MEMTABLE-POST-FLUSHER 0 0 1125 > > FLUSH-WRITER-POOL 0 0 1125 > > AE-SERVICE-STAGE 0 0 0 > > HINTED-HANDOFF-POOL 1 4 0 > > /opt/apache-cassandra-0.6.4/bin/nodetool --host 192.168.123.5 info > > 97646479029625162367516203572215570207 > > Load : 196.01 GB > > Generation No: 1282656715 > > Uptime (seconds) : 64437 > > Heap Memory (MB) : 2245.43 / 5111.69 > > > > /opt/apache-cassandra-0.6.4/bin/nodetool --host 192.168.123.100 tpstats > > Pool NameActive Pending Completed > > FILEUTILS-DELETE-POOL 0 0950 > > STREAM-STAGE 0 0 0 > > RESPONSE-STAGE0 0 88290400 > > ROW-READ-STAGE0 0 0 > > LB-OPERATIONS 0 0 0 > > MESSAGE-DESERIALIZER-POOL 0 0 149317269 > > GMFD 0 0 187571 > > LB-TARGET 0 0 0 > > CONSISTENCY-MANAGER 0 0 0 > > ROW-MUTATION-STAGE0 0 104055920 > > MESSAGE-STREAMING-POOL0 0 0 > > LOAD-BALANCER-STAGE 0 0 0 > > FLUSH-SORTER-POOL 0 0 0 > > MEMTABLE-POST-FLUSHER 0 0 1749 > > FLUSH-WRITER-POOL 0 0 1749 > > AE-SERVICE-STAGE 0 0 0 > > HINTED-HANDOFF-POOL 1 4 17 > > /opt/apache-cassandra-0.6.4/bin/nodetool --host 192.168.123.100 info > > 150826772797302282411816801037163789836 > > Load : 302.79 GB > > Generation No: 1282656138 > > Uptime (seconds) : 65439 > > Heap Memory (MB) : 1854.20 / 6135.69 > > /opt/apache-cassandra-0.6.4/bin/nodetool --host 192.168.123.101 tpstats > > Pool NameActive Pending Completed > > FILEUTILS-DELETE-POOL 0 0594 > > STREAM-STAGE 0 0 0 > > RESPONSE-STAGE0 0 120024993 > > ROW-READ-STAGE0 0 0 > > LB-OPERATIONS 0 0 0 > > MESSAGE-DESERIALIZER-POOL 0 0 154158111 > > GMFD 0 0 193471 > > LB-TARGET 0 0 0 > > CONSISTENCY-MANAGER 0 0 0 > > ROW-MUTATION-STAGE0 0 64174075 > > MESSAGE-STREAMING-POOL0 0 0 > > LOAD-BALANCER-STAGE 0 0 0 > > FLUSH-SORTER-POOL 0 0 0 > > MEMTABLE-POST-FLUSHER 0 0 1091 > > FLUSH-WRITER-POOL 0 0 1091 > > AE-SERVICE-STAGE 0 0 0 > > HINTED-HANDOFF-POOL 1 3 18 > >
Re: is it my cassandra cluster ok?
Looks like you need to do some load balancing. -ryan On Wed, Aug 25, 2010 at 12:33 AM, john xie wrote: > /opt/apache-cassandra-0.6.4/bin/nodetool --host 192.168.123.100 ring > Address Status Load Range > Ring > > 162027259805094200094770502377853667196 > 192.168.123.101Up 183.43 GB > 26404162423947656621914545677405489813 |<--| > 192.168.123.5 Up 196.18 GB > 97646479029625162367516203572215570207 | | > 192.168.123.100Up 302.86 GB > 150826772797302282411816801037163789836 | | > 192.168.123.102Up 235.83 GB > 162027259805094200094770502377853667196 |-->| > > > /opt/apache-cassandra-0.6.4/bin/nodetool --host 192.168.123.5 tpstats > Pool Name Active Pending Completed > FILEUTILS-DELETE-POOL 0 0 610 > STREAM-STAGE 0 0 0 > RESPONSE-STAGE 0 0 18879316 > ROW-READ-STAGE 0 0 0 > LB-OPERATIONS 0 0 0 > MESSAGE-DESERIALIZER-POOL 0 0 86925654 > GMFD 0 0 168769 > LB-TARGET 0 0 0 > CONSISTENCY-MANAGER 0 0 0 > ROW-MUTATION-STAGE 0 0 66657550 > MESSAGE-STREAMING-POOL 0 0 0 > LOAD-BALANCER-STAGE 0 0 0 > FLUSH-SORTER-POOL 0 0 0 > MEMTABLE-POST-FLUSHER 0 0 1125 > FLUSH-WRITER-POOL 0 0 1125 > AE-SERVICE-STAGE 0 0 0 > HINTED-HANDOFF-POOL 1 4 0 > /opt/apache-cassandra-0.6.4/bin/nodetool --host 192.168.123.5 info > 97646479029625162367516203572215570207 > Load : 196.01 GB > Generation No : 1282656715 > Uptime (seconds) : 64437 > Heap Memory (MB) : 2245.43 / 5111.69 > > /opt/apache-cassandra-0.6.4/bin/nodetool --host 192.168.123.100 tpstats > Pool Name Active Pending Completed > FILEUTILS-DELETE-POOL 0 0 950 > STREAM-STAGE 0 0 0 > RESPONSE-STAGE 0 0 88290400 > ROW-READ-STAGE 0 0 0 > LB-OPERATIONS 0 0 0 > MESSAGE-DESERIALIZER-POOL 0 0 149317269 > GMFD 0 0 187571 > LB-TARGET 0 0 0 > CONSISTENCY-MANAGER 0 0 0 > ROW-MUTATION-STAGE 0 0 104055920 > MESSAGE-STREAMING-POOL 0 0 0 > LOAD-BALANCER-STAGE 0 0 0 > FLUSH-SORTER-POOL 0 0 0 > MEMTABLE-POST-FLUSHER 0 0 1749 > FLUSH-WRITER-POOL 0 0 1749 > AE-SERVICE-STAGE 0 0 0 > HINTED-HANDOFF-POOL 1 4 17 > /opt/apache-cassandra-0.6.4/bin/nodetool --host 192.168.123.100 info > 150826772797302282411816801037163789836 > Load : 302.79 GB > Generation No : 1282656138 > Uptime (seconds) : 65439 > Heap Memory (MB) : 1854.20 / 6135.69 > /opt/apache-cassandra-0.6.4/bin/nodetool --host 192.168.123.101 tpstats > Pool Name Active Pending Completed > FILEUTILS-DELETE-POOL 0 0 594 > STREAM-STAGE 0 0 0 > RESPONSE-STAGE 0 0 120024993 > ROW-READ-STAGE 0 0 0 > LB-OPERATIONS 0 0 0 > MESSAGE-DESERIALIZER-POOL 0 0 154158111 > GMFD 0 0 193471 > LB-TARGET 0 0 0 > CONSISTENCY-MANAGER 0 0 0 > ROW-MUTATION-STAGE 0 0 64174075 > MESSAGE-STREAMING-POOL 0 0 0 > LOAD-BALANCER-STAGE 0 0 0 > FLUSH-SORTER-POOL 0 0 0 > MEMTABLE-POST-FLUSHER 0 0 1091 > FLUSH-WRITER-POOL 0 0 1091 > AE-SERVICE-STAGE 0 0 0 > HINTED-HANDOFF-POOL 1 3 18 > /opt/apache-cassandra-0.6.4/bin/nodetool --host 192.168.123.101 info > 26404162423947656621914545677405489813 > Load : 183.43 GB > Generation No : 1282655724 > Uptime (seconds) : 65784 > Heap Memory (MB) : 1406.52 / 6135.69 > > > /opt/
