[
https://issues.apache.org/jira/browse/CASSANDRA-14917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16711373#comment-16711373
]
Igor Zubchenok commented on CASSANDRA-14917:
--------------------------------------------
I bootstrap a new node to this cluster and there is the real 'screenshots' of
the process with number of already sent files that isn't always increasing:
5>6>5>5>6
7>7>6>6>6
6>7>6>6>6
12>12>12>12>12 - ok
13>14>13>13>13
and number of files doesn't grow until bootstrap is finished.
{code:java}
----------------------------------------------------------------------------------------------------------
Every 2.0s: nodetool netstats | grep -v 100% a13: Thu Dec 6 12:17:51 2018
Mode: JOINING
Bootstrap 0d6aaca0-f943-11e8-b165-13c227abbdd3
/X.X.X.X
Receiving 2144 files, 678588356474 bytes total. Already received 5 files,
593625256 bytes total
app_tracks/metered_tracks 267601306/340975156 bytes(78%) received from
idx:0/X.X.X.X
/X.X.X.X
Receiving 2791 files, 894961971209 bytes total. Already received 7 files,
977844994 bytes total
/X.X.X.X
Receiving 2448 files, 670153883888 bytes total. Already received 6 files,
288703706 bytes total
app_tracks/metered_tracks 195338482/248380217 bytes(78%) received from
idx:0/X.X.X.X
/X.X.X.X
Receiving 1771 files, 169619035230 bytes total. Already received 12 files,
4199353175 bytes total
app_tracks/tracks 3611426622/4476905035 bytes(80%) received from idx:0/X.X.X.X
/X.X.X.X
Receiving 1606 files, 140966853868 bytes total. Already received 13 files,
186857054 bytes total
app_tracks/tracks 6551929/346313177 bytes(1%) received from idx:0/X.X.X.X
Read Repair Statistics:
Attempted: 0
Mismatch (Blocking): 0
Mismatch (Background): 0
Pool Name Active Pending Completed Dropped
Large messages n/a 1 0 1
Small messages n/a 3 37259963 1
Gossip messages n/a 8 19574 453
----------------------------------------------------------------------------------------------------------
Every 2.0s: nodetool netstats | grep -v 100% a13: Thu Dec 6 12:18:11 2018
Mode: JOINING
Bootstrap 0d6aaca0-f943-11e8-b165-13c227abbdd3
/X.X.X.X
Receiving 2144 files, 678588356474 bytes total. Already received 6 files,
492152491 bytes total
/X.X.X.X
Receiving 2791 files, 894961971209 bytes total. Already received 7 files,
1195998824 bytes total
/X.X.X.X
Receiving 2448 files, 670153883888 bytes total. Already received 7 files,
303546968 bytes total
/X.X.X.X
Receiving 1771 files, 169619035230 bytes total. Already received 12 files,
4555465168 bytes total
app_tracks/tracks 3967538615/4476905035 bytes(88%) received from idx:0/X.X.X.X
/X.X.X.X
Receiving 1606 files, 140966853868 bytes total. Already received 14 files,
526618302 bytes total
Read Repair Statistics:
Attempted: 0
Mismatch (Blocking): 0
Mismatch (Background): 0
Pool Name Active Pending Completed Dropped
Large messages n/a 1 0 1
Small messages n/a 1 37385384 1
Gossip messages n/a 6 19640 455
----------------------------------------------------------------------------------------------------------
Every 2.0s: nodetool netstats | grep -v 100% a13: Thu Dec 6 12:18:39 2018
Mode: JOINING
Bootstrap 0d6aaca0-f943-11e8-b165-13c227abbdd3
/X.X.X.X
Receiving 2144 files, 678588356474 bytes total. Already received 5 files,
679191606 bytes total
app_tracks/metered_tracks 353167656/392570476 bytes(89%) received from
idx:0/X.X.X.X
/X.X.X.X
Receiving 2791 files, 894961971209 bytes total. Already received 6 files,
961464028 bytes total
app_tracks/metered_tracks 62614009/456870721 bytes(13%) received from
idx:0/X.X.X.X
/X.X.X.X
Receiving 2448 files, 670153883888 bytes total. Already received 6 files,
278650726 bytes total
app_tracks/metered_tracks 186554977/275613755 bytes(67%) received from
idx:0/X.X.X.X
/X.X.X.X
Receiving 1771 files, 169619035230 bytes total. Already received 12 files,
5043265900 bytes total
app_tracks/tracks 4455339347/4476905035 bytes(99%) received from idx:0/X.X.X.X
/X.X.X.X
Receiving 1606 files, 140966853868 bytes total. Already received 13 files,
315366847 bytes total
app_tracks/tracks 135061722/222430762 bytes(60%) received from idx:0/X.X.X.X
Read Repair Statistics:
Attempted: 0
Mismatch (Blocking): 0
Mismatch (Background): 0
Pool Name Active Pending Completed Dropped
Large messages n/a 1 0 1
Small messages n/a 2 37556944 1
Gossip messages n/a 1 19727 462
----------------------------------------------------------------------------------------------------------
Every 2.0s: nodetool netstats | grep -v 100% a13: Thu Dec 6 12:18:50 2018
Mode: JOINING
Bootstrap 0d6aaca0-f943-11e8-b165-13c227abbdd3
/X.X.X.X
Receiving 2144 files, 678588356474 bytes total. Already received 5 files,
386382661 bytes total
app_tracks/metered_tracks 60358711/326869568 bytes(18%) received from
idx:0/X.X.X.X
/X.X.X.X
Receiving 2791 files, 894961971209 bytes total. Already received 6 files,
1146490391 bytes total
app_tracks/metered_tracks 247640372/456870721 bytes(54%) received from
idx:0/X.X.X.X
/X.X.X.X
Receiving 2448 files, 670153883888 bytes total. Already received 6 files,
145562331 bytes total
app_tracks/metered_tracks 53466582/114731604 bytes(46%) received from
idx:0/X.X.X.X
/X.X.X.X
Receiving 1771 files, 169619035230 bytes total. Already received 12 files,
706555271 bytes total
app_tracks/tracks 118628718/260360480 bytes(45%) received from idx:0/X.X.X.X
/X.X.X.X
Receiving 1606 files, 140966853868 bytes total. Already received 13 files,
227426411 bytes total
app_tracks/tracks 47121286/195600979 bytes(24%) received from idx:0/X.X.X.X
Read Repair Statistics:
Attempted: 0
Mismatch (Blocking): 0
Mismatch (Background): 0
Pool Name Active Pending Completed Dropped
Large messages n/a 1 0 1
Small messages n/a 1 37623847 1
Gossip messages n/a 3 19761 462
----------------------------------------------------------------------------------------------------------
Every 2.0s: nodetool netstats | grep -v 100% a13: Thu Dec 6 12:19:23 2018
Mode: JOINING
Bootstrap 0d6aaca0-f943-11e8-b165-13c227abbdd3
/X.X.X.X
Receiving 2144 files, 678588356474 bytes total. Already received 6 files,
329030174 bytes total
/X.X.X.X
Receiving 2791 files, 894961971209 bytes total. Already received 6 files,
368554613 bytes total
app_tracks/metered_tracks 28310799/221775633 bytes(12%) received from
idx:0/X.X.X.X
/X.X.X.X
Receiving 2448 files, 670153883888 bytes total. Already received 6 files,
125507198 bytes total
app_tracks/metered_tracks 33411449/196862696 bytes(16%) received from
idx:0/X.X.X.X
/X.X.X.X
Receiving 1771 files, 169619035230 bytes total. Already received 12 files,
614483021 bytes total
app_tracks/tracks 26556468/145252512 bytes(18%) received from idx:0/X.X.X.X
/X.X.X.X
Receiving 1606 files, 140966853868 bytes total. Already received 13 files,
409035357 bytes total
app_tracks/tracks 228730232/321753240 bytes(71%) received from idx:0/X.X.X.X
Read Repair Statistics:
Attempted: 0
Mismatch (Blocking): 0
Mismatch (Background): 0
Pool Name Active Pending Completed Dropped
Large messages n/a 1 0 1
Small messages n/a 1 37826037 1
Gossip messages n/a 2 19855 465
{code}
> Nodetool netstats displays incorrect information on streaming
> -------------------------------------------------------------
>
> Key: CASSANDRA-14917
> URL: https://issues.apache.org/jira/browse/CASSANDRA-14917
> Project: Cassandra
> Issue Type: Bug
> Components: Streaming and Messaging
> Reporter: Igor Zubchenok
> Assignee: Dinesh Joshi
> Priority: Minor
>
> nodetool netstats command displays 'Sending 0 files' and non-zero 'bytes
> total' during node decommission.
> {code:java}
> Sending 0 files, 198933290919 bytes total. Already sent 0 files, 0 bytes total
> {code}
> Complete notetool netstats response
> {code:java}
> # nodetool netstats | grep -v 100%
> Mode: LEAVING
> Unbootstrap 67096090-f604-11e8-bbbb-03532290668f
> /X.X.X.X
> Sending 8039 files, 174905861575 bytes total. Already sent 3147
> files, 39883605552 bytes total
>
> /var/lib/cassandra/data/app_tracks/tracks-bfd4a21086b711e7b6cbfd84ea9f1f78/mc-100884-big-Data.db
> 1866267759/8275615307 bytes(22%) sent to idx:0/5.9.54.111
> /X.X.X.X
> Sending 5475 files, 167399940563 bytes total. Already sent 2416
> files, 49417386715 bytes total
>
> /var/lib/cassandra/data/app_tracks/tracks-bd8310f086b711e7b6cbfd84ea9f1f78/mc-459374-big-Data.db
> 10192112/17529144 bytes(58%) sent to idx:0/5.9.59.101
> /X.X.X.X
> Sending 5843 files, 181124719187 bytes total. Already sent 2613
> files, 57001466824 bytes total
>
> /var/lib/cassandra/data/app_tracks/tracks-bd8310f086b711e7b6cbfd84ea9f1f78/mc-461873-big-Data.db
> 1439600/93308008 bytes(1%) sent to idx:0/46.4.31.97
> /X.X.X.X
> Sending 7303 files, 213976795121 bytes total. Already sent 1811
> files, 28956350780 bytes total
>
> /var/lib/cassandra/data/app_tracks/tracks-bfd4a21086b711e7b6cbfd84ea9f1f78/mc-100465-big-Data.db
> 3719051/37149976 bytes(10%) sent to idx:0/144.76.85.237
> /X.X.X.X
> Sending 7893 files, 204271020294 bytes total. Already sent 2397
> files, 36086600359 bytes total
>
> /var/lib/cassandra/data/app_tracks/tracks-bfd4a21086b711e7b6cbfd84ea9f1f78/mc-100197-big-Data.db
> 646314/8291439 bytes(7%) sent to idx:0/144.76.29.39
> /X.X.X.X
> Sending 0 files, 198933290919 bytes total. Already sent 0 files, 0
> bytes total
> /X.X.X.X
> Sending 6159 files, 187102577561 bytes total. Already sent 1526
> files, 26019708822 bytes total
>
> /var/lib/cassandra/data/app_tracks/tracks-bfd4a21086b711e7b6cbfd84ea9f1f78/mc-100685-big-Data.db
> 52211410/67213497 bytes(77%) sent to idx:0/144.76.85.182
> /X.X.X.X
> Sending 6534 files, 193239644509 bytes total. Already sent 2367
> files, 48105187871 bytes total
>
> /var/lib/cassandra/data/app_tracks/tracks-bfd4a21086b711e7b6cbfd84ea9f1f78/mc-100884-big-Data.db
> 5907583715/10068538729 bytes(58%) sent to idx:0/5.9.48.222
> /X.X.X.X
> Sending 5923 files, 213438389441 bytes total. Already sent 1663
> files, 32469866925 bytes total
> Read Repair Statistics:
> Attempted: 3537331
> Mismatch (Blocking): 2193
> Mismatch (Background): 4326
> Pool Name Active Pending Completed Dropped
> Large messages n/a 18 87460 746
> Small messages n/a 8 9837560424 12410
> Gossip messages n/a 8 7666199 84717
> {code}
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
