[
https://issues.apache.org/jira/browse/CASSANDRA-14155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16726920#comment-16726920
]
Ariel Weisberg edited comment on CASSANDRA-14155 at 12/21/18 5:22 PM:
----------------------------------------------------------------------
Got the endpoint state map + some additional logging during the shadow round.
Container 5 , rolling upgrade ssl test
https://circleci.com/gh/aweisberg/cassandra/2329#artifacts/containers/99
https://2329-26126838-gh.circle-artifacts.com/5/dtest_upgrade_no_vnodes_logs/1545411075201_test_rolling_upgrade_with_internode_ssl/node1_debug.log
{noformat}
java.lang.AssertionError: previous (Gossip ApplicationState.HOST_ID for this
node) is null: Messages = Starting shadow gossip round to check for endpoint
collision at 127.0.0.2:7000
Sending shadow round GOSSIP DIGEST SYN to seeds [127.0.0.1:7000, 127.0.0.3:7000]
Received a regular ack from 127.0.0.1:7000, can now exit shadow round, epStates
= {127.0.0.2:7000=EndpointState: HeartBeatState = HeartBeat: generation =
1545333335, version = 2147483647, AppStateMap = {},
127.0.0.1:7000=EndpointState: HeartBeatState = HeartBeat: generation =
1545333481, version = 123, AppStateMap = {}}
at org.apache.cassandra.gms.Gossiper.isSafeForStartup(Gossiper.java:834)
at
org.apache.cassandra.service.StorageService.checkForEndpointCollision(StorageService.java:556)
at
org.apache.cassandra.service.StorageService.prepareToJoin(StorageService.java:835)
at
org.apache.cassandra.service.StorageService.initServer(StorageService.java:693)
at
org.apache.cassandra.service.StorageService.initServer(StorageService.java:644)
at
org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:369)
at
org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:581)
at
org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:670)
{noformat}
https://2329-26126838-gh.circle-artifacts.com/5/dtest_upgrade_no_vnodes_logs/1545411075201_test_rolling_upgrade_with_internode_ssl/node2_debug.log
{noformat}
java.lang.AssertionError: previous (Gossip ApplicationState.HOST_ID for this
node) is null: Messages = Starting shadow gossip round to check for endpoint
collision at 127.0.0.2:7000
Sending shadow round GOSSIP DIGEST SYN to seeds [127.0.0.1:7000, 127.0.0.3:7000]
Received a regular ack from 127.0.0.1:7000, can now exit shadow round,
epStateMap {127.0.0.3:7000=EndpointState: HeartBeatState = HeartBeat:
generation = 1545410617, version = 240, AppStateMap = {},
127.0.0.2:7000=EndpointState: HeartBeatState = HeartBeat: generation =
1545410603, version = 2147483647, AppStateMap = {},
127.0.0.1:7000=EndpointState: HeartBeatState = HeartBeat: generation =
1545410741, version = 123, AppStateMap = {}}, epStates =
{127.0.0.3:7000=EndpointState: HeartBeatState = HeartBeat: generation =
1545410617, version = 240, AppStateMap = {}, 127.0.0.2:7000=EndpointState:
HeartBeatState = HeartBeat: generation = 1545410603, version = 2147483647,
AppStateMap = {}, 127.0.0.1:7000=EndpointState: HeartBeatState = HeartBeat:
generation = 1545410741, version = 123, AppStateMap = {}}
at org.apache.cassandra.gms.Gossiper.isSafeForStartup(Gossiper.java:834)
at
org.apache.cassandra.service.StorageService.checkForEndpointCollision(StorageService.java:556)
at
org.apache.cassandra.service.StorageService.prepareToJoin(StorageService.java:835)
at
org.apache.cassandra.service.StorageService.initServer(StorageService.java:693)
at
org.apache.cassandra.service.StorageService.initServer(StorageService.java:644)
at
org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:369)
at
org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:581)
at
org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:670)
{noformat}
was (Author: aweisberg):
Got the endpoint state map + some additional logging during the shadow round.
{noformat}
java.lang.AssertionError: previous (Gossip ApplicationState.HOST_ID for this
node) is null: Messages = Starting shadow gossip round to check for endpoint
collision at 127.0.0.2:7000
Sending shadow round GOSSIP DIGEST SYN to seeds [127.0.0.1:7000, 127.0.0.3:7000]
Received a regular ack from 127.0.0.1:7000, can now exit shadow round, epStates
= {127.0.0.2:7000=EndpointState: HeartBeatState = HeartBeat: generation =
1545333335, version = 2147483647, AppStateMap = {},
127.0.0.1:7000=EndpointState: HeartBeatState = HeartBeat: generation =
1545333481, version = 123, AppStateMap = {}}
at org.apache.cassandra.gms.Gossiper.isSafeForStartup(Gossiper.java:834)
at
org.apache.cassandra.service.StorageService.checkForEndpointCollision(StorageService.java:556)
at
org.apache.cassandra.service.StorageService.prepareToJoin(StorageService.java:835)
at
org.apache.cassandra.service.StorageService.initServer(StorageService.java:693)
at
org.apache.cassandra.service.StorageService.initServer(StorageService.java:644)
at
org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:369)
at
org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:581)
at
org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:670)
{noformat}
{noformat}
java.lang.AssertionError: previous (Gossip ApplicationState.HOST_ID for this
node) is null: Messages = Starting shadow gossip round to check for endpoint
collision at 127.0.0.2:7000
Sending shadow round GOSSIP DIGEST SYN to seeds [127.0.0.1:7000, 127.0.0.3:7000]
Received a regular ack from 127.0.0.1:7000, can now exit shadow round,
epStateMap {127.0.0.3:7000=EndpointState: HeartBeatState = HeartBeat:
generation = 1545410617, version = 240, AppStateMap = {},
127.0.0.2:7000=EndpointState: HeartBeatState = HeartBeat: generation =
1545410603, version = 2147483647, AppStateMap = {},
127.0.0.1:7000=EndpointState: HeartBeatState = HeartBeat: generation =
1545410741, version = 123, AppStateMap = {}}, epStates =
{127.0.0.3:7000=EndpointState: HeartBeatState = HeartBeat: generation =
1545410617, version = 240, AppStateMap = {}, 127.0.0.2:7000=EndpointState:
HeartBeatState = HeartBeat: generation = 1545410603, version = 2147483647,
AppStateMap = {}, 127.0.0.1:7000=EndpointState: HeartBeatState = HeartBeat:
generation = 1545410741, version = 123, AppStateMap = {}}
at org.apache.cassandra.gms.Gossiper.isSafeForStartup(Gossiper.java:834)
at
org.apache.cassandra.service.StorageService.checkForEndpointCollision(StorageService.java:556)
at
org.apache.cassandra.service.StorageService.prepareToJoin(StorageService.java:835)
at
org.apache.cassandra.service.StorageService.initServer(StorageService.java:693)
at
org.apache.cassandra.service.StorageService.initServer(StorageService.java:644)
at
org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:369)
at
org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:581)
at
org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:670)
{noformat}
> [TRUNK] Gossiper somewhat frequently hitting an NPE on node startup with
> dtests at
> org.apache.cassandra.gms.Gossiper.isSafeForStartup(Gossiper.java:769)
> --------------------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: CASSANDRA-14155
> URL: https://issues.apache.org/jira/browse/CASSANDRA-14155
> Project: Cassandra
> Issue Type: Bug
> Components: Lifecycle, Testing
> Reporter: Michael Kjellman
> Assignee: Jason Brown
> Priority: Major
> Labels: dtest
>
> Gossiper is somewhat frequently hitting an NPE on node startup with dtests at
> org.apache.cassandra.gms.Gossiper.isSafeForStartup(Gossiper.java:769)
> {code}
> test teardown failure
> Unexpected error found in node logs (see stdout for full details). Errors:
> [ERROR [main] 2018-01-08 21:41:01,832 CassandraDaemon.java:675 - Exception
> encountered during startup
> java.lang.NullPointerException: null
> at
> org.apache.cassandra.gms.Gossiper.isSafeForStartup(Gossiper.java:769)
> ~[main/:na]
> at
> org.apache.cassandra.service.StorageService.checkForEndpointCollision(StorageService.java:511)
> ~[main/:na]
> at
> org.apache.cassandra.service.StorageService.prepareToJoin(StorageService.java:761)
> ~[main/:na]
> at
> org.apache.cassandra.service.StorageService.initServer(StorageService.java:621)
> ~[main/:na]
> at
> org.apache.cassandra.service.StorageService.initServer(StorageService.java:568)
> ~[main/:na]
> at
> org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:360)
> [main/:na]
> at
> org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:569)
> [main/:na]
> at
> org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:658)
> [main/:na], ERROR [main] 2018-01-08 21:41:01,832 CassandraDaemon.java:675 -
> Exception encountered during startup
> java.lang.NullPointerException: null
> at
> org.apache.cassandra.gms.Gossiper.isSafeForStartup(Gossiper.java:769)
> ~[main/:na]
> at
> org.apache.cassandra.service.StorageService.checkForEndpointCollision(StorageService.java:511)
> ~[main/:na]
> at
> org.apache.cassandra.service.StorageService.prepareToJoin(StorageService.java:761)
> ~[main/:na]
> at
> org.apache.cassandra.service.StorageService.initServer(StorageService.java:621)
> ~[main/:na]
> at
> org.apache.cassandra.service.StorageService.initServer(StorageService.java:568)
> ~[main/:na]
> at
> org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:360)
> [main/:na]
> at
> org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:569)
> [main/:na]
> at
> org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:658)
> [main/:na]]
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
