[ https://issues.apache.org/jira/browse/CASSANDRA-12560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Prateek Agarwal resolved CASSANDRA-12560. ----------------------------------------- Resolution: Invalid Turns out there were stale directories commit_log and saved_caches which i missed to delete earlier. The instructions work correctly with those directories deleted. > Cassandra Restart issues while restoring to a new cluster > --------------------------------------------------------- > > Key: CASSANDRA-12560 > URL: https://issues.apache.org/jira/browse/CASSANDRA-12560 > Project: Cassandra > Issue Type: Bug > Components: Configuration > Environment: distro: Ubuntu 14.04 LTS > Reporter: Prateek Agarwal > > I am restoring to a fresh new Cassandra 2.2.5 cluster consisting of 3 nodes. > Initial cluster health of the NEW cluster: > {code} > -- Address Load Tokens Owns Host ID > Rack > UN 10.40.1.1 259.31 KB 256 ? > d2b29b08-9eac-4733-9798-019275d66cfc uswest1adevc > UN 10.40.1.2 230.12 KB 256 ? > 5484ab11-32b1-4d01-a5fe-c996a63108f1 uswest1adevc > UN 10.40.1.3 248.47 KB 256 ? > bad95fe2-70c5-4a2f-b517-d7fd7a32bc45 uswest1cdevc > {code} > As part of the [restore instructions in Datastax 2.2 > docs|http://docs.datastax.com/en/cassandra/2.2/cassandra/operations/opsSnapshotRestoreNewCluster.html], > i do the following on the new cluster: > 1) cassandra stop on all of the three nodes one by one. > 2) Edit cassandra.yaml for all of the three nodes with the backup'ed token > ring information. [Step 2 from docs] > 3) Remove the contents from /var/lib/cassandra/data/system/* [Step 4 from > docs] > 4) cassandra start on nodes 10.40.1.1, 10.40.1.2, 10.40.1.3 respectively. > Result: 10.40.1.1 restarts back successfully: > {code} > -- Address Load Tokens Owns Host ID > Rack > UN 10.40.1.1 259.31 KB 256 ? > 2d23add3-9eac-4733-9798-019275d125d3 uswest1adevc > {code} > But the second and the third nodes fail to restart stating: > {code} > java.lang.RuntimeException: A node with address 10.40.1.2 already exists, > cancelling join. Use cassandra.replace_address if you want to replace this > node. > at > org.apache.cassandra.service.StorageService.checkForEndpointCollision(StorageService.java:546) > ~[apache-cassandra-2.2.5.jar:2.2.5] > at > org.apache.cassandra.service.StorageService.prepareToJoin(StorageService.java:766) > ~[apache-cassandra-2.2.5.jar:2.2.5] > at > org.apache.cassandra.service.StorageService.initServer(StorageService.java:693) > ~[apache-cassandra-2.2.5.jar:2.2.5] > at > org.apache.cassandra.service.StorageService.initServer(StorageService.java:585) > ~[apache-cassandra-2.2.5.jar:2.2.5] > at > org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:300) > [apache-cassandra-2.2.5.jar:2.2.5] > at > org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:516) > [apache-cassandra-2.2.5.jar:2.2.5] > at > org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:625) > [apache-cassandra-2.2.5.jar:2.2.5] > INFO [StorageServiceShutdownHook] 2016-08-09 18:13:21,980 Gossiper.java:1449 > - Announcing shutdown > {code} > {code} > java.lang.RuntimeException: A node with address 10.40.1.3 already exists, > cancelling join. Use cassandra.replace_address if you want to replace this > node. > ... > {code} > Eventual cluster health: > {code} > -- Address Load Tokens Owns Host ID > Rack > UN 10.40.1.1 259.31 KB 256 ? > 2d23add3-9eac-4733-9798-019275d125d3 uswest1adevc > DN 10.40.1.2 230.12 KB 256 ? > 6w2321ad-32b1-4d01-a5fe-c996a63108f1 uswest1adevc > DN 10.40.1.3 248.47 KB 256 ? > 9et4944d-70c5-4a2f-b517-d7fd7a32bc45 uswest1cdevc > {code} > I understand that the HostID of a node might change after system dirs are > removed. > I think the restore docs are incomplete and need to mention the 'replace IP' > part as well OR am i missing something in my steps? -- This message was sent by Atlassian JIRA (v6.3.4#6332)