Re: Rebuild failing when adding new datacenter (3.0.8)

2016-09-22 Thread Timo Ahokas
Hi Yabin/Alain, I changed the replication strategies for system_distributed, system_auth and system_traces to use NetworkTopologyStrategies and repaired the affected keyspaces. Now the rebuild process starts up ok without errors. Thanks a lot for your help! Best regards, Timo On 22 September

Re: Rebuild failing when adding new datacenter (3.0.8)

2016-09-22 Thread Yabin Meng
It is a Cassandra bug. The workaround is to change system_distributed keyspce replication strategy to something as below: alter keyspace system_distributed with replication = {'class': 'NetworkTopologyStrategy', 'DC1': '3', 'DC2': '3', 'DC3': '3'}; You may see similar problem for other

Re: Rebuild failing when adding new datacenter (3.0.8)

2016-09-22 Thread Timo Ahokas
Hi Alain, Our normal user keyspaces have RF3 in all DCs, e.g: create keyspace reporting with replication = {'class': 'NetworkTopologyStrategy', 'DC1': '3', 'DC2': '3', 'DC3': '3'}; Any idea would it be safe to change the system_distributed keyspace to match this? -Timo On 22 September 2016 at

Re: Rebuild failing when adding new datacenter (3.0.8)

2016-09-22 Thread Timo Ahokas
Hi Alain, Thanks a lot for a helping out! Some of the basic keyspace / cluster info you requested: # echo "DESCRIBE KEYSPACE system_distributed;" | cqlsh CREATE KEYSPACE system_distributed WITH replication = {'class': 'SimpleStrategy', 'replication_factor': '3'} AND durable_writes = true;

Re: Rebuild failing when adding new datacenter (3.0.8)

2016-09-22 Thread Alain RODRIGUEZ
It could be a bug. Yet I am not very aware of this system_distributed keyspace, but from what I see, it is using a simple strategy: root@tlp-cassandra-2:~# echo "DESCRIBE KEYSPACE system_distributed;" | cqlsh $(hostname -I | awk '{print $1}') CREATE KEYSPACE system_distributed WITH replication