RE: Node went down and came back up

2013-05-06 Thread Dan Kogan
@cassandra.apache.org Subject: Node went down and came back up Hello, Last night one of our nodes froze and the server had to be rebooted. After it came up, the node joined the ring and everything looked normal. However, this morning there seem to be some inconsistencies in the data (e.g. some

Re: Node went down and came back up

2013-05-06 Thread Robert Coli
On Mon, May 6, 2013 at 6:20 AM, Dan Kogan d...@iqtell.com wrote: It seems that we did not have the JMX ports (1024+) opened in our firewall. Once we opened ports 1024+ the hinted handoffs completed and it seems that the cluster went back to normal. Does that make sense? No, JMX should not

RE: Node went down and came back up

2013-05-06 Thread Dan Kogan
Thanks. So then, Hinted Handoff should be sent over port 7000 (or 7001 with SSL), correct? -Original Message- From: Robert Coli [mailto:rc...@eventbrite.com] Sent: Monday, May 06, 2013 1:19 PM To: user@cassandra.apache.org Subject: Re: Node went down and came back up On Mon, May 6

Re: Node went down and came back up

2013-05-06 Thread Robert Coli
On Mon, May 6, 2013 at 12:31 PM, Dan Kogan d...@iqtell.com wrote: Thanks. So then, Hinted Handoff should be sent over port 7000 (or 7001 with SSL), correct? Yes, hinted handoff goes over the storage protocol port, which is shared with the gossip port, 7000/1. =Rob

Node went down and came back up

2013-05-05 Thread Dan Kogan
Hello, Last night one of our nodes froze and the server had to be rebooted. After it came up, the node joined the ring and everything looked normal. However, this morning there seem to be some inconsistencies in the data (e.g. some nodes don't have a given record or have a different version of