Re: finding Cassandra servers

2010-03-03 Thread Gary Dusbabek
2010/3/3 Ted Zlatanov t...@lifelogs.com: On Mon, 01 Mar 2010 12:15:11 -0600 Ted Zlatanov t...@lifelogs.com wrote: TZ I need to find Cassandra servers on my network from several types of TZ clients and platforms.  The goal is to make adding and removing servers TZ painless, assuming a leading

Re: finding Cassandra servers

2010-03-03 Thread Ted Zlatanov
On Wed, 3 Mar 2010 08:41:18 -0600 Gary Dusbabek gdusba...@gmail.com wrote: GD It wouldn't be a lot work for you to write a mdns service that would GD query the seeds for endpoints and publish it to interested clients. GD It could go in contrib. This requires knowledge of the seeds so I need to

Re: finding Cassandra servers

2010-03-03 Thread Gary Dusbabek
2010/3/3 Ted Zlatanov t...@lifelogs.com: On Wed, 3 Mar 2010 08:41:18 -0600 Gary Dusbabek gdusba...@gmail.com wrote: GD It wouldn't be a lot work for you to write a mdns service that would GD query the seeds for endpoints and publish it to interested clients. GD It could go in contrib. This

Re: finding Cassandra servers

2010-03-03 Thread Ted Zlatanov
On Wed, 3 Mar 2010 09:32:33 -0600 Gary Dusbabek gdusba...@gmail.com wrote: GD 2010/3/3 Ted Zlatanov t...@lifelogs.com: This requires knowledge of the seeds so I need to at least look in storage-conf.xml to find them.  Are you saying there's no chance of Cassandra nodes (or just seeds)

Re: finding Cassandra servers

2010-03-03 Thread Eric Evans
On Wed, 2010-03-03 at 10:05 -0600, Ted Zlatanov wrote: I can do a patch+ticket for this in the core, making it optional and off by default, or do the same for a contrib/ service as you suggested. So I'd appreciate a +1/-1 quick vote on whether this can go in the core to save me from rewriting

Re: finding Cassandra servers

2010-03-03 Thread Christopher Brind
So is the current general practice to connect to a known node, e.g. by ip address? If so, what happens if that node is down? Is the entire cluster effectively broken at that point? Or do clients simply maintain a list of nodes a just connect to the first available in the list? Thanks in

Re: finding Cassandra servers

2010-03-03 Thread Ted Zlatanov
On Wed, 03 Mar 2010 10:43:19 -0600 Eric Evans eev...@rackspace.com wrote: EE It's entirely possible that you've identified a problem that others EE can't see, or haven't yet encountered. I don't see it, but then maybe EE I'm just thick. Getting back to my original question, how do you (and

Re: finding Cassandra servers

2010-03-03 Thread Ian Holsman
+1 on erics comments We could create a branch or git fork where you guys could develop it, and if it reaches a usable state and others find it interesting it could get integrated in then On 3/3/10, Eric Evans eev...@rackspace.com wrote: On Wed, 2010-03-03 at 10:05 -0600, Ted Zlatanov wrote: I

Re: finding Cassandra servers

2010-03-03 Thread Ted Zlatanov
On Wed, 3 Mar 2010 09:04:37 -0800 Ryan King r...@twitter.com wrote: RK Something like RRDNS is no more complex that managing a list of seed nodes. How do your clients at Twitter find server nodes? Do you just run them local to each node? My concern is that both RRDNS and seed node lists are

Re: finding Cassandra servers

2010-03-03 Thread Chris Goffinet
At Digg we have automated infrastructure. We use Puppet + our own in-house system that allows us to query pools of nodes for 'seeds'. Config files like storage-conf.xml are auto generated on the fly, and we randomly pick a set of seeds. Seeds can be per datacenter as well. As soon as a

Re: finding Cassandra servers

2010-03-03 Thread Brandon Williams
2010/3/3 Ted Zlatanov t...@lifelogs.com On Wed, 3 Mar 2010 09:04:37 -0800 Ryan King r...@twitter.com wrote: RK Something like RRDNS is no more complex that managing a list of seed nodes. My concern is that both RRDNS and seed node lists are vulnerable to individual node failure. They're

Re: finding Cassandra servers

2010-03-03 Thread Ted Zlatanov
On Wed, 3 Mar 2010 12:08:06 -0500 Ian Holsman i...@holsman.net wrote: IH We could create a branch or git fork where you guys could develop it, IH and if it reaches a usable state and others find it interesting it IH could get integrated in then Thanks, Ian. Would it be OK to do it as a patch

Re: finding Cassandra servers

2010-03-03 Thread Jonathan Ellis
We appear to be reaching consensus that this is solving a non-problem, so I have closed that ticket. 2010/3/3 Ted Zlatanov t...@lifelogs.com: On Wed, 3 Mar 2010 12:08:06 -0500 Ian Holsman i...@holsman.net wrote: IH We could create a branch or git fork where you guys could develop it, IH and

Re: finding Cassandra servers

2010-03-03 Thread Eric Evans
On Wed, 2010-03-03 at 16:49 +, Christopher Brind wrote: So is the current general practice to connect to a known node, e.g. by ip address? There are so many ways you could tackle this but... If you're talking about provisioning/startup of new nodes, just use the IPs of 2-4 nodes in the

Re: finding Cassandra servers

2010-03-03 Thread Ted Zlatanov
On Wed, 3 Mar 2010 09:19:28 -0800 Chris Goffinet goffi...@digg.com wrote: CG At Digg we have automated infrastructure. We use Puppet + our own CG in-house system that allows us to query pools of nodes for CG 'seeds'. Config files like storage-conf.xml are auto generated on CG the fly, and we

Re: finding Cassandra servers

2010-03-03 Thread Ryan King
2010/3/3 Ted Zlatanov t...@lifelogs.com: On Wed, 3 Mar 2010 09:04:37 -0800 Ryan King r...@twitter.com wrote: RK Something like RRDNS is no more complex that managing a list of seed nodes. How do your clients at Twitter find server nodes?  Do you just run them local to each node? RRDNS +

Re: finding Cassandra servers

2010-03-03 Thread Ryan King
On Wed, Mar 3, 2010 at 9:27 AM, Eric Evans eev...@rackspace.com wrote: On Wed, 2010-03-03 at 16:49 +, Christopher Brind wrote: So is the current general practice to connect to a known node, e.g. by ip address? There are so many ways you could tackle this but... If you're talking about

Re: finding Cassandra servers

2010-03-03 Thread Ted Zlatanov
On Wed, 3 Mar 2010 09:35:31 -0800 Ryan King r...@twitter.com wrote: With seed node lists, if I get unlucky I'd be trying to hit a downed node in which case I may as well just use RRDNS and deal with connection failure from the start. RK Why would you not deal with connection failure? I mean