Re: [GENERAL] horizontal sharding

2009-06-28 Thread mobiledreamers
Thanks a lot greg trying it out If it does not work i ll post to pgpool groups thanks again but i think what you have pointed out is the right solution On Sat, Jun 27, 2009 at 10:59 PM, Greg Smith wrote: > On Fri, 26 Jun 2009, mobiledream...@gmail.com wrote: > > 2009-06-26 18:48:34 ERROR: pid

Re: [GENERAL] horizontal sharding

2009-06-27 Thread Greg Smith
On Fri, 26 Jun 2009, mobiledream...@gmail.com wrote: 2009-06-26 18:48:34 ERROR: pid 5563: pool_read_int: data does not match between between master(0) slot[1] (50331648) 2009-06-26 18:48:34 ERROR: pid 5563: pool_do_auth: read auth kind failed My guess is that you have different types of conne

Re: [GENERAL] horizontal sharding

2009-06-27 Thread mobiledreamers
yeah i have never tried slony and i didnt try plproxy as it is a new language and need to modify all client code not modifiying client code in pgpool 2 rocks On Sat, Jun 27, 2009 at 12:52 AM, Scott Marlowe wrote: > Oh crap I think I mixed it up in my head with slony II. nevermind. :) > > On Sa

Re: [GENERAL] horizontal sharding

2009-06-27 Thread Scott Marlowe
Oh crap I think I mixed it up in my head with slony II. nevermind. :) On Sat, Jun 27, 2009 at 1:17 AM, wrote: > no it is very good and well designed the whole app code doesnt need to > change > > we jus need to configure the pgpool insertion logic > > and it has a cool pgpooladmin in php like p

Re: [GENERAL] horizontal sharding

2009-06-27 Thread mobiledreamers
no it is very good and well designed the whole app code doesnt need to change we jus need to configure the pgpool insertion logic and it has a cool pgpooladmin in php like phppgadmin if only i can get it to work On Fri, Jun 26, 2009 at 10:53 PM, Scott Marlowe wrote: > I thought pgool II was ab

Re: [GENERAL] horizontal sharding

2009-06-26 Thread Scott Marlowe
On Mon, Jun 15, 2009 at 11:36 AM, John R Pierce wrote: > Jim Mlodgenski wrote: >> >> >>    also is it possible to paritition without changing client code >> >> Yes, but it depends on the SQL in your client code. If you are just using >> simple SQL with no stored functions, you should be able to sli

Re: [GENERAL] horizontal sharding

2009-06-26 Thread Scott Marlowe
I thought pgool II was abandonware... On Fri, Jun 26, 2009 at 7:50 PM, wrote: > Hey john > thanks > i did read both extensively, but finishing all the steps parallel mode or > horizontal partitioning mode doesnot work! > but this is my conf file > > # backend_hostname, backend_port, backend_weigh

Re: [GENERAL] horizontal sharding

2009-06-26 Thread mobiledreamers
Hey johnthanks i did read both extensively, but finishing all the steps parallel mode or horizontal partitioning mode doesnot work! but this is my conf file # backend_hostname, backend_port, backend_weight # here are examples backend_hostname0 = 'localhost' backend_port0 = 5432 backend_weight0

Re: [GENERAL] horizontal sharding

2009-06-26 Thread John R Pierce
mobiledream...@gmail.com wrote: can someone show how to setup pgpool 2 in parallel *query* mode ie horizontal partitioning did you look at http://pgpool.projects.postgresql.org/pgpool-II/doc/tutorial-en.html#parallel ? I'd pay close attention to the restrictions here, too... http://pgpool.

Re: [GENERAL] horizontal sharding

2009-06-26 Thread mobiledreamers
can someone show how to setup pgpool 2 in parallel replication modethanks a lot On Thu, Jun 25, 2009 at 10:28 AM, Scott Marlowe wrote: > On Thu, Jun 25, 2009 at 12:03 AM, wrote: > > GOals are to scale our game for 1 simultaneous connection to db > > right now db crashing at 500 or 1000 sim c

Re: [GENERAL] horizontal sharding

2009-06-26 Thread mobiledreamers
can someone show how to setup pgpool 2 in parallel *query* mode ie horizontal partitioningthanks a lot On Fri, Jun 26, 2009 at 5:35 PM, wrote: > can someone show how to setup pgpool 2 in parallel replication modethanks > a lot > > > On Thu, Jun 25, 2009 at 10:28 AM, Scott Marlowe > wrote: > >>

Re: [GENERAL] horizontal sharding

2009-06-25 Thread Scott Marlowe
On Thu, Jun 25, 2009 at 12:03 AM, wrote: > GOals are to scale our game for 1 simultaneous connection to db > right now db crashing at 500 or 1000 sim connections Definitely look into pooling. I've got a pretty hefty database server (16 15k5 drives, HW RAID, 32Gig RAM and 8 cores) and I would

Re: [GENERAL] horizontal sharding

2009-06-25 Thread mobiledreamers
GOals are to scale our game for 1 simultaneous connection to db right now db crashing at 500 or 1000 sim connections On Mon, Jun 15, 2009 at 8:07 AM, David Fetter wrote: > On Mon, Jun 15, 2009 at 12:32:15AM -0700, mobiledream...@gmail.com wrote: > > Hey guys > > what is a good way to horizon

Re: [GENERAL] horizontal sharding

2009-06-25 Thread mobiledreamers
Jim thanks Can you please show how to setup partitining in gridsql and pgpool 2 thanks a lot On Mon, Jun 15, 2009 at 10:28 AM, Jim Mlodgenski wrote: > what is a good way to horizontal shard in postgresql > >> 1. pgpool 2 >> 2. gridsql >> >> which is a better way to use sharding >> > > Both are

Re: [GENERAL] horizontal sharding

2009-06-25 Thread David Fetter
On Wed, Jun 24, 2009 at 11:03:07PM -0700, mobiledream...@gmail.com wrote: > GOals are to scale our game for 1 simultaneous connection to db > right now db crashing at 500 or 1000 sim connections Consider using pgbouncer to multiplex your database connections. If that doesn't work, consider hi

Re: [GENERAL] horizontal sharding

2009-06-15 Thread Scott Marlowe
On Mon, Jun 15, 2009 at 11:36 AM, John R Pierce wrote: > Jim Mlodgenski wrote: >> >> >>    also is it possible to paritition without changing client code >> >> Yes, but it depends on the SQL in your client code. If you are just using >> simple SQL with no stored functions, you should be able to sli

Re: [GENERAL] horizontal sharding

2009-06-15 Thread Jim Mlodgenski
what about queries that need to do joins or aggregate reporting across the partitions?!? I can't see how that could be done transparently short of something like Oracle RAC. GridSQL actually does a nice job of breaking up the query and optimizing it appropriately to handle cross node joins. There

Re: [GENERAL] horizontal sharding

2009-06-15 Thread John R Pierce
Jim Mlodgenski wrote: also is it possible to paritition without changing client code Yes, but it depends on the SQL in your client code. If you are just using simple SQL with no stored functions, you should be able to slip in either solution without changing the client code. what ab

Re: [GENERAL] horizontal sharding

2009-06-15 Thread Jim Mlodgenski
what is a good way to horizontal shard in postgresql > 1. pgpool 2 > 2. gridsql > > which is a better way to use sharding > Both are good methods of sharding, but it depends on your goals. GridSQL is better in reporting applications where as PG Pool2 is better in transactional situations. > > a

Re: [GENERAL] horizontal sharding

2009-06-15 Thread David Fetter
On Mon, Jun 15, 2009 at 12:32:15AM -0700, mobiledream...@gmail.com wrote: > Hey guys > what is a good way to horizontal shard in postgresql "Sharding" is not really a technical term, so it's not really possible to answer this question meaningfully as posed. What is it that you actually want to ac

[GENERAL] horizontal sharding

2009-06-15 Thread mobiledreamers
Hey guys what is a good way to horizontal shard in postgresql 1. pgpool 2 2. gridsql which is a better way to use sharding also is it possible to paritition without changing client code thanks -- Bidegg worlds best auction site http://bidegg.com