Re: [GENERAL] Extracting SQL from logs in a usable format

2009-12-21 Thread Chris Ernst
Dimitri Fontaine wrote: Le 19 déc. 2009 à 16:20, Chris Ernst a écrit : Hmm.. That does look very interesting. The only thing that concerns me is where it says it supports Basic Queries (Extended queries not yet supported). I'm not sure what is meant by Extended queries. Any idea? I

Re: [GENERAL] Extracting SQL from logs in a usable format

2009-12-21 Thread Dimitri Fontaine
Le 21 déc. 2009 à 15:24, Chris Ernst a écrit : Ouch! You're right. And that's would be a deal killer for me. About 90% of the traffic is prepared queries that are run over and over with different parameters. The driver project and code are now there it seems: http://frihjul.net/pgsql

Re: [GENERAL] Extracting SQL from logs in a usable format

2009-12-20 Thread JGuillaume (ioguix) de Rorthais
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hey guys, Albe Laurenz a écrit : Chris Ernst wrote: I have a project where I need to be able to capture every query from a production system into a file such that I can replay them on a staging system. Does such a thing already exist or should

Re: [GENERAL] Extracting SQL from logs in a usable format

2009-12-20 Thread JGuillaume (ioguix) de Rorthais
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Shoaib Mir a écrit : On Sun, Dec 20, 2009 at 9:37 AM, Albe Laurenz laurenz.a...@wien.gv.at mailto:laurenz.a...@wien.gv.at wrote: Chris Ernst wrote: I have a project where I need to be able to capture every query from a production system into a

Re: [GENERAL] Extracting SQL from logs in a usable format

2009-12-20 Thread hubert depesz lubaczewski
On Fri, Dec 18, 2009 at 02:08:07PM -0700, Chris Ernst wrote: Hi all, I have a project where I need to be able to capture every query from a production system into a file such that I can replay them on a staging system. Does such a thing already exist or should I start writing my own log

Re: [GENERAL] Extracting SQL from logs in a usable format

2009-12-20 Thread Craig Ringer
On 20/12/2009 7:59 PM, hubert depesz lubaczewski wrote: On Fri, Dec 18, 2009 at 02:08:07PM -0700, Chris Ernst wrote: Hi all, I have a project where I need to be able to capture every query from a production system into a file such that I can replay them on a staging system. Does such a thing

Re: [GENERAL] Extracting SQL from logs in a usable format

2009-12-20 Thread Albe Laurenz
JGuillaume (ioguix) de Rorthais wrote: I am currently developing such a beast, it is currently still quite alpha. If you are interested I can send you a copy. I'll try to publish it once it is sufficiently beta. Interesting project, but but I have one big issue under 8.1 and advanced query

Re: [GENERAL] Extracting SQL from logs in a usable format

2009-12-20 Thread Dimitri Fontaine
Le 19 déc. 2009 à 16:20, Chris Ernst a écrit : Hmm.. That does look very interesting. The only thing that concerns me is where it says it supports Basic Queries (Extended queries not yet supported). I'm not sure what is meant by Extended queries. Any idea? I think it refers to the Extended

Re: [GENERAL] Extracting SQL from logs in a usable format

2009-12-19 Thread Filip Rembiałkowski
Tsung [http://tsung.erlang-projects.org/] has a nice pg proxy module. It records your query stream and is able to replay it later. 2009/12/18 Chris Ernst cer...@esoft.com Hi all, I have a project where I need to be able to capture every query from a production system into a file such that

Re: [GENERAL] Extracting SQL from logs in a usable format

2009-12-19 Thread Chris Ernst
Greg Smith wrote: Chris Ernst wrote: I started writing my own log parser to pull the statements from the postgres logs, but as I get in to the details, it's not quite as straight forward as I had thought. Keeping track of which client connections have prepared queries, merging the correct

Re: [GENERAL] Extracting SQL from logs in a usable format

2009-12-19 Thread Chris Ernst
Hmm.. That does look very interesting. The only thing that concerns me is where it says it supports Basic Queries (Extended queries not yet supported). I'm not sure what is meant by Extended queries. Any idea? Thank you for the pointer, Filip. I'll check it out. - Chris Filip

Re: [GENERAL] Extracting SQL from logs in a usable format

2009-12-19 Thread Albe Laurenz
Chris Ernst wrote: I have a project where I need to be able to capture every query from a production system into a file such that I can replay them on a staging system. Does such a thing already exist or should I start writing my own log parser? I am currently developing such a beast, it is

Re: [GENERAL] Extracting SQL from logs in a usable format

2009-12-19 Thread Shoaib Mir
On Sun, Dec 20, 2009 at 9:37 AM, Albe Laurenz laurenz.a...@wien.gv.atwrote: Chris Ernst wrote: I have a project where I need to be able to capture every query from a production system into a file such that I can replay them on a staging system. Does such a thing already exist or should I

[GENERAL] Extracting SQL from logs in a usable format

2009-12-18 Thread Chris Ernst
Hi all, I have a project where I need to be able to capture every query from a production system into a file such that I can replay them on a staging system. Does such a thing already exist or should I start writing my own log parser? Thank you for your help. Chris Ernst eSoft, Inc. -- Sent

Re: [GENERAL] Extracting SQL from logs in a usable format

2009-12-18 Thread Rory Campbell-Lange
On 18/12/09, Chris Ernst (cer...@esoft.com) wrote: I have a project where I need to be able to capture every query from a production system into a file such that I can replay them on a staging system. Does such a thing already exist or should I start writing my own log parser? I'm sure there

Re: [GENERAL] Extracting SQL from logs in a usable format

2009-12-18 Thread Chris Ernst
Rory Campbell-Lange wrote: On 18/12/09, Chris Ernst (cer...@esoft.com) wrote: I have a project where I need to be able to capture every query from a production system into a file such that I can replay them on a staging system. Does such a thing already exist or should I start writing my own

Re: [GENERAL] Extracting SQL from logs in a usable format

2009-12-18 Thread Greg Smith
Chris Ernst wrote: I started writing my own log parser to pull the statements from the postgres logs, but as I get in to the details, it's not quite as straight forward as I had thought. Keeping track of which client connections have prepared queries, merging the correct arguments and