Re: Log Unique Queries without Params?

2020-04-13 Thread Rene Romero Benavides
Also try pg_stat_statements, does that on the fly and it will give you very
interesting execution stats too.

On Mon, Apr 13, 2020 at 12:37 AM Chris Morris 
wrote:

> Thx!
>
> On Sat, Apr 11, 2020 at 11:55 PM Julien Rouhaud 
> wrote:
>
>> On Sun, Apr 12, 2020 at 6:51 AM Chris Morris 
>> wrote:
>> >
>> > I have a local script I've written that will scan a log of PG queries
>> to extract out unique queries without any specific parameter data. For
>> example, if these 2 queries are actually run:
>> >
>> > SELECT * FROM foo where bar = 1;
>> > SELECT * FROM foo where bar = 2;
>> >
>> > It will capture only:
>> >
>> > SELECT * FROM foo whee bar = :id;
>> >
>> > Are there any existing tools that do this already for me? I'm
>> considering setting up a server that can have logs forwarded to it and only
>> logging unique queries like this, but I don't want to build anything that
>> may already exist out there.
>>
>> pgbadger (http://pgbadger.darold.net/#about) will do that and much
>> more.  Depending on what you want to achieve maybe pg_stat_statements
>> (https://www.postgresql.org/docs/current/pgstatstatements.html) is
>> also an alternative.
>>
>

-- 
El genio es 1% inspiraciĆ³n y 99% transpiraciĆ³n.
Thomas Alva Edison
http://pglearn.blogspot.mx/


Re: Log Unique Queries without Params?

2020-04-12 Thread Chris Morris
Thx!

On Sat, Apr 11, 2020 at 11:55 PM Julien Rouhaud  wrote:

> On Sun, Apr 12, 2020 at 6:51 AM Chris Morris 
> wrote:
> >
> > I have a local script I've written that will scan a log of PG queries to
> extract out unique queries without any specific parameter data. For
> example, if these 2 queries are actually run:
> >
> > SELECT * FROM foo where bar = 1;
> > SELECT * FROM foo where bar = 2;
> >
> > It will capture only:
> >
> > SELECT * FROM foo whee bar = :id;
> >
> > Are there any existing tools that do this already for me? I'm
> considering setting up a server that can have logs forwarded to it and only
> logging unique queries like this, but I don't want to build anything that
> may already exist out there.
>
> pgbadger (http://pgbadger.darold.net/#about) will do that and much
> more.  Depending on what you want to achieve maybe pg_stat_statements
> (https://www.postgresql.org/docs/current/pgstatstatements.html) is
> also an alternative.
>


Re: Log Unique Queries without Params?

2020-04-11 Thread Julien Rouhaud
On Sun, Apr 12, 2020 at 6:51 AM Chris Morris  wrote:
>
> I have a local script I've written that will scan a log of PG queries to 
> extract out unique queries without any specific parameter data. For example, 
> if these 2 queries are actually run:
>
> SELECT * FROM foo where bar = 1;
> SELECT * FROM foo where bar = 2;
>
> It will capture only:
>
> SELECT * FROM foo whee bar = :id;
>
> Are there any existing tools that do this already for me? I'm considering 
> setting up a server that can have logs forwarded to it and only logging 
> unique queries like this, but I don't want to build anything that may already 
> exist out there.

pgbadger (http://pgbadger.darold.net/#about) will do that and much
more.  Depending on what you want to achieve maybe pg_stat_statements
(https://www.postgresql.org/docs/current/pgstatstatements.html) is
also an alternative.




Log Unique Queries without Params?

2020-04-11 Thread Chris Morris
I have a local script I've written that will scan a log of PG queries to
extract out unique queries without any specific parameter data. For
example, if these 2 queries are actually run:

SELECT * FROM foo where bar = 1;
SELECT * FROM foo where bar = 2;

It will capture only:

SELECT * FROM foo whee bar = :id;

Are there any existing tools that do this already for me? I'm considering
setting up a server that can have logs forwarded to it and only logging
unique queries like this, but I don't want to build anything that may
already exist out there.