Re: Table Export & Import

[Andreas Kretschmer]

On 1 April 2019 08:09:37 CEST, Sathish Kumar  wrote:
>Hi Team,
>
>We have a requirement to copy a table from one database server to
>another
>database server. We are looking for a solution to achieve this with
>lesser
>downtime on Prod. Can you help us with this?
>
>Table Size: 160GB
>Postgresql Server Version: 9.5

You can take a dump at any time without downtime. Other solution would be a 
logical replicarion using, for instance, slony, londiste or pg_logical from 
2ndQuadrant.


Regards, Andreas




-- 
2ndQuadrant - The PostgreSQL Support Company

Table Export & Import

[Sathish Kumar]

Hi Team,

We have a requirement to copy a table from one database server to another
database server. We are looking for a solution to achieve this with lesser
downtime on Prod. Can you help us with this?

Table Size: 160GB
Postgresql Server Version: 9.5

Re: Gigantic load average spikes

[David Rowley]

On Mon, 1 Apr 2019 at 18:08, rihad  wrote:
>
> > What exactly do you mean by "running processes"? I don't think I've ever
> > seen a Unix with only 1 to 3 running processes in total, so you are
> > probably referring to processes in a certain state. Runnable (R)?
> > Uninterruptible sleep (D)? Both? Something else?
>
> Just that, 250-300 running processes in top shown for a second. 250-300
> is the number of postgres worker processes used, but normally only 1-3
> of them are running according to top. At times of load FreeBSD (?)
> schedules all of them to run. This doesn't really put the machine on its
> knees, it just impacts load avg.

Perhaps a bunch of processes waiting on the access exclusive lock on
the materialized view being released?

log_lock_waits might help you if the MV takes more than a second to
refresh, otherwise, you might need to have a look at ungranted locks
in pg_locks and see if the number of locks spikes during the refresh.

-- 
 David Rowley   http://www.2ndQuadrant.com/
 PostgreSQL Development, 24x7 Support, Training & Services

Re: Gigantic load average spikes

[rihad]

What exactly do you mean by "running processes"? I don't think I've ever
seen a Unix with only 1 to 3 running processes in total, so you are
probably referring to processes in a certain state. Runnable (R)?
Uninterruptible sleep (D)? Both? Something else?


Just that, 250-300 running processes in top shown for a second. 250-300 
is the number of postgres worker processes used, but normally only 1-3 
of them are running according to top. At times of load FreeBSD (?) 
schedules all of them to run. This doesn't really put the machine on its 
knees, it just impacts load avg.

Re: Gigantic load average spikes

[Peter J. Holzer]

On 2019-03-31 19:23:11 +0400, rihad wrote:
> Postgres 10.3 On freebsd 10.3 is almost idle, disk i/o about 5-10%, number
> running processes about 1-3, cpu about 90% idle, then we run a i/o heavy job
> like "refresh materialized view", cpu & disk i/o still not maxed out, all of
> a sudden the number of running processes increases to about 250-300 for a

What exactly do you mean by "running processes"? I don't think I've ever
seen a Unix with only 1 to 3 running processes in total, so you are
probably referring to processes in a certain state. Runnable (R)?
Uninterruptible sleep (D)? Both? Something else?

hp

-- 
   _  | Peter J. Holzer| we build much bigger, better disasters now
|_|_) || because we have much more sophisticated
| |   | h...@hjp.at | management tools.
__/   | http://www.hjp.at/ | -- Ross Anderson 


signature.asc
Description: PGP signature

Re: Regarding pgaudit log_directory

[David Steele]

On 3/31/19 8:01 PM, Durgamahesh Manne wrote:


On Saturday, March 30, 2019, David Steele > wrote:


On 3/29/19 3:32 PM, Durgamahesh Manne wrote:

    I could not find parameter related to pgaudit log_directory  .

pgAudit does not support logging outside the standard PostgreSQL
logging facility and there are no plans for such a feature.

The general solution is to use Splunk, ELK, etc. to do manipulation
of the PostgreSQL logs.

Regards,
-- 
-David

da...@pgmasters.net 

Please let me know open source application interface to monitor of 
pgaudit logs only

As I have installed pgaudit successfully


For open source ELK is probably your best bet.  This may help get you 
started: 
https://prezi.com/f2dvt6m9tbf9/integrating-postgresql-with-logstash-for-real-time-monitoring/


--
-David
da...@pgmasters.net

Regarding pgaudit

[Durgamahesh Manne]

Hi

Respected postgres team

Please let me know open source application interface to monitor the pgaudit
log files only as I have installed pgaudit tool

Regards

Durgamahesh Manne

Regarding pgaudit log_directory

[Durgamahesh Manne]

On Saturday, March 30, 2019, David Steele  wrote:

> On 3/29/19 3:32 PM, Durgamahesh Manne wrote:
>
>>
>>I could not find parameter related to pgaudit log_directory  .
>>
>
> pgAudit does not support logging outside the standard PostgreSQL logging
> facility and there are no plans for such a feature.
>
> The general solution is to use Splunk, ELK, etc. to do manipulation of the
> PostgreSQL logs.
>
> Regards,
> --
> -David
> da...@pgmasters.net
>

Hi

Please let me know open source application interface to do manipulation of
pgaudit logs only
As I have installed pgaudit successfully

Regards

Durgamahesh Manne

Re: Regarding pgaudit log_directory

[Durgamahesh Manne]

On Saturday, March 30, 2019, David Steele  wrote:

> On 3/29/19 3:32 PM, Durgamahesh Manne wrote:
>
>>
>>I could not find parameter related to pgaudit log_directory  .
>>
>
> pgAudit does not support logging outside the standard PostgreSQL logging
> facility and there are no plans for such a feature.
>
> The general solution is to use Splunk, ELK, etc. to do manipulation of the
> PostgreSQL logs.
>
> Regards,
> --
> -David
> da...@pgmasters.net
>

Hi

Please let me know open source application interface to monitor of pgaudit
logs only
As I have installed pgaudit successfully

Regards

Durgamahesh Manne

Re: Gigantic load average spikes

[Adrian Klaver]

On 3/31/19 8:23 AM, rihad wrote:
Postgres 10.3 On freebsd 10.3 is almost idle, disk i/o about 5-10%, 
number running processes about 1-3, cpu about 90% idle, then we run a 
i/o heavy job like "refresh materialized view", cpu & disk i/o still not 
maxed out, all of a sudden the number of running processes increases to 
about 250-300 for a second, which increases load averages that we 


Do you know what the processes are?

Are there any messages in the Postgres log from that time period that 
might shed light?


periodically poll to see if everything's alright. Why is that? Disk i/o 
is far from being maxed out, the actual number of running processes is 
really small.


You are referring to the between spikes process count?









--
Adrian Klaver
adrian.kla...@aklaver.com

Gigantic load average spikes

[rihad]

Postgres 10.3 On freebsd 10.3 is almost idle, disk i/o about 5-10%, 
number running processes about 1-3, cpu about 90% idle, then we run a 
i/o heavy job like "refresh materialized view", cpu & disk i/o still not 
maxed out, all of a sudden the number of running processes increases to 
about 250-300 for a second, which increases load averages that we 
periodically poll to see if everything's alright. Why is that? Disk i/o 
is far from being maxed out, the actual number of running processes is 
really small.

Re: Required postgreSQL 10.4 version for Suse enterprise

[Adrian Klaver]

On 3/30/19 10:45 PM, Ankit Trivedi wrote:

Dear Adrian,

Thanks for your prompt reply.

But i specifically need 10.4 version.

plz provide me steps or rpm for 10.4


https://zypp.postgresql.org/10/suse/sles-12-x86_64/repoview/postgresql10-server.html

--
Adrian Klaver
adrian.kla...@aklaver.com

Re: Required postgreSQL 10.4 version for Suse enterprise

[Ankit Trivedi]

Dear Adrian,

Thanks for your prompt reply.

But i specifically need 10.4 version.

plz provide me steps or rpm for 10.4

On Sat, Mar 30, 2019, 19:23 Adrian Klaver  wrote:

> On 3/30/19 4:09 AM, Ankit Trivedi wrote:
> >
> > Dear Team,
> >
> > I want to install postgreSQL 10.4 version in my suse linux Enterprise
> > but i am not able to find repo file for version 10.4.
>
> Did you look here?:
>
> https://zypp.postgresql.org/howtozypp.php
>
> >
> > Please help me for the same.
> > Thanks & Regards,
> > *Ankit Trivedi,*
> > Sysem Admin - IT
> > ankit.triv...@nascentinfo.com 
> > +91-9408771306
> > Nascent Info Technologies Pvt. Ltd.
> > *Nascent Info Technologies Pvt. Ltd.*
> > AF-1 ,Shapath IV, Opp. Karnavati Club
> > SG Highway, Ahmedabad - 380 051
> > Tel: +91 79 4032 1200 
> > *www.nascentinfo.com* 
> >
>
>
> --
> Adrian Klaver
> adrian.kla...@aklaver.com
>