Re: pg_restore enhancements

2023-11-22 Thread Ron Johnson
On Wed, Nov 22, 2023 at 2:28 PM Tom Lane wrote: > "Efrain J. Berdecia" writes: > > Thanks, the issue we've run into, which I guess could be really a setup > issue, with running a COPY command while executing pg_restore, is that if > we are restoring a large table (bigger than 500GB) our WAL dire

Re: pg_restore enhancements

2023-11-22 Thread Tom Lane
"Efrain J. Berdecia" writes: > Thanks, the issue we've run into, which I guess could be really a setup > issue, with running a COPY command while executing pg_restore, is that if we > are restoring a large table (bigger than 500GB) our WAL directory can grow to > be very large. > I would think

Re: strange behavior of pg_hba.conf file

2023-11-22 Thread Adrian Klaver
On 11/22/23 10:01 AM, Adrian Klaver wrote: On 11/22/23 9:55 AM, Andreas Kretschmer wrote: Am 22.11.23 um 18:44 schrieb Atul Kumar: I am giving this command psql -d postgres -U postgres -p 5432 -h localhost Then only I get that error. so localhost resolved to an IPv6 - address ... Yeah

Re: strange behavior of pg_hba.conf file

2023-11-22 Thread Adrian Klaver
On 11/22/23 10:03 AM, Atul Kumar wrote: Please can you share any command  for due diligence whether ip is resolved to ipv6 ?. This: psql -d postgres -U postgres -p 5432 -h localhost where pretty sure /etc/hosts is resolving localhost --> ::1 On Wed, Nov 22, 2023 at 11:25 PM Andreas Kre

Re: strange behavior of pg_hba.conf file

2023-11-22 Thread Atul Kumar
Please can you share any command for due diligence whether ip is resolved to ipv6 ?. On Wed, Nov 22, 2023 at 11:25 PM Andreas Kretschmer wrote: > > > Am 22.11.23 um 18:44 schrieb Atul Kumar: > > I am giving this command > > psql -d postgres -U postgres -p 5432 -h localhost > > Then only I get t

Re: strange behavior of pg_hba.conf file

2023-11-22 Thread Adrian Klaver
On 11/22/23 9:55 AM, Andreas Kretschmer wrote: Am 22.11.23 um 18:44 schrieb Atul Kumar: I am giving this command psql -d postgres -U postgres -p 5432 -h localhost Then only I get that error. so localhost resolved to an IPv6 - address ... Yeah, you should take a look at: /etc/hosts In

Re: strange behavior of pg_hba.conf file

2023-11-22 Thread Andreas Kretschmer
Am 22.11.23 um 18:44 schrieb Atul Kumar: I am giving this command psql -d postgres -U postgres -p 5432 -h localhost Then only I get that error. so localhost resolved to an IPv6 - address ... but when I  pass ip or hostname of the local server then I don't get such error message 1. psql

Re: strange behavior of pg_hba.conf file

2023-11-22 Thread Atul Kumar
I am giving this command psql -d postgres -U postgres -p 5432 -h localhost Then only I get that error. but when I pass ip or hostname of the local server then I don't get such error message 1. psql -d postgres -U postgres -p 5432 -h 2. psql -d postgres -U postgres -p 5432 -h I don;t get that

Re: Removing oids with pg_repack

2023-11-22 Thread Achilleas Mantzios
Στις 22/11/23 15:14, ο/η CG έγραψε: On Wednesday, November 22, 2023 at 01:20:18 AM EST, Achilleas Mantzios wrote: Στις 21/11/23 20:41, ο/η CG έγραψε: I have a very large PostgreSQL 9.5 database that still has very large tables with oids. I'm trying to get rid of the oids with as little d

Re: strange behavior of pg_hba.conf file

2023-11-22 Thread Adrian Klaver
On 11/22/23 09:03, Atul Kumar wrote: The entries that I changed were to replace the md5 with scram-sha-256 and remove unnecessary remote IPs. FYI from: https://www.postgresql.org/docs/current/auth-password.html md5 The method md5 uses a custom less secure challenge-response mechanism. I

Re: strange behavior of pg_hba.conf file

2023-11-22 Thread Ron Johnson
The error message is EXPLICIT, and DOES NOT LIE. Either someone removed the ::1 entry, or you're now using IPv6. On Wed, Nov 22, 2023 at 12:03 PM Atul Kumar wrote: > The entries that I changed were to replace the md5 with scram-sha-256 and > remove unnecessary remote IPs. > > But it has nothing

Re: strange behavior of pg_hba.conf file

2023-11-22 Thread Atul Kumar
The entries that I changed were to replace the md5 with scram-sha-256 and remove unnecessary remote IPs. But it has nothing to do with connecting the server locally with "psql -d postgres -U postgres -h localhost" But when I try to connect it locally I get this error. So it is related to local co

Re: pg_restore enhancements

2023-11-22 Thread Efrain J. Berdecia
Thanks, the issue we've run into, which I guess could be really a setup issue, with running a COPY command while executing pg_restore, is that if we are restoring a large table (bigger than 500GB) our WAL directory can grow to be very large. I would think that if the pg_restore or COPY command w

Re: pg_restore enhancements

2023-11-22 Thread Adrian Klaver
On 11/22/23 05:25, Efrain J. Berdecia wrote: After working for a site where we are constantly doing logical pg_dump to refresh environments I've come to miss features available in other RDBMS' refresh/restore utilities. Someone could point me in the right direction otherwise, but pg_restore s

Re: strange behavior of pg_hba.conf file

2023-11-22 Thread Ron Johnson
On Wed, Nov 22, 2023 at 11:22 AM Atul Kumar wrote: > Hi, > > I have postgres 12 running in centos 7, recently I changed the > authentication of entries of pg_hba.conf to scram-sh-256 for localhost. > > I think you changed something else, at the same time. > Since then I have started getting the

Re: strange behavior of pg_hba.conf file

2023-11-22 Thread Adrian Klaver
On 11/22/23 08:21, Atul Kumar wrote: Hi, I have postgres 12 running in centos 7, recently I changed the authentication of entries of pg_hba.conf to scram-sh-256 for localhost. Since then I have started getting the below error: no pg_hba.conf entry for host "::1", user "postgres", database "p

Re: strange behavior of pg_hba.conf file

2023-11-22 Thread Andreas Kretschmer
Am 22.11.23 um 17:21 schrieb Atul Kumar: Since then I have started getting the below error: no pg_hba.conf entry for host "::1", user "postgres", database "postgres What I am missing here, please suggest. that's sounds like an issue with IPv6. Do you use it? Disable it or add an en

Re: General support on postgres replication

2023-11-22 Thread Ron Johnson
On Wed, Nov 22, 2023 at 11:17 AM Vijaykumar Patil < vijaykumar.pa...@maersk.com> wrote: > Hi Team, > > > > Need some support for below issue . > > > > I have created streaming replication with two nodes . > > > > One is primary and 2nd one is standby but after doing any DML or DDL > operation on p

strange behavior of pg_hba.conf file

2023-11-22 Thread Atul Kumar
Hi, I have postgres 12 running in centos 7, recently I changed the authentication of entries of pg_hba.conf to scram-sh-256 for localhost. Since then I have started getting the below error: no pg_hba.conf entry for host "::1", user "postgres", database "postgres The entry of pg_hba.conf is l

Re: Feature request: pg_get_tabledef(text)

2023-11-22 Thread Ron Johnson
On Wed, Nov 22, 2023 at 11:09 AM Laurenz Albe wrote: > On Wed, 2023-11-22 at 16:41 +0100, Hans Schou wrote: > > Similar to pg_get_viewdef() and pg_get_functiondef() it would be useful > with a pg_get_tabledef() to get a full description of how a table is > defined. > > This has been requested bef

Re: Feature request: pg_get_tabledef(text)

2023-11-22 Thread Erik Wienhold
On 2023-11-22 16:41 +0100, Hans Schou wrote: > Similar to pg_get_viewdef() and pg_get_functiondef() it would be useful > with a pg_get_tabledef() to get a full description of how a table is > defined. There's already a discussion on that topic[1]. But I don't know about the current state of devel

General support on postgres replication

2023-11-22 Thread Vijaykumar Patil
Hi Team, Need some support for below issue . I have created streaming replication with two nodes . One is primary and 2nd one is standby but after doing any DML or DDL operation on primary Walreceiver process is terminated on standby and standby database is opening in read write mode. Below a

Re: LibPQ: PQresultMemorySize as proxy to transfered bytes

2023-11-22 Thread Alvaro Herrera
On 2023-Jun-28, Dominique Devienne wrote: > And if there's a better proxy to programmatically know the network > traffic exchanged on the connection's socket, that's cross-platform? > Obviously > libpq itself knows, but I don't see any way to access that info. > > Perhaps tracing might? But will

Configuration knobs & dials to speed up query optimization

2023-11-22 Thread Ron Johnson
Pg 9.6.24, which will change by April, but not now. We've got some huge (2200 line long) queries that are many UNIONs of complicated queries hitting inheritance-partitioned tables. They can't be refactored immediately, and maybe not at all (complicated applications hitting normalized databases ma

Re: Feature request: pg_get_tabledef(text)

2023-11-22 Thread Laurenz Albe
On Wed, 2023-11-22 at 16:41 +0100, Hans Schou wrote: > Similar to pg_get_viewdef() and pg_get_functiondef() it would be useful with > a pg_get_tabledef() to get a full description of how a table is defined. This has been requested before: https://www.postgresql.org/message-id/flat/CAFEN2wxsDSSuOv

Re: Feature request: pg_get_tabledef(text)

2023-11-22 Thread Ron Johnson
On Wed, Nov 22, 2023 at 10:41 AM Hans Schou wrote: > Hi > > Similar to pg_get_viewdef() and pg_get_functiondef() it would be useful > with a pg_get_tabledef() to get a full description of how a table is > defined. > Because there's already pg_get_viewdef(), pg_get_functiondef(), pg_get_constrain

Feature request: pg_get_tabledef(text)

2023-11-22 Thread Hans Schou
Hi Similar to pg_get_viewdef() and pg_get_functiondef() it would be useful with a pg_get_tabledef() to get a full description of how a table is defined. Currently the table definition can be extracted with the command: pg_dump -d foo --schema-only --table=bar | egrep '^[^-]' The psql command

Re: Removing oids with pg_repack

2023-11-22 Thread Tom Lane
CG writes: > I have the fallback position for the Percona ETL strategy. But I feel like > I'm REALLY close with pg_repack and I just don't understand enough about the > system internals to nudge it to correctness and need some expert assistance > to tap it in the hole. The only "system metadat

Re: Removing oids with pg_repack

2023-11-22 Thread Ron Johnson
On Tue, Nov 21, 2023 at 1:43 PM CG wrote: > I have a very large PostgreSQL 9.5 database that still has very large > tables with oids. I'm trying to get rid of the oids with as little downtime > as possible so I can prep the database for upgrade past PostgreSQL 11. I > had a wild idea to mod pg_re

Re: Connection fails on one system in a address range allowed to connect

2023-11-22 Thread Tom Lane
Laurenz Albe writes: > On Tue, 2023-11-21 at 23:27 +, Johnson, Bruce E - (bjohnson) wrote: >> DBI >> connect('dbname=webdata;host=dhbpostgres.pharmacy.arizona.edu;port=5432','trav',...) >> failed: FATAL: password authentication failed for user "trav" >> FATAL: no pg_hba.conf entry for host

Re: pg_restore enhancements

2023-11-22 Thread Efrain J. Berdecia
Thanks, I'm trying to gage the interest on such a feature enhancement.  Up to now I have not actively contributed to the Postgres Project but this is itching my rusty programming fingers lol Thanks,Efrain J. Berdecia On Wednesday, November 22, 2023 at 08:28:18 AM EST, David G. Johnston wro

Re: pg_restore enhancements

2023-11-22 Thread David G. Johnston
On Wednesday, November 22, 2023, Efrain J. Berdecia wrote: > > Thanks in advance for any suggestions or the green light to post this to > the PG-developer group :-) > If you aren’t offering up a patch for these it isn’t developer material and belongs right here. David J.

pg_restore enhancements

2023-11-22 Thread Efrain J. Berdecia
After working for a site where we are constantly doing logical pg_dump to refresh environments I've come to miss features available in other RDBMS' refresh/restore utilities. Someone could point me in the right direction otherwise, but pg_restore seems to be lacking the ability to resume a resto

Re: Removing oids with pg_repack

2023-11-22 Thread CG
On Wednesday, November 22, 2023 at 01:20:18 AM EST, Achilleas Mantzios wrote: Στις 21/11/23 20:41, ο/η CG έγραψε: I have a very large PostgreSQL 9.5 database that still has very large tables with oids. I'm trying to get rid of the oids with as little downtime as possible so I

Re: PITR

2023-11-22 Thread Andreas Kretschmer
Am 22.11.23 um 11:50 schrieb Ron Johnson: On Wed, Nov 22, 2023 at 3:12 AM Rajesh Kumar wrote: How do I do PITR. Backup strategy is weekly full backup and daily differential backup. Using pgbackrest. Also. In future how do i monitor time of drop commands. https://blog.hagan

Re: PITR

2023-11-22 Thread Ron Johnson
On Wed, Nov 22, 2023 at 3:12 AM Rajesh Kumar wrote: > Hi > > A person dropped the table and don't know time of drop. > Revoke his permission to drop tables? > How do I do PITR. Backup strategy is weekly full backup and daily > differential backup. Using pgbackrest. > > Also. In future how do i

Re: Connection fails on one system in a address range allowed to connect

2023-11-22 Thread Laurenz Albe
On Tue, 2023-11-21 at 23:27 +, Johnson, Bruce E - (bjohnson) wrote: > DBI > connect('dbname=webdata;host=dhbpostgres.pharmacy.arizona.edu;port=5432','trav',...) > failed: FATAL: password authentication failed for user "trav" > FATAL: no pg_hba.conf entry for host "150.135.124.50", user "tra

Re: Connection fails on one system in a address range allowed to connect

2023-11-22 Thread Inzamam Shafiq
you need to allow connection from this IP in your pg_hba file and reload the configurations. From: Johnson, Bruce E - (bjohnson) Sent: Wednesday, November 22, 2023 4:27 AM To: pgsql-general@lists.postgresql.org Subject: Connection fails on one system in a address

Connection fails on one system in a address range allowed to connect

2023-11-22 Thread Johnson, Bruce E - (bjohnson)
I am migrating an existing web application from Oracle to postgres and I’m testing the connectivity. Trying to run a test program (that works on another system in the same subnet!) I get this error: Error system: [root@dhbroomscheduling4 ~]# ./pg_test.pl DBI connect('dbname=webdata;host=dhbp