Re: could not open file "global/pg_filenode.map": Operation not permitted

2024-03-13 Thread Stephen Frost
Greetings, * Nick Renders (postg...@arcict.com) wrote: > > ...run them under different users on the system. > > Are you referring to the "postgres" user / role? Does that also mean setting > up 2 postgres installation directories? Yes, two separate MacOS user accounts is what I was suggesting.

Re: Create a standby server

2024-03-11 Thread Stephen Frost
Greetings, On Mon, Mar 11, 2024 at 13:33 normandavis1990 wrote: > > On Monday, March 11th, 2024 at 3:43 PM, Stephen Frost < > sfr...@snowman.net> wrote: > > > Greetings, > > > > * normandavis1990 (normandavis1...@proton.me) wrote: > > > > &

Re: Create a standby server

2024-03-11 Thread Stephen Frost
Greetings, * normandavis1990 (normandavis1...@proton.me) wrote: > I have a master and tow standby servers. I want to create another one. These > servers are made by someone else and I am a newbie in PostgreSQL. > I found the following two tutorials: [...] > A) Which on is better and easier?

Re: could not open file "global/pg_filenode.map": Operation not permitted

2024-03-11 Thread Stephen Frost
Greetings, * Nick Renders (postg...@arcict.com) wrote: > The one thing different about this machine however, is that it runs 2 > instances of Postgres: > - cluster A on port 165 > - cluster B on port 164 > Cluster A is actually a backup from another Postgres server that is restored > on a daily

Re: About rsync

2024-03-11 Thread Stephen Frost
Greetings, * Rama Krishnan (raghuld...@gmail.com) wrote: > I have primary and stand by setup in that customer using wal_keep_segment > very low number and database size were also high so that cilent asking with > me in order use pgbase backup can't we use rsyn > > Here my question is if the wal

Re: Thoughts on user-defined types for talk at Postgres conference?

2024-03-06 Thread Stephen Frost
Greetings, * Guyren Howe (guy...@gmail.com) wrote: > Thanks for that! We'd generally prefer that responses are in-line (such as I'm doing here) and not top-posted (as you did on your response). This helps others reading the lists follow the discussion. > It seems as though a Composite Type

Re: Thoughts on user-defined types for talk at Postgres conference?

2024-03-06 Thread Stephen Frost
Greetings, * Guyren Howe (guy...@gmail.com) wrote: > But what *really* sets Postgres apart from comparable systems is user defined > types. I would like to carefully lay out how to define and use a user-defined > type (I don’t think I have time to dig into doing fancy stuff with C > functions,

Re: Unable to get PostgreSQL 15 with Kerberos (GSS) working

2024-03-05 Thread Stephen Frost
Greetings, * Matthew Dennison (m...@matty-uk.co.uk) wrote: > Host file looks like: > > 127.0.0.1 localhost hostname hostname.mydomain.net > ::1 localhost hostname hostname.mydomain.net > 10.204.50.65 hostname hostname.mydomain.net > > I also tried commenting out the ::1 line, but the

Re: Unable to get PostgreSQL 15 with Kerberos (GSS) working

2024-02-29 Thread Stephen Frost
Greetings, * Matthew Dennison (m...@matty-uk.co.uk) wrote: > If I run kinit and get Kerberos ticket ahead of running the command I then > receive: Right, have to kinit first. > psql: error: connection to server at " hostname.mydomain.net " (::1), port > 5432 failed: could not initiate GSSAPI

Re: Unable to get PostgreSQL 15 with Kerberos (GSS) working

2024-02-28 Thread Stephen Frost
Greetings, * Matthew Dennison (m...@matty-uk.co.uk) wrote: > Sorry, yes I tried that and received the same results. Did you try doing a 'klist' after? Would be interesting to know if you got a Kerberos ticket or not. Thanks, Stephen signature.asc Description: PGP signature

Re: Unable to get PostgreSQL 15 with Kerberos (GSS) working

2024-02-28 Thread Stephen Frost
Greetings, * Matthew Dennison (m...@matty-uk.co.uk) wrote: > I have subsequence discovered that the psql command running from remote > Windows (server/client) and RHEL8 works as expected using GSS. PGAdmin4 also > works via Kerberos (was on my list of things to get working). It's just >

Re: Unable to get PostgreSQL 15 with Kerberos (GSS) working

2024-02-26 Thread Stephen Frost
Greetings, * Matthew Dennison (m...@matty-uk.co.uk) wrote: > No matter what I try I don't seem to be able to get the psl command locally > to work using Kerberos. I receive for following message: > FATAL: GSSAPI authentication failed for user "postgres" > FATAL: GSSAPI authentication failed

Re: Initiate backup from routine?

2024-01-18 Thread Stephen Frost
Greetings, * Ron Johnson (ronljohnso...@gmail.com) wrote: > On Wed, Jan 17, 2024 at 9:41 AM Troels Arvin wrote: > > I would like to allow a co-worker to perform a backup of a database, such > > that the backup is saved to the database server itself. One use case is > > that (s)he would like an

Re: Fixing or Mitigating this ERROR: invalid page in block 35217 of relation base/16421/3192429

2023-11-30 Thread Stephen Frost
Greetings, On Thu, Nov 30, 2023 at 02:51 Abdul Qoyyuum wrote: > On Wed, Nov 29, 2023 at 5:53 PM Stephen Frost wrote: > >> * Abdul Qoyyuum (aqoyy...@cardaccess.com.bn) wrote: >> > Knowing that it's a data corruption issue, the only way to fix this is >> to >>

Re: Fixing or Mitigating this ERROR: invalid page in block 35217 of relation base/16421/3192429

2023-11-29 Thread Stephen Frost
Greetings, * Abdul Qoyyuum (aqoyy...@cardaccess.com.bn) wrote: > Knowing that it's a data corruption issue, the only way to fix this is to > vacuum and reindex the database. What was suggested was the following: > > SET zero_damaged_pages = 0; # This is so that we can have the application > to

Re: pgBackRest for a 50 TB database

2023-10-05 Thread Stephen Frost
Greetings, On Thu, Oct 5, 2023 at 03:10 Abhishek Bhola wrote: > Here is the update with compress-type=zst in the config file > Process-max is still 30. *But it longer than before, around 27 hours 50 > mins* > > full backup: 20231004-130621F > timestamp start/stop: 2023-10-04

Re: pgBackRest for a 50 TB database

2023-10-03 Thread Stephen Frost
Greetings, On Mon, Oct 2, 2023 at 20:08 Abhishek Bhola wrote: > As said above, I tested pgBackRest on my bigger DB and here are the > results. > Server on which this is running has the following config: > Architecture: x86_64 > CPU op-mode(s):32-bit, 64-bit > Byte Order:

Re: Will PostgreSQL 16 supports native transparent data encryption ?

2023-09-07 Thread Stephen Frost
Greetings, * Matthias Apitz (g...@unixarea.de) wrote: > message from Stephen Frost mailto:sfr...@snowman.net> > > * Ron (ronljohnso...@gmail.com <mailto:ronljohnso...@gmail.com>) wrote: > > > On 8/21/23 18:49, Bruce Momjian wrote: > > > > On Mon, Aug 21,

Re: Will PostgreSQL 16 supports native transparent data encryption ?

2023-09-07 Thread Stephen Frost
Greetings, * Ron (ronljohnso...@gmail.com) wrote: > On 8/24/23 14:08, Stephen Frost wrote: > > * Ron (ronljohnso...@gmail.com) wrote: > > > On 8/21/23 18:49, Bruce Momjian wrote: > > > > On Mon, Aug 21, 2023 at 07:02:46PM +0300, Mostafa Fathy wrote: > > > &g

Re: pgBackRest for a 50 TB database

2023-08-27 Thread Stephen Frost
Greetings, * Abhishek Bhola (abhishek.bh...@japannext.co.jp) wrote: > I am trying to use pgBackRest for all my Postgres servers. I have tested it > on a sample database and it works fine. But my concern is for some of the > bigger DB clusters, the largest one being 50TB and growing by about >

Re: LDAP Authentication

2023-08-25 Thread Stephen Frost
Greetings, * Dominique Devienne (ddevie...@gmail.com) wrote: > On Thu, Aug 24, 2023 at 10:07 PM Stephen Frost wrote: > > * Emile Amewoto (emil...@yahoo.com) wrote: > > > Here is the high level process: > > > 1- Create the user x without password in Postgres. >

Re: Will PostgreSQL 16 supports native transparent data encryption ?

2023-08-24 Thread Stephen Frost
Greetings, * Ron (ronljohnso...@gmail.com) wrote: > On 8/21/23 18:49, Bruce Momjian wrote: > > On Mon, Aug 21, 2023 at 07:02:46PM +0300, Mostafa Fathy wrote: > > > It is mentioned here https://www.postgresql.org/about/press/faq/#:~:text= > > >

Re: LDAP Authentication

2023-08-24 Thread Stephen Frost
Greetings, * Emile Amewoto (emil...@yahoo.com) wrote: > Here is the high level process: > 1- Create the user x without password in Postgres. > 2- Assign role or roles to the user x > 3- Update pg_hba.conf with the ldap connection link. > > You might need cert for the ldap to connect to AD,

Re: Best strategy to perform individual incremental backups

2023-08-14 Thread Stephen Frost
Greetings, * Mario Diangelo (watisdit...@msn.com) wrote: > We use different Windows servers with Postgresql and looking for the best > strategy to create daily incremental backups to a (managed) volume. We want > to achieve this with scripts and run them daily within the TaskSchedular. > Point

Re: PostgreSQL 14.8 - server fails to start even though all transaction logs with base backup are restored

2023-08-09 Thread Stephen Frost
Greetings, * Meera Nair (mn...@commvault.com) wrote: > The backups we ran were all exclusive backups. You should not use exclusive backups. They've been deprecated for a long, long time and have been removed in the most recent version of PG. You really should not be trying to build your own

Re: PostgreSQL 14.8 - server fails to start even though all transaction logs with base backup are restored

2023-08-08 Thread Stephen Frost
Greetings, * Meera Nair (mn...@commvault.com) wrote: > We are following > https://www.postgresql.org/docs/14/continuous-archiving.html#BACKUP-LOWLEVEL-BASE-BACKUP > Making An Exclusive Low-Level Backup. Exclusive backups have been removed, so you really don't want to be depending on it. >

Re: Difference in the tablespace folders on primary and secondary nodes

2023-07-26 Thread Stephen Frost
Greetings, On Wed, Jul 26, 2023 at 21:31 Abhishek Bhola wrote: > Thank you for the very detailed reply. I tried the above method and it > works. I'm still setting up pgBackRest. > > I have one last question if you can answer that too please. > >> A delta restore will only restore those >> files

Re: Difference in the tablespace folders on primary and secondary nodes

2023-07-26 Thread Stephen Frost
Greetings, * Abhishek Bhola (abhishek.bh...@japannext.co.jp) wrote: > > Basically, this is not a valid way to perform a backup/restore of PG. > > Is it not valid only for PG 15 or even for earlier versions? I have always > referred to this https://www.postgresql.org/docs/8.1/backup-online.html

Re: Error 503 Backend fetch failed

2023-07-25 Thread Stephen Frost
Greetings, * Sabri Taner Burak ALTINDAL (s...@protonmail.com) wrote: > I am interning at a company. I was using Python to download your mail lists, > but it seems that there was an unwanted situation, and you have restricted > access to log in. However, I read that you are not against the

Re: Difference in the tablespace folders on primary and secondary nodes

2023-07-25 Thread Stephen Frost
Greetings, * Abhishek Bhola (abhishek.bh...@japannext.co.jp) wrote: > I recently set up a Postgres15 master-slave (Primary-secondary) cluster on > 2 nodes. At the time of starting, I ensured that data files are exactly the > same on both the nodes. The size of the DB is 1.5TB. > The directory

Re: Requesting Information for GSSAPI

2023-07-12 Thread Stephen Frost
Greetings, * Lingesan Jeyapandy (lingesan.jeyapa...@gilead.com) wrote: > We have configured postgres GSSAPI setup on Linux server. We have huge > domain AD users in our org. > > But we are looking to limit access only to setup AD distributed groups. Is > there any way to control access only

Re: Would PostgreSQL 16 native transparent data encryption support database level encryption?

2023-05-23 Thread Stephen Frost
Greetings, There seems to be a bit of confusion here, so I'll try to clear it up. * Tony Xu (tony...@rubrik.com) wrote: > Thanks all for the discussions. It sounds like there are different > questions to clear before we can get to a conclusion on if per-database KEK > is possible or not. It's

Re: Would PostgreSQL 16 native transparent data encryption support database level encryption?

2023-05-18 Thread Stephen Frost
Greetings, Really, please don't top-post on these lists. * Tony Xu (tony...@rubrik.com) wrote: > Regarding the multiple clusters idea, how does that work? Assume we can > store one customer's data in one cluster, is it possible to have separate > KEK for different clusters? In the proposed TDE

Re: Would PostgreSQL 16 native transparent data encryption support database level encryption?

2023-05-18 Thread Stephen Frost
Greetings, Please don't top-post on these lists. * Tony Xu (tony...@rubrik.com) wrote: > Our use-case is for a multi-tenancy scenario - we are considering using > different databases to store different customer's data, however, for > cost-efficiency, we want to host them in the same server (to

Re: Would PostgreSQL 16 native transparent data encryption support database level encryption?

2023-05-18 Thread Stephen Frost
Greetings, * Tony Xu (tony...@rubrik.com) wrote: > The FAQ (copied below) mentioned that native transparent data encryption > might be included in 16. Is it fair to assume that it will support database > level encryption, that is, we can use two encryption keys for two databases > in the same

Re: Adding SHOW CREATE TABLE

2023-05-12 Thread Stephen Frost
Greetings, * Kirk Wolak (wol...@gmail.com) wrote: > On Fri, May 12, 2023 at 4:37 PM Stephen Frost wrote: > > * Tom Lane (t...@sss.pgh.pa.us) wrote: > > > Stephen Frost writes: > > > > Again, would be great to see someone actually work on this. There's > &

Re: Adding SHOW CREATE TABLE

2023-05-12 Thread Stephen Frost
Greetings, * Tom Lane (t...@sss.pgh.pa.us) wrote: > Stephen Frost writes: > > Again, would be great to see someone actually work on this. There's > > already a good chunk of code in core in pg_dump and in the postgres_fdw > > for doing exactly this and it'd be

Re: Adding SHOW CREATE TABLE

2023-05-12 Thread Stephen Frost
Greetings, * Nathaniel Sabanski (sabansk...@gmail.com) wrote: > > Perhaps a bit more discussion about what exactly the use-case is would > > be helpful- what would you use this feature for? > > App writers: To facilitate table creation and simplify schema verification, > without relying on a GUI

Re: Adding SHOW CREATE TABLE

2023-05-12 Thread Stephen Frost
Greetings, Please don't top-post on these lists. * Nathaniel Sabanski (sabansk...@gmail.com) wrote: > I believe most users would anticipate a CREATE TABLE statement that aligns > with the currently installed version- this is the practical solution for > the vast majority. Perhaps a bit more

Re: Adding SHOW CREATE TABLE

2023-05-12 Thread Stephen Frost
Greetings, * Nathaniel Sabanski (sabansk...@gmail.com) wrote: > HN had a thread regarding the challenges faced by new users during the > adoption of Postgres in 2023. > > One particular issue that garnered significant votes was the lack of a > "SHOW CREATE TABLE" command, and seems like it would

Re: PostgreSQL Mailing list public archives : search not working ...

2023-04-06 Thread Stephen Frost
Greetings, * Imre Samu (pella.s...@gmail.com) wrote: > Theory: Maybe the search doesn't always work ... It does ... but perhaps not as expected (or as ideal). > Is this a known problem? Yes and no. > My use case: > in https://www.postgresql.org/list/ -> "Search the Archives" > search for

Re: R: Proposal: Shared Work Mem Area

2023-04-06 Thread Stephen Frost
Greetings, Please don't top-post on the PG mailing lists, it makes it harder to follow the discussion. * Marco Fortina (marco_fort...@hotmail.it) wrote: > https://commitfest.postgresql.org/42/3867/ is not exacly what I proposed as > new feature to developers. I understood what you were

Re: Proposal: Shared Work Mem Area

2023-04-06 Thread Stephen Frost
Greetings, * Marco Fortina (marco_fort...@hotmail.it) wrote: > I would like to propose to developers a new feature to replace the private > management of the work mem with a management through shared memory: allocated > at the start of PostgreSQL this area should be shared to all worker

Re: can't get psql authentication against Active Directory working

2023-03-12 Thread Stephen Frost
Greetings, * Tomas Pospisek (t...@sourcepole.ch) wrote: > On 25.02.23 00:52, Stephen Frost wrote: > > * Tomas Pospisek (t...@sourcepole.ch) wrote: > > > On 21.02.23 16:29, Stephen Frost wrote: > > > > * Tomas Pospisek (t...@sourcepole.ch) wrote: > > > >

Re: can't get psql authentication against Active Directory working

2023-02-24 Thread Stephen Frost
Greetings, * Tomas Pospisek (t...@sourcepole.ch) wrote: > again thanks a lot for trying to help me! Sure, would like to see it work for you. > On 21.02.23 16:29, Stephen Frost wrote: > > * Tomas Pospisek (t...@sourcepole.ch) wrote: > > > On 20.02.23 15:17, Stephen Frost w

Re: RLS without leakproof restrictions?

2023-02-23 Thread Stephen Frost
Greetings, * Tom Dunstan (pg...@tomd.cc) wrote: > I'm currently researching different strategies for retrofitting some > multi-tenant functionality into our existing Postgres-backed application. > One of the options is using RLS policies to do row filtering. This is quite > attractive as I dread

Re: can't get psql authentication against Active Directory working

2023-02-21 Thread Stephen Frost
Greetings, * Tomas Pospisek (t...@sourcepole.ch) wrote: > On 20.02.23 15:17, Stephen Frost wrote: > > * Tomas Pospisek (t...@sourcepole.ch) wrote: > > > so I'm trying to authenticate psql (on Windows) -> postgres (on Linux) via > > > Active Directory. > > >

Re: can't get psql authentication against Active Directory working

2023-02-20 Thread Stephen Frost
Greetings, * Tomas Pospisek (t...@sourcepole.ch) wrote: > so I'm trying to authenticate psql (on Windows) -> postgres (on Linux) via > Active Directory. Looks like you're trying to do a bit more than that as you're using GSSAPI (not SSPI, which would be the more typical method on Windows..) and

Re: PostgreSQL

2023-02-07 Thread Stephen Frost
Greetings, * Joseph Kennedy (joseph.kennedy@gmail.com) wrote: > Thank you Laurenz, I just wanted to make sure. > > Do you know any alternative solution to RLS ? ... to do what? If you want to limit the set of rows that a given user can see, RLS is how to do that. If you want to limit the

Re: pgbackrest Help Required

2022-09-27 Thread Stephen Frost
Greetings, * Inzamam Shafiq (inzamam.sha...@hotmail.com) wrote: > I am in process of configuring pgbackrest, I have followed documents and > configured backup from backup server. I have a setup of Primary and Hot > Standby, when I configured pgbackrest the standby DB got un-synced and now I >

Re: pgBackRest on MacOS

2022-09-12 Thread Stephen Frost
Greetings, * Ron (ronljohnso...@gmail.com) wrote: > On 9/10/22 07:31, Marc wrote: > >Has anybody pgbackrest running on MacOS ( Monterey ? ) > > > >If yes are you willing to share the how to ? > > > >Or can anybody guide us to an “easy” how to ? > > It's written in Perl, so installation from

Re: Setting up a server with previous day data

2022-08-23 Thread Stephen Frost
Greetings, * Srinivasa T N (seen...@gmail.com) wrote: >I have a primary postgresql 12 server which is being continuously used > for transaction processing. For reporting purposes, I want to set up a > secondary server which has got previous day data. Everyday night, I want > the data from

Re: About revoking large number of privileges; And the PUBLIC role.

2022-07-15 Thread Stephen Frost
Greetings, * Dominique Devienne (ddevie...@gmail.com) wrote: > So my goal is to delete all those "db specific" ROLEs, then the DB > with all its schemas. If you want to drop the database anyway.. then why not simply do that first? Nothing can be connected to a DB that's being dropped and we

Re: Feedback about hybrid SAN snap and rsync'd approach for large systemcloning

2022-04-18 Thread Stephen Frost
Greetings, * Jerry Sievers (gsiever...@comcast.net) wrote: > Suppose we have a DB cluster with an additional tablespace and we are > able to make an atomic SAN snapshot of *only* the main cluster > volume... > > The additional tablespace contains only UNLOGGED relations. > > We cannot snap that

Re: PG12: Any drawback of increasing wal_keep_segments

2022-03-31 Thread Stephen Frost
Greetings, On Thu, Mar 31, 2022 at 12:58 Marc wrote: > On 29 Mar 2022, at 17:17, Stephen Frost wrote: > > Greetings, > >- Alvaro Herrera (alvhe...@alvh.no-ip.org) wrote: > > On 2022-Mar-22, Shukla, Pranjal wrote: > > Are there any disadvantages of increa

Re: PG12: Any drawback of increasing wal_keep_segments

2022-03-29 Thread Stephen Frost
Greetings, * Alvaro Herrera (alvhe...@alvh.no-ip.org) wrote: > On 2022-Mar-22, Shukla, Pranjal wrote: > > Are there any disadvantages of increasing the “wal_keep_segments” to a > > higher number say, 500? Will it have any impact on performance of > > streaming replication, on primary or secondary

Re: WAL Archiving and base backup

2022-01-18 Thread Stephen Frost
Greetings, * David G. Johnston (david.g.johns...@gmail.com) wrote: > On Tue, Jan 18, 2022 at 10:53 AM Stephen Frost wrote: > > We already have pg_receivewal, which is part of pg_basebackup, and is > > able to use a slot and such. I'm not sure that making pg_basebackup > &

Re: WAL Archiving and base backup

2022-01-18 Thread Stephen Frost
Greetings, * David G. Johnston (david.g.johns...@gmail.com) wrote: > On Fri, Jan 14, 2022 at 11:31 AM Stephen Frost wrote: > > * Issa Gorissen (issa-goris...@usa.net) wrote: > > > Thx a lot. I thought about it but was not so sure about having a complex > > > script (

Re: WAL Archiving and base backup

2022-01-14 Thread Stephen Frost
Greetings, * Ron (ronljohnso...@gmail.com) wrote: > On 1/14/22 12:31 PM, Stephen Frost wrote: > >* Issa Gorissen (issa-goris...@usa.net) wrote: > >>Thx a lot. I thought about it but was not so sure about having a complex > >>script (compared to the very simple versi

Re: WAL Archiving and base backup

2022-01-14 Thread Stephen Frost
Greetings, * Issa Gorissen (issa-goris...@usa.net) wrote: > Thx a lot. I thought about it but was not so sure about having a complex > script (compared to the very simple version when using the exclusive backup > - but this this is deprecated...). > > I will test your option with the simpler

Re: ZFS filesystem - supported ?

2021-11-01 Thread Stephen Frost
Greetings, * Lucas (r...@sud0.nz) wrote: > > On 2/11/2021, at 6:00 AM, Stephen Frost wrote: > > * Lucas (r...@sud0.nz) wrote: > >> The snapshots are done this way: > >> 1. Grab the latest applied WAL File for further references, stores that in > >> a var

Re: ZFS filesystem - supported ?

2021-11-01 Thread Stephen Frost
Greetings, * Lucas (r...@sud0.nz) wrote: > > On 27/10/2021, at 8:35 AM, Stephen Frost wrote: > > I do want to again stress that I don't recommend writing your own tools > > for doing backup/restore/PITR and I would caution people against people > > trying to use this a

Re: ZFS filesystem - supported ?

2021-10-26 Thread Stephen Frost
Greetings, * Lucas (r...@sud0.nz) wrote: > On 26/10/2021, at 6:13 AM, Stephen Frost wrote: > > * Mladen Gogala (gogala.mla...@gmail.com) wrote: > >> On 10/23/21 23:12, Lucas wrote: > >>> This has proven to work very well for me. I had to restore a few backups >

Re: ZFS filesystem - supported ?

2021-10-25 Thread Stephen Frost
Greetings, * Mladen Gogala (gogala.mla...@gmail.com) wrote: > On 10/23/21 23:12, Lucas wrote: > >This has proven to work very well for me. I had to restore a few backups > >already and it always worked. The bad part is that I need to stop the > >database before performing the Snapshot, for data

Re: LDAP authorization with postgresql

2021-10-08 Thread Stephen Frost
Greetings, * Keith Brown (keith6...@gmail.com) wrote: > I use GSS for authentication. But I would like to setup LDAP based > authorization, so a user can have access to a particular > database/role/etc...I found documentation on how to setup LDAP but > don't really see any examples for what I am

Re: Can we get rid of repeated queries from pg_dump?

2021-08-29 Thread Stephen Frost
Greetings, * Tom Lane (t...@sss.pgh.pa.us) wrote: > Alvaro Herrera writes: > > Another pointlessly repetitive query is in getTriggers, which we run > > once per table to be dumped containing triggers. We could reduce that > > by running it in bulk for many relations at a time. I suppose it's >

Re: Can we get rid of repeated queries from pg_dump?

2021-08-27 Thread Stephen Frost
Greetings, * Tom Lane (t...@sss.pgh.pa.us) wrote: > Stephen Frost writes: > > * Tom Lane (t...@sss.pgh.pa.us) wrote: > >> I experimented with the attached, very quick-n-dirty patch to collect > >> format_type results during the initial scan of pg_type, instead. On t

Re: Can we get rid of repeated queries from pg_dump?

2021-08-27 Thread Stephen Frost
Greetings, * Tom Lane (t...@sss.pgh.pa.us) wrote: > Laurenz Albe writes: > > On Thu, 2021-08-26 at 18:06 +0200, hubert depesz lubaczewski wrote: > >> In total, there were 5000 queries: > >> SELECT pg_catalog.format_type('[0-9]+'::pg_catalog.oid, NULL) > >> But there were only 83 separate oids

Re: psycopg2 mail list subscription issues

2021-07-13 Thread Stephen Frost
Greetings, * Rich Shepard (rshep...@appl-ecosys.com) wrote: > On Tue, 13 Jul 2021, Tom Lane wrote: > > >Is it possible that you're sending the list request mail out of some other > >IP address? > > tom, > > No. I have a personal domain but use my business domain for all > business-related mail

Re: possible license violations

2021-06-04 Thread Stephen Frost
Greetings, * Bruce Momjian (br...@momjian.us) wrote: > On Thu, Jun 3, 2021 at 06:08:42PM -0400, Tom Lane wrote: > > Bruce Momjian writes: > > > On Thu, Jun 3, 2021 at 09:31:15PM +, tom.beacon wrote: > > >> What is the best contact with whom to discuss possible violations of the > > >>

Re: pgbackrest - hiding the encryption password

2021-05-19 Thread Stephen Frost
Greetings, * Ron (ronljohnso...@gmail.com) wrote: > Currently on our RHEL 7.8 system, /etc/pgbackrest.conf is root:root and 633 > perms.  Normally, that's ok, but is a horrible idea when it's a plaintext > file, and stores the pgbackrest encryption password. > > Would pgbackrest (or something

Re: Approach to creating users in Database

2021-04-27 Thread Stephen Frost
Greetings, * Sanjay Minni (sanjay.mi...@gmail.com) wrote: > what is the usual approach in creating users / role in a postgresql > database serving as the data repository to a hosted multi-tenanted > application with a large number of users. > > the 2 approaches I can think of is > A. The user

Re: enable_seqscan to off -> initial cost 10000000000

2021-04-23 Thread Stephen Frost
Greetings, * Luca Ferrari (fluca1...@gmail.com) wrote: > this could be trivial, but I would like an explaination: if I turn off > sequential scans on a table without indexes, the same access plan is > increased by a 100 factor. I suspect this is a warning for me > to remind that something

Re: LDAP, single sign on from Windows client

2021-04-06 Thread Stephen Frost
Greetings, * chlor (hans.sc...@gmail.com) wrote: > I have a Linux server which is setup with authentication via LDAP against a > Windows A/D. In pg_hba I have > host ... ldap ldapserver=example.org ldapprefix="" ldapsuffix="@example.org" > > The user is also created in PostgreSQL but without a

Re: Encryption of Data Specific to a Tenant in PostgreSQL database | General Idea

2021-02-11 Thread Stephen Frost
Greetings, * Jagmohan Kaintura (jagmo...@tecorelabs.com) wrote: > Yup right now data is being accessed in this manner only. > application access using tenant user only who have specific tenantId in > that session and can see its own data only. It doesn't know about anyone > else's data and

Re: Using more than one LDAP?

2021-01-08 Thread Stephen Frost
Greetings, * Paul Förster (paul.foers...@gmail.com) wrote: > Ok, since LDAP doesn't work that way, I either need to build GSSAPI packages > and have the AD admins to provide me with the keytab file or make the > transition a "hard" one, i.e. no transition phase. Though I'd rather have > liked

Re: LDAP(s) doc misleading

2021-01-06 Thread Stephen Frost
Greetings, * Paul Förster (paul.foers...@gmail.com) wrote: > I found this because I'm in the process of making our Linux LDAP servers > obsolete by reconfiguring PostgreSQL to use our company Windows Active > Directory LDAPS service. When in an Active Directory environment, it's far more

Re: Problem with ssl and psql in Postgresql 13

2020-12-30 Thread Stephen Frost
Greetings, First, thanks a lot for working on all of this and improving things! * Tom Lane (t...@sss.pgh.pa.us) wrote: > I've got one last complaint about the backend GSS code: we are doing > things randomly differently in the two places that install > krb_server_keyfile as the active

Re: Problem with ssl and psql in Postgresql 13

2020-12-23 Thread Stephen Frost
Greetings, * Tom Lane (t...@sss.pgh.pa.us) wrote: > Stephen Frost writes: > > * Tom Lane (t...@sss.pgh.pa.us) wrote: > >> However: it is true (and undocumented, so we have at least a docs bug > >> to fix) that v12-and-later libpq will try for GSS encryption fir

Re: Problem with ssl and psql in Postgresql 13

2020-12-23 Thread Stephen Frost
Greetings, * Tom Lane (t...@sss.pgh.pa.us) wrote: > I wrote: > > Gustavsson Mikael writes: > >> So if i set gssencmode=disable on my pgsql-13 to postgres 13 server > >> connection i get an SSL connection. > > > It looks like, if there is a credentials cache and gssencmode isn't > > explicitly

Re: "Required checkpoints occurs too frequently"

2020-12-11 Thread Stephen Frost
Greetings, * Atul Kumar (akumar14...@gmail.com) wrote: > Please help me in optimizing the same to avoid this alert. Please don't post the same question to multiple lists, nor post the same question over and over to the same list with little time between them. Thanks, Stephen signature.asc

Re: Hot backup in PostgreSQL

2020-10-23 Thread Stephen Frost
Greetings, * Mark Johnson (remi9...@gmail.com) wrote: > User managed backups in PostgreSQL work very similar to what you know from > Oracle. You first place the cluster in backup mode, then copy the database > files, and lastly take the cluster out of backup mode. The first and last > steps are

Re: UUID with variable length

2020-10-16 Thread Stephen Frost
Greetings, * Christophe Pettus (x...@thebuild.com) wrote: > > On Oct 15, 2020, at 13:49, Dirk Krautschick > > wrote: > > Or do you have some other ideas how to use a primary key datatype like UUID > > but with variable length? > > You're probably best off storing it as a VARCHAR() with a

Re: Handling time series data with PostgreSQL

2020-10-07 Thread Stephen Frost
Greetings, * Mark Johnson (remi9...@gmail.com) wrote: > I think the OP may be referring to Oracle's Temporal Validity feature. Perhaps, but that's not the only way to manage time series data. > [ ... ] In earlier releases of each DBMS we tried to accomplish > the same by adding pairs of

Re: Handling time series data with PostgreSQL

2020-10-07 Thread Stephen Frost
Greetings, * Jayaram (jairam...@gmail.com) wrote: > So, Do we need the timescaleDB as mandatory to handle time series data? Is > there any way to handle hourly to days,months,yearly data with PGSQL alone > without timescale addon? Certainly there is and a lot of people do it- what isn't clear is

Re: Autovacuum of independent tables

2020-09-09 Thread Stephen Frost
Greetings, * Michael Holzman (michaelholz...@gmail.com) wrote: > I have two applications A and B. A runs SELECT statements only and only on > tableA. B actively updates tableB, A never looks into tableB. B has nothing > to do with tableA. In an ideal world, such distinct applications would

Re: SSL between Primary and Seconday PostgreSQL DBs

2020-09-03 Thread Stephen Frost
Greetings, * Susan Joseph (sandajos...@verizon.net) wrote: > So I made the changes on the secondary to change the sslmode to verify-fullI > removed the clientcert=1 in pg_hba.conf and removed any connections other > than sslI removed the passfile info from recovery.confand now I am getting >

Re: SSL between Primary and Seconday PostgreSQL DBs

2020-09-03 Thread Stephen Frost
Greetings, We really prefer it if you don't top-post on these lists but instead reply in-line, as I did. * Susan Joseph (sandajos...@verizon.net) wrote: > This is great, thanks.  I have not heard of verify-full but I will try that > and let you know if I have issues. > So I will remove the

Re: SSL between Primary and Seconday PostgreSQL DBs

2020-09-03 Thread Stephen Frost
Greetings, * Susan Joseph (sandajos...@verizon.net) wrote: >- primary_conninfo = 'user=rep_user passfile=''/data/.pgpass'' > host= port=5432 sslmode=verify-ca sslcert=client.crt > sslkey=client.key sslcompression=0 target_session_attrs=any' You really should be using sslmode=verify-full,

Re: has_database_privilege is true?

2020-08-23 Thread Stephen Frost
Greetings, * Paul Förster (paul.foers...@gmail.com) wrote: > > On 23. Aug, 2020, at 16:28, Stephen Frost wrote: > > > > The role attribute system (where you see 'cannot login') is largely > > independent from the GRANT system (which is what has_database_privilege

Re: has_database_privilege is true?

2020-08-23 Thread Stephen Frost
Greetings, * Paul Förster (paul.foers...@gmail.com) wrote: > I create a role "test" and it can't (intentionally) login. But why does > has_database_privilege() return true if "test" can't connect to the cluster > and can't use any database? Is this a bug or am I doing something strange > here?

Re: Database logins taking longer and longer, showing up as "authentication" in ps(1)

2020-08-18 Thread Stephen Frost
Greetings, * Adam Sjøgren (a...@koldfront.dk) wrote: > We have a PostgreSQL 11.3¹ running on an Ubuntu 16.04 server, which > sometimes exhibits a behaviour I can't quite understand: simply logging > into the database starts to take minutes to complete. > > We have 60 processes (workers) running

Re: Point in time recovery

2020-08-18 Thread Stephen Frost
Greetings, Please don't top-post. * Ron (ronljohnso...@gmail.com) wrote: > Search the log file for errors? Sadly, this doesn't actually work if you're really doing PITR- you need to look for the specific message saying "recovery stopping before commit" or similar, eg: 2020-08-18 12:55:31.240

Re: "Go" (lang) standard driver

2020-08-18 Thread Stephen Frost
Greetings, * Olivier Gautherot (ogauthe...@gautherot.net) wrote: > Le mar. 18 août 2020 à 09:36, Tony Shelver a écrit : > > -- Forwarded message - > > From: Tony Shelver > > Date: Tue, 18 Aug 2020 at 09:33 > > Subject: Re: "Go" (lang) standard driver > > To: Edson Richter > > >

Re: pg_basebackup + delta base backups

2020-08-15 Thread Stephen Frost
Greetings, * Christopher Pereira (krip...@imatronix.cl) wrote: > On 26-May-20 10:20, Stephen Frost wrote: > >"out of sync" is a bit of an odd concept, but having a replica fall > >behind a long way is certainly something that can happen and may require > >a rebui

Re: UUID or auto-increment

2020-08-10 Thread Stephen Frost
Greetings, * Israel Brewster (ijbrews...@alaska.edu) wrote: > > On Aug 10, 2020, at 8:53 AM, Stephen Frost wrote: > > * Ron (ronljohnso...@gmail.com) wrote: > >> On 8/10/20 11:38 AM, Ravi Krishna wrote: > >>> Finally UUID results in write amplication in wal logs.

Re: UUID or auto-increment

2020-08-10 Thread Stephen Frost
Greeitngs, * Ron (ronljohnso...@gmail.com) wrote: > On 8/10/20 11:38 AM, Ravi Krishna wrote: > >Finally UUID results in write amplication in wal logs.  Keep that in mind > >if your app does lot of writes. > > Because UUID is 32 bytes, while SERIAL is 4 bytes? and because it's random and so will

Re: privileges oddity

2020-08-06 Thread Stephen Frost
Greetings, * Scott Ribe (scott_r...@elevated-dev.com) wrote: > when user akanzler tries to run query "SELECT * FROM zoewang.sometable...", > it triggers this error: > > 2020-08-06 17:27:27.664 UTC [15914]: [3] > user=akanzler,db=risk_oltp_prod,app=[unknown],client=10.8.170.24: ERROR: >

Re: Safe switchover

2020-07-13 Thread Stephen Frost
Greetings, * Paul Förster (paul.foers...@gmail.com) wrote: > > On 13. Jul, 2020, at 18:00, Stephen Frost wrote: > > Ah, yes, if you rebuild the replica from a backup (or from the primary), > > then sure, that's pretty similar to the pgbackrest delta restore, except > &g

Re: Safe switchover

2020-07-13 Thread Stephen Frost
Greetings, * Paul Förster (paul.foers...@gmail.com) wrote: > > On 13. Jul, 2020, at 17:47, Stephen Frost wrote: > > > > Sure, Patroni will handle the failover fine- but that's not what I was > > referring to. If the server crashes and you have no idea why or what > &

  1   2   3   4   >