Re: Pgbackrest failure for INCR and DIFF but not FULL backup

On Wed, May 7, 2025 at 6:46 PM Greg Sabino Mullane wrote: > On Wed, May 7, 2025 at 7:15 AM KK CHN wrote: > >> *archive_command = 'pgbackrest --stanza=My_Repo archive-push %p && cp %p >> /data/archive/%f' * >> > > Don't do this. You are archiv

Pgbackrest failure for INCR and DIFF but not FULL backup

Hi folks, I am facing a strange issue, Pgbackrest backup fails for DIFF or INCR backups but not Full backup, with the * error WAL file cannot be archived before 6 ms timeout.* The pgbackrest " *stanza check* " command *sometimes succeeds, but sometimes fails.* I don't know why * PG is u

checkpoint_timeout parameter & WAL archive delay, pgbackrest fails

Hi folks, My pgbackrest backup on one of my RepoServer fails. The backup fails some times with the error WAL file cannot be archived before 6 ms timeout. The pgbackrest stanza check command is sometimes successful, but sometimes fails. I don't know whyPG is unable to copy WAL fi

Re: Pgbackrest : Resumable backup of same type exists

Thanks for the helpful hints. The backup finished successfully : 20250425-115723F timestamp start/stop: 2025-05-01 09:31:36+05:30 / 2025-05-01 14:13:08+ The log doesn't show anything other than (025-05-01 09:30:16.377 P00 WARN: resumable backup 20250425-115723F of same type exists -

Pgbackrest : Resumable backup of same type exists

Hi, Due to a backup failure in my Reposerver, the storage disk ran out of space, fixed later. I reschedule the cron job to take a full backup but it show for the last 3 hours 025-05-01 09:30:16.377 P00 WARN: resumable backup 20250425-115723F of same type exists -- invalid files will be removed

pgbackrest with two remote backend servers fails

Folks, I am able to perfectly run pgbackrest with Single RepoServer works fine. ( Stanza My_Repo created successfully, info Check runs successfully , backup perfectly works) [ PG 16 server(10.1.2.202) , RHEL9.4, Pgbackrest 2.52.1) backup to remote repo server1 (IP 10.x.4.242, ). works fi

Re: Pgbackrest fails due after an ISP change

d go wrong) , please correct/guide me Thank you, Krishane On Mon, Apr 21, 2025 at 9:49 PM Greg Sabino Mullane wrote: > > > On Mon, Apr 21, 2025 at 9:03 AM KK CHN wrote: > >> >> ERROR: [082]: WAL segment 000102200038 was not archived >> before the

Pgbackrest fails due after an ISP change

List, I am running a pgbackrest(2.52.1) backup setup for a postgres(16) server(RHEL9.4) to a repo server RHEL 9.4.. The pgbackrest was working fine and the remote repo server got regular backups through cron scheduler. Suddenly there was an ISP change at our end, the VPN tunnel between DB s

PgBackRest fails due to filesystem full

List, I am running PgbackRest-2.52.1 on RHEL9.3 and EDB16 to backup to a remote repo server . Everything was working fine and backups were regularly taken with cron scheduler daily. But due to a / partition full 100 % utilization, the pgbackrest backup failed the other day. I came t

Re: PgBackRest fails due to filesystem full

On Tue, Apr 8, 2025 at 10:28 PM Greg Sabino Mullane wrote: > On Mon, Apr 7, 2025 at 5:32 AM KK CHN wrote: > >> *ERROR: [082]: WAL segment 000101EB00*4B was not archived >> before the 6ms timeout >> > > This is the part you need to focus on. Look

Long Running query and trace potential issues

List postgres=# SELECT PID, now() - pg_stat_activity.query_start AS duration, query, state FROM pg_stat_activity WHERE (now() - pg _stat_activity.query_start) > interval '5 minutes' AND state = 'active'; pid |duration | query | state --+--

Postgres performance issue with High CPU usage

List, Could someone point out how can I trace what causes the edb-postgres process with %CPU usage reaching 73 to 80.1 percentage in this box. What's wrong with the server VM.. The clients connecting the databases experience slow responses .. The top out put of the DB server is pasted below

WAL replication standby server: query

List , I am trying to configure a WAL replicated standby server(EDB16) .. In the archive command I used a dedicated "/data/archive " directory for WAL archiving as follows, as I don't want any WAL overwriting in the default WAL directory and loss of WAL files. I have archive_command= ' c

Re: CLOSE_WAIT pileup and Application Timeout

On Mon, Oct 7, 2024 at 12:07 AM Alvaro Herrera wrote: > On 2024-Oct-04, KK CHN wrote: > > > The mobile tablets are installed with the android based vehicle > > tracking app which updated every 30 seconds its location fitted inside > the > > vehicle ( lat long coordi

Re: CLOSE_WAIT pileup and Application Timeout

On Fri, Oct 4, 2024 at 9:17 PM Adrian Klaver wrote: > On 10/3/24 21:29, KK CHN wrote: > > List, > > > > I am facing a network (TCP IP connection closing issue) . > > > > Running a mobile tablet application, Android application to update the > > status of

CLOSE_WAIT pileup and Application Timeout

List, I am facing a network (TCP IP connection closing issue) . Running a mobile tablet application, Android application to update the status of vehicles fleet say around 1000 numbers installed with the app on each vehicle along with a vehicle tracking application server solution based on Ja

PgBackRest : Restore to a checkpoint shows further transactions

List, PgBackRest : I tried to restore the latest backup taken at my RepoServer to a testing EPAS server freshly deployed . I have a full backup, two diff and one INCR as on today morning. The latest one is INCR full backup: 20240922-232733F timestamp start/stop: 2024-09-2

PgBackRest and WAL archive expiry

List, I successfully configured pgbackrest (pgBackRest 2.52.1) on RHEL 9.4 with EPAS 16.1 for a couple of production servers and a Remote Repo Server. Seems everything is working as expected. I have a serious concern of archive dir growing day by day.. 1. In the EPAS serverI have postg

Re: ssh to DB server and su normal users very slow :

update : the ssh -v root@db_Server_IP from my Windows cmd pasted below for more details On Mon, Sep 9, 2024 at 4:50 PM KK CHN wrote: > List, > > I have configured pgbackrest for the DB server and Repo Server(created the > stanza info check all fine. in these machines

ssh to DB server and su normal users very slow :

List, I have configured pgbackrest for the DB server and Repo Server(created the stanza info check all fine. in these machines. /var/spool/pgbackrest shows the .Okfor each WAL and the Repo server receiving the archiving of WAL in the archive directory . I didn't schedule a pgbackre

PgBackRest full backup first time : Verification

List, pgbackrest backup what all the directories and files PgBackRest will backup to RepoServer when performing backup using PgBackRest. ( Because of a limited infr ( N/W bandwidth 8Mbps between DB Server and RepoServer) . 1. I am not sure the pgbackrest command finished output message in t

PgBackRest Ideal N/W need to provisioned ?

List, I am doing a full backup using PgBackRest from a production server to Reposerver. My connection is IPSec VPN over ILL ( 8 Mbps link) between the Production DB Server and the remote RepoServer. I understood the bottleneck of 8 Mbps between servers. (Server NICs 10Gbps and switch 10G)

Re: PgBackRest Full backup and N/W reliability

On Thu, Aug 29, 2024 at 6:54 PM Greg Sabino Mullane wrote: > On Thu, Aug 29, 2024 at 2:21 AM KK CHN wrote: > >> I am doing a full backup using PgBackRest from a production server to >> Reposerver. >> > ... > >> If so, does the backup process start again fro

PgBackRest client_loop: send disconnect: Connection reset

List, I am facing an Error : on a connection reset while PgBackRest is doing backup process for DB server to Repo Server. But the reissue of the pgbackrest backup command fails as follows... "Unable to acquire lock on file '/tmp/pgbackrest/Repo-backup.lock': Resource temporarily unavaila

PgBackRest Full backup and N/W reliability

List, I am doing a full backup using PgBackRest from a production server to Reposerver. My connection is IPSec VPN over ILL ( 8 Mbps link) between the Production DB Server and the remote RepoServer. I understood the bottleneck of 8 Mbps between servers. (Server NICs 10Gbps and switch) Que

Re: PgbackRest : Stanza creation fails on DB Server and Repo Server

t 28, 2024, Amitabh Kant wrote: > >> On Wed, Aug 28, 2024 at 8:00 PM David G. Johnston < >> david.g.johns...@gmail.com> wrote: >> >>> On Wednesday, August 28, 2024, KK CHN wrote: >>> >>>> >>>> and I have .pgpass in DB server as

PgbackRest stanza creation : on DB server or both DB and Repo server ?

List, I am configuring the Pgbackrest ( RHEL9.4 , EPAS 16 , PgbackRest 2.52.1 ) on two servers.(Database cluster server and Repo Server). Query.1 Do I need to create stanza on both servers ( DB server EPAS16 User : enterprisedb,as well as on RepoServer user: postgres ) 1.

PgbackRest : Stanza creation fails on DB Server and Repo Server

I am trying pgbackrest config on a Production Server and a Repo server ( RHEL 9.4 EPAS 16 , pgbackrest 2.52.1 I have configured pbbackrest.conf on both machines as per the official docs. >From b*oth machines password less auth works for the db user *(enterprisedb ) and repouser(postgres) .

Re: Pgbackrest specifying the default DB necessary/correct way ?

Very helpful. On Wed, Aug 28, 2024 at 5:51 PM Greg Sabino Mullane wrote: > On Wed, Aug 28, 2024 at 1:39 AM KK CHN wrote: > >> In this DB serverI have other databases than the default "edb" >> database. Specifying the above line aspg1-database=edb /

Pgbackrest specifying the default DB necessary/correct way ?

List, I have configured the pgbackrest on a live DB server and a Repo Server. ( EPAS 16, RHEL 9.4 and Pgbackrest 2.52.1 ) On DB Server I have ## [root@db1 ~]# cd [root@db1 ~]# cat /etc/pgbackrest/pgbackrest.conf [Demo_Repo] pg1-path=/data/edb/as16/data pg1-port=5444

pgbackrest restore with a checkpoint and timestamp after the checkpoint

List, Query: Can I perform a pgbackrest restore with the last backup diff or incr + further transactions in the WAL replayed to restore the transactions that happened after the last pgbackrest backup checkpoint ? Scenario: I am trying to perform this and unable to get a solution. I h

WAL replication and Archive command for pgbackrest on same server conf

Hi List , I am trying to configure the pgbackrest on a live server ( RHEL9, EPAS16 and Pgbacrest .2.52) which is having a working WAL archive configuration to a standby server in postgresql.conf as follows 1. archive_mod =on 2. archive_level=replica 3. archive_command = 'cp %p /data/archive

Re: PgBackRest PTR recovery: After table drop to get dropped state

te another one, insert some data, do whatever to have > another transaction in WALs. > > Cheers, > Mateusz > > czw., 1 sie 2024 o 12:23 KK CHN napisał(a): > >> The logs are here. >> >> https://pastecode.io/s/s5dp8ur1 >> >> >> >> On Thu,

Re: PgBackRest PTR recovery: After table drop to get dropped state

sorry ignore the previous paste , was in complete Here the full one. https://pastecode.io/s/hya0fyvo On Thu, Aug 1, 2024 at 4:02 PM KK CHN wrote: > The logs are here. > > https://pastecode.io/s/s5dp8ur1 > > > > On Thu, Aug 1, 2024 at 3:30 PM Kashif Zeeshan > wro

Re: PgBackRest PTR recovery: After table drop to get dropped state

The logs are here. https://pastecode.io/s/s5dp8ur1 On Thu, Aug 1, 2024 at 3:30 PM Kashif Zeeshan wrote: > Hi > > On Thu, Aug 1, 2024 at 2:54 PM KK CHN wrote: > >> List, >> >> *Not working (start EPAS server always fails):* >> >> 1. Testing PTR us

PgBackRest PTR recovery: After table drop to get dropped state

List, *Not working (start EPAS server always fails):* 1. Testing PTR using PgBackRest(2.52.1) on RHEL9 EPAS-16, and RHEL9 ( Repo Server) When I do a PTR 1. After doing a table drop and then 2. Noting down the time stamp and then 3. Taking an incremental backup in hope that If I do a

Re: PgbackRest PointTIme Recovery : server unable to start back

onf as this archive_mode = on archive_command = 'pgbackrest --stanza=Demo_Repo archive-push %p' log_filename = 'postgresql.log' max_wal_senders = 5 wal_level = replica Any help ? Krishane On Fri, Jul 26, 2024 at 10:45 AM Muhammad Ikram wrote: > Hi KK CHN > > Could you

PgbackRest PointTIme Recovery : server unable to start back

List, Reference: https://pgbackrest.org/user-guide-rhel.html#pitr I am following the PTR on RHEL9 EPAS16. I am able to do a backup(Full, diff and incr) and restore from a full backup and restart of EPAS16 works fine. But when I do an incremental backup after doing the procedures mentio

pgBackRest for multiple production servers

Hi list , I am exploring the PgBackRest tool for production deployment. ( My lab setup with one Database server and another Reposerver deployed working fine as in the official docs) Query: What may be the standard practice employed to backup multiple production servers to one RepoServer ? (

Re: PgbackRest and EDB Query

re currently trying through following command, without specifying > an ssh key for passwordless connection. > > From the EDB Postgres Advanced Server nodes > $ sudo -u enterprisedb ssh pgbackrest@backup-server > > > > > On Fri, Jul 19, 2024 at 10:06 AM Kashif Zeeshan >

Re: PgbackRest and EDB Query

I am not sure where to create .ssh dir and authorized_keys for passwordless auth ) Any one who has already tackled this kindly guide me on how to achieve this . Thank you, Krishane On Wed, Jul 17, 2024 at 9:07 PM Kashif Zeeshan wrote: > Hi > > On Wed, Jul 17, 2024 at 5:21 PM KK

PgbackRest and EDB Query

Hi , I am trying pgbackrest(2.52.1) with postgresql( version 16) on a lab setup on RHEL-9. Both PostgreSQL server and a remote Repository host configured with pgbackrest and everything working fine as specified in the documentation. note: here I am running postgres server and pgbackrest ever

Re: pgBackRest on old installation

< a.mantz...@cloud.gatewaynet.com> wrote: > > On 11/20/23 12:31, KK CHN wrote: > > list, > > I am trying pgBackRest on an RHEL 7.6 and old EDB 10 database cluster( a > legacy application.) > > I have installed pgbackrest through package install on RHEL7.6 >

pgBackRest on old installation

list, I am trying pgBackRest on an RHEL 7.6 and old EDB 10 database cluster( a legacy application.) I have installed pgbackrest through package install on RHEL7.6 But unable to get the basic stanza-creation working It throws an error. * /etc/pgbackrest.conf as follows..* #

capacity planning question

Hi, I am in need of an infrastructure set up for data analytics / live video stream analytics application using big data and analytics technology.. The data is basically right now stored as structured data(no video streaming) in PostgresDatabase. ( Its an emergency call handling solution, In

Re: pgBackRest for a 50 TB database

Greetings, Happy to hear you successfully performed pgBackRest for a 50TB DB. Out of curiosity I would like to know your infrastructure settings. 1. The connectivity protocoal and bandwidth you used for your backend storage ? Is it iSCSI, FC FCoE or GbE ? what's the exact reason for the 26 H

Re: DB Server slow down & hang during Peak hours of Usage

>> >> Also check the logs, postgres tells his life there... >> >> >> >> >> >> Marc MILLAS >> Senior Architect >> +33607850334 >> www.mokadb.com >> >> >> Thank you all for your time and the valuable inputs to fix the

Re: My 1st TABLESPACE

On Mon, Aug 7, 2023 at 5:47 PM Amn Ojee Uw wrote: > Thanks Negora. > > Makes sense, I will check it out. > > On 8/7/23 1:48 a.m., negora wrote: > > Hi: > > Although the "postgres" user owns the "data" directory, Has he access to > the whole branch of directories? Maybe the problem is that he can'

DB Server slow down & hang during Peak hours of Usage

List , *Description:* Maintaining a DB Server Postgres and with a lot of read writes to this Server( virtual machine running on ESXi 7 with CentOS 7) . ( I am not sure how to get the read / write counts or required IOPS or any other parameters for you. If you point our I can execute those com

Re: Backup Copy of a Production server.

On Mon, Aug 7, 2023 at 10:49 AM Ron wrote: > On 8/7/23 00:02, KK CHN wrote: > > List, > > I am in need to copy a production PostgreSQL server data( 1 TB) to an > external storage( Say USB Hard Drive) and need to set up a backup server > with this data dir. > > Wh

Backup Copy of a Production server.

List, I am in need to copy a production PostgreSQL server data( 1 TB) to an external storage( Say USB Hard Drive) and need to set up a backup server with this data dir. What is the trivial method to achieve this ?? 1. Is Sqldump an option at a production server ?? ( Will this affect the serv

EDB to Postgres Migration

List, Recently I happened to have managed a few EDB instances running on the EDB-10 version . I am looking for an option for migrating all these EDB instances to Postgres Community edition. 1. What major steps / actions involved ( in bird's eye view ) for a successful migration to postgres

BI Reports and Postgres

List, 1. For generating BI reports, which Databases are more suitable ( RDBMS like Postgres OR NoSQL like MongoDB ) ? Which is best? Why ? 2. Is NoSQL DBs like MongoDB et all useful in which scenarios and application context ? or NoSQLs are losing the initial hype ? 3. Could someone point out

PostgreSQL Server Hang​

*Description of System: * 1. We are running a Postgres Server (version 12, on CentOS 6) for an emergency call attending and vehicle tracking system fitted with mobile devices for vehicles with navigation apps for emergency service. 2. vehicles every 30 Seconds sending location coordinates( Lat