Re: How to recover from compressed wal archieve in windows

2020-05-21 Thread Andrus
Hi! Will wal_compression=on will produce compressed wal files to additional compression is not needed? Yes. Not sure how it will play with the streaming that pg_receivewal does. I looked into WAL files created with wal_compression=on in pg_wal directory. They still contain lot of ascii data

Re: How to recover from compressed wal archieve in windows

2020-05-20 Thread Michael Paquier
On Thu, May 21, 2020 at 01:38:11PM +0900, Kyotaro Horiguchi wrote: > Difference from decompression by restore_command? > > A WAL (segment) file is filled with multiple WAL records. The "full > page image", which is described to be compressed by the parameter, is > a part of WAL record. A WAL file

Re: How to recover from compressed wal archieve in windows

2020-05-20 Thread Kyotaro Horiguchi
At Thu, 21 May 2020 06:55:41 +0200, Paul Förster wrote in > Hi Adrian, > > > On 21. May, 2020, at 01:03, Adrian Klaver wrote: > > > > Yeah, the issue would be getting a version of gunzip that works on Windows. > > In the past I have had luck with: > > > > https://www.7-zip.org/ > > > >

Re: How to recover from compressed wal archieve in windows

2020-05-20 Thread Paul Förster
Hi Adrian, > On 21. May, 2020, at 01:03, Adrian Klaver wrote: > > Yeah, the issue would be getting a version of gunzip that works on Windows. > In the past I have had luck with: > > https://www.7-zip.org/ > > Not sure how well it works with redirects/pipes. I'm no windoze guru, so I don't

Re: How to recover from compressed wal archieve in windows

2020-05-20 Thread Kyotaro Horiguchi
At Wed, 20 May 2020 19:25:50 -0700, Adrian Klaver wrote in > On 5/20/20 6:27 PM, Michael Paquier wrote: > > On Wed, May 20, 2020 at 11:36:09AM -0700, Adrian Klaver wrote: > >> The next problem is that I'm pretty sure a WAL file with *.gz > >> extension will > >> not be able to be processed

Re: How to recover from compressed wal archieve in windows

2020-05-20 Thread Adrian Klaver
On 5/20/20 6:27 PM, Michael Paquier wrote: On Wed, May 20, 2020 at 11:36:09AM -0700, Adrian Klaver wrote: The next problem is that I'm pretty sure a WAL file with *.gz extension will not be able to be processed directly by the server. So you are going to have to uncompress it at some point

Re: How to recover from compressed wal archieve in windows

2020-05-20 Thread Michael Paquier
On Wed, May 20, 2020 at 11:36:09AM -0700, Adrian Klaver wrote: > The next problem is that I'm pretty sure a WAL file with *.gz extension will > not be able to be processed directly by the server. So you are going to have > to uncompress it at some point before it gets restored. The short answer

Re: How to recover from compressed wal archieve in windows

2020-05-20 Thread Adrian Klaver
On 5/20/20 12:09 PM, Andrus wrote: Hi! I'm guessing: restore_command='copy "D:\\wallog\\%f.gz" "%p"' will get you the file. The next problem is that I'm pretty sure a WAL file with *.gz extension will not be able to be processed directly by the server. So you are going to have to uncompress

Re: How to recover from compressed wal archieve in windows

2020-05-20 Thread Adrian Klaver
On 5/20/20 11:43 AM, Paul Förster wrote: Hi Andrus, hi Adrian, see: 25.3.6.2. Compressed Archive Logs https://www.postgresql.org/docs/12/continuous-archiving.html#BACKUP-TIPS Hope this helps in dealing with compressed WAL files. Yeah, the issue would be getting a version of gunzip that

Re: How to recover from compressed wal archieve in windows

2020-05-20 Thread Andrus
Hi! I'm guessing: restore_command='copy "D:\\wallog\\%f.gz" "%p"' will get you the file. The next problem is that I'm pretty sure a WAL file with *.gz extension will not be able to be processed directly by the server. So you are going to have to uncompress it at some point before it gets

Re: How to recover from compressed wal archieve in windows

2020-05-20 Thread Paul Förster
Hi Andrus, hi Adrian, see: 25.3.6.2. Compressed Archive Logs https://www.postgresql.org/docs/12/continuous-archiving.html#BACKUP-TIPS Hope this helps in dealing with compressed WAL files. Cheers, Paul > On 20. May, 2020, at 20:36, Adrian Klaver wrote: > > On 5/20/20 8:08 AM, Andrus wrote:

Re: How to recover from compressed wal archieve in windows

2020-05-20 Thread Adrian Klaver
On 5/20/20 8:08 AM, Andrus wrote: In windows 10 pg_receivewal --directory="d:\wallog" --verbose --compress=9 is used to archieve WAL. This creates .gz files For restore restore_command='copy "D:\\wallog\\%f" "%p"' I'm guessing: restore_command='copy "D:\\wallog\\%f.gz" "%p"' will get you