Re: Using base backup exclusion filters to reduce data transferred with pg_rewind

2018-03-28 Thread Michael Paquier
On Thu, Mar 29, 2018 at 05:01:40AM +0900, Fujii Masao wrote: > Committed. Thanks! Thanks for including as well the documentation changes and committing it. The result looks good to me. -- Michael signature.asc Description: PGP signature

Re: Using base backup exclusion filters to reduce data transferred with pg_rewind

2018-03-28 Thread Fujii Masao
On Wed, Mar 28, 2018 at 7:54 AM, Michael Paquier wrote: > On Wed, Mar 28, 2018 at 04:13:25AM +0900, Fujii Masao wrote: >> This code is almost ok in practice, but using the check of >> "strstr(path, localpath) == path" is more robust here? > > No problems with that either. > >> Using the following

Re: Using base backup exclusion filters to reduce data transferred with pg_rewind

2018-03-27 Thread Michael Paquier
On Wed, Mar 28, 2018 at 04:13:25AM +0900, Fujii Masao wrote: > This code is almost ok in practice, but using the check of > "strstr(path, localpath) == path" is more robust here? No problems with that either. > Using the following code instead is more robust? > This original code is almost ok in

Re: Using base backup exclusion filters to reduce data transferred with pg_rewind

2018-03-27 Thread Fujii Masao
On Tue, Mar 27, 2018 at 10:55 AM, Michael Paquier wrote: > On Tue, Mar 27, 2018 at 01:32:41AM +0900, Fujii Masao wrote: >> +1. It's better for us to focus on the code change of the fillter on >> pg_rewind >> rather than such "refactoring". > > (filter takes one 'l', not two) > > Okay. I had my m

Re: Using base backup exclusion filters to reduce data transferred with pg_rewind

2018-03-26 Thread Michael Paquier
On Sat, Mar 24, 2018 at 09:12:09PM -0400, Stephen Frost wrote: > Yeah, neither 2 or 3 really appeals to me. Option 1 does touch a number > of places but in a pretty straight-forward way- and if there's a typo > there, the compiler is likely to complain, so it seems like the risk is > relatively lo

Re: Using base backup exclusion filters to reduce data transferred with pg_rewind

2018-03-26 Thread Michael Paquier
On Tue, Mar 27, 2018 at 01:32:41AM +0900, Fujii Masao wrote: > +1. It's better for us to focus on the code change of the fillter on pg_rewind > rather than such "refactoring". (filter takes one 'l', not two) Okay. I had my mind mostly focused on how to shape the exclusion list and get it shared

Re: Using base backup exclusion filters to reduce data transferred with pg_rewind

2018-03-26 Thread Fujii Masao
On Sun, Mar 25, 2018 at 5:06 PM, Michael Paquier wrote: > On Sat, Mar 24, 2018 at 11:14:34PM -0400, Tom Lane wrote: >> Stephen Frost writes: >>> I don't completely buy off on the argument that having these #define's >>> would make it easier for forks (we've had quite a few folks fork PG, but >>>

Re: Using base backup exclusion filters to reduce data transferred with pg_rewind

2018-03-25 Thread Stephen Frost
Greetings, * Michael Paquier (mich...@paquier.xyz) wrote: > On Sat, Mar 24, 2018 at 11:14:34PM -0400, Tom Lane wrote: > > Stephen Frost writes: > >> I don't completely buy off on the argument that having these #define's > >> would make it easier for forks (we've had quite a few folks fork PG, but

Re: Using base backup exclusion filters to reduce data transferred with pg_rewind

2018-03-25 Thread Michael Paquier
On Sat, Mar 24, 2018 at 11:14:34PM -0400, Tom Lane wrote: > Stephen Frost writes: >> I don't completely buy off on the argument that having these #define's >> would make it easier for forks (we've had quite a few folks fork PG, but >> how many of them have actually changed "base"?) and I'm on the

Re: Using base backup exclusion filters to reduce data transferred with pg_rewind

2018-03-24 Thread Tom Lane
Stephen Frost writes: > I don't completely buy off on the argument that having these #define's > would make it easier for forks (we've had quite a few folks fork PG, but > how many of them have actually changed "base"?) and I'm on the fence > about if these will make our lives simpler down the roa

Re: Using base backup exclusion filters to reduce data transferred with pg_rewind

2018-03-24 Thread Stephen Frost
Greetings, * Michael Paquier (mich...@paquier.xyz) wrote: > On Fri, Mar 23, 2018 at 01:38:38AM +0900, Fujii Masao wrote: > > Personally it looks very intrusive, so I'm feeling inclined to push > > the changes without that refactoring. I've been reading over the first couple of posted patches and

Re: Using base backup exclusion filters to reduce data transferred with pg_rewind

2018-03-22 Thread Michael Paquier
On Fri, Mar 23, 2018 at 01:38:38AM +0900, Fujii Masao wrote: > Personally it looks very intrusive, so I'm feeling inclined to push > the changes without that refactoring. Okay. Just moving the list of items from basebackup.c to a dedicated header is not sufficient though as things like RELCACHE_I

Re: Using base backup exclusion filters to reduce data transferred with pg_rewind

2018-03-22 Thread Fujii Masao
On Tue, Mar 13, 2018 at 9:48 PM, Michael Paquier wrote: > On Tue, Mar 13, 2018 at 01:16:27PM +0300, Anastasia Lubennikova wrote: >> Since these patches contain mostly cosmetic changes and do not break >> anything, I think it's fine to mark this thread as Ready For Committer >> without long discuss

Re: Using base backup exclusion filters to reduce data transferred with pg_rewind

2018-03-13 Thread Michael Paquier
On Tue, Mar 13, 2018 at 01:16:27PM +0300, Anastasia Lubennikova wrote: > Since these patches contain mostly cosmetic changes and do not break > anything, I think it's fine to mark this thread as Ready For Committer > without long discussion. Thanks Anastasia for the review. The refactoring is qui

Re: Using base backup exclusion filters to reduce data transferred with pg_rewind

2018-03-13 Thread Anastasia Lubennikova
05.02.2018 10:10, Michael Paquier: So the patch set attached is made of the following: - 0001, which refactors all hardcoded system paths into pg_paths.h. This modifies only initdb.c and basebackup.c to ease reviews. - 0002 spreads the path changes and the use of pg_paths.h across the core code.

Using base backup exclusion filters to reduce data transferred with pg_rewind

2018-02-04 Thread Michael Paquier
Hi all, Many threads have touched $subject: https://www.postgresql.org/message-id/CAN-RpxDPE4baiMMJ6TLd6AiUvrG=yrc05tgxrgp4auuth9j...@mail.gmail.com https://www.postgresql.org/message-id/7c50423.5ad0.15e8b308b2f.coremail.chjis...@163.com https://www.postgresql.org/message-id/1516736993.5599.4.ca..