Re: Double-writes, take two?

2018-04-19 Thread Michael Paquier
On Thu, Apr 19, 2018 at 06:28:01PM -0400, Robert Haas wrote: > On Wed, Apr 18, 2018 at 2:22 AM, Michael Paquier wrote: >> I was thinking about this problem, and it looks that one approach for >> double-writes would be to introduce it as a secondary WAL stream >> independent

Re: Double-writes, take two?

2018-04-19 Thread Michael Paquier
On Wed, Apr 18, 2018 at 11:40:51AM +0200, Fabien COELHO wrote: >> - double-write buffers use a pre-decided numbers of pages (32 for the >> checkpointer, 128 divided into 4 buckets for the backends), which are >> synced into disk once each batch is full. > >> - The double-write file of the

Re: Double-writes, take two?

2018-04-19 Thread Robert Haas
On Wed, Apr 18, 2018 at 2:22 AM, Michael Paquier wrote: > I was thinking about this problem, and it looks that one approach for > double-writes would be to introduce it as a secondary WAL stream > independent from the main one: > - Once a buffer is evicted from shared buffers

Double-writes, take two?

2018-04-18 Thread Michael Paquier
Hi all, Back in 2012, Dan Scales, who was working on VMware Postgres, has posted a patch aimed at removing the need of full-page writes by introducing the concept of double writes using a double-write buffer approach in order to fix torn page problems: