On Wed, Sep 11, 2019 at 5:38 AM Anastasia Lubennikova <a.lubennik...@postgrespro.ru> wrote: > Attached is v12, which contains WAL optimizations for posting split and > page > deduplication.
Hmm. So v12 seems to have some problems with the WAL logging for posting list splits. With wal_debug = on and wal_consistency_checking='all', I can get a replica to fail consistency checking very quickly when "make installcheck" is run on the primary: 4448/2019-09-11 15:01:06 PDT LOG: REDO @ 0/30423A0; LSN 0/30425A0: prev 0/3041C78; xid 506; len 3; blkref #0: rel 1663/16385/2608, blk 56 FPW - Heap/INSERT: off 20 flags 0x00 4448/2019-09-11 15:01:06 PDT LOG: REDO @ 0/30425A0; LSN 0/3042F78: prev 0/30423A0; xid 506; len 4; blkref #0: rel 1663/16385/2673, blk 13 FPW - Btree/INSERT_LEAF: off 138; in_posting_offset 0 4448/2019-09-11 15:01:06 PDT LOG: REDO @ 0/3042F78; LSN 0/3043788: prev 0/30425A0; xid 506; len 4; blkref #0: rel 1663/16385/2674, blk 37 FPW - Btree/INSERT_LEAF: off 68; in_posting_offset 0 4448/2019-09-11 15:01:06 PDT LOG: REDO @ 0/3043788; LSN 0/30437C0: prev 0/3042F78; xid 506; len 28 - Transaction/ABORT: 2019-09-11 15:01:06.291717-07; rels: pg_tblspc/16388/PG_13_201909071/16385/16399 4448/2019-09-11 15:01:06 PDT LOG: REDO @ 0/30437C0; LSN 0/3043A30: prev 0/3043788; xid 507; len 3; blkref #0: rel 1663/16385/1247, blk 9 FPW - Heap/INSERT: off 9 flags 0x00 4448/2019-09-11 15:01:06 PDT LOG: REDO @ 0/3043A30; LSN 0/3043D08: prev 0/30437C0; xid 507; len 4; blkref #0: rel 1663/16385/2703, blk 2 FPW - Btree/INSERT_LEAF: off 51; in_posting_offset 0 4448/2019-09-11 15:01:06 PDT LOG: REDO @ 0/3043D08; LSN 0/3044948: prev 0/3043A30; xid 507; len 4; blkref #0: rel 1663/16385/2704, blk 1 FPW - Btree/INSERT_LEAF: off 169; in_posting_offset 0 4448/2019-09-11 15:01:06 PDT LOG: REDO @ 0/3044948; LSN 0/3044B58: prev 0/3043D08; xid 507; len 3; blkref #0: rel 1663/16385/2608, blk 56 FPW - Heap/INSERT: off 21 flags 0x00 4448/2019-09-11 15:01:06 PDT LOG: REDO @ 0/3044B58; LSN 0/30454A0: prev 0/3044948; xid 507; len 4; blkref #0: rel 1663/16385/2673, blk 8 FPW - Btree/INSERT_LEAF: off 156; in_posting_offset 0 4448/2019-09-11 15:01:06 PDT LOG: REDO @ 0/30454A0; LSN 0/3045CC0: prev 0/3044B58; xid 507; len 4; blkref #0: rel 1663/16385/2674, blk 37 FPW - Btree/INSERT_LEAF: off 71; in_posting_offset 0 4448/2019-09-11 15:01:06 PDT LOG: REDO @ 0/3045CC0; LSN 0/3045F48: prev 0/30454A0; xid 507; len 3; blkref #0: rel 1663/16385/1247, blk 9 FPW - Heap/INSERT: off 10 flags 0x00 4448/2019-09-11 15:01:06 PDT LOG: REDO @ 0/3045F48; LSN 0/3046240: prev 0/3045CC0; xid 507; len 4; blkref #0: rel 1663/16385/2703, blk 2 FPW - Btree/INSERT_LEAF: off 51; in_posting_offset 0 4448/2019-09-11 15:01:06 PDT LOG: REDO @ 0/3046240; LSN 0/3046E70: prev 0/3045F48; xid 507; len 4; blkref #0: rel 1663/16385/2704, blk 1 FPW - Btree/INSERT_LEAF: off 44; in_posting_offset 0 4448/2019-09-11 15:01:06 PDT LOG: REDO @ 0/3046E70; LSN 0/3047090: prev 0/3046240; xid 507; len 3; blkref #0: rel 1663/16385/2608, blk 56 FPW - Heap/INSERT: off 22 flags 0x00 4448/2019-09-11 15:01:06 PDT LOG: REDO @ 0/3047090; LSN 0/30479E0: prev 0/3046E70; xid 507; len 4; blkref #0: rel 1663/16385/2673, blk 8 FPW - Btree/INSERT_LEAF: off 156; in_posting_offset 0 4448/2019-09-11 15:01:06 PDT LOG: REDO @ 0/30479E0; LSN 0/3048420: prev 0/3047090; xid 507; len 4; blkref #0: rel 1663/16385/2674, blk 38 FPW - Btree/INSERT_LEAF: off 10; in_posting_offset 0 4448/2019-09-11 15:01:06 PDT LOG: REDO @ 0/3048420; LSN 0/30486B0: prev 0/30479E0; xid 507; len 3; blkref #0: rel 1663/16385/1259, blk 0 FPW - Heap/INSERT: off 6 flags 0x00 4448/2019-09-11 15:01:06 PDT LOG: REDO @ 0/30486B0; LSN 0/3048C30: prev 0/3048420; xid 507; len 4; blkref #0: rel 1663/16385/2662, blk 2 FPW - Btree/INSERT_LEAF: off 119; in_posting_offset 0 4448/2019-09-11 15:01:06 PDT LOG: REDO @ 0/3048C30; LSN 0/3049668: prev 0/30486B0; xid 507; len 4; blkref #0: rel 1663/16385/2663, blk 1 FPW - Btree/INSERT_LEAF: off 42; in_posting_offset 0 4448/2019-09-11 15:01:06 PDT LOG: REDO @ 0/3049668; LSN 0/304A550: prev 0/3048C30; xid 507; len 4; blkref #0: rel 1663/16385/3455, blk 1 FPW - Btree/INSERT_LEAF: off 2; in_posting_offset 1 4448/2019-09-11 15:01:06 PDT FATAL: inconsistent page found, rel 1663/16385/3455, forknum 0, blkno 1 4448/2019-09-11 15:01:06 PDT CONTEXT: WAL redo at 0/3049668 for Btree/INSERT_LEAF: off 2; in_posting_offset 1 4447/2019-09-11 15:01:06 PDT LOG: startup process (PID 4448) exited with exit code 1 4447/2019-09-11 15:01:06 PDT LOG: terminating any other active server processes 4447/2019-09-11 15:01:06 PDT LOG: database system is shut down I regularly use this test case for the patch -- I think that I fixed a similar problem in v11, when I changed the same WAL logging, but I didn't mention it until now. I will debug this myself in a few days, though you may prefer to do it before then. -- Peter Geoghegan
