Re: [HACKERS] backup_label during crash recovery: do we know how to solve it?

2012-01-02 Thread Magnus Hagander
On Sun, Jan 1, 2012 at 23:09, Daniel Farina dan...@heroku.com wrote: On Sun, Jan 1, 2012 at 6:13 AM, Magnus Hagander mag...@hagander.net wrote: It also doesn't affect backups taken through pg_basebackup - but I guess you have good reasons for not being able to use that? Parallel

Re: [HACKERS] backup_label during crash recovery: do we know how to solve it?

2012-01-02 Thread Dimitri Fontaine
Magnus Hagander mag...@hagander.net writes: Well, that certainly goes to enough detail to agree that no, that can't be done with only minor modifications to pg_basebackup. Nor could it be done with your python program talking directly to the walsender backend and get around it that way. But

Re: [HACKERS] backup_label during crash recovery: do we know how to solve it?

2012-01-01 Thread Heikki Linnakangas
On 30.12.2011 02:40, Daniel Farina wrote: How about this revised protocol (names and adjustments welcome), to enable a less-terrible approach? Not only is that workaround incorrect (it has a small window where the system will not be able to restart), but it's pretty inconvenient. New concepts:

Re: [HACKERS] backup_label during crash recovery: do we know how to solve it?

2012-01-01 Thread Magnus Hagander
On Sun, Jan 1, 2012 at 14:18, Heikki Linnakangas heikki.linnakan...@enterprisedb.com wrote: On 30.12.2011 02:40, Daniel Farina wrote: How about this revised protocol (names and adjustments welcome), to enable a less-terrible approach?  Not only is that workaround incorrect (it has a small

Re: [HACKERS] backup_label during crash recovery: do we know how to solve it?

2012-01-01 Thread Daniel Farina
On Sun, Jan 1, 2012 at 5:18 AM, Heikki Linnakangas heikki.linnakan...@enterprisedb.com wrote: That's awfully complicated. If we're going to require co-operation from the backup/archiving software, we might as well just change the procedure so that backup_label is not stored in the data

Re: [HACKERS] backup_label during crash recovery: do we know how to solve it?

2012-01-01 Thread Daniel Farina
On Sun, Jan 1, 2012 at 6:13 AM, Magnus Hagander mag...@hagander.net wrote: It also doesn't affect backups taken through pg_basebackup - but I guess you have good reasons for not being able to use that? Parallel archiving/de-archiving and segmentation of the backup into pieces and rate limiting

Re: [HACKERS] backup_label during crash recovery: do we know how to solve it?

2011-12-29 Thread Daniel Farina
On Sat, Dec 3, 2011 at 8:04 AM, Heikki Linnakangas heikki.linnakan...@enterprisedb.com wrote: At the moment, if the situation is ambiguous, the system assumes that you're restoring from a backup. What your suggestion amounts to is to reverse tht assumption, and assume instead that you're doing

Re: [HACKERS] backup_label during crash recovery: do we know how to solve it?

2011-12-03 Thread Heikki Linnakangas
On 03.12.2011 01:25, Daniel Farina wrote: Here's a protocol: have pg_start_backup() write a file that just means backing up. Restarts are OK, because that's all it means, it has no meaning to a recovery/restoration process. When one wishes to restore, one must touch a file -- not unlike the

Re: [HACKERS] backup_label during crash recovery: do we know how to solve it?

2011-12-02 Thread Daniel Farina
On Thu, Dec 1, 2011 at 3:47 PM, Robert Haas robertmh...@gmail.com wrote: On Tue, Nov 29, 2011 at 9:10 PM, Daniel Farina dan...@heroku.com wrote: Reviving a thread that has hit its second birthday: http://archives.postgresql.org/pgsql-hackers/2009-11/msg00024.php In our case not being able to

Re: [HACKERS] backup_label during crash recovery: do we know how to solve it?

2011-12-02 Thread Robert Haas
On Fri, Dec 2, 2011 at 6:25 PM, Daniel Farina dan...@heroku.com wrote: Here's a protocol: have pg_start_backup() write a file that just means backing up.  Restarts are OK, because that's all it means, it has no meaning to a recovery/restoration process. When one wishes to restore, one must

Re: [HACKERS] backup_label during crash recovery: do we know how to solve it?

2011-12-01 Thread Robert Haas
On Tue, Nov 29, 2011 at 9:10 PM, Daniel Farina dan...@heroku.com wrote: Reviving a thread that has hit its second birthday: http://archives.postgresql.org/pgsql-hackers/2009-11/msg00024.php In our case not being able to restart Postgres when it has been taken down in the middle of a base

[HACKERS] backup_label during crash recovery: do we know how to solve it?

2011-11-29 Thread Daniel Farina
Reviving a thread that has hit its second birthday: http://archives.postgresql.org/pgsql-hackers/2009-11/msg00024.php In our case not being able to restart Postgres when it has been taken down in the middle of a base backup is starting to manifest as a serious source of downtime: basically, any