On Friday, April 4, 2014 3:33:32 PM UTC-7, Daniel Farina wrote:
>
> On Fri, Apr 4, 2014 at 2:38 PM, Joe Van Dyk <[email protected]<javascript:>>
> wrote:
> > On Friday, April 4, 2014 2:32:25 PM UTC-7, Daniel Farina wrote:
> >> The latter it never did make, because there are recovery.conf settings
> >> in there that WAL-E as-is doesn't know anything about, like hot
> >> standby or where the primary_conninfo ought to be or even how to load
> >> configuration for WAL-E. I agree it'd be nice to get to one-less-step
> >> without losing power somehow, but it's a new surface area that to date
> >> WAL-E has never had.
> >>
> >>
> >> As for avoiding postgresql.conf: my rationale is that it is full of
> >> absolute paths and settings that can be dangerous upon restore.
> >
> >
> > Maybe make recovery.conf.sample and postresql.conf.old files?
> >
> > recovery.conf.sample could use the sample recovery line in the
> > documentation, with some information gathered from how the current wal-e
> > backup-fetch process was started.
> >
> > And postgresql.conf.old could contain the original master
> postgresql.conf
> > file.
> >
> > Then, at the end of backup-fetch, tell users about two files and
> indicate
> > that they should restore them or make new ones?
>
> That sounds like a kernel of a good idea to me. There's some fine
> tuning about the file names (as so one can overwrite or, alternatively
> not-back-up old sample files) after a failover, but I like the
> convenience to mechanism to power ratio in general. I'll think on it.
>
> >> >> But, pg_subtrans should show up if the primary had it.
> >> >> Any errors in the logs of the download?
> >> >
> >> >
> >> > No errors. Primary has it.
> >>
> >> Well that's disturbing. Uh. What's the exact path relative to
> >> $PGDATA that's missing? I think to catch this one we'll need some
> >> instrumentation, and if you can reproduce this then I don't want to
> >> let this go if you have the time.
> >
> >
> > ./pg_subtrans
> >
> > I'll see if it can be reproduced..
>
> Thanks a lot for the help on that one.
>
wal_e.worker.s3.s3_worker INFO MSG: beginning partition download
DETAIL: The partition being downloaded is part_99.tar.lzo.
HINT: The absolute S3 key is
wal-e/9.3/basebackups_005/base_0000000100000657000000A4_00678264/tar_partitions/part_99.tar.lzo.
STRUCTURED: time=2014-04-04T21:58:18.805505-00 pid=12123
[[email protected]:/disk/scratch] $ ls -l wal-e-test/pg_
pg_clog/ pg_ident.conf pg_notify/ pg_snapshots/ pg_stat_tmp/
pg_twophase/
pg_hba.conf pg_multixact/ pg_serial/ pg_stat/ pg_tblspc/
pg_xlog/
pg_subtrans isn't there.
On the master:
$ sudo ls -l /mnt/postgresql/9.3/pg_subtrans
total 5024
-rw------- 1 postgres postgres 262144 Apr 4 09:35 18BE
-rw------- 1 postgres postgres 262144 Apr 4 10:00 18BF
-rw------- 1 postgres postgres 262144 Apr 4 10:20 18C0
-rw------- 1 postgres postgres 262144 Apr 4 10:40 18C1
-rw------- 1 postgres postgres 262144 Apr 4 11:00 18C2
-rw------- 1 postgres postgres 262144 Apr 4 11:25 18C3
-rw------- 1 postgres postgres 262144 Apr 4 11:40 18C4
-rw------- 1 postgres postgres 262144 Apr 4 12:05 18C5
-rw------- 1 postgres postgres 262144 Apr 4 12:20 18C6
-rw------- 1 postgres postgres 262144 Apr 4 12:40 18C7
-rw------- 1 postgres postgres 262144 Apr 4 12:55 18C8
-rw------- 1 postgres postgres 262144 Apr 4 13:15 18C9
-rw------- 1 postgres postgres 262144 Apr 4 13:30 18CA
-rw------- 1 postgres postgres 262144 Apr 4 13:50 18CB
-rw------- 1 postgres postgres 262144 Apr 4 14:10 18CC
-rw------- 1 postgres postgres 262144 Apr 4 14:25 18CD
-rw------- 1 postgres postgres 262144 Apr 4 14:50 18CE
-rw------- 1 postgres postgres 262144 Apr 4 15:10 18CF
-rw------- 1 postgres postgres 262144 Apr 4 15:30 18D0
-rw------- 1 postgres postgres 81920 Apr 4 15:35 18D1
$ sudo ls -l /mnt/postgresql/9.3
...
drwx------ 2 postgres postgres 4096 Apr 4 15:30 pg_subtrans
I don't know much about the internals of pg_subtrans -- does it exist on
all postgresql installations? Or is it created as needed?
All the subtrans directories on the master look like they were recently
created, what would happen if that directory was created after the wal-e
basebackup was taken? The wal-e base backup was taken before 9 am today.
--
You received this message because you are subscribed to the Google Groups
"wal-e" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
For more options, visit https://groups.google.com/d/optout.
