WE deployed 3 OpenBSD machines yesterday to replace older OpenBSD machines
that had been backing up happily. I honestly cannot remember which version
of Amanda was on these machines. The new ones have 2.6.1. The Amanda master
machine is 2.6.1, and has been happily backing up 55 machines every night
prior to this.
At least one filessytem failed on each of the upgraded machines on last
nights run. I manually started a run again this morning, and was able to
reproduce the failure. I am attaching 2 sendbackup debug files from one of
the machines. I am not quite certain why there are 2 files. I deleted all
the Amanda debug files, prior to doing the manual run, so I so I expected
just to have one debug file for a given filessytem, but found 2.
What can I do to further debug this?
--
One of the main causes of the fall of the roman empire was that, lacking
zero, they had no way to indicate successful termination of their C
programs.
1250248929.858286: sendbackup: pid 964 ruid 1002 euid 1002 version 2.6.1: start
at Fri Aug 14 07:22:09 2009
1250248929.858411: sendbackup: Version 2.6.1
1250248929.859910: sendbackup: pid 964 ruid 1002 euid 1002 version 2.6.1:
rename at Fri Aug 14 07:22:09 2009
1250248929.860521: sendbackup: Parsed request as: program `DUMP'
1250248929.860531: sendbackup: disk `wd0a'
1250248929.860539: sendbackup: device `wd0a'
1250248929.860547: sendbackup: level 0
1250248929.860556: sendbackup: since NODATE
1250248929.860564: sendbackup: options `'
1250248929.861003: sendbackup: start: pbuild3:wd0a lev 0
1250248929.874126: sendbackup: pipespawnv: stdoutfd is 50
1250248929.874174: sendbackup: Spawning "/usr/bin/gzip /usr/bin/gzip --fast" in
pipeline
1250248929.874495: sendbackup: dump: pid 21760: /usr/bin/gzip1250248929.874520:
sendbackup: --fast1250248929.874528: sendbackup:
1250248929.874825: sendbackup: dumping device '/dev/rwd0a' with 'ffs'
1250248929.875137: sendbackup: pipespawnv: stdoutfd is 8
1250248929.875249: sendbackup: Spawning "/sbin/dump dump 0usf 1048576 -
/dev/rwd0a" in pipeline
1250248929.875505: sendbackup: Started backup
1250248929.889781: sendbackup: Started index creator: "/sbin/restore -tvf -
2>&1 | sed -e '
s/^leaf[ ]*[0-9]*[ ]*\.//
t
/^dir[ ]/ {
s/^dir[ ]*[0-9]*[ ]*\.//
s%$%/%
t
}
d
'"
1250248929.890393: sendbackup: 91: normal(|): DUMP: Date of this level 0
dump: Fri Aug 14 07:22:09 2009
1250248929.892432: sendbackup: 91: normal(|): DUMP: Date of last level 0
dump: the epoch
1250248929.914190: sendbackup: 91: normal(|): DUMP: Dumping /dev/rwd0a (/)
to standard output
1250248929.948981: sendbackup: 91: normal(|): DUMP: mapping (Pass I)
[regular files]
1250248930.356555: sendbackup: 91: normal(|): DUMP: mapping (Pass II)
[directories]
1250248930.357239: sendbackup: 91: normal(|): DUMP: estimated 62068 tape
blocks.
1250248930.358079: sendbackup: 91: normal(|): DUMP: Volume 1 started at:
Fri Aug 14 07:22:10 2009
1250248930.359434: sendbackup: 91: normal(|): DUMP: dumping (Pass III)
[directories]
1250248930.694942: sendbackup: 91: normal(|): DUMP: dumping (Pass IV)
[regular files]
1250248932.290402: sendbackup: 116: strange(?): gzip: stdout: Resource
temporarily unavailable
1250248932.290841: sendbackup: critical (fatal): index tee cannot write [Broken
pipe]
1250248932.292169: sendbackup: 116: strange(?): sendbackup: index tee cannot
write [Broken pipe]
1250248932.293596: sendbackup: 91: normal(|): DUMP: Broken pipe
1250248932.294404: sendbackup: 91: normal(|): DUMP: The ENTIRE dump is
aborted.
1250248932.294820: sendbackup: critical (fatal): error [dump (30584) /sbin/dump
returned 3, compress (21760) compress returned 1]
1250248957.055133: sendbackup: pid 25239 ruid 1002 euid 1002 version 2.6.1:
start at Fri Aug 14 07:22:37 2009
1250248957.055258: sendbackup: Version 2.6.1
1250248957.057459: sendbackup: pid 25239 ruid 1002 euid 1002 version 2.6.1:
rename at Fri Aug 14 07:22:37 2009
1250248957.058119: sendbackup: Parsed request as: program `DUMP'
1250248957.058130: sendbackup: disk `wd0a'
1250248957.058138: sendbackup: device `wd0a'
1250248957.058146: sendbackup: level 0
1250248957.058154: sendbackup: since NODATE
1250248957.058163: sendbackup: options `'
1250248957.058331: sendbackup: start: pbuild3:wd0a lev 0
1250248957.058400: sendbackup: pipespawnv: stdoutfd is 50
1250248957.058446: sendbackup: Spawning "/usr/bin/gzip /usr/bin/gzip --fast" in
pipeline
1250248957.058773: sendbackup: dump: pid 2691: /usr/bin/gzip1250248957.058800:
sendbackup: --fast1250248957.058807: sendbackup:
1250248957.059117: sendbackup: dumping device '/dev/rwd0a' with 'ffs'
1250248957.059429: sendbackup: pipespawnv: stdoutfd is 8
1250248957.059542: sendbackup: Spawning "/sbin/dump dump 0usf 1048576 -
/dev/rwd0a" in pipeline
1250248957.059834: sendbackup: Started backup
1250248957.069665: sendbackup: 91: normal(|): DUMP: Date of this level 0
dump: Fri Aug 14 07:22:37 2009
1250248957.072056: sendbackup: Started index creator: "/sbin/restore -tvf -
2>&1 | sed -e '
s/^leaf[ ]*[0-9]*[ ]*\.//
t
/^dir[ ]/ {
s/^dir[ ]*[0-9]*[ ]*\.//
s%$%/%
t
}
d
'"
1250248957.075611: sendbackup: 91: normal(|): DUMP: Date of last level 0
dump: the epoch
1250248957.078536: sendbackup: 91: normal(|): DUMP: Dumping /dev/rwd0a (/)
to standard output
1250248957.307428: sendbackup: 91: normal(|): DUMP: mapping (Pass I)
[regular files]
1250248957.688632: sendbackup: 91: normal(|): DUMP: mapping (Pass II)
[directories]
1250248957.689289: sendbackup: 91: normal(|): DUMP: estimated 62068 tape
blocks.
1250248957.690124: sendbackup: 91: normal(|): DUMP: Volume 1 started at:
Fri Aug 14 07:22:37 2009
1250248957.691500: sendbackup: 91: normal(|): DUMP: dumping (Pass III)
[directories]
1250248958.018712: sendbackup: 91: normal(|): DUMP: dumping (Pass IV)
[regular files]
1250248962.038761: sendbackup: 116: strange(?): gzip: stdout: Resource
temporarily unavailable
1250248962.039198: sendbackup: critical (fatal): index tee cannot write [Broken
pipe]
1250248962.040316: sendbackup: 116: strange(?): sendbackup: index tee cannot
write [Broken pipe]
1250248962.041808: sendbackup: 91: normal(|): DUMP: Broken pipe
1250248962.042592: sendbackup: 91: normal(|): DUMP: The ENTIRE dump is
aborted.
1250248962.042998: sendbackup: critical (fatal): error [dump (28975) /sbin/dump
returned 3, compress (2691) compress returned 1]
