There is 1GB of physical memory available and 2 GB of swap available. I
would assume that one would see things exiting abnormally in the logs
though if the memory was bottoming out? In any case, the remote machines
seem to get backed up fine but when it comes to backing itself up then
there is a problem which makes me think that if it was a memory issue
then all of the backups would fail, not just the localhost... right?
You prompted me to go back and look at the logs, in doing so it seems as
if I get 2 X of each log per run which I didn't notice before and now I
am seeing some problems. I can't tell if this is a permissions problems
or if this is something else. Attached are the logs containing the
problems. A little more info is that as soon as I had these problems I
went and switched the name from localhost to the FQDN of the machine in
both .amandahosts as well as disklist in hopes this would fix the
problem. I hope I didn't make anything worse, it sure didn't make
anything better.
On Thu, 2004-04-29 at 01:06, Paul Bijnens wrote:
> Kris Vassallo wrote:
>
> > - I am getting debug logs in /tmp/amanda
>
> What kind of debug logs? There should be a log from amandad with
> the protocol packets in it, and sendsize log, and a sendbackup log,
> and to run{tar,dump} logs.
> Which are there, compare it carefully with one that did succeed.
> Maybe send it to the list, (or to me if you believe too much sensitive
> information is in it).
>
> One of the stupid things that bit me once was running out of swap
> space: amcheck did succeed, but anything using more memory crashed
> without traces in the logs.
>
amandad: debug 1 pid 12359 ruid 33 euid 33: start at Wed Apr 28 23:59:01 2004
amandad: version 2.4.3
amandad: build: VERSION="Amanda-2.4.3"
amandad: BUILT_DATE="Thu Feb 13 11:14:37 EST 2003"
amandad: BUILT_MACH="Linux stripples.devel.redhat.com 2.4.20-2.41smp #1 SMP Sun
Feb 9 09:47:42 EST 2003 i686 i686 i386 GNU/Linux"
amandad: CC="gcc"
amandad: CONFIGURE_COMMAND="'./configure' '--host=i386-redhat-linux'
'--build=i386-redhat-linux' '--target=i386-redhat-linux-gnu' '--program-prefix='
'--prefix=/usr' '--exec-prefix=/usr' '--bindir=/usr/bin' '--sbindir=/usr/sbin'
'--sysconfdir=/etc' '--datadir=/usr/share' '--includedir=/usr/include'
'--libdir=/usr/lib' '--libexecdir=/usr/lib/amanda' '--localstatedir=/var/lib'
'--sharedstatedir=/usr/com' '--mandir=/usr/share/man' '--infodir=/usr/share/info'
'--enable-shared' '--with-index-server=localhost'
'--with-gnutar-listdir=/var/lib/amanda/gnutar-lists'
'--with-smbclient=/usr/bin/smbclient' '--with-amandahosts' '--with-user=amanda'
'--with-group=disk' '--with-gnutar=/bin/tar'"
amandad: paths: bindir="/usr/bin" sbindir="/usr/sbin"
amandad: libexecdir="/usr/lib/amanda" mandir="/usr/share/man"
amandad: AMANDA_TMPDIR="/tmp/amanda" AMANDA_DBGDIR="/tmp/amanda"
amandad: CONFIG_DIR="/etc/amanda" DEV_PREFIX="/dev/"
amandad: RDEV_PREFIX="/dev/r" DUMP="/sbin/dump"
amandad: RESTORE="/sbin/restore" SAMBA_CLIENT="/usr/bin/smbclient"
amandad: GNUTAR="/bin/tar" COMPRESS_PATH="/usr/bin/gzip"
amandad: UNCOMPRESS_PATH="/usr/bin/gzip" MAILER="/usr/bin/Mail"
amandad: listed_incr_dir="/var/lib/amanda/gnutar-lists"
amandad: defs: DEFAULT_SERVER="localhost" DEFAULT_CONFIG="DailySet1"
amandad: DEFAULT_TAPE_SERVER="localhost"
amandad: DEFAULT_TAPE_DEVICE="/dev/null" HAVE_MMAP HAVE_SYSVSHM
amandad: LOCKING=POSIX_FCNTL SETPGRP_VOID DEBUG_CODE
amandad: AMANDA_DEBUG_DAYS=4 BSD_SECURITY USE_AMANDAHOSTS
amandad: CLIENT_LOGIN="amanda" FORCE_USERID HAVE_GZIP
amandad: COMPRESS_SUFFIX=".gz" COMPRESS_FAST_OPT="--fast"
amandad: COMPRESS_BEST_OPT="--best" UNCOMPRESS_OPT="-dc"
amandad: time 0.000: got packet:
--------
Amanda 2.4 REQ HANDLE 000-C0710608 SEQ 1083221943
SECURITY USER amanda
SERVICE sendsize
OPTIONS features=fffffeff9f00;maxdumps=1;hostname=venus.berkeley-da.com;
GNUTAR /backup/repo 0 1970:1:1:0:0:0 -1 OPTIONS |;auth=bsd;compress-best;index;
GNUTAR /home 0 1970:1:1:0:0:0 -1 OPTIONS |;auth=bsd;compress-best;index;
--------
amandad: time 0.001: sending ack:
----
Amanda 2.4 ACK HANDLE 000-C0710608 SEQ 1083221943
----
amandad: time 0.001: bsd security: remote host venus.berkeley-da.com user amanda local
user amanda
amandad: time 0.001: amandahosts security check passed
amandad: time 0.001: running service "/usr/lib/amanda/sendsize"
amandad: time 600.977: got packet:
----
Amanda 2.4 REQ HANDLE 000-C0710608 SEQ 1083221943
SECURITY USER amanda
SERVICE sendsize
OPTIONS features=fffffeff9f00;maxdumps=1;hostname=venus.berkeley-da.com;
GNUTAR /backup/repo 0 1970:1:1:0:0:0 -1 OPTIONS |;auth=bsd;compress-best;index;
GNUTAR /home 0 1970:1:1:0:0:0 -1 OPTIONS |;auth=bsd;compress-best;index;
----
amandad: time 600.977: received dup P_REQ packet, ACKing it
amandad: time 600.977: sending ack:
----
Amanda 2.4 ACK HANDLE 000-C0710608 SEQ 1083221943
----
amandad: time 1201.135: got packet:
----
Amanda 2.4 REQ HANDLE 000-C0710608 SEQ 1083221943
SECURITY USER amanda
SERVICE sendsize
OPTIONS features=fffffeff9f00;maxdumps=1;hostname=venus.berkeley-da.com;
GNUTAR /backup/repo 0 1970:1:1:0:0:0 -1 OPTIONS |;auth=bsd;compress-best;index;
GNUTAR /home 0 1970:1:1:0:0:0 -1 OPTIONS |;auth=bsd;compress-best;index;
----
amandad: time 1201.135: received dup P_REQ packet, ACKing it
amandad: time 1201.135: sending ack:
----
Amanda 2.4 ACK HANDLE 000-C0710608 SEQ 1083221943
----
amandad: time 4244.080: sending REP packet:
----
Amanda 2.4 REP HANDLE 000-C0710608 SEQ 1083221943
OPTIONS features=fffffeff9f00;
/home 0 SIZE 209076080
/backup/repo 0 SIZE 323990
----
amandad: time 4254.077: dgram_recv: timeout after 10 seconds
amandad: time 4254.077: waiting for ack: timeout, retrying
amandad: time 4264.079: dgram_recv: timeout after 10 seconds
amandad: time 4264.079: waiting for ack: timeout, retrying
amandad: time 4274.082: dgram_recv: timeout after 10 seconds
amandad: time 4274.082: waiting for ack: timeout, retrying
amandad: time 4284.085: dgram_recv: timeout after 10 seconds
amandad: time 4284.085: waiting for ack: timeout, retrying
amandad: time 4294.087: dgram_recv: timeout after 10 seconds
amandad: time 4294.087: waiting for ack: timeout, giving up!
amandad: time 4294.087: pid 12359 finish time Thu Apr 29 01:10:35 2004
amtrmidx: debug 1 pid 12491 ruid 33 euid 33: start at Thu Apr 29 00:29:07 2004
/usr/lib/amanda/amtrmidx: version 2.4.3
venus.berkeley-da.com /home
could not open index directory
"/var/lib/amanda/DailySet1/index/venus.berkeley-da.com/_home/"venus.berkeley-da.com
/backup/repo
could not open index directory
"/var/lib/amanda/DailySet1/index/venus.berkeley-da.com/_backup_repo/"bda1.berkeley-da.com
/home
bda2.berkeley-da.com /var/www
amtrmidx: pid 12491 finish time Thu Apr 29 00:29:07 2004
