Greetings; More of the same with 20091217's snapshot. Comments inserted.
---------- Forwarded Message ---------- Subject: The Coyote Den AMANDA MAIL REPORT FOR December 20, 2009 Date: Sunday 20 December 2009 From: [email protected] To: [email protected] *** THE DUMPS DID NOT FINISH PROPERLY! Hostname: coyote.coyote.den Org : The Coyote Den Config : Daily Date : December 20, 2009 There are 26085k of dumps left in the holding disk. They will be flushed on the next run. The next tape Amanda expects to use is: Dailys-3. FAILURE DUMP SUMMARY: coyote /home lev 0 FAILED [does not support auth] coyote /home lev 0 FAILED [does not support index] ------------------we interrupt this email for a comment At least a clue, but where in the assorted .dbg files would I find out why? The only _obvious_ error is the attempts to find the 'shop' client, which has crashed, presumably frozen up. Here are the perms on ~/.amandahosts: [r...@coyote /]# ls -l /home/amanda/.amandahosts -rw------- 1 amanda disk 417 2006-11-27 19:29 /home/amanda/.amandahosts And its contents: [r...@coyote /]# cat /home/amanda/.amandahosts coyote.coyote.den amanda amdump amindexd amidxtaped coyote amanda amdump amindexd amidxtaped coyote.coyote.den root amdump amindexd amidxtaped shop.coyote.den root amdump amindexd amidxtaped shop root amdump amindexd amidxtaped shop.coyote.den amanda amdump amindexd amidxtaped shop amanda amdump amindexd amidxtaped Some of those are probably not needed, but I was covering all bases since one doesn't get an answer for hours if its wrong. ------------------------------back to the email from amanda coyote /GenesAmandaHelper-0.6 RESULTS MISSING coyote /bin RESULTS MISSING coyote /boot RESULTS MISSING coyote /etc RESULTS MISSING coyote /lib RESULTS MISSING coyote /opt RESULTS MISSING coyote /root RESULTS MISSING coyote /sbin RESULTS MISSING coyote /tmp RESULTS MISSING coyote /var RESULTS MISSING coyote /usr/bin RESULTS MISSING coyote /usr/dlds/misc RESULTS MISSING coyote /usr/dlds/rpms RESULTS MISSING coyote /usr/dlds/tgzs RESULTS MISSING coyote /usr/brlcad RESULTS MISSING coyote /usr/java RESULTS MISSING coyote /usr/weber RESULTS MISSING coyote /usr/include RESULTS MISSING coyote /usr/kerberos RESULTS MISSING coyote /usr/lib RESULTS MISSING coyote /usr/libexec RESULTS MISSING coyote /usr/movies RESULTS MISSING coyote /usr/local RESULTS MISSING coyote /usr/music RESULTS MISSING coyote /usr/pix RESULTS MISSING coyote /usr/sbin RESULTS MISSING coyote /usr/share RESULTS MISSING coyote /usr/src RESULTS MISSING shop /home RESULTS MISSING shop /etc RESULTS MISSING shop /usr/lib/amanda RESULTS MISSING shop /var/lib/amanda RESULTS MISSING shop /usr/local RESULTS MISSING shop /usr/src RESULTS MISSING planner: ERROR Request to shop failed: timeout waiting for ACK ----------------------------[snippety snip the rest of it]----------------- And of course nothing was written to /amandatapes/Dailys/slot3, and there is about 29 megs of stuff sitting in /dumps, 4 failures now. I have the 2009/20/15 snapshot installing now. I know it worked. And it is apparently similarly stuck. lsof says only 2 files debug files are open, and a tail on them has no activity. But since amanda never sleeps... From /tmp/amanda-dbg/server/Daily : [r...@coyote Daily]# tail `ls |grep 20091220104` ==> amcheck.20091220104020.debug <== Sun Dec 20 10:40:21 2009: amcheck-clients: security_close(handle=0x88475a0, driver=0xb7810180 (BSD)) Sun Dec 20 10:40:30 2009: amcheck-clients: dgram_send_addr(addr=0x88450f8, dgram=0xb7818364) Sun Dec 20 10:40:30 2009: amcheck-clients: (sockaddr_in *)0x88450f8 = { 2, 10080, 192.168.71.4 } Sun Dec 20 10:40:30 2009: amcheck-clients: dgram_send_addr: 0xb7818364->socket = 4 Sun Dec 20 10:40:40 2009: amcheck-clients: dgram_send_addr(addr=0x88450f8, dgram=0xb7818364) Sun Dec 20 10:40:40 2009: amcheck-clients: (sockaddr_in *)0x88450f8 = { 2, 10080, 192.168.71.4 } Sun Dec 20 10:40:40 2009: amcheck-clients: dgram_send_addr: 0xb7818364->socket = 4 Sun Dec 20 10:40:50 2009: amcheck-clients: security_seterror(handle=0x88450d8, driver=0xb7810180 (BSD) error=timeout waiting for ACK) Sun Dec 20 10:40:50 2009: amcheck-clients: security_close(handle=0x88450d8, driver=0xb7810180 (BSD)) Sun Dec 20 10:40:50 2009: amcheck: pid 5089 finish time Sun Dec 20 10:40:50 2009 ==> amcheck.20091220104536.debug <== Sun Dec 20 10:45:38 2009: amcheck-clients: security_close(handle=0x9f61620, driver=0xb77de180 (BSD)) Sun Dec 20 10:45:46 2009: amcheck-clients: dgram_send_addr(addr=0x9f5f180, dgram=0xb77e6364) Sun Dec 20 10:45:46 2009: amcheck-clients: (sockaddr_in *)0x9f5f180 = { 2, 10080, 192.168.71.4 } Sun Dec 20 10:45:46 2009: amcheck-clients: dgram_send_addr: 0xb77e6364->socket = 4 Sun Dec 20 10:45:56 2009: amcheck-clients: dgram_send_addr(addr=0x9f5f180, dgram=0xb77e6364) Sun Dec 20 10:45:56 2009: amcheck-clients: (sockaddr_in *)0x9f5f180 = { 2, 10080, 192.168.71.4 } Sun Dec 20 10:45:56 2009: amcheck-clients: dgram_send_addr: 0xb77e6364->socket = 4 Sun Dec 20 10:46:06 2009: amcheck-clients: security_seterror(handle=0x9f5f160, driver=0xb77de180 (BSD) error=timeout waiting for ACK) Sun Dec 20 10:46:06 2009: amcheck-clients: security_close(handle=0x9f5f160, driver=0xb77de180 (BSD)) Sun Dec 20 10:46:06 2009: amcheck: pid 5296 finish time Sun Dec 20 10:46:06 2009 ==> amcheck-device.20091220104020.debug <== Sun Dec 20 10:40:20 2009: amcheck-device: pid 5092 ruid 500 euid 500 version 2.6.2alpha: start at Sun Dec 20 10:40:20 2009 Sun Dec 20 10:40:20 2009: amcheck-device: pid 5092 ruid 500 euid 500 version 2.6.2alpha: rename at Sun Dec 20 10:40:20 2009 Sun Dec 20 10:40:20 2009: amcheck-device: Amanda::Changer::compat initialized with script /usr/local/libexec/amanda/chg-disk, temporary directory /usr/local/etc/amanda/Daily Sun Dec 20 10:40:20 2009: amcheck-device: Amanda::Changer::compat: invoking /usr/local/libexec/amanda/chg-disk with -info Sun Dec 20 10:40:20 2009: amcheck-device: Amanda::Changer::compat: Got response '3 30 1' with exit status 0 Sun Dec 20 10:40:20 2009: amcheck-device: Amanda::Changer::compat: invoking /usr/local/libexec/amanda/chg-disk with -slot current Sun Dec 20 10:40:21 2009: amcheck-device: Amanda::Changer::compat: Got response '3 file:/amandatapes/Dailys/' with exit status 0 Sun Dec 20 10:40:21 2009: amcheck-device: Amanda::Taper::Scan::traditional result: 'Dailys-3' on file:/amandatapes/Dailys/, mode 2 Sun Dec 20 10:40:21 2009: amcheck-device: pid 5092 finish time Sun Dec 20 10:40:21 2009 ==> amcheck-device.20091220104536.debug <== Sun Dec 20 10:45:36 2009: amcheck-device: pid 5299 ruid 500 euid 500 version 2.6.2alpha: start at Sun Dec 20 10:45:36 2009 Sun Dec 20 10:45:36 2009: amcheck-device: pid 5299 ruid 500 euid 500 version 2.6.2alpha: rename at Sun Dec 20 10:45:36 2009 Sun Dec 20 10:45:36 2009: amcheck-device: Amanda::Changer::compat initialized with script /usr/local/libexec/amanda/chg-disk, temporary directory /usr/local/etc/amanda/Daily Sun Dec 20 10:45:36 2009: amcheck-device: Amanda::Changer::compat: invoking /usr/local/libexec/amanda/chg-disk with -info Sun Dec 20 10:45:36 2009: amcheck-device: Amanda::Changer::compat: Got response '3 30 1' with exit status 0 Sun Dec 20 10:45:36 2009: amcheck-device: Amanda::Changer::compat: invoking /usr/local/libexec/amanda/chg-disk with -slot current Sun Dec 20 10:45:37 2009: amcheck-device: Amanda::Changer::compat: Got response '3 file:/amandatapes/Dailys/' with exit status 0 Sun Dec 20 10:45:37 2009: amcheck-device: Amanda::Taper::Scan::traditional result: 'Dailys-3' on file:/amandatapes/Dailys/, mode 2 Sun Dec 20 10:45:37 2009: amcheck-device: pid 5299 finish time Sun Dec 20 10:45:37 2009 ==> driver.20091220104606.debug <== Sun Dec 20 10:46:06 2009: driver: pid 5424 ruid 500 euid 500 version 2.6.2alpha: start at Sun Dec 20 10:46:06 2009 Sun Dec 20 10:46:06 2009: driver: pid 5424 ruid 500 euid 500 version 2.6.2alpha: rename at Sun Dec 20 10:46:06 2009 ==> dumper.20091220104606000.debug <== Sun Dec 20 10:46:06 2009: dumper: pid 5427 ruid 0 euid 500 version 2.6.2alpha: start at Sun Dec 20 10:46:06 2009 Sun Dec 20 10:46:06 2009: dumper: pid 5427 ruid 0 euid 500 version 2.6.2alpha: rename at Sun Dec 20 10:46:06 2009 Sun Dec 20 10:46:06 2009: dumper: getcmd: START 20091220104606 Sun Dec 20 10:46:06 2009: dumper: getcmd: QUIT Sun Dec 20 10:46:06 2009: dumper: pid 5427 finish time Sun Dec 20 10:46:06 2009 ==> dumper.20091220104606.debug <== Sun Dec 20 10:46:06 2009: dumper: pid 5426 ruid 0 euid 500 version 2.6.2alpha: start at Sun Dec 20 10:46:06 2009 Sun Dec 20 10:46:06 2009: dumper: pid 5426 ruid 0 euid 500 version 2.6.2alpha: rename at Sun Dec 20 10:46:06 2009 Sun Dec 20 10:46:06 2009: dumper: getcmd: START 20091220104606 Sun Dec 20 10:46:06 2009: dumper: getcmd: QUIT Sun Dec 20 10:46:06 2009: dumper: pid 5426 finish time Sun Dec 20 10:46:06 2009 ==> planner.20091220104606.debug <== Sun Dec 20 10:46:07 2009: planner: dgram_recv(dgram=0xb76fe364, timeout=0, fromaddr=0xb770e350) Sun Dec 20 10:46:07 2009: planner: (sockaddr_in *)0xb770e350 = { 2, 10080, 192.168.71.3 } Sun Dec 20 10:46:16 2009: planner: dgram_send_addr(addr=0x82af5f8, dgram=0xb76fe364) Sun Dec 20 10:46:16 2009: planner: (sockaddr_in *)0x82af5f8 = { 2, 10080, 192.168.71.4 } Sun Dec 20 10:46:16 2009: planner: dgram_send_addr: 0xb76fe364->socket = 3 Sun Dec 20 10:46:26 2009: planner: dgram_send_addr(addr=0x82af5f8, dgram=0xb76fe364) Sun Dec 20 10:46:26 2009: planner: (sockaddr_in *)0x82af5f8 = { 2, 10080, 192.168.71.4 } Sun Dec 20 10:46:26 2009: planner: dgram_send_addr: 0xb76fe364->socket = 3 Sun Dec 20 10:46:36 2009: planner: security_seterror(handle=0x82af5d8, driver=0xb76f6180 (BSD) error=timeout waiting for ACK) Sun Dec 20 10:46:36 2009: planner: security_close(handle=0x82af5d8, driver=0xb76f6180 (BSD)) ==> taper.20091220104607.debug <== Sun Dec 20 10:46:07 2009: taper: pid 5425 ruid 500 euid 500 version 2.6.2alpha: start at Sun Dec 20 10:46:07 2009 Sun Dec 20 10:46:07 2009: taper: pid 5425 ruid 500 euid 500 version 2.6.2alpha: rename at Sun Dec 20 10:46:07 2009 Sun Dec 20 10:46:07 2009: taper: Amanda::Changer::compat initialized with script /usr/local/libexec/amanda/chg-disk, temporary directory /usr/local/etc/amanda/Daily Sun Dec 20 10:46:07 2009: taper: info: Amanda::Taper::Scan::traditional: stage 1: search for oldest reusable volume Sun Dec 20 10:46:07 2009: taper: info: Amanda::Taper::Scan::traditional: oldest reusable volume is 'Dailys-3' Sun Dec 20 10:46:07 2009: taper: Amanda::Changer::compat: invoking /usr/local/libexec/amanda/chg-disk with -info Then in /tmp/amanda-dbg/client/Daily : [r...@coyote Daily]# tail `ls |grep 20091220104` ==> amgtar.20091220104021000.debug <== Sun Dec 20 10:40:21 2009: amgtar: SIZE ^ *Total bytes written: [0-9][0-9]* Sun Dec 20 10:40:21 2009: amgtar: IGNORE : Directory is new$ Sun Dec 20 10:40:21 2009: amgtar: IGNORE : Directory has been renamed Sun Dec 20 10:40:21 2009: amgtar: NORMAL ^could not open conf file Sun Dec 20 10:40:21 2009: amgtar: NORMAL ^Elapsed time: Sun Dec 20 10:40:21 2009: amgtar: NORMAL ^Throughput Sun Dec 20 10:40:21 2009: amgtar: NORMAL : socket ignored$ Sun Dec 20 10:40:21 2009: amgtar: NORMAL : File .* shrunk by [0-9][0-9]* bytes, padding with zeros Sun Dec 20 10:40:21 2009: amgtar: NORMAL : Cannot add file .*: No such file or directory$ Sun Dec 20 10:40:21 2009: amgtar: NORMAL : Error exit delayed from previous errors [...] ==> selfcheck.20091220104021.debug <== Sun Dec 20 10:40:21 2009: selfcheck: support line: INCLUDE-OPTIONAL YES Sun Dec 20 10:40:21 2009: selfcheck: support line: EXCLUDE-FILE YES Sun Dec 20 10:40:21 2009: selfcheck: support line: EXCLUDE-LIST YES Sun Dec 20 10:40:21 2009: selfcheck: support line: EXCLUDE-OPTIONAL YES Sun Dec 20 10:40:21 2009: selfcheck: support line: COLLECTION NO Sun Dec 20 10:40:21 2009: selfcheck: support line: MULTI-ESTIMATE YES Sun Dec 20 10:40:21 2009: selfcheck: support line: CALCSIZE YES Sun Dec 20 10:40:21 2009: selfcheck: support line: CLIENT-ESTIMATE YES Sun Dec 20 10:40:21 2009: selfcheck: Spawning "/usr/local/libexec/amanda/application/amgtar amgtar selfcheck --message line --config Daily --host coyote --disk /GenesAmandaHelper-0.6 --device /GenesAmandaHelper-0.6 --index line --record --check-device no" in pipeline Sun Dec 20 10:40:21 2009: selfcheck: pid 5125 finish time Sun Dec 20 10:40:21 2009 ==> sendsize.20091220104607.debug <== Sun Dec 20 10:46:07 2009: sendsize: pid 5448 ruid 500 euid 500 version 2.6.2alpha: start at Sun Dec 20 10:46:07 2009 Sun Dec 20 10:46:07 2009: sendsize: version 2.6.2alpha Sun Dec 20 10:46:07 2009: sendsize: pid 5448 ruid 500 euid 500 version 2.6.2alpha: rename at Sun Dec 20 10:46:07 2009 I can't see the trees for all this forest. :-( -- Cheers, Gene "There are four boxes to be used in defense of liberty: soap, ballot, jury, and ammo. Please use in that order." -Ed Howdershelt (Author) "Let us condemn to hellfire all those who disagree with us." -- militant religionists everywhere
