Re: amanda 3.1.2 on Solaris 10x86
Jean-Louis, On Thu, Nov 04, 2010 at 01:19:58PM -0400, Jean-Louis Martineau wrote: > The amzfs-snapshot failed, you might find the reason in the > amzfs-snapshot or sendbackup debug files. > > With the attached patch, the error message will be in the report. > > Jean-Louis The debug file is not terribly more informative. Wait, this is a different file system and a different error, I will send this but will look again...no the error I expected to find is not in any of the debug files from last night. I'll apply the patch and see what turns up, we've been running flawlessly since we installed 3.1.2 so I don't know what triggered the error last night. Amzfs_snapshot.20101103183611.debug :: Wed Nov 3 18:36:11 2010: Amzfs_snapshot: pid 22913 ruid 110 euid 110 version 3.1.2: start at Wed Nov 3 18:36:11 2010 Wed Nov 3 18:36:11 2010: Amzfs_snapshot: pid 22913 ruid 110 euid 110 version 3.1.2: rename at Wed Nov 3 18:36:11 2010 Wed Nov 3 18:36:11 2010: Amzfs_snapshot: script: Amzfs_snapshot Wed Nov 3 18:36:11 2010: Amzfs_snapshot: command: pre_dle_backup Wed Nov 3 18:36:11 2010: Amzfs_snapshot: running: /usr/bin/pfexec /usr/sbin/zfs get -H -o value mountpoint /cascadep/export/shain Wed Nov 3 18:36:11 2010: Amzfs_snapshot: running: /usr/sbin/df /cascadep/export/shain Wed Nov 3 18:36:11 2010: Amzfs_snapshot: running: /usr/bin/pfexec /usr/sbin/zfs get -H -o value mountpoint cascadep/export/shain| Wed Nov 3 18:36:11 2010: Amzfs_snapshot: running: /usr/bin/pfexec /usr/sbin/zfs snapshot cascadep/export/sh...@amanda-_cascadep_export_shain-current Wed Nov 3 18:36:12 2010: Amzfs_snapshot: warning: Use of uninitialized value in ref-to-glob cast at /usr/perl5/site_perl/5.8.4/Amanda/Script_App.pm line 120. thank you, Brian > > Brian Cuttler wrote: > >client==server > > > ># amdump ran perfectly otherwise. Periodically we see errors > >like this, but we've had pretty good runs since the installation > >of 3.1.2. > > > >- Forwarded message from Amanda/Cascade - > > > >These dumps were to tape Cascade43. > >The next 2 tapes Amanda expects to use are: Cascade44, Cascade45. > >FAILURE DUMP SUMMARY: > > cascade /cascadep/nalm/alm2 lev 0 FAILED [too many dumper retry: > > [request failed: timeout waiting for ACK]] > > > >STRANGE DUMP SUMMARY: > > cascade /cascadep/export/shain lev 1 STRANGE (see below) > > > >STRANGE DUMP DETAILS: > > /-- cascade /cascadep/export/shain lev 1 STRANGE > > ? Script 'amzfs-snapshot' command 'PRE-DLE-BACKUP': Can't use string > > ("") as a symbol ref while "strict refs" in use at > > /usr/perl5/site_perl/5.8.4/Amanda/Script_App.pm line 120. > > ? Script 'amzfs-snapshot' command 'PRE-DLE-BACKUP' exited with status 9: > > see /tmp/amanda/client/cascade/sendbackup.20101103183611.debug > > sendbackup: info BACKUP=APPLICATION > > sendbackup: info APPLICATION=amstar > > sendbackup: info RECOVER_CMD=/usr/local/bin/gzip -dc > > |/usr/local/libexec/amanda/application/amstar restore > > [./file-to-restore]+ > > sendbackup: info COMPRESS_SUFFIX=.gz > > sendbackup: info end > > | Type of this level 1 dump: full > > | Date of this level 1 dump: Wed Nov 3 18:36:12 2010 > > | Date of last level 0 dump: Wed Oct 6 18:31:57 2010 > > | /opt/schily/bin/star: 2110149 blocks + 0 bytes (total of 21607925760 > > bytes = 21101490.00k). > > | Dump record level 1 dump: Wed Nov 3 18:36:12 2010 written > > sendbackup: size 21101490 > > sendbackup: end > > \ > > > >(brought to you by Amanda version 3.1.2) > > > >--- > > Brian R Cuttler brian.cutt...@wadsworth.org > > Computer Systems Support(v) 518 486-1697 > > Wadsworth Center(f) 518 473-6384 > > NYS Department of HealthHelp Desk 518 473-0773 > > > > > > > >IMPORTANT NOTICE: This e-mail and any attachments may contain > >confidential or sensitive information which is, or may be, legally > >privileged or otherwise protected by law from further disclosure. It > >is intended only for the addressee. If you received this in error or > >from someone who was not authorized to send it to you, please do not > >distribute, copy or use it or any attachments. Please notify the > >sender immediately by reply e-mail and delete this from your > >system. Thank you for your cooperation. > > > > > > > --- Brian R Cuttler brian.cutt...@wadsworth.org Computer Systems Support(v) 518 486-1697 Wadsworth Center(f) 518 473-6384 NYS Department of HealthHelp Desk 518 473-0773 IMPORTANT NOTICE: This e-mail and any attachments may contain confidential or sensitive information which is, or may be, legally privileged or otherwise protected by law from further disclosure. It is intended only for the addressee. If you received this in error or from someone who was not authorized to
Re: amanda 3.1.2 on Solaris 10x86
The amzfs-snapshot failed, you might find the reason in the amzfs-snapshot or sendbackup debug files. With the attached patch, the error message will be in the report. Jean-Louis Brian Cuttler wrote: client==server # amdump ran perfectly otherwise. Periodically we see errors like this, but we've had pretty good runs since the installation of 3.1.2. - Forwarded message from Amanda/Cascade - These dumps were to tape Cascade43. The next 2 tapes Amanda expects to use are: Cascade44, Cascade45. FAILURE DUMP SUMMARY: cascade /cascadep/nalm/alm2 lev 0 FAILED [too many dumper retry: [request failed: timeout waiting for ACK]] STRANGE DUMP SUMMARY: cascade /cascadep/export/shain lev 1 STRANGE (see below) STRANGE DUMP DETAILS: /-- cascade /cascadep/export/shain lev 1 STRANGE ? Script 'amzfs-snapshot' command 'PRE-DLE-BACKUP': Can't use string ("") as a symbol ref while "strict refs" in use at /usr/perl5/site_perl/5.8.4/Amanda/Script_App.pm line 120. ? Script 'amzfs-snapshot' command 'PRE-DLE-BACKUP' exited with status 9: see /tmp/amanda/client/cascade/sendbackup.20101103183611.debug sendbackup: info BACKUP=APPLICATION sendbackup: info APPLICATION=amstar sendbackup: info RECOVER_CMD=/usr/local/bin/gzip -dc |/usr/local/libexec/amanda/application/amstar restore [./file-to-restore]+ sendbackup: info COMPRESS_SUFFIX=.gz sendbackup: info end | Type of this level 1 dump: full | Date of this level 1 dump: Wed Nov 3 18:36:12 2010 | Date of last level 0 dump: Wed Oct 6 18:31:57 2010 | /opt/schily/bin/star: 2110149 blocks + 0 bytes (total of 21607925760 bytes = 21101490.00k). | Dump record level 1 dump: Wed Nov 3 18:36:12 2010 written sendbackup: size 21101490 sendbackup: end \ (brought to you by Amanda version 3.1.2) --- Brian R Cuttler brian.cutt...@wadsworth.org Computer Systems Support(v) 518 486-1697 Wadsworth Center(f) 518 473-6384 NYS Department of HealthHelp Desk 518 473-0773 IMPORTANT NOTICE: This e-mail and any attachments may contain confidential or sensitive information which is, or may be, legally privileged or otherwise protected by law from further disclosure. It is intended only for the addressee. If you received this in error or from someone who was not authorized to send it to you, please do not distribute, copy or use it or any attachments. Please notify the sender immediately by reply e-mail and delete this from your system. Thank you for your cooperation. diff --git a/application-src/amzfs-snapshot.pl b/application-src/amzfs-snapshot.pl index 3872dd4..11396b9 100644 --- a/application-src/amzfs-snapshot.pl +++ b/application-src/amzfs-snapshot.pl @@ -151,6 +151,10 @@ sub command_post_dle_estimate { sub command_pre_dle_backup { my $self = shift; +my $mesgout_fd; +open ($mesgout_fd, '>&=1') || die("Can't open mesgout_fd: $!"); +$self->{mesgout} = $mesgout_fd; + $self->zfs_snapshot_set_value(); if ($self->{error_status} == $Amanda::Script_App::GOOD) { $self->zfs_create_snapshot("backup");
amanda 3.1.2 on Solaris 10x86
client==server # amdump ran perfectly otherwise. Periodically we see errors like this, but we've had pretty good runs since the installation of 3.1.2. - Forwarded message from Amanda/Cascade - These dumps were to tape Cascade43. The next 2 tapes Amanda expects to use are: Cascade44, Cascade45. FAILURE DUMP SUMMARY: cascade /cascadep/nalm/alm2 lev 0 FAILED [too many dumper retry: [request failed: timeout waiting for ACK]] STRANGE DUMP SUMMARY: cascade /cascadep/export/shain lev 1 STRANGE (see below) STRANGE DUMP DETAILS: /-- cascade /cascadep/export/shain lev 1 STRANGE ? Script 'amzfs-snapshot' command 'PRE-DLE-BACKUP': Can't use string ("") as a symbol ref while "strict refs" in use at /usr/perl5/site_perl/5.8.4/Amanda/Script_App.pm line 120. ? Script 'amzfs-snapshot' command 'PRE-DLE-BACKUP' exited with status 9: see /tmp/amanda/client/cascade/sendbackup.20101103183611.debug sendbackup: info BACKUP=APPLICATION sendbackup: info APPLICATION=amstar sendbackup: info RECOVER_CMD=/usr/local/bin/gzip -dc |/usr/local/libexec/amanda/application/amstar restore [./file-to-restore]+ sendbackup: info COMPRESS_SUFFIX=.gz sendbackup: info end | Type of this level 1 dump: full | Date of this level 1 dump: Wed Nov 3 18:36:12 2010 | Date of last level 0 dump: Wed Oct 6 18:31:57 2010 | /opt/schily/bin/star: 2110149 blocks + 0 bytes (total of 21607925760 bytes = 21101490.00k). | Dump record level 1 dump: Wed Nov 3 18:36:12 2010 written sendbackup: size 21101490 sendbackup: end \ (brought to you by Amanda version 3.1.2) --- Brian R Cuttler brian.cutt...@wadsworth.org Computer Systems Support(v) 518 486-1697 Wadsworth Center(f) 518 473-6384 NYS Department of HealthHelp Desk 518 473-0773 IMPORTANT NOTICE: This e-mail and any attachments may contain confidential or sensitive information which is, or may be, legally privileged or otherwise protected by law from further disclosure. It is intended only for the addressee. If you received this in error or from someone who was not authorized to send it to you, please do not distribute, copy or use it or any attachments. Please notify the sender immediately by reply e-mail and delete this from your system. Thank you for your cooperation.
Re: amanda 3.1.2 on Solaris 10x86
Installed 3.1.2 on the client, client and server both Solaris 10x86. Result is the same, no improvement. > amcheck -c curie finsen Amanda Backup Client Hosts Check ERROR: finsen: service selfcheck: selfcheck: error [open pipe to /usr/local/libexec/amanda/application/amzfs-snapshot: Too many open files] ERROR: finsen: service /usr/local/libexec/amanda/selfcheck failed: pid 1230 exited with code 1 Client check: 1 host checked in 113.009 seconds. 2 problems found. (brought to you by Amanda 3.1.2) On Wed, Oct 27, 2010 at 09:14:03AM -0400, Brian Cuttler wrote: > > This is a new error in our amcheck. This particular client, finsen > (server curie, client!=server) is pushing 180 DLEs, not sure how > many DLE there are in the disklist, but this problem seems client > specific. > > First step will be amanda client update, still running 2.6.1p1-20091023 > on client. > > > > /usr/local/sbin/amcheck -c curie > > Amanda Backup Client Hosts Check > > ERROR: finsen: service selfcheck: selfcheck: error [open pipe to > /usr/local/libexec/amanda/application/amzfs-snapshot: Too many open files] > ERROR: finsen: service /usr/local/libexec/amanda/selfcheck failed: pid > 21210 exited with code 1 > Client check: 36 hosts checked in 108.809 seconds. 2 problems found. > > (brought to you by Amanda 3.1.2) > > --- >Brian R Cuttler brian.cutt...@wadsworth.org >Computer Systems Support(v) 518 486-1697 >Wadsworth Center(f) 518 473-6384 >NYS Department of HealthHelp Desk 518 473-0773 > > > > IMPORTANT NOTICE: This e-mail and any attachments may contain > confidential or sensitive information which is, or may be, legally > privileged or otherwise protected by law from further disclosure. It > is intended only for the addressee. If you received this in error or > from someone who was not authorized to send it to you, please do not > distribute, copy or use it or any attachments. Please notify the > sender immediately by reply e-mail and delete this from your > system. Thank you for your cooperation. > > --- Brian R Cuttler brian.cutt...@wadsworth.org Computer Systems Support(v) 518 486-1697 Wadsworth Center(f) 518 473-6384 NYS Department of HealthHelp Desk 518 473-0773 IMPORTANT NOTICE: This e-mail and any attachments may contain confidential or sensitive information which is, or may be, legally privileged or otherwise protected by law from further disclosure. It is intended only for the addressee. If you received this in error or from someone who was not authorized to send it to you, please do not distribute, copy or use it or any attachments. Please notify the sender immediately by reply e-mail and delete this from your system. Thank you for your cooperation.
amanda 3.1.2 on Solaris 10x86
This is a new error in our amcheck. This particular client, finsen (server curie, client!=server) is pushing 180 DLEs, not sure how many DLE there are in the disklist, but this problem seems client specific. First step will be amanda client update, still running 2.6.1p1-20091023 on client. > /usr/local/sbin/amcheck -c curie Amanda Backup Client Hosts Check ERROR: finsen: service selfcheck: selfcheck: error [open pipe to /usr/local/libexec/amanda/application/amzfs-snapshot: Too many open files] ERROR: finsen: service /usr/local/libexec/amanda/selfcheck failed: pid 21210 exited with code 1 Client check: 36 hosts checked in 108.809 seconds. 2 problems found. (brought to you by Amanda 3.1.2) --- Brian R Cuttler brian.cutt...@wadsworth.org Computer Systems Support(v) 518 486-1697 Wadsworth Center(f) 518 473-6384 NYS Department of HealthHelp Desk 518 473-0773 IMPORTANT NOTICE: This e-mail and any attachments may contain confidential or sensitive information which is, or may be, legally privileged or otherwise protected by law from further disclosure. It is intended only for the addressee. If you received this in error or from someone who was not authorized to send it to you, please do not distribute, copy or use it or any attachments. Please notify the sender immediately by reply e-mail and delete this from your system. Thank you for your cooperation.