Re: amanda 3.1.2 on Solaris 10x86

2010-11-04 Thread Brian Cuttler

Jean-Louis,

On Thu, Nov 04, 2010 at 01:19:58PM -0400, Jean-Louis Martineau wrote:
> The amzfs-snapshot failed, you might find the reason in the 
> amzfs-snapshot or sendbackup debug files.
> 
> With the attached patch, the error message will be in the report.
> 
> Jean-Louis

The debug file is not terribly more informative.

Wait, this is a different file system and a different error, 
I will send this but will look again...no the error I expected
to find is not in any of the debug files from last night.

I'll apply the patch and see what turns up, we've been running
flawlessly since we installed 3.1.2 so I don't know what triggered
the error last night.

Amzfs_snapshot.20101103183611.debug
::
Wed Nov  3 18:36:11 2010: Amzfs_snapshot: pid 22913 ruid 110 euid 110 version 
3.1.2: start at Wed Nov  3 18:36:11 2010
Wed Nov  3 18:36:11 2010: Amzfs_snapshot: pid 22913 ruid 110 euid 110 version 
3.1.2: rename at Wed Nov  3 18:36:11 2010
Wed Nov  3 18:36:11 2010: Amzfs_snapshot: script: Amzfs_snapshot
Wed Nov  3 18:36:11 2010: Amzfs_snapshot: command: pre_dle_backup
Wed Nov  3 18:36:11 2010: Amzfs_snapshot: running: /usr/bin/pfexec 
/usr/sbin/zfs get -H -o value mountpoint /cascadep/export/shain
Wed Nov  3 18:36:11 2010: Amzfs_snapshot: running: /usr/sbin/df 
/cascadep/export/shain
Wed Nov  3 18:36:11 2010: Amzfs_snapshot: running: /usr/bin/pfexec 
/usr/sbin/zfs get -H -o value mountpoint cascadep/export/shain|
Wed Nov  3 18:36:11 2010: Amzfs_snapshot: running: /usr/bin/pfexec 
/usr/sbin/zfs snapshot 
cascadep/export/sh...@amanda-_cascadep_export_shain-current
Wed Nov  3 18:36:12 2010: Amzfs_snapshot: warning: Use of uninitialized value 
in ref-to-glob cast at /usr/perl5/site_perl/5.8.4/Amanda/Script_App.pm line 120.
thank you,

Brian

> 
> Brian Cuttler wrote:
> >client==server
> >
> ># amdump ran perfectly otherwise. Periodically we see errors
> >like this, but we've had pretty good runs since the installation
> >of 3.1.2.
> >
> >- Forwarded message from Amanda/Cascade  -
> >
> >These dumps were to tape Cascade43.
> >The next 2 tapes Amanda expects to use are: Cascade44, Cascade45.
> >FAILURE DUMP SUMMARY:
> >  cascade /cascadep/nalm/alm2 lev 0  FAILED [too many dumper retry: 
> >  [request failed: timeout waiting for ACK]]
> >
> >STRANGE DUMP SUMMARY:
> >  cascade /cascadep/export/shain lev 1  STRANGE (see below)
> >
> >STRANGE DUMP DETAILS:
> >  /-- cascade /cascadep/export/shain lev 1 STRANGE
> >  ? Script 'amzfs-snapshot' command 'PRE-DLE-BACKUP': Can't use string 
> >  ("") as a symbol ref while "strict refs" in use at 
> >  /usr/perl5/site_perl/5.8.4/Amanda/Script_App.pm line 120.
> >  ? Script 'amzfs-snapshot' command 'PRE-DLE-BACKUP' exited with status 9: 
> >  see /tmp/amanda/client/cascade/sendbackup.20101103183611.debug
> >  sendbackup: info BACKUP=APPLICATION
> >  sendbackup: info APPLICATION=amstar
> >  sendbackup: info RECOVER_CMD=/usr/local/bin/gzip -dc 
> >  |/usr/local/libexec/amanda/application/amstar restore 
> >  [./file-to-restore]+
> >  sendbackup: info COMPRESS_SUFFIX=.gz
> >  sendbackup: info end
> >  | Type of this level 1  dump: full
> >  | Date of this level 1  dump: Wed Nov  3 18:36:12 2010
> >  | Date of last level 0  dump: Wed Oct  6 18:31:57 2010
> >  | /opt/schily/bin/star: 2110149 blocks + 0 bytes (total of 21607925760 
> >  bytes = 21101490.00k).
> >  | Dump record  level 1  dump: Wed Nov  3 18:36:12 2010 written
> >  sendbackup: size 21101490
> >  sendbackup: end
> >  \
> >
> >(brought to you by Amanda version 3.1.2)
> >
> >---
> >   Brian R Cuttler brian.cutt...@wadsworth.org
> >   Computer Systems Support(v) 518 486-1697
> >   Wadsworth Center(f) 518 473-6384
> >   NYS Department of HealthHelp Desk 518 473-0773
> >
> >
> >
> >IMPORTANT NOTICE: This e-mail and any attachments may contain
> >confidential or sensitive information which is, or may be, legally
> >privileged or otherwise protected by law from further disclosure.  It
> >is intended only for the addressee.  If you received this in error or
> >from someone who was not authorized to send it to you, please do not
> >distribute, copy or use it or any attachments.  Please notify the
> >sender immediately by reply e-mail and delete this from your
> >system. Thank you for your cooperation.
> >
> >
> >  
> 


---
   Brian R Cuttler brian.cutt...@wadsworth.org
   Computer Systems Support(v) 518 486-1697
   Wadsworth Center(f) 518 473-6384
   NYS Department of HealthHelp Desk 518 473-0773



IMPORTANT NOTICE: This e-mail and any attachments may contain
confidential or sensitive information which is, or may be, legally
privileged or otherwise protected by law from further disclosure.  It
is intended only for the addressee.  If you received this in error or
from someone who was not authorized to

Re: amanda 3.1.2 on Solaris 10x86

2010-11-04 Thread Jean-Louis Martineau
The amzfs-snapshot failed, you might find the reason in the 
amzfs-snapshot or sendbackup debug files.


With the attached patch, the error message will be in the report.

Jean-Louis

Brian Cuttler wrote:

client==server

# amdump ran perfectly otherwise. Periodically we see errors
like this, but we've had pretty good runs since the installation
of 3.1.2.

- Forwarded message from Amanda/Cascade  -

These dumps were to tape Cascade43.
The next 2 tapes Amanda expects to use are: Cascade44, Cascade45.
FAILURE DUMP SUMMARY:
  cascade /cascadep/nalm/alm2 lev 0  FAILED [too many dumper retry: [request 
failed: timeout waiting for ACK]]

STRANGE DUMP SUMMARY:
  cascade /cascadep/export/shain lev 1  STRANGE (see below)

STRANGE DUMP DETAILS:
  /-- cascade /cascadep/export/shain lev 1 STRANGE
  ? Script 'amzfs-snapshot' command 'PRE-DLE-BACKUP': Can't use string ("") as a symbol 
ref while "strict refs" in use at /usr/perl5/site_perl/5.8.4/Amanda/Script_App.pm line 
120.
  ? Script 'amzfs-snapshot' command 'PRE-DLE-BACKUP' exited with status 9: see 
/tmp/amanda/client/cascade/sendbackup.20101103183611.debug
  sendbackup: info BACKUP=APPLICATION
  sendbackup: info APPLICATION=amstar
  sendbackup: info RECOVER_CMD=/usr/local/bin/gzip -dc 
|/usr/local/libexec/amanda/application/amstar restore [./file-to-restore]+
  sendbackup: info COMPRESS_SUFFIX=.gz
  sendbackup: info end
  | Type of this level 1  dump: full
  | Date of this level 1  dump: Wed Nov  3 18:36:12 2010
  | Date of last level 0  dump: Wed Oct  6 18:31:57 2010
  | /opt/schily/bin/star: 2110149 blocks + 0 bytes (total of 21607925760 bytes 
= 21101490.00k).
  | Dump record  level 1  dump: Wed Nov  3 18:36:12 2010 written
  sendbackup: size 21101490
  sendbackup: end
  \

(brought to you by Amanda version 3.1.2)

---
   Brian R Cuttler brian.cutt...@wadsworth.org
   Computer Systems Support(v) 518 486-1697
   Wadsworth Center(f) 518 473-6384
   NYS Department of HealthHelp Desk 518 473-0773



IMPORTANT NOTICE: This e-mail and any attachments may contain
confidential or sensitive information which is, or may be, legally
privileged or otherwise protected by law from further disclosure.  It
is intended only for the addressee.  If you received this in error or
from someone who was not authorized to send it to you, please do not
distribute, copy or use it or any attachments.  Please notify the
sender immediately by reply e-mail and delete this from your
system. Thank you for your cooperation.


  


diff --git a/application-src/amzfs-snapshot.pl b/application-src/amzfs-snapshot.pl
index 3872dd4..11396b9 100644
--- a/application-src/amzfs-snapshot.pl
+++ b/application-src/amzfs-snapshot.pl
@@ -151,6 +151,10 @@ sub command_post_dle_estimate {
 sub command_pre_dle_backup {
 my $self = shift;
 
+my $mesgout_fd;
+open ($mesgout_fd, '>&=1') || die("Can't open mesgout_fd: $!");
+$self->{mesgout} = $mesgout_fd;
+
 $self->zfs_snapshot_set_value();
 if ($self->{error_status} == $Amanda::Script_App::GOOD) {
 	$self->zfs_create_snapshot("backup");


amanda 3.1.2 on Solaris 10x86

2010-11-04 Thread Brian Cuttler

client==server

# amdump ran perfectly otherwise. Periodically we see errors
like this, but we've had pretty good runs since the installation
of 3.1.2.

- Forwarded message from Amanda/Cascade  -

These dumps were to tape Cascade43.
The next 2 tapes Amanda expects to use are: Cascade44, Cascade45.
FAILURE DUMP SUMMARY:
  cascade /cascadep/nalm/alm2 lev 0  FAILED [too many dumper retry: [request 
failed: timeout waiting for ACK]]

STRANGE DUMP SUMMARY:
  cascade /cascadep/export/shain lev 1  STRANGE (see below)

STRANGE DUMP DETAILS:
  /-- cascade /cascadep/export/shain lev 1 STRANGE
  ? Script 'amzfs-snapshot' command 'PRE-DLE-BACKUP': Can't use string ("") as 
a symbol ref while "strict refs" in use at 
/usr/perl5/site_perl/5.8.4/Amanda/Script_App.pm line 120.
  ? Script 'amzfs-snapshot' command 'PRE-DLE-BACKUP' exited with status 9: see 
/tmp/amanda/client/cascade/sendbackup.20101103183611.debug
  sendbackup: info BACKUP=APPLICATION
  sendbackup: info APPLICATION=amstar
  sendbackup: info RECOVER_CMD=/usr/local/bin/gzip -dc 
|/usr/local/libexec/amanda/application/amstar restore [./file-to-restore]+
  sendbackup: info COMPRESS_SUFFIX=.gz
  sendbackup: info end
  | Type of this level 1  dump: full
  | Date of this level 1  dump: Wed Nov  3 18:36:12 2010
  | Date of last level 0  dump: Wed Oct  6 18:31:57 2010
  | /opt/schily/bin/star: 2110149 blocks + 0 bytes (total of 21607925760 bytes 
= 21101490.00k).
  | Dump record  level 1  dump: Wed Nov  3 18:36:12 2010 written
  sendbackup: size 21101490
  sendbackup: end
  \

(brought to you by Amanda version 3.1.2)

---
   Brian R Cuttler brian.cutt...@wadsworth.org
   Computer Systems Support(v) 518 486-1697
   Wadsworth Center(f) 518 473-6384
   NYS Department of HealthHelp Desk 518 473-0773



IMPORTANT NOTICE: This e-mail and any attachments may contain
confidential or sensitive information which is, or may be, legally
privileged or otherwise protected by law from further disclosure.  It
is intended only for the addressee.  If you received this in error or
from someone who was not authorized to send it to you, please do not
distribute, copy or use it or any attachments.  Please notify the
sender immediately by reply e-mail and delete this from your
system. Thank you for your cooperation.




Re: amanda 3.1.2 on Solaris 10x86

2010-10-27 Thread Brian Cuttler

Installed 3.1.2 on the client, client and server both Solaris 10x86.

Result is the same, no improvement.

> amcheck -c curie finsen

Amanda Backup Client Hosts Check

ERROR: finsen: service selfcheck: selfcheck: error [open pipe to 
/usr/local/libexec/amanda/application/amzfs-snapshot: Too many open files]
ERROR: finsen: service /usr/local/libexec/amanda/selfcheck failed: pid 1230 
exited with code 1
Client check: 1 host checked in 113.009 seconds.  2 problems found.

(brought to you by Amanda 3.1.2)


On Wed, Oct 27, 2010 at 09:14:03AM -0400, Brian Cuttler wrote:
> 
> This is a new error in our amcheck. This particular client, finsen
> (server curie, client!=server) is pushing 180 DLEs, not sure how
> many DLE there are in the disklist, but this problem seems client
> specific.
> 
> First step will be amanda client update, still running 2.6.1p1-20091023
> on client.
> 
> 
> > /usr/local/sbin/amcheck -c curie
> 
> Amanda Backup Client Hosts Check
> 
> ERROR: finsen: service selfcheck: selfcheck: error [open pipe to 
> /usr/local/libexec/amanda/application/amzfs-snapshot: Too many open files]
> ERROR: finsen: service /usr/local/libexec/amanda/selfcheck failed: pid 
> 21210 exited with code 1
> Client check: 36 hosts checked in 108.809 seconds.  2 problems found.
> 
> (brought to you by Amanda 3.1.2)
> 
> ---
>Brian R Cuttler brian.cutt...@wadsworth.org
>Computer Systems Support(v) 518 486-1697
>Wadsworth Center(f) 518 473-6384
>NYS Department of HealthHelp Desk 518 473-0773
> 
> 
> 
> IMPORTANT NOTICE: This e-mail and any attachments may contain
> confidential or sensitive information which is, or may be, legally
> privileged or otherwise protected by law from further disclosure.  It
> is intended only for the addressee.  If you received this in error or
> from someone who was not authorized to send it to you, please do not
> distribute, copy or use it or any attachments.  Please notify the
> sender immediately by reply e-mail and delete this from your
> system. Thank you for your cooperation.
> 
> 
---
   Brian R Cuttler brian.cutt...@wadsworth.org
   Computer Systems Support(v) 518 486-1697
   Wadsworth Center(f) 518 473-6384
   NYS Department of HealthHelp Desk 518 473-0773



IMPORTANT NOTICE: This e-mail and any attachments may contain
confidential or sensitive information which is, or may be, legally
privileged or otherwise protected by law from further disclosure.  It
is intended only for the addressee.  If you received this in error or
from someone who was not authorized to send it to you, please do not
distribute, copy or use it or any attachments.  Please notify the
sender immediately by reply e-mail and delete this from your
system. Thank you for your cooperation.




amanda 3.1.2 on Solaris 10x86

2010-10-27 Thread Brian Cuttler

This is a new error in our amcheck. This particular client, finsen
(server curie, client!=server) is pushing 180 DLEs, not sure how
many DLE there are in the disklist, but this problem seems client
specific.

First step will be amanda client update, still running 2.6.1p1-20091023
on client.


> /usr/local/sbin/amcheck -c curie

Amanda Backup Client Hosts Check

ERROR: finsen: service selfcheck: selfcheck: error [open pipe to 
/usr/local/libexec/amanda/application/amzfs-snapshot: Too many open files]
ERROR: finsen: service /usr/local/libexec/amanda/selfcheck failed: pid 
21210 exited with code 1
Client check: 36 hosts checked in 108.809 seconds.  2 problems found.

(brought to you by Amanda 3.1.2)

---
   Brian R Cuttler brian.cutt...@wadsworth.org
   Computer Systems Support(v) 518 486-1697
   Wadsworth Center(f) 518 473-6384
   NYS Department of HealthHelp Desk 518 473-0773



IMPORTANT NOTICE: This e-mail and any attachments may contain
confidential or sensitive information which is, or may be, legally
privileged or otherwise protected by law from further disclosure.  It
is intended only for the addressee.  If you received this in error or
from someone who was not authorized to send it to you, please do not
distribute, copy or use it or any attachments.  Please notify the
sender immediately by reply e-mail and delete this from your
system. Thank you for your cooperation.