Re: checking date of file to be dumped

2013-06-05 Thread Stefan G. Weichinger
Am 04.06.2013 16:37, schrieb Jon LaBadie:

 Probably not what you are looking for, but you could use smbclient
 to do a dos dir command on the file.
 
   $ smbclient -N -c 'dir ifconfig-mumsxp /t:c' //cyberxp/jon   
   Domain=[CYBERXP] OS=[Windows 5.1] Server=[Windows 2000 LAN Manager]
ifconfig-mumsxpA  933  Mon Feb 21 18:55:46 2011
 
   51199 blocks of size 2097152. 35262 blocks available
   $
 
 The /t:c option causes create timestamp to be printed.
 Of course you still have to get rid of headers etc.

Thanks for the suggestion, Jon ... gotta try that ...

Stefan



amanda 3.3.3 too many files

2013-06-05 Thread Brian Cuttler

Hello amanda users,

I just updates amanda 3.3.0 to 3.3.0 on a Solaris 10/x86 system.
The system is both the server and the client, there are no other
clients of this system.

We have ~265 DLEs on this system (large zfs arrays and all
samba shares are their own file systems and DLE, thank goodness
I was able to talk my manager out of making all user directories
their own DLE as well, though they are their own zfs file systems).

The following errors are -not- new with 3.3.3, we've had them for
a while, I'd hoped the upgrade would take are of it. 

Also the amcheck leaves an amanda-check file around for one of
the zfs file systems (yes, configured to use zfs snapshot). [I'm
pretty sure these two errors are related to one another]

The filesystem amanda-*-check file left is for the same filesystem
each night, unless we add/remove DLE/filesystems. So I think it is
the nth filesystem and at the limit of the open file counter, rather
than something in the file system itself.

I was hoping there was an easy fix for this. Last I recall on the
topic it had to do with the fillm being a 32 bit rather than 64 bit
value (I could be wrong about this).

Otherwise all # amcheck tests run successfully. Will run # amdump
this evening but do not anticipate any issues there.

thank you,

Brian

 amcheck -c finsen

Amanda Backup Client Hosts Check

ERROR: finsen: service selfcheck: selfcheck: Error opening pipe to child: Too 
many open files
ERROR: finsen: service /usr/local/libexec/amanda/selfcheck failed: pid 8590 
exited with code 1
Client check: 1 host checked in 83.304 seconds.  2 problems found.

(brought to you by Amanda 3.3.3)


from /var/log/conlog

Jun  5 10:55:04 finsen amandad[8583]: [ID 927837 daemon.info] connect from 
finsen.wadsworth.org
Jun  5 10:56:27 finsen selfcheck[8590]: [ID 702911 daemon.error] Error opening 
pipe to child: Too many open files





---
   Brian R Cuttler brian.cutt...@wadsworth.org
   Computer Systems Support(v) 518 486-1697
   Wadsworth Center(f) 518 473-6384
   NYS Department of HealthHelp Desk 518 473-0773



Re: amanda 3.3.3 too many files

2013-06-05 Thread Jean-Louis Martineau

Brian,

Can you increase the number of open files at the system level?

amcheck check all DLEs in parallel, you can try to add spindle (in the 
disklist) to reduce parallelism but that can have a bad impact on dump 
performance, so it is not a good workaround.


You would like a maxcheck  setting similar to maxdump, I put it in my 
TODO list.


Jean-Louis

On 06/05/2013 11:05 AM, Brian Cuttler wrote:

Hello amanda users,

I just updates amanda 3.3.0 to 3.3.0 on a Solaris 10/x86 system.
The system is both the server and the client, there are no other
clients of this system.

We have ~265 DLEs on this system (large zfs arrays and all
samba shares are their own file systems and DLE, thank goodness
I was able to talk my manager out of making all user directories
their own DLE as well, though they are their own zfs file systems).

The following errors are -not- new with 3.3.3, we've had them for
a while, I'd hoped the upgrade would take are of it.

Also the amcheck leaves an amanda-check file around for one of
the zfs file systems (yes, configured to use zfs snapshot). [I'm
pretty sure these two errors are related to one another]

The filesystem amanda-*-check file left is for the same filesystem
each night, unless we add/remove DLE/filesystems. So I think it is
the nth filesystem and at the limit of the open file counter, rather
than something in the file system itself.

I was hoping there was an easy fix for this. Last I recall on the
topic it had to do with the fillm being a 32 bit rather than 64 bit
value (I could be wrong about this).

Otherwise all # amcheck tests run successfully. Will run # amdump
this evening but do not anticipate any issues there.

thank you,

Brian


amcheck -c finsen

Amanda Backup Client Hosts Check

ERROR: finsen: service selfcheck: selfcheck: Error opening pipe to child: Too 
many open files
ERROR: finsen: service /usr/local/libexec/amanda/selfcheck failed: pid 8590 
exited with code 1
Client check: 1 host checked in 83.304 seconds.  2 problems found.

(brought to you by Amanda 3.3.3)


from /var/log/conlog

Jun  5 10:55:04 finsen amandad[8583]: [ID 927837 daemon.info] connect from 
finsen.wadsworth.org
Jun  5 10:56:27 finsen selfcheck[8590]: [ID 702911 daemon.error] Error opening 
pipe to child: Too many open files





---
Brian R Cuttler brian.cutt...@wadsworth.org
Computer Systems Support(v) 518 486-1697
Wadsworth Center(f) 518 473-6384
NYS Department of HealthHelp Desk 518 473-0773





Re: amanda 3.3.3 too many files

2013-06-05 Thread Jon LaBadie
On Wed, Jun 05, 2013 at 11:05:36AM -0400, Brian Cuttler wrote:
 
 Hello amanda users,
 
 I just updates amanda 3.3.0 to 3.3.0 on a Solaris 10/x86 system.
 The system is both the server and the client, there are no other
 clients of this system.
 
 We have ~265 DLEs on this system (large zfs arrays and all
 samba shares are their own file systems and DLE, thank goodness
 I was able to talk my manager out of making all user directories
 their own DLE as well, though they are their own zfs file systems).
 
 The following errors are -not- new with 3.3.3, we've had them for
 a while, I'd hoped the upgrade would take are of it. 
 
 Also the amcheck leaves an amanda-check file around for one of
 the zfs file systems (yes, configured to use zfs snapshot). [I'm
 pretty sure these two errors are related to one another]
 
 The filesystem amanda-*-check file left is for the same filesystem
 each night, unless we add/remove DLE/filesystems. So I think it is
 the nth filesystem and at the limit of the open file counter, rather
 than something in the file system itself.
 
 I was hoping there was an easy fix for this. Last I recall on the
 topic it had to do with the fillm being a 32 bit rather than 64 bit
 value (I could be wrong about this).

It could very well be too many files open.  My research says
Solaris 10 default value for process.max-file-descriptor
is 256.  Check it with ulimit -n.  Solaris maintains both
a soft and a hard set of limits for some parameters.
To check the hard limit try ulimit -H -n.

For process.max-file-descriptor an ordinary user can reduce
the hard limit but not increase it.  That user can also
reduce the soft limit and can raise it to a maximum of
the hard limit.

To raise the soft limit try either:

 ulimit -S -n 1024

or something like:

  prctl -n process.max-file-descriptor -t basic -v  1024 -r -i process $$

These could go in amanda's .profile and that would help for
login sessions, but I doubt it would help for cron started
jobs.  You may have to run it in a wrapper.

With root access you can change the system default, but I
doubt you want it changed at the system level.  Maybe I'm
wrong, you probably only need to change the amanda server(s).

Jon
-- 
Jon H. LaBadie j...@jgcomp.com
 11226 South Shore Rd.  (703) 787-0688 (H)
 Reston, VA  20190  (609) 477-8330 (C)


Re: amanda 3.3.3 too many files

2013-06-05 Thread Brian Cuttler

Jean-Louis,

Yes, I did find some information on a run time mechanism to
increase the 256 file limit (file limit stored in unsigned character).

The work-around employes requires the exection of /usr/lib/extendedFILE.so.1
prior to the binary being executed.

Following up on your maxcheck and Spindle number, I wonder if I 
couldn't automatically build an alternate disklist file with 
spindle number and swap it in and out. It would have to be done
dynamically (since my disklist changes and making changes in 
multiple locations is error prone), but that can be scripted and
called from cron.

/* I need something that will handle both formats of DLE
 *
finsen  /export2 zfs-snapshot2
finsen  /export/home-AZ /export/home   {
user-tar2
include ./[A-Z]*
}
 *
 */

Since this is an amanda-client issue, rather than an amanda server
issue, I need to ask you, how to execute this on the client-side
before attempting to check the DLE list. Is there a way to invoke
this from the amanda daemon?

 - Alternatively, if someone better versed than I am on the Solaris
   inetd or in SMF knows how to insert the requisit command on the
   client side - I would be appreciative if they would share their
   information.

thank you,

Brian


On Wed, Jun 05, 2013 at 11:54:35AM -0400, Jean-Louis Martineau wrote:
 Brian,
 
 Can you increase the number of open files at the system level?
 
 amcheck check all DLEs in parallel, you can try to add spindle (in the 
 disklist) to reduce parallelism but that can have a bad impact on dump 
 performance, so it is not a good workaround.
 
 You would like a maxcheck  setting similar to maxdump, I put it in my 
 TODO list.
 
 Jean-Louis
 
 On 06/05/2013 11:05 AM, Brian Cuttler wrote:
 Hello amanda users,
 
 I just updates amanda 3.3.0 to 3.3.0 on a Solaris 10/x86 system.
 The system is both the server and the client, there are no other
 clients of this system.
 
 We have ~265 DLEs on this system (large zfs arrays and all
 samba shares are their own file systems and DLE, thank goodness
 I was able to talk my manager out of making all user directories
 their own DLE as well, though they are their own zfs file systems).
 
 The following errors are -not- new with 3.3.3, we've had them for
 a while, I'd hoped the upgrade would take are of it.
 
 Also the amcheck leaves an amanda-check file around for one of
 the zfs file systems (yes, configured to use zfs snapshot). [I'm
 pretty sure these two errors are related to one another]
 
 The filesystem amanda-*-check file left is for the same filesystem
 each night, unless we add/remove DLE/filesystems. So I think it is
 the nth filesystem and at the limit of the open file counter, rather
 than something in the file system itself.
 
 I was hoping there was an easy fix for this. Last I recall on the
 topic it had to do with the fillm being a 32 bit rather than 64 bit
 value (I could be wrong about this).
 
 Otherwise all # amcheck tests run successfully. Will run # amdump
 this evening but do not anticipate any issues there.
 
  thank you,
 
  Brian
 
 amcheck -c finsen
 Amanda Backup Client Hosts Check
 
 ERROR: finsen: service selfcheck: selfcheck: Error opening pipe to child: 
 Too many open files
 ERROR: finsen: service /usr/local/libexec/amanda/selfcheck failed: pid 
 8590 exited with code 1
 Client check: 1 host checked in 83.304 seconds.  2 problems found.
 
 (brought to you by Amanda 3.3.3)
 
 
 from /var/log/conlog
 
 Jun  5 10:55:04 finsen amandad[8583]: [ID 927837 daemon.info] connect from 
 finsen.wadsworth.org
 Jun  5 10:56:27 finsen selfcheck[8590]: [ID 702911 daemon.error] Error 
 opening pipe to child: Too many open files
 
 
 
 
 
 ---
 Brian R Cuttler brian.cutt...@wadsworth.org
 Computer Systems Support(v) 518 486-1697
 Wadsworth Center(f) 518 473-6384
 NYS Department of HealthHelp Desk 518 473-0773
 
 
---
   Brian R Cuttler brian.cutt...@wadsworth.org
   Computer Systems Support(v) 518 486-1697
   Wadsworth Center(f) 518 473-6384
   NYS Department of HealthHelp Desk 518 473-0773



Re: amanda 3.3.3 too many files

2013-06-05 Thread Jean-Louis Martineau

On 06/05/2013 01:41 PM, Brian Cuttler wrote:

Jean-Louis,

Yes, I did find some information on a run time mechanism to
increase the 256 file limit (file limit stored in unsigned character).

The work-around employes requires the exection of /usr/lib/extendedFILE.so.1
prior to the binary being executed.

Following up on your maxcheck and Spindle number, I wonder if I
couldn't automatically build an alternate disklist file with
spindle number and swap it in and out. It would have to be done
dynamically (since my disklist changes and making changes in
multiple locations is error prone), but that can be scripted and
called from cron.

/* I need something that will handle both formats of DLE
  *
finsen  /export2 zfs-snapshot2
finsen  /export/home-AZ /export/home   {
 user-tar2
 include ./[A-Z]*
 }
  *
  */

Since this is an amanda-client issue, rather than an amanda server
issue, I need to ask you, how to execute this on the client-side
before attempting to check the DLE list. Is there a way to invoke
this from the amanda daemon?

It must be done on the server before amcheck is executed.

./script-add-spindle  disklist  disklist.spindle
./amcheck CONF -odiskfile=disklist.spindle

Jean-Louis



Re: amanda 3.3.3 too many files

2013-06-05 Thread Brian Cuttler

Jean-Louis,

Thank you, I'm sorry I was unclear. Yes, of course the disklist
needs to be in place when I invoke amcheck on the server.

I'd meant that I need to find out how to up the file limit on
the client, which is a more difficult proposition since its
SMF/INET and not simply something I can script in cron on the
server. The fact that the client and the server are the same
box doesn't help much in this case.

thank you,

Brian

On Wed, Jun 05, 2013 at 03:08:45PM -0400, Jean-Louis Martineau wrote:
 On 06/05/2013 01:41 PM, Brian Cuttler wrote:
 Jean-Louis,
 
 Yes, I did find some information on a run time mechanism to
 increase the 256 file limit (file limit stored in unsigned character).
 
 The work-around employes requires the exection of 
 /usr/lib/extendedFILE.so.1
 prior to the binary being executed.
 
 Following up on your maxcheck and Spindle number, I wonder if I
 couldn't automatically build an alternate disklist file with
 spindle number and swap it in and out. It would have to be done
 dynamically (since my disklist changes and making changes in
 multiple locations is error prone), but that can be scripted and
 called from cron.
 
 /* I need something that will handle both formats of DLE
   *
 finsen  /export2 zfs-snapshot2
 finsen  /export/home-AZ /export/home   {
  user-tar2
  include ./[A-Z]*
  }
   *
   */
 
 Since this is an amanda-client issue, rather than an amanda server
 issue, I need to ask you, how to execute this on the client-side
 before attempting to check the DLE list. Is there a way to invoke
 this from the amanda daemon?
 It must be done on the server before amcheck is executed.
 
 ./script-add-spindle  disklist  disklist.spindle
 ./amcheck CONF -odiskfile=disklist.spindle
 
 Jean-Louis
 
---
   Brian R Cuttler brian.cutt...@wadsworth.org
   Computer Systems Support(v) 518 486-1697
   Wadsworth Center(f) 518 473-6384
   NYS Department of HealthHelp Desk 518 473-0773



Re: amanda 3.3.3 too many files

2013-06-05 Thread Jean-Louis Martineau

On 06/05/2013 03:56 PM, Brian Cuttler wrote:

Jean-Louis,

Thank you, I'm sorry I was unclear. Yes, of course the disklist
needs to be in place when I invoke amcheck on the server.

I'd meant that I need to find out how to up the file limit on
the client, which is a more difficult proposition since its
SMF/INET and not simply something I can script in cron on the
server. The fact that the client and the server are the same
box doesn't help much in this case.
It can help. use the 'local' auth, which is a fork of amandad instead of 
connecting to it.
If you increase the limit for amcheck, then that amandad will get the 
same limit.


Jean-Louis


thank you,

Brian

On Wed, Jun 05, 2013 at 03:08:45PM -0400, Jean-Louis Martineau wrote:

On 06/05/2013 01:41 PM, Brian Cuttler wrote:

Jean-Louis,

Yes, I did find some information on a run time mechanism to
increase the 256 file limit (file limit stored in unsigned character).

The work-around employes requires the exection of
/usr/lib/extendedFILE.so.1
prior to the binary being executed.

Following up on your maxcheck and Spindle number, I wonder if I
couldn't automatically build an alternate disklist file with
spindle number and swap it in and out. It would have to be done
dynamically (since my disklist changes and making changes in
multiple locations is error prone), but that can be scripted and
called from cron.

/* I need something that will handle both formats of DLE
  *
finsen  /export2 zfs-snapshot2
finsen  /export/home-AZ /export/home   {
 user-tar2
 include ./[A-Z]*
 }
  *
  */

Since this is an amanda-client issue, rather than an amanda server
issue, I need to ask you, how to execute this on the client-side
before attempting to check the DLE list. Is there a way to invoke
this from the amanda daemon?

It must be done on the server before amcheck is executed.

./script-add-spindle  disklist  disklist.spindle
./amcheck CONF -odiskfile=disklist.spindle

Jean-Louis


---
Brian R Cuttler brian.cutt...@wadsworth.org
Computer Systems Support(v) 518 486-1697
Wadsworth Center(f) 518 473-6384
NYS Department of HealthHelp Desk 518 473-0773