Re: Questions and Answers and Thanks
* Chris Marble [EMAIL PROTECTED] (Sat, Feb 17, 2001 at 07:59:17PM -0800) Gerhard den Hollander wrote: I noticed when looking through the logs that the *dumper* performance is around the 1Kps (or less) on my system , whereas the *taper* gets a performance of about 7 Kps. So apparently it's not the speedn of my tapedrive that's the bottleneck, but soemthing within amanda. I have now turned compression off and im hoping this will imporve matters. Are there any other ways to tweak amanda.conf to improve dumper performance Best of luck finding your current bottleneck. I did some experiments (I still need to write this out and stick it on a proper website or somesuch :) ) Anyway, the bottleneck is (In my case) the mutli pipe that amanda does tar cvf - +--- holdingdisk | +--- | tar tvf - -- index daemon Sticking gzip in there makes things even worse. What I did is: - Make sure I have a big holding disk - Patch/Hack sendsize to use the calcsize executable iso gnutar to calculate estimates (estimate generation went down frm well over 4 hours to 45 minutes) - set maxdumps to 4 (having 4 dumps in paralel to holding disk) - dump everything from holding disk to tape. With this I get upto 11K performance to tape And while the avergae performance of a backup to dumper has dropped to ~ 2.5 Ks (was 3K whitout compression, 1K with) I have 4 of them inparalel giving approx 10Ks I never got the bandwidth setting corect on my setup so I have a LOT of different dump-types with different maxdumps and dumpcycle settings. I've got 36Gb of holding disk and a single 50Gb AIT-2 drive. One of the 18 machines I'm backing up has a 36Gb drive with 30Gb of already gzipped data on it. I work to keep the full backups of that drive confined to weekends. Or use guntar, and split the big disk in smaller gnutarrable slices. That's what I did with the 420G disk, I've made a bunch of slices all of which are 50G and I have 50+ G of holding disk space (on that same disk). My backup host is a Dell Precision 610 with 2 SCSI cards. I'm going to move the tape drive to the internal controlled since my holding disks are one the external one. Maybe I'll pick up some speed there. The holding disk is 4 9Gb drives striped with software RAID. I formatted for large block sizes and few inodes to improve large file performance. I'm running RedHat Linux 6.2 with kernel 2.2.16-8. Machine's got a single 500MHz Xeon CPU and 256Mb RAM. I know a faster CPU will help during the gzip phase. Will more RAM? Depends on what else you are running. I noticed that a 500Mhz can give rather excellent theoughput with gzip -fast. Since it's a linux box , you may want to look into using reiserFS. I found that file access with Reiser is faster than ext2 (although nothing shocking) esp. when going through a lot of smaller files in one swoop. Gerhard, @jasongeo.com == The Acoustic Motorbiker == -- and family | |Oo. __O__0 |__/-=`\, =`\, (*) (=)/(=)(=)/(=)
Re: amrestore problem
Am Freitag, 16. Februar 2001 20:57 schrieben Sie: root@fileserver:/usr/local/sbin ./amrestore /dev/sg5 king /dev/sg5 is a changer. The tape device is /dev/nst0, and that's what amrestore wants. OK, i will testing at theses day. Thanks a lot. Bye Juergen -- Dies ist eine Microsoft freie Mail!
Re: amreport Problem
Am Freitag, 16. Februar 2001 20:57 schrieben Sie: Hi Alexandre! amreport: mail command failed: /usr/sbin/sendmail -s "Daily AMANDA MAIL REPORT FOR BogusMonth 0, 0" [EMAIL PROTECTED] It shouldn't be running sendmail directly. It should be using `Mail', `mailx' or `mail', as per configure. Why did you override the MAILER choice? Hmi didn't give them another name for the Mail. I compiled amanda with the standard options. Where can i change the mailname to the original name? Bye Juergen -- Dies ist eine Microsoft freie Mail!
message: ...missing estimate on Red Hat Linux client from Irix 6.5 host
I am in the process of configuring an amanda setup to backup Irix6.5 and Red Hat Linux 6.0 systems. The host is Irix based, and Irix to Irix backup works fine using xfsbackup. The linux client is configured to use GNU tar 1.12. The recommended tar patch is applied. The host is not configured to use tar. When introducing the Linux system in the scheme, the backup fails in the planning stage with the following message. What am I doing wrong ?? Gerrit Hommersom [EMAIL PROTECTED] ==LOG FROM AMDUMP== . . . READING CONF FILES... startup took 0.010 secs SETTING UP FOR ESTIMATES... setting up estimates for linux1.aaa.aaa.aaa:/boot linux1.aaa.aaa.aaa.:/boot overdue 11373 days for level 0 setup_estimate: linux1.aaa.aaa.aaa:/boot: command 0, options: last_level -1 next_level0 -11373 level_days 0 getting estimates 0 (0) -1 (-1) -1 (-1) setting up estimates took 0.001 secs GETTING ESTIMATES... driver: pid 9119631 executable /usr/prog/amanda/amanda-2.4.2/libexec/driver version 2.4.2 driver: send-cmd time 0.009 to taper: START-TAPER 20010219 error result for host tnlnx1.eur.dow.com disk /boot: missing estimate getting estimates took 0.025 secs FAILED QUEUE: 0: linux1.aaa.aaa.aaa /boot DONE QUEUE: empty ANALYZING ESTIMATES... planner: FAILED linux1.aaa.aaa.aaa /boot 0 [missing result for /boot in linux1.aaa.aaa.aaa response] INITIAL SCHEDULE (size 264): . . .
spam messages in the amanda-user mailing list
There are now daily spam messages about toner supplies going to the amanda mailing list. This is a big annoyance. Please do something to prevent such a thing from happening again. If needed I can provide headers and the emails that I recieved. Regards, Ryan Williams
Re: spam messages in the amanda-user mailing list
As a reminder: If you are at a pay-phone, call the 1-800 number they gave. Tell them you don't LIKE sapm. And walk away knowing that you cost them $0.35 a minute. (they may have a better rate) On Mon, 19 Feb 2001, Ryan Williams wrote: There are now daily spam messages about toner supplies going to the amanda mailing list. This is a big annoyance. Please do something to prevent such a thing from happening again. If needed I can provide headers and the emails that I recieved. Regards, Ryan Williams
[Fwd: enp3.unam.mx spam relay]
Hello all, My experience trying to help some scientists at UNAM is that unam.mx is a disaster area, therefore this e-mail is a shot in the dark at best. FYI I am not an admin of amanda-users or the server that hosts it, so don't complain to me about spam or other problems. Original Message Subject: enp3.unam.mx spam relay Date: Mon, 19 Feb 2001 14:35:34 -0500 From: Jonathan Dill [EMAIL PROTECTED] Organization: CARB To: [EMAIL PROTECTED], [EMAIL PROTECTED], [EMAIL PROTECTED] Dear administrators, enp3.unam.mx has incorrect e-mail configuration which allows spammers everywhere in the world to use it to send spam. Please refer the admin of the system to http://maps.vix.com/tsi for instructions on the correct way to configure a SMTP server. This particular spammer sends several spam messages to the amanda-users-list which is very rude and annoying, so I hope somebody can do something about it. Original Message Return-Path: [EMAIL PROTECTED] Received: from ashd1-1.relay.mail.uu.net ([199.171.54.245]) byumbi3.umbi.umd.edu (Netscape Messaging Server 4.15) with ESMTPid G90R4300.HKS for [EMAIL PROTECTED]; Mon, 19 Feb 2001 14:21:39 -0500 Received: from surly.omniscient.com by mr0.ash.ops.us.uu.net with ESMTP (peer crosschecked as: surly.omniscient.com [208.213.83.10])id QQkdbx04110;Mon, 19 Feb 2001 19:18:09 GMT Received: (from root@localhost)by surly.omniscient.com (8.11.1/8.11.1) id f1JJE9a169507for amanda.org.amanda-users-list; Mon, 19 Feb 2001 19:14:09 GMT Received: from enp3 (enp3.unam.mx [132.248.93.100])by surly.omniscient.com (8.11.1/8.11.1) with SMTP id f1JJCld169568for [EMAIL PROTECTED]; Mon, 19 Feb 2001 14:12:47 -0500 (EST) Received: from 132.248.93.100 by enp3 (SMI-8.6/SMI-SVR4)id UAA03664; Thu, 15 Feb 2001 20:20:14 -0600 From: [EMAIL PROTECTED] Message-Id: 200102160220.UAA03664@enp3 To: [EMAIL PROTECTED] Date: Thu, 15 Feb 01 01:26:44 EST Subject: toner supplies Sender: [EMAIL PROTECTED] Precedence: bulk PLEASE FORWARD TO THE PERSON RESPONSIBLE FOR PURCHASING YOUR LASER PRINTER SUPPLIES VORTEX SUPPLIES -SPECIALS OF THE DAY ON LASER TONER SUPPLIES AT DISCOUNT PRICES-- LASER PRINTER TONER CARTRIDGES COPIER AND FAX CARTRIDGES WE ARE --THE-- PLACE TO BUY YOUR TONER CARTRIDGES BECAUSE YOU SAVE UP TO 30% FROM OFFICE DEPOT'S, QUILL'S OR OFFICE MAX'S EVERY DAY LOW PRICES ORDER BY PHONE:1-888-288-9043 ORDER BY FAX: 1-888-977-1577 CUSTOMER SERVICE: 1-888-248-2015 E-MAIL REMOVAL LINE: 1-888-248-4930 UNIVERSITY AND/OR SCHOOL PURCHASE ORDERS WELCOME. (NO CREDIT APPROVAL REQUIRED) ALL OTHER PURCHASE ORDER REQUESTS REQUIRE CREDIT APPROVAL. PAY BY CHECK (C.O.D), CREDIT CARD OR PURCHASE ORDER (NET 30 DAYS). IF YOUR ORDER IS BY CREDIT CARD PLEASE LEAVE YOUR CREDIT CARD # PLUS EXPIRATION DATE. IF YOUR ORDER IS BY PURCHASE ORDER LEAVE YOUR SHIPPING/BILLING ADDRESSES AND YOUR P.O. NUMBER NO SHIPPING CHARGES FOR ORDERS $49 OR OVER ADD $4.75 FOR ORDERS UNDER $49. C.O.D. ORDERS ADD $4.5 TO SHIPPING CHARGES. FOR THOSE OF YOU WHO REQUIRE MORE INFORMATION ABOUT OUR COMPANY INCUDING FEDERAL TAX ID NUMBER, CLOSEST SHIPPING OR CORPORATE ADDRESS IN THE CONTINENTAL U.S. OR FOR CATALOG REQUESTS PLEASE CALL OUR CUSTOMER SERVICE LINE 1-888-248-2015 OUR NEW (LASER PRINTER TONER CARTRIDGE) PRICiES ARE AS FOLLOWS: (PLEASE ORDER BY PAGE NUMBER AND/OR ITEM NUMBER) HEWLETT PACKARD: (ON PAGE 2) ITEM #1 LASERJET SERIES 4L,4P (74A)$44 ITEM #2 LASERJET SERIES 1100 (92A)-$44 ITEM #3 LASERJET SERIES 2 (95A)---$39 ITEM #4 LASERJET SERIES 2P (75A)-$54 ITEM #5 LASERJET SERIES 5P,6P,5MP, 6MP (3903A)--$44 ITEM #6 LASERJET SERIES 5SI, 5000 (29A)--$95 ITEM #7 LASERJET SERIES 2100 (96A)-$74 ITEM #8 LASERJET SERIES 8100 (82X)---$145 ITEM #9 LASERJET SERIES 5L/6L (3906A0--$35 ITEM #10 LASERJET SERIES 4V-$95 ITEM #11 LASERJET SERIES 4000 (27X)-$72 ITEM #12 LASERJET SERIES 3SI/4SI (91A)$54 ITEM #13 LASERJET SERIES 4, 4M, 5,5M---$49 HEWLETT PACKARD FAX (ON PAGE 2) ITEM #14 LASERFAX 500, 700 (FX1)--$49 ITEM #15 LASERFAX 5000,7000 (FX2)--$54 ITEM #16 LASERFAX (FX3)$59 ITEM #17 LASERFAX (FX4)$54 LEXMARK/IBM (ON PAGE 3) OPTRA 4019, 4029 HIGH YIELD---$89 OPTRA R, 4039, 4049 HIGH YIELD-$105 OPTRA E$59 OPTRA N--$115 OPTRA S--$165 - EPSON (ON PAGE 4) ACTION LASER 7000,7500,8000,9000---$105 ACTION LASER 1000,1500-$105 CANON PRINTERS (ON PAGE 5) PLEASE CALL FOR MODELS
Re: spam messages in the amanda-user mailing list
Ryan Williams wrote: There are now daily spam messages about toner supplies going to the amanda mailing list. This is a big annoyance. Please do something to prevent such a thing from happening again. If needed I can provide headers and the emails that I recieved. I'm mad about it too, but what makes you think that John R. Jackson can do anything about it, or anybody else subscribed to the list for that matter? Majordomo doesn't have much capabilities for spam filtering as far as I know. Personally, I'd like to see the list run on mailman rather than majordomo. The list appears to be hosted on surly.omniscient.com. I'm going to inquire about helping out with the admin of the server and some other options. Until then, I'd suggest getting a real e-mail client like Netscape Messenger and use a message filter on "Sender-Contains" and "toner" then "Move To-Spam" or something like that. -- "Jonathan F. Dill" ([EMAIL PROTECTED]) CARB Systems and Network Administrator Home Page: http://www.umbi.umd.edu/~dill
tweaking the schedule
I have a couple of machines that are slow and poorly connected to my tape server. In every instance, I happen to *know* that if these machines were to appear first in the backup schedule, the backup would finish more quickly. Is there a way I can push them to the front? Ben
Re: spam messages in the amanda-user mailing list
There are now daily spam messages about toner supplies going to the amanda mailing list. This is a big annoyance. Please do something to prevent such a thing from happening again. If needed I can provide headers and the emails that I recieved. your best bet when you see repetative spam like that is to send something about it to [EMAIL PROTECTED] Full headers of the offensive messages are always appreciated. The offending address that's been relaying these have been blacklisted. -Todd
file locking, 2.4.1 vs. 2.4.2
On an Auspex, SunOS caeauspex 4.1.4 1 AUSPEX-VERSION 1.9.2M1Z2 aushp When running configure for 2.4.2p1, I get: checking whether posix fcntl locking works... no checking whether flock locking works... no checking whether lockf locking works... no checking whether lnlock locking works... no configure: warning: *** No working file locking capability found! configure: warning: *** Be VERY VERY careful. When running configure for 2.4.1p1, I get: checking whether posix fcntl locking works... yes Same machine, same terminal window, different distribution directory. Did the test for file locking change? My configure command for the respective cases above: ./configure --with-user=root --with-group=bin \ --prefix=/home/amanda/common --exec-prefix=/home/amanda_2.4.2 ./configure --with-user=root --with-group=bin \ --prefix=/home/amanda/common --exec-prefix=/home/amanda_2.4.1 Mario Obejas Engineering Automation Computing Raytheon Electronic Systems 310-334-7201 (Voice) 310-366-4867 (Pager)
Re: spam messages in the amanda-user mailing list
I do not have any experience with majordomo but I know that, with mailman, it is easy to do. If nothing else there could be a line put into the sendmail access file that says REJECT bad.relay.mailserver.mx or just make shure that the person is subscribed before they can send email to the list. Like I said though, I do not run majordomo and I am unfamiliar with how it works. I am just assuming that this can be done. Regards, Ryan Williams - Original Message - From: "Jonathan Dill" [EMAIL PROTECTED] To: "Ryan Williams" [EMAIL PROTECTED] Cc: [EMAIL PROTECTED]; [EMAIL PROTECTED] Sent: Monday, February 19, 2001 3:11 PM Subject: Re: spam messages in the amanda-user mailing list Ryan Williams wrote: There are now daily spam messages about toner supplies going to the amanda mailing list. This is a big annoyance. Please do something to prevent such a thing from happening again. If needed I can provide headers and the emails that I recieved. I'm mad about it too, but what makes you think that John R. Jackson can do anything about it, or anybody else subscribed to the list for that matter? Majordomo doesn't have much capabilities for spam filtering as far as I know. Personally, I'd like to see the list run on mailman rather than majordomo. The list appears to be hosted on surly.omniscient.com. I'm going to inquire about helping out with the admin of the server and some other options. Until then, I'd suggest getting a real e-mail client like Netscape Messenger and use a message filter on "Sender-Contains" and "toner" then "Move To-Spam" or something like that. -- "Jonathan F. Dill" ([EMAIL PROTECTED]) CARB Systems and Network Administrator Home Page: http://www.umbi.umd.edu/~dill
Re: List of dumptypes?
Where might I find a list of dumptypes that amanda knows about by default (like root-tar, nocomp-user, etc)? It depends on what you mean by "by default". Amanda has some dumptypes built in, but usually the ones used are explicitly defined in your amanda.conf, either from the sample file that comes with Amanda or by creating them yourself. You can see the built in ones (and everything else) with this: cd server-src make conffile ./conffile /path/to/your/amanda.conf -Paul John R. Jackson, Technical Software Specialist, [EMAIL PROTECTED]
Re: coherency between amindexd and amrecover
saturn:~ # amrecover -C DailySet1 -s saturn -d /dev/nst0 AMRECOVER Version 2.4.1p1. Contacting server on saturn ... amrecover: Unexpected server end of file What does "Unexpectes server end.." mean?? Who produces this message?? The message comes from amrecover and means the amindexd server quit. Go to "saturn" and look in /tmp/amanda/amindexd*debug for more info. It is also not possible to connect via telnet to the port: Why would you think it would be possible? Jörn, John R. Jackson, Technical Software Specialist, [EMAIL PROTECTED]
Re: amreport Problem
Hmi didn't give them another name for the Mail. I compiled amanda with the standard options. Where can i change the mailname to the original name? It is built in from what ./configure finds. You'll have to remove config.cache (or "make distclean") and rerun ./configure to get this reset. Pay particular attention to where it hunts for a mail program. For instance, it says this for me: ... checking for gzip... /usr/local/bin/gzip checking for Mail... /usr/ucb/Mail checking for mt... /usr/bin/mt ... If ./configure cannot find the right program (it looks for "Mail", "mailx" and "mail"), you can set the "MAILER" environment variable to a full path to a mail program that understands "-s subject user". When you're done, run "amadmin xx version | grep MAIL" and see what that says. It should point to the path Amanda will use. Bye Juergen John R. Jackson, Technical Software Specialist, [EMAIL PROTECTED]
Re: message: ...missing estimate on Red Hat Linux client from Irix 6. 5 host
When introducing the Linux system in the scheme, the backup fails in the planning stage with the following message. What does "amcheck -cl config" have to say? Gerrit Hommersom John R. Jackson, Technical Software Specialist, [EMAIL PROTECTED]
Re: tweaking the schedule
I have a couple of machines that are slow and poorly connected to my tape server. In every instance, I happen to *know* that if these machines were to appear first in the backup schedule, the backup would finish more quickly. Is there a way I can push them to the front? That's harder than you might think. Planner generates the list of what to do based on size, requests for special service (forced full dumps, etc) and so on. That's a text "file" with one line per disk piped into driver. Driver takes that list and builds a queue of disks to process. That queue is sorted by estimated dump time (which is based on historical information, etc), shortest time first (see read_schedule()). When driver is looking for something to do (see start_some_dumps()), it scans the list in that order. Planner is the one that estimates the time needed and passes that (see below). But note that driver may skip over entries and come back to them later based on other criteria, such as already having maxdumps backups going on to that client, bandwidth, spindle contention, and so on. So the obvious idea of sticking a filter between planner and driver and having it adjust (lie about :-) the estimated times should re-order the queue, but it may not do exactly what you want depending on a lot of other factors. You can see the lines planner generates in the "GENERATING SCHEDULE" section of an amdump.NN file. Here's a sample broken into multiple lines and formatted slightly to ease discussion: fortress.cc.purdue.edu / 1 \ 0 1970:1:1:0:0:0 597618 182 \ 1 2001:2:12:4:43:9 24681 35 The first three fields say this is a dump of "/" on fortress.cc and if we have to drop into degraded mode, the priority should be "1". Note that "priority" is only used in degraded mode -- don't get your hopes up for an easy fix :-). The next four fields say a level 0 based at "1970:1:1:0:0:0" is estimated to need 597618 KBytes and take 182 seconds. The next/last four fields say a level 1 based at "2001:2:12:4:43:9" will need 24681 KBytes and take 35 seconds. The first four fields are what planner wants driver to do. The second four fields are optional and tell driver what to do if it falls back to degraded mode. It shouldn't be too hard to slip a little perl or awk between planner and driver (it's literally a simple pipeline in the amdump script) to tweak the values. And you can test the script with what you see in amdump.NN. The only question is whether it ends up doing what you want. Harder would be going into driver and coming up with some other way of deciding what to do next (start_some_dumps()) in a way that did not make matters worse. I don't think the estimated time is used by Amanda other than to order the initial list, i.e. it's not saved in the database. Rather, the actual results are saved for the next planner run to base its work on. Ben John R. Jackson, Technical Software Specialist, [EMAIL PROTECTED]
Re: file locking, 2.4.1 vs. 2.4.2
Here's your answer, hope it's not too much: It was just what I needed. In file included from common-src/amflock.c:48, from configure:19266: common-src/amanda.h:509: parse error before `areads_dataready' ... This appears to be caused by someone getting a little too enthusiastic with ssize_t (signed size type), which apparently your OS does not provide, at least in the normal include files. Please give the following patch a try. There is still (deliberately) one ssize_t left, so if your OS just plain doesn't have that defined, it may fail when it comes to building this (it will happen in file.c) but I think the patch will at least get you through ./configure. If you have more trouble, let me know and I'll add to the fix. Mario Obejas John R. Jackson, Technical Software Specialist, [EMAIL PROTECTED] file.diff
Re: tweaking the schedule
Ben Elliston wrote: I have a couple of machines that are slow and poorly connected to my tape server. In every instance, I happen to *know* that if these machines were to appear first in the backup schedule, the backup would finish more quickly. Can you put in a delay time for all the rest of the backups? Write up a dumptype and set a value for starttime. Use that dumptype for all the backups but the ones you want to have start first. -- [EMAIL PROTECTED] - HMC UNIX Systems Manager My opinions are my own and probably don't represent anything anyway.
Failure and strange dump summary
Hi ! i have installed amanda 2.4.2 with Debian 2.2 core 2.2.16fix1 in a compaq proliant server i created the host list, tape labels, volume indexand configured my changer ( autoloader 7x DAT DDS-3) all dumps complete successfully but one fails with the following error : /-- luisinII / lev 1 STRANGEsendbackup: start [luisinII:/ level 1]sendbackup: info BACKUP=/bin/tarsendbackup: info RECOVER_CMD=/bin/tar -f... -sendbackup: info end? gtar: ./dev/log: socket ignored| Total bytes written: 143360 (140kB, ?B/s)sendbackup: size 140sendbackup: end\ Can someoneexplain tome what this log means and what's the problem? Regards. José
