Thanks gurus, let me share more info about my setup: Network-speed: On main server: # dmesg | grep -i duplex bnx2: eth0 NIC Copper Link is Up, 1000 Mbps full duplex
On few clients: # dmesg | grep -i duplex tg3: eth0: Link is up at 1000 Mbps, full duplex. # dmesg | grep -i duplex [ 13.122791] e1000e: em1 NIC Link is Up 100 Mbps Full Duplex, Flow Control: None # dmesg | grep -i duplex [ 69.739204] e1000e: em1 NIC Link is Up 100 Mbps Full Duplex, Flow Control: Rx/Tx Selected lines of amanda-config amanda-config for DailySet2 --> http://pastebin.com/42z3RYZb Mostly I am using dumptype local-files, remote-files, remote-files1. Above conf I used for weekly backup. amanda-config for final --> http://pastebin.com/QbHawKnz Above conf I used for monthly backup. Which end with 2.6TB of backup which took 4-5 days. Very recently I have did some fine tuning which I was expected to improve the performance but it was not more than 5%. Like following entries: device_output_buffer_size 128m #performance chunksize 1000 GB #performance inparallel 30 #performance maxdumps 5 #performance blocksize 8192 kbytes #performance readblocksize 8 m #performance Even I was thinking as I am using same disk as holding disk & final backup destination. So I had disable use of holding disk by using following parameter, but no much success. holdingdisk never #performance We having NAS for Holding Disk as well as final backup in virtual tapes. (QNAP TS-879 Pro<http://www.qnap.com/en/index.php?lang=en&sn=822&c=351&sc=698&t=701&n=3423> ) # df -h /nasbackup/ Filesystem Size Used Avail Use% Mounted on 172.21.124.65:/nasbackup 19T 8.3T 11T 44% /nasbackup I have tested & distributed dle that few dle will have compression on server few will have compression on clients. I did not able to observe parallel processing. I can see only one dumping at a time: -bash-4.0$ amstatus DailySet2 | grep dumping bengkulu:/var 0 8g dumping 6g ( 73.75%) (11:52:57) wait for dumping: 0 0g ( 0.00%) dumping to tape : 0 0g ( 0.00%) dumping : 1 6g 8g ( 73.75%) ( 18.47%) -bash-4.0$ I can see only one file get updated in holding disk. # ls -lh /nasbackup/dumps/amanda1/2* total 7.7G -rw-------+ 1 amandabackup disk 7.7G 2013-03-15 12:02 bengkulu._var.0.tmp Can some explain me how to achieve parallel processing ? I am adding more info in next mail. Thanks again. On Thu, Mar 14, 2013 at 9:22 PM, Brian Cuttler <br...@wadsworth.org> wrote: > > Amit, > > I don't think you told us how many client systems, compression > can be done on the client or the server. Also, besides the inparallel > and maxdump settings, are you short on work area - as Jean-Louis > said, the amplot output will help you spot those bottlenecks. > > Brian > > On Thu, Mar 14, 2013 at 08:27:11AM -0400, Jean-Louis Martineau wrote: > > Compression is often a CPU bottleneck, did you check for cpu usage? You > > can try to use pigz instead of gzip if you have available core. > > > > How many dump are you doing in parallel? You can try to increase > > inparallel, netusage and/or maxdumps. > > > > You can use amplot and amstatus to check amanda performance. > > > > Jean-Louis > > > > > > On 03/13/2013 10:44 PM, Amit Karpe wrote: > > >Hi all, > > >I am using Amanda to take backup weekly & monthly. For monthly backup > > >which is 2.5 to 2.7TB in size after backup with compression, it take > > >4-5 days. (Total size is around 6-7 TB, and there 52 entries DLEs, > > >from 10 different host in network. I am backuping on NAS, where I have > > >19T total space.) > > >Off course there are various parameter we have to consider to claim > > >whether it is slow process or not. > > >Could you please let me know how should I check and compare whether my > > >backup process is slow or not ? > > >Which are main parameter which affect Amanda Performance ? > > >Which tool I should use to check Amanda Performance ? > > >Currently I am using following steps: > > > > > >1. I have started monthly backup. > > >2. Using bandwidth monitoring tools i.e. ntop, bmon I am checking > > >Backup Server to NAS bandwidth usage & trafic status. > > >3. Using iotop I am checking status / speed of io operation. > > >4. There are other few tools, which may help to understand io, had > > >disk usage. But as my backup directory is not a local device, (I have > > >mounted as nfs directory) I can't run hdparm or iostat directly. > > >5. Monitoring NAS's admin interface for its bandwidth usage. > > >6. Currently I am checking for some spastics, which help to compare > > >with my current setup. > > > > > >Still I can't understand whether I going right way or not ! > > >It will be if you help me here. > > > > > >-- > > >Regards > > >Amit Karpe. > > >http://www.amitkarpe.com/ > > >http://news.karpe.net.in/ > > > --- > Brian R Cuttler brian.cutt...@wadsworth.org > Computer Systems Support (v) 518 486-1697 > Wadsworth Center (f) 518 473-6384 > NYS Department of Health Help Desk 518 473-0773 > > -- Regards Amit Karpe. http://www.amitkarpe.com/ http://news.karpe.net.in/
