Re: LanFree very low performance
Have you found the problem? What kind of drives? What speed FC? How many drives zoned to each FC port? Type of switch? Host or drive compression? Andy Huebner -Original Message- From: ADSM: Dist Stor Manager [mailto:ads...@vm.marist.edu] On Behalf Of peppix Sent: Wednesday, November 24, 2010 2:44 AM To: ADSM-L@VM.MARIST.EDU Subject: [ADSM-L] LanFree very low performance @Ullrich Mdnz, thanks: I have 5 filesystem and the max mount point for this node is 12. The throughput reported isn't ok cause referred to the sum of all sessions backup via fiber channel (lanfree) and isn't acceptable for a FC disk storage (not SATA). @David McClelland, thanks: how can I obtain this output? @chart2: 1) I have 5 filesystem (/oracle/SID/data1-2-3-4-5) 2) Can you explain me this point? 3) yes, consider that with the same tape drives I backup SAP by TDP with an average of 300MB/s 4) yes, I see fc (2 ports) throughput by nmon, I see the 5 tape drives allocated to the storage agent node, I see node wirte directly in the tapes thanks all friends +-- |This was sent by barberi.giuse...@gmail.com via Backup Central. |Forward SPAM to ab...@backupcentral.com. +-- This e-mail (including any attachments) is confidential and may be legally privileged. If you are not an intended recipient or an authorized representative of an intended recipient, you are prohibited from using, copying or distributing the information in this e-mail or its attachments. If you have received this e-mail in error, please notify the sender immediately by return e-mail and delete all copies of this message and any attachments. Thank you.
LanFree very low performance
Have you resolved this problem ? Have you tried to replace the LANFREECommmethod to use SHAREDMEM instead of TCPIP ? Regards Maciej +-- |This was sent by mianowski.mac...@gmail.com via Backup Central. |Forward SPAM to ab...@backupcentral.com. +--
LanFree very low performance
@Ullrich Mdnz, thanks: I have 5 filesystem and the max mount point for this node is 12. The throughput reported isn't ok cause referred to the sum of all sessions backup via fiber channel (lanfree) and isn't acceptable for a FC disk storage (not SATA). @David McClelland, thanks: how can I obtain this output? @chart2: 1) I have 5 filesystem (/oracle/SID/data1-2-3-4-5) 2) Can you explain me this point? 3) yes, consider that with the same tape drives I backup SAP by TDP with an average of 300MB/s 4) yes, I see fc (2 ports) throughput by nmon, I see the 5 tape drives allocated to the storage agent node, I see node wirte directly in the tapes thanks all friends +-- |This was sent by barberi.giuse...@gmail.com via Backup Central. |Forward SPAM to ab...@backupcentral.com. +--
LanFree very low performance
I have a doubt: the datafiles are 20GB each one...but the TXNByteLimit=2097152 (2GB infact is the maximum for tsm 5.5). Could be it the problem? +-- |This was sent by barberi.giuse...@gmail.com via Backup Central. |Forward SPAM to ab...@backupcentral.com. +--
LanFree very low performance
no reply...? +-- |This was sent by barberi.giuse...@gmail.com via Backup Central. |Forward SPAM to ab...@backupcentral.com. +--
Antwort: [ADSM-L] LanFree very low performance
Hi peppix, you are using incremental backup for an offline database backup. I wonder, how you deal with 5 tape drives. Normally, backup incremental is using one session per mountpoint. set max. number of mountpoints in node definition for parallelism. The throughput reported is ok for single session backup via LAN, It is slow for a large file backup via LANfree for a completely fibre channel based RAID system, but acceptable for SATA storage. Have a look at your storage environment and node definitions with respect to the directory layout of the database environment. regards Ulli - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - Ullrich Mänz System-Integration FRITZ MACZIOL Software und Computervertrieb GmbH Ludwig Str. 180D, 63067 Offenbach, Germany Mobil: +49 170 7678434 Fax: +49 69 38013500 10 Web: http://www.fum.de Amtsgericht Ulm, Handelsregister-Nummer: HRB 1936 Geschäftsführer: Heribert Fritz, Oliver Schallhorn, Frank Haines Inhaber: Imtech N.V., Gouda, Niederlande Referenzen finden Sie auf unserer Website, Rubrik 'News'. Von:peppix tsm-fo...@backupcentral.com An: ADSM-L@VM.MARIST.EDU Datum: 23.11.2010 00:25 Betreff:[ADSM-L] LanFree very low performance Gesendet von: ADSM: Dist Stor Manager ADSM-L@VM.MARIST.EDU Hi all, I'm trying to backup an oracle db (5TB) by lanfree, but the transfer speed is 70 mb/s (over 5 drives)!! The db is offiline so I use the incremental backup. The client configuration (v.5.5.2.2): SErvername X COMMMethodTCPip TCPPort 1500 TCPServeraddress XXX DISKBUFFSIZE 1023 TCPWindowsize 1024 TCPBUffsize 512 passwordaccess generate nodename XXX RESOURCEUTILIZATION 10 TCPNOdelay YES TXNByteLimit 2097152 LargeCommBuffer NO CommRestartDuration 5 CommRestartInterval 15 schedmode prompted managedservices schedule webclient ERRORlogname /usr/tivoli/tsm/client/ba/bin/dsmerror.log ERRORlogrete7 D SCHEDlogname /usr/tivoli/tsm/client/ba/bin/dsmsched.log schedlogrete 7 D inclexcl /usr/tivoli/tsm/client/ba/bin/inclexcl.lst enablelanfreeyes LANFREECommmethod TCPIP LANFREETCPPort1500 Server configuration (v.5.5.4.0): COMMmethod TCPIP TCPPort1500 TCPWindowsize 1024 TCPBufsize32 TCPNODELAY YES COMMmethod HTTP HTTPPort 1580 COMMmethod SHaredmem SHMPort 1510 IDLETimeout 2880 LANGuage en_US DATEformat 2 TIMEformat 1 NUMberformat5 EXPInterval 0 MIRRORREAD LOG NORMAL MIRRORREAD DB NORMAL MIRRORWRITE LOG PARALLEL MIRRORWRITE DB SEQUENTIAL VOLUMEHistory /tsmdblog/config/volhistory.txt VOLUMEHistory /usr/tivoli/tsm/server/bin/volhistory.txt DEVCONFig /tsmdblog/config/devconfig.txt DEVCONFig /usr/tivoli/tsm/server/bin/devconfig.txt BUFPoolsize 32768 LOGPoolsize 4096 TXNGroupmax 256 MOVEBatchsize 1000 MOVESizethresh1024 tcpnodelay YES DNSLOOKUP NO COMMTIMEOUT14400 MAXSESSIONS 80 SANDISCOVERYON Considerations: - 12 drives installed in the library - SAN and TSM work good (with the same tsm server in the same SAN I backup a lot of SAP by TDP at 300MB/s) - all server backupped by incremental have the same problem (same configuration but different san switch and different hba). Can you help me please? thanks, best regards +-- |This was sent by barberi.giuse...@gmail.com via Backup Central. |Forward SPAM to ab...@backupcentral.com. +--
Re: Antwort: [ADSM-L] LanFree very low performance
Peppix, It may be helpful if you are able to send to the list the output of a backup session summary report from the client for a backup operation which exhibited this poor performance. Rgds, __ David Mc, London, UK -Original Message- From: ADSM: Dist Stor Manager [mailto:ads...@vm.marist.edu] On Behalf Of Ullrich Mänz Sent: 23 November 2010 14:09 To: ADSM-L@VM.MARIST.EDU Subject: [ADSM-L] Antwort: [ADSM-L] LanFree very low performance Hi peppix, you are using incremental backup for an offline database backup. I wonder, how you deal with 5 tape drives. Normally, backup incremental is using one session per mountpoint. set max. number of mountpoints in node definition for parallelism. The throughput reported is ok for single session backup via LAN, It is slow for a large file backup via LANfree for a completely fibre channel based RAID system, but acceptable for SATA storage. Have a look at your storage environment and node definitions with respect to the directory layout of the database environment. regards Ulli - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - Ullrich Mänz System-Integration FRITZ MACZIOL Software und Computervertrieb GmbH Ludwig Str. 180D, 63067 Offenbach, Germany Mobil: +49 170 7678434 Fax: +49 69 38013500 10 Web: http://www.fum.de Amtsgericht Ulm, Handelsregister-Nummer: HRB 1936 Geschäftsführer: Heribert Fritz, Oliver Schallhorn, Frank Haines Inhaber: Imtech N.V., Gouda, Niederlande Referenzen finden Sie auf unserer Website, Rubrik 'News'. Von:peppix tsm-fo...@backupcentral.com An: ADSM-L@VM.MARIST.EDU Datum: 23.11.2010 00:25 Betreff:[ADSM-L] LanFree very low performance Gesendet von: ADSM: Dist Stor Manager ADSM-L@VM.MARIST.EDU Hi all, I'm trying to backup an oracle db (5TB) by lanfree, but the transfer speed is 70 mb/s (over 5 drives)!! The db is offiline so I use the incremental backup. The client configuration (v.5.5.2.2): SErvername X COMMMethodTCPip TCPPort 1500 TCPServeraddress XXX DISKBUFFSIZE 1023 TCPWindowsize 1024 TCPBUffsize 512 passwordaccess generate nodename XXX RESOURCEUTILIZATION 10 TCPNOdelay YES TXNByteLimit 2097152 LargeCommBuffer NO CommRestartDuration 5 CommRestartInterval 15 schedmode prompted managedservices schedule webclient ERRORlogname /usr/tivoli/tsm/client/ba/bin/dsmerror.log ERRORlogrete7 D SCHEDlogname /usr/tivoli/tsm/client/ba/bin/dsmsched.log schedlogrete 7 D inclexcl /usr/tivoli/tsm/client/ba/bin/inclexcl.lst enablelanfreeyes LANFREECommmethod TCPIP LANFREETCPPort1500 Server configuration (v.5.5.4.0): COMMmethod TCPIP TCPPort1500 TCPWindowsize 1024 TCPBufsize32 TCPNODELAY YES COMMmethod HTTP HTTPPort 1580 COMMmethod SHaredmem SHMPort 1510 IDLETimeout 2880 LANGuage en_US DATEformat 2 TIMEformat 1 NUMberformat5 EXPInterval 0 MIRRORREAD LOG NORMAL MIRRORREAD DB NORMAL MIRRORWRITE LOG PARALLEL MIRRORWRITE DB SEQUENTIAL VOLUMEHistory /tsmdblog/config/volhistory.txt VOLUMEHistory /usr/tivoli/tsm/server/bin/volhistory.txt DEVCONFig /tsmdblog/config/devconfig.txt DEVCONFig /usr/tivoli/tsm/server/bin/devconfig.txt BUFPoolsize 32768 LOGPoolsize 4096 TXNGroupmax 256 MOVEBatchsize 1000 MOVESizethresh1024 tcpnodelay YES DNSLOOKUP NO COMMTIMEOUT14400 MAXSESSIONS 80 SANDISCOVERYON Considerations: - 12 drives installed in the library - SAN and TSM work good (with the same tsm server in the same SAN I backup a lot of SAP by TDP at 300MB/s) - all server backupped by incremental have the same problem (same configuration but different san switch and different hba). Can you help me please? thanks, best regards +-- |This was sent by barberi.giuse...@gmail.com via Backup Central. |Forward SPAM to ab...@backupcentral.com. +--
Re: Antwort: [ADSM-L] LanFree very low performance
A couple questions 1) How is this 5TB laid out, 1,2,3,4 or more file systems? 2) How many streams do you see when the backup is running? (Resource utilization / mutli streaming is by File System for flat file backups. 3) Are the tape drives on dedicated HBA's? 4) Are you sure that the Data is going over the fibre? If not configured properly TSM will automatically direct the backups over the LAN (sounds right for 70MBS) Charles -Original Message- From: ADSM: Dist Stor Manager [mailto:ads...@vm.marist.edu] On Behalf Of David McClelland Sent: Tuesday, November 23, 2010 8:14 AM To: ADSM-L@VM.MARIST.EDU Subject: Re: [ADSM-L] Antwort: [ADSM-L] LanFree very low performance Peppix, It may be helpful if you are able to send to the list the output of a backup session summary report from the client for a backup operation which exhibited this poor performance. Rgds, __ David Mc, London, UK -Original Message- From: ADSM: Dist Stor Manager [mailto:ads...@vm.marist.edu] On Behalf Of Ullrich Mänz Sent: 23 November 2010 14:09 To: ADSM-L@VM.MARIST.EDU Subject: [ADSM-L] Antwort: [ADSM-L] LanFree very low performance Hi peppix, you are using incremental backup for an offline database backup. I wonder, how you deal with 5 tape drives. Normally, backup incremental is using one session per mountpoint. set max. number of mountpoints in node definition for parallelism. The throughput reported is ok for single session backup via LAN, It is slow for a large file backup via LANfree for a completely fibre channel based RAID system, but acceptable for SATA storage. Have a look at your storage environment and node definitions with respect to the directory layout of the database environment. regards Ulli - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - Ullrich Mänz System-Integration FRITZ MACZIOL Software und Computervertrieb GmbH Ludwig Str. 180D, 63067 Offenbach, Germany Mobil: +49 170 7678434 Fax: +49 69 38013500 10 Web: http://www.fum.de Amtsgericht Ulm, Handelsregister-Nummer: HRB 1936 Geschäftsführer: Heribert Fritz, Oliver Schallhorn, Frank Haines Inhaber: Imtech N.V., Gouda, Niederlande Referenzen finden Sie auf unserer Website, Rubrik 'News'. Von:peppix tsm-fo...@backupcentral.com An: ADSM-L@VM.MARIST.EDU Datum: 23.11.2010 00:25 Betreff:[ADSM-L] LanFree very low performance Gesendet von: ADSM: Dist Stor Manager ADSM-L@VM.MARIST.EDU Hi all, I'm trying to backup an oracle db (5TB) by lanfree, but the transfer speed is 70 mb/s (over 5 drives)!! The db is offiline so I use the incremental backup. The client configuration (v.5.5.2.2): SErvername X COMMMethodTCPip TCPPort 1500 TCPServeraddress XXX DISKBUFFSIZE 1023 TCPWindowsize 1024 TCPBUffsize 512 passwordaccess generate nodename XXX RESOURCEUTILIZATION 10 TCPNOdelay YES TXNByteLimit 2097152 LargeCommBuffer NO CommRestartDuration 5 CommRestartInterval 15 schedmode prompted managedservices schedule webclient ERRORlogname /usr/tivoli/tsm/client/ba/bin/dsmerror.log ERRORlogrete7 D SCHEDlogname /usr/tivoli/tsm/client/ba/bin/dsmsched.log schedlogrete 7 D inclexcl /usr/tivoli/tsm/client/ba/bin/inclexcl.lst enablelanfreeyes LANFREECommmethod TCPIP LANFREETCPPort1500 Server configuration (v.5.5.4.0): COMMmethod TCPIP TCPPort1500 TCPWindowsize 1024 TCPBufsize32 TCPNODELAY YES COMMmethod HTTP HTTPPort 1580 COMMmethod SHaredmem SHMPort 1510 IDLETimeout 2880 LANGuage en_US DATEformat 2 TIMEformat 1 NUMberformat5 EXPInterval 0 MIRRORREAD LOG NORMAL MIRRORREAD DB NORMAL MIRRORWRITE LOG PARALLEL MIRRORWRITE DB SEQUENTIAL VOLUMEHistory /tsmdblog/config/volhistory.txt VOLUMEHistory /usr/tivoli/tsm/server/bin/volhistory.txt DEVCONFig /tsmdblog/config/devconfig.txt DEVCONFig /usr/tivoli/tsm/server/bin/devconfig.txt BUFPoolsize 32768 LOGPoolsize 4096 TXNGroupmax 256 MOVEBatchsize 1000 MOVESizethresh1024 tcpnodelay YES DNSLOOKUP NO COMMTIMEOUT14400 MAXSESSIONS 80 SANDISCOVERYON Considerations: - 12 drives installed in the library - SAN and TSM work good (with the same tsm server in the same SAN I backup a lot of SAP by TDP at 300MB/s) - all server backupped
LanFree very low performance
Hi all, I'm trying to backup an oracle db (5TB) by lanfree, but the transfer speed is 70 mb/s (over 5 drives)!! The db is offiline so I use the incremental backup. The client configuration (v.5.5.2.2): SErvername X COMMMethodTCPip TCPPort 1500 TCPServeraddress XXX DISKBUFFSIZE 1023 TCPWindowsize 1024 TCPBUffsize 512 passwordaccess generate nodename XXX RESOURCEUTILIZATION 10 TCPNOdelay YES TXNByteLimit 2097152 LargeCommBuffer NO CommRestartDuration 5 CommRestartInterval 15 schedmode prompted managedservices schedule webclient ERRORlogname /usr/tivoli/tsm/client/ba/bin/dsmerror.log ERRORlogrete7 D SCHEDlogname /usr/tivoli/tsm/client/ba/bin/dsmsched.log schedlogrete 7 D inclexcl/usr/tivoli/tsm/client/ba/bin/inclexcl.lst enablelanfreeyes LANFREECommmethod TCPIP LANFREETCPPort1500 Server configuration (v.5.5.4.0): COMMmethod TCPIP TCPPort1500 TCPWindowsize 1024 TCPBufsize32 TCPNODELAY YES COMMmethod HTTP HTTPPort 1580 COMMmethod SHaredmem SHMPort 1510 IDLETimeout 2880 LANGuage en_US DATEformat 2 TIMEformat 1 NUMberformat5 EXPInterval 0 MIRRORREAD LOG NORMAL MIRRORREAD DB NORMAL MIRRORWRITE LOG PARALLEL MIRRORWRITE DB SEQUENTIAL VOLUMEHistory /tsmdblog/config/volhistory.txt VOLUMEHistory /usr/tivoli/tsm/server/bin/volhistory.txt DEVCONFig /tsmdblog/config/devconfig.txt DEVCONFig /usr/tivoli/tsm/server/bin/devconfig.txt BUFPoolsize 32768 LOGPoolsize 4096 TXNGroupmax 256 MOVEBatchsize 1000 MOVESizethresh1024 tcpnodelay YES DNSLOOKUP NO COMMTIMEOUT14400 MAXSESSIONS 80 SANDISCOVERYON Considerations: - 12 drives installed in the library - SAN and TSM work good (with the same tsm server in the same SAN I backup a lot of SAP by TDP at 300MB/s) - all server backupped by incremental have the same problem (same configuration but different san switch and different hba). Can you help me please? thanks, best regards +-- |This was sent by barberi.giuse...@gmail.com via Backup Central. |Forward SPAM to ab...@backupcentral.com. +--
