Re: Question about NDMP and TSM.
Hi First check compatibility with IBM and EMC. Ron has mentioned a solution that applies to NetApp that may not apply to EMC isilon eg. isilon does not have a vfiler concept. I found that the restrictions of NDMP did not warrant the effort to use it on something like an isilon cluster. The benefit of isilon is the size you can grow them to and the bandwidth you have to storage with multiple nodes. Using NDMP negates all of this and reduces the functionality. - you are limited to the bandwidth a single host(TSM server) and single isilon node can service. - There is no incremental only differential. There is no snapdiff type functionality that NetApps have - you can't use NDMP to back up part of it. - The time it would take to do a full backup. - The time it would take to do a restore. One other niggle is that you need a windows machine to do a graphical restore (Web/Java UI). That said if your data is small then these probably don't matter so much. Grant On 16/07/14 13:51, Gee, Norman wrote: I found out that this is true a long time ago, but it does not stop you from manually doing a move data to empty out a tape volume. It is just a very manual form of reclaim. -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Steven Harris Sent: Tuesday, July 15, 2014 6:48 PM To: ADSM-L@VM.MARIST.EDU Subject: Re: Question about NDMP and TSM. And as a bonus, ndmp storage pools cannot be reclaimed and this means that they hold tapes until the last data has expired. TSM format storage pools can be reclaimed, and if they are file storage pools can be deduped as well. Regards Steve Steven Harris TSM Admin Canberra Australia On 16 July 2014 05:38, Ron Delaware ron.delaw...@us.ibm.com wrote: Ricky, The configuration that you are referring to is what could be considered the 'Traditional' implementation of NDMP. As you have found for yourself, there are a number of restrictions on how the data can be managed though. If you configure the NDMP environment so that a Tivoli Storage Manager controls the data flow instead of the NetApp Appliance, you have more options This configuration will allow you backup up to TSM storage pools (Disk, VTL, Tape), send copies offsite, because the TSM Server controls the destination. You have the option to use a traditional TSM Client utilizing the NDMP protocol or have the TSM server perform the backup and restores using the BACKUP NODE and RESTORE NODE commands. It a table of contents storage pool (disk based only highly recommended) you can perform single file restores. you can also create virtual filespace pointers to your vfiler that will allow you to run simultaneous backups of the vfiler, that could shorten your backup and restore times. Best Regards, _ * Ronald C. Delaware* IBM Level 2 - IT Plus Certified Specialist – Expert IBM Corporation | Tivoli Software IBM Certified Solutions Advisor - Tivoli Storage IBM Certified Deployment Professional Butterfly Solutions Professional 916-458-5726 (Office 925-457-9221 (cell phone) email: *ron.delaw...@us.ibm.com* ron.delaw...@us.ibm.com *Storage Services Offerings* http://www-01.ibm.com/software/tivoli/services/consulting/offers-storage-optimization.html From:Schneider, Jim jschnei...@ussco.com To:ADSM-L@vm.marist.edu Date:07/15/2014 12:19 PM Subject:Re: [ADSM-L] Question about NDMP and TSM. Sent by:ADSM: Dist Stor Manager ADSM-L@vm.marist.edu -- Ricky, The Isilon uses the OneFS file system and TSM views it as one huge file system. If backing up to disk, TSM will attempt to preallocate enough space to back up the entire allocated space on the Isilon. Defining Virtual File systems will not help because directory quota information is not passed to TSM, and TSM only sees the total allocated space. We were able to back up the Isilon to disk when we started on a test system with little data on it, around 25 GB. When we attempted to implement the same backups on a second, well-populated Isilon we ran into the space allocation problem. When backing up to tape, TSM assumes you have unlimited storage available and is able to run VFS backups. We use Virtual File Space Mapping (VFS) and back up to tape. Refer to EMC SR#4646, TSM PMR 23808,122,000. Jim Schneider United Stationers -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU ADSM-L@VM.MARIST.EDU] On Behalf Of Plair, Ricky Sent: Tuesday, July 15, 2014 1:21 PM To: ADSM-L@VM.MARIST.EDU Subject: [ADSM-L] Question about NDMP and TSM. I have been asked to look into backing up our EMC Isilon using our TSM server. Everything I read, seems to point to backing this NDMP device to tape. Problem is, we do not use tape to backup production. I have researched and found a few articles about backing the NDMP device to tape but, there seem to
Fwd: [ADSM-L] Lun versus logical volume for DB volumes
Thanks Ron for the reply Its actually moot as the back end is XIV behind SVCs. But the SAN guys like to allocate standard size luns and my DB luns are all a bit small for their liking, so if I could get the same multithread effect by allocating one big lun, with multiple AIX VGs on it, that would be happiness. Regards Steve. On 16 July 2014 13:05, Ron Delaware ron.delaw...@us.ibm.com wrote: Steven, The logical volumes are not dedicated disks in most cases, which means that other applications may be using the same disks at the same time. With our new TSM Server Blueprint standards, TSM database's over 1TB require 16 luns. You can go to this link to find out more https://www.ibm.com/developerworks/community/wikis/home?lang=en#!/wiki/Tivoli%20Storage%20Manager/page/NEW%20-%20Tivoli%20Storage%20Manager%20Blueprint%20-%20%20Improve%20the%20time-to-value%20of%20your%20deployments Best Regards, _ * Ronald C. Delaware* IBM Level 2 - IT Plus Certified Specialist – Expert IBM Corporation | Tivoli Software IBM Certified Solutions Advisor - Tivoli Storage IBM Certified Deployment Professional Butterfly Solutions Professional 916-458-5726 (Office 925-457-9221 (cell phone) email: *ron.delaw...@us.ibm.com* ron.delaw...@us.ibm.com From:Steven Harris st...@stevenharris.info To:ADSM-L@vm.marist.edu Date:07/15/2014 06:55 PM Subject:[ADSM-L] Lun versus logical volume for DB volumes Sent by:ADSM: Dist Stor Manager ADSM-L@vm.marist.edu -- Hi, I've specced a design for a new TSM server and as recommended have specified multiple luns for the database. The folklore is that DB2 will start one thread per lun so for a big database you use 8 luns and hence get 8 threads. My AIX guy is asking whether I really need 8 luns or will 8 AIX logical volumes have the same effect. Does anyone know or can tell me where to look? Thanks Steve. Steven Harris TSM Admin Canberra Australia
Re: Lun versus logical volume for DB volumes
allocating one big lun, with multiple AIX VGs on it In AIX, a lun is part of a vg. A single lun can only be part of a single vg. Our experience with big databases is with Oracle on AIX. AIX has 2 levels of queues: - on the hba (lsattr -El fcsX | grep num_cmd_elems) - on the lun (lsattr -El hdiskY | grep queue_depth) Your backend with SVC/XIV means that you shouldn't hit disk hot spots on the storage array. This is really good. One problem you can hit is to max out the queue of the host hba, SVC hba or XIV hba. The AIX fcs depth can be seen in the above lsattr cmd. If the AIX fcs queue is full, AIX waits. If the queue at the SVC/XIV is full, that system sends a cmd back to the host saying to stop sending. This causes a slowdown. Since multiple servers probably share the SVC ports, there can be a problem if the aggregate server I/O's fill the SVC port queue. AIX iostat has a stat for tracking if this occurs (sqfull???). This is one reason for having multiple hba's on a server into the SAN, feeding multiple ports on the SVC, into multiple ports on the XIV is really helpful. Be sure the luns are set to algorithm round-robin to make use of multiple paths to the lun. I assume the SVC has the same idea for the backend I/O's to the XIV via multiple paths. There is also a queue for each lun. If your AIX application (DB2, Oracle, whatever) pounds a single lun (hdisk), you can max out this queue. So while you may have lots of backend IOPS in the SVC/XIV, you may not be able to get I/O's through to them. This is why a single big lun in AIX isn't really good. You can raise the queue size of the lun. You can also spread your database/application across multiple luns. For our big systems we allocate lots of luns and spread the AIX VG physical partitions across all the luns (maximum parm of the vg). When we add a lun to a server like this, we then do a reorgvg to re-spread the physical partitions so that all luns are performing I/O. (If you have a hot spot that fits within a single physical partition, there's not much you can do about it!) Think of a lun as having two characteristics: capacity and IOPS. Capacity is easy to get and use up, IOPS can be much harder to get and use. With your SVC in the middle you have 3 levels of virtualization to figure out and handle: AIX LVM (vg's and lv's), the SVC (IOGROUPS, pools, mdisks???, not sure what all), and finally the XIV (different heads and extents spread across all disks).This multiple levels of stripping is called a PLAID. It's really good for random workloads, but can be bad for sequential processing! Interesting . . . doesn't DB2 do some kind of stripping across the separate filesystems you can give the db, and, has limits on concurrent I/O's per filesystem That would make a 4th levels of stripping and tuning!! A, things are so simple! (not) Rick -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Steven Harris Sent: Wednesday, July 16, 2014 8:43 AM To: ADSM-L@VM.MARIST.EDU Subject: Fwd: [ADSM-L] Lun versus logical volume for DB volumes Thanks Ron for the reply Its actually moot as the back end is XIV behind SVCs. But the SAN guys like to allocate standard size luns and my DB luns are all a bit small for their liking, so if I could get the same multithread effect by allocating one big lun, with multiple AIX VGs on it, that would be happiness. Regards Steve. On 16 July 2014 13:05, Ron Delaware ron.delaw...@us.ibm.com wrote: Steven, The logical volumes are not dedicated disks in most cases, which means that other applications may be using the same disks at the same time. With our new TSM Server Blueprint standards, TSM database's over 1TB require 16 luns. You can go to this link to find out more https://www.ibm.com/developerworks/community/wikis/home?lang=en#!/wiki /Tivoli%20Storage%20Manager/page/NEW%20-%20Tivoli%20Storage%20Manager% 20Blueprint%20-%20%20Improve%20the%20time-to-value%20of%20your%20deplo yments Best Regards, _ * Ronald C. Delaware* IBM Level 2 - IT Plus Certified Specialist – Expert IBM Corporation | Tivoli Software IBM Certified Solutions Advisor - Tivoli Storage IBM Certified Deployment Professional Butterfly Solutions Professional 916-458-5726 (Office 925-457-9221 (cell phone) email: *ron.delaw...@us.ibm.com* ron.delaw...@us.ibm.com From:Steven Harris st...@stevenharris.info To:ADSM-L@vm.marist.edu Date:07/15/2014 06:55 PM Subject:[ADSM-L] Lun versus logical volume for DB volumes Sent by:ADSM: Dist Stor Manager ADSM-L@vm.marist.edu -- Hi, I've specced a design for a new TSM server and as recommended have specified multiple luns for the database. The folklore is that DB2 will start one thread per lun so for a big database you
TSM server appears to hang
Hi Everyone, The past couple of days we're had a strange problem with one of our TSM instances (v6.2.5). At times it appears to hang. Last night (and the previous night) it had many servers that got a dozen or more sessions. This is really strange! This morning as I was looking at this, cmds like q vol and q stgpool hang - no response! Commands like q node and q proc work. The server was doing very little I/O. All of a sudden the hung cmds all ran through and the server I/O jumped to 200-400MB/s. Something was locking I/O. I think the many sessions are clients that retry because the server is not responding. In the TSM actlog there are no unusual messages about the time it un-stuck. The only strange entry in the actlog is a ANRD with lockwait error early the previous evening.There are no AIX errors. Any thought? Rick - The information contained in this message is intended only for the personal and confidential use of the recipient(s) named above. If the reader of this message is not the intended recipient or an agent responsible for delivering it to the intended recipient, you are hereby notified that you have received this document in error and that any review, dissemination, distribution, or copying of this message is strictly prohibited. If you have received this communication in error, please notify us immediately, and delete the original message.
Re: TSM server appears to hang
Hi Rick, From my experience, I had problem with an Expire inventory process (was hanging on a very large node in term of items 13 millions ) that froze TSM but it was on 6.1 version. Also, REORG can use a lot of resources an impact TSM. Pierre Billaudeau Analyste en stockage Livraison des Infrastructures Serveurs Société des Alcools du Québec 514-254-6000 x 6559 -Message d'origine- De : ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] De la part de Rhodes, Richard L. Envoyé : 16 juillet 2014 11:08 À : ADSM-L@VM.MARIST.EDU Objet : [ADSM-L] TSM server appears to hang Hi Everyone, The past couple of days we're had a strange problem with one of our TSM instances (v6.2.5). At times it appears to hang. Last night (and the previous night) it had many servers that got a dozen or more sessions. This is really strange! This morning as I was looking at this, cmds like q vol and q stgpool hang - no response! Commands like q node and q proc work. The server was doing very little I/O. All of a sudden the hung cmds all ran through and the server I/O jumped to 200-400MB/s. Something was locking I/O. I think the many sessions are clients that retry because the server is not responding. In the TSM actlog there are no unusual messages about the time it un-stuck. The only strange entry in the actlog is a ANRD with lockwait error early the previous evening.There are no AIX errors. Any thought? Rick - The information contained in this message is intended only for the personal and confidential use of the recipient(s) named above. If the reader of this message is not the intended recipient or an agent responsible for delivering it to the intended recipient, you are hereby notified that you have received this document in error and that any review, dissemination, distribution, or copying of this message is strictly prohibited. If you have received this communication in error, please notify us immediately, and delete the original message. -- Information confidentielle : Le présent message, ainsi que tout fichier qui y est joint, est envoyé à l'intention exclusive de son ou de ses destinataires; il est de nature confidentielle et peut constituer une information privilégiée. Nous avertissons toute personne autre que le destinataire prévu que tout examen, réacheminement, impression, copie, distribution ou autre utilisation de ce message et de tout fichier qui y est joint est strictement interdit. Si vous n'êtes pas le destinataire prévu, veuillez en aviser immédiatement l'expéditeur par retour de courriel et supprimer ce message et tout document joint de votre système. Merci.
Re: TSM server appears to hang
We use to have problem with expiration hangs on v5, but haven't seen this on v6. Will check out if expiration was running overnight or early this morning. The REORG stuff. Is there any way to know when TSm is performing unusual stuff on the db? If this is occurring, I'm not seeing anything in the actlog to indicate this, but maybe it doesn't log anything. Thanks Rick -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Billaudeau, Pierre Sent: Wednesday, July 16, 2014 11:19 AM To: ADSM-L@VM.MARIST.EDU Subject: Re: TSM server appears to hang Hi Rick, From my experience, I had problem with an Expire inventory process (was hanging on a very large node in term of items 13 millions ) that froze TSM but it was on 6.1 version. Also, REORG can use a lot of resources an impact TSM. Pierre Billaudeau Analyste en stockage Livraison des Infrastructures Serveurs Société des Alcools du Québec 514-254-6000 x 6559 -Message d'origine- De : ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] De la part de Rhodes, Richard L. Envoyé : 16 juillet 2014 11:08 À : ADSM-L@VM.MARIST.EDU Objet : [ADSM-L] TSM server appears to hang Hi Everyone, The past couple of days we're had a strange problem with one of our TSM instances (v6.2.5). At times it appears to hang. Last night (and the previous night) it had many servers that got a dozen or more sessions. This is really strange! This morning as I was looking at this, cmds like q vol and q stgpool hang - no response! Commands like q node and q proc work. The server was doing very little I/O. All of a sudden the hung cmds all ran through and the server I/O jumped to 200-400MB/s. Something was locking I/O. I think the many sessions are clients that retry because the server is not responding. In the TSM actlog there are no unusual messages about the time it un-stuck. The only strange entry in the actlog is a ANRD with lockwait error early the previous evening.There are no AIX errors. Any thought? Rick - The information contained in this message is intended only for the personal and confidential use of the recipient(s) named above. If the reader of this message is not the intended recipient or an agent responsible for delivering it to the intended recipient, you are hereby notified that you have received this document in error and that any review, dissemination, distribution, or copying of this message is strictly prohibited. If you have received this communication in error, please notify us immediately, and delete the original message. -- Information confidentielle : Le présent message, ainsi que tout fichier qui y est joint, est envoyé à l'intention exclusive de son ou de ses destinataires; il est de nature confidentielle et peut constituer une information privilégiée. Nous avertissons toute personne autre que le destinataire prévu que tout examen, réacheminement, impression, copie, distribution ou autre utilisation de ce message et de tout fichier qui y est joint est strictement interdit. Si vous n'êtes pas le destinataire prévu, veuillez en aviser immédiatement l'expéditeur par retour de courriel et supprimer ce message et tout document joint de votre système. Merci. - The information contained in this message is intended only for the personal and confidential use of the recipient(s) named above. If the reader of this message is not the intended recipient or an agent responsible for delivering it to the intended recipient, you are hereby notified that you have received this document in error and that any review, dissemination, distribution, or copying of this message is strictly prohibited. If you have received this communication in error, please notify us immediately, and delete the original message.
Re: TSM server appears to hang
Rick, Take a look at APARs IC99934 IT02590 (though supposedly only IT02590 applies to 6.2). Two different issues with similar symptoms; it took close to 7 months to get both issues identified. There are still no patch or maintenance releases with the fixes yet. If your symptoms seem to match one of those APARs, you'll need to open a case with support to get a developer build of your server version with the fix(es) applied. (If one of these issues is what you hit, you were quite lucky that the server recovered on its own! I had to halt or externally kill the server almost every time.) =Dave On 07/16/2014 10:07 AM, Rhodes, Richard L. wrote: Hi Everyone, The past couple of days we're had a strange problem with one of our TSM instances (v6.2.5). At times it appears to hang. Last night (and the previous night) it had many servers that got a dozen or more sessions. This is really strange! This morning as I was looking at this, cmds like q vol and q stgpool hang - no response! Commands like q node and q proc work. The server was doing very little I/O. All of a sudden the hung cmds all ran through and the server I/O jumped to 200-400MB/s. Something was locking I/O. I think the many sessions are clients that retry because the server is not responding. In the TSM actlog there are no unusual messages about the time it un-stuck. The only strange entry in the actlog is a ANRD with lockwait error early the previous evening.There are no AIX errors. Any thought? Rick -- Hello World.David Bronder - Systems Architect Segmentation Fault ITS-EI, Univ. of Iowa Core dumped, disk trashed, quota filled, soda warm. david-bron...@uiowa.edu
Re: TSM server appears to hang
Hi Rick, Have you tried pinpointing the problem using some of the show commands? I'd take a look at: show resq (to see if there are any waiters) Try to correlate a particular session with the problem using the following: show threads show locks show txnt (I believe those are fairly well discussed in past threads on this list.) Check what's going on on the DB2 side. In most cases you'll need to be the instance owner. Here are a few things to check, but I'm sure it's not exhaustive: -Look at the db2diag.log for errors and warnings. -Use 'db2pd -d yourdbname -utilities' and 'db2pd -d yourdbname -reorg' to see if you have any runstats or reorgs running; the output will show the state of anything out there. -Use 'db2top -d yourdbname' , particularly using the 'B' option to view bottlenecks, and the 'U' option to see locks. There's some reasonable documentation on the db2 commands in the Knowledge Center: http://www-01.ibm.com/support/knowledgecenter/SSEPGG_9.8.0/com.ibm.db2.luw.admin.trb.doc/doc/c0054595.html?lang=en http://www-01.ibm.com/support/knowledgecenter/SSEPGG_9.8.0/com.ibm.db2.luw.admin.cmd.doc/doc/r0025222.html?lang=en HTH, Ruth Mitchell U of I, Urbana -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Rhodes, Richard L. Sent: Wednesday, July 16, 2014 10:08 AM To: ADSM-L@VM.MARIST.EDU Subject: [ADSM-L] TSM server appears to hang Hi Everyone, The past couple of days we're had a strange problem with one of our TSM instances (v6.2.5). At times it appears to hang. Last night (and the previous night) it had many servers that got a dozen or more sessions. This is really strange! This morning as I was looking at this, cmds like q vol and q stgpool hang - no response! Commands like q node and q proc work. The server was doing very little I/O. All of a sudden the hung cmds all ran through and the server I/O jumped to 200-400MB/s. Something was locking I/O. I think the many sessions are clients that retry because the server is not responding. In the TSM actlog there are no unusual messages about the time it un-stuck. The only strange entry in the actlog is a ANRD with lockwait error early the previous evening.There are no AIX errors. Any thought? Rick - The information contained in this message is intended only for the personal and confidential use of the recipient(s) named above. If the reader of this message is not the intended recipient or an agent responsible for delivering it to the intended recipient, you are hereby notified that you have received this document in error and that any review, dissemination, distribution, or copying of this message is strictly prohibited. If you have received this communication in error, please notify us immediately, and delete the original message.
Odpověď: [ADSM-L] TSM server appears to hang
Hello, seems like I have been facing the same experience with one of my TSM server (v.6.2.5). I have been quite lucky until now because the server has recovered on its own. I opened a case in this matter with support a few month ago. I was told to focus on setting a time window for reorg activity. Their recommendation: Please find the day of time when the server is not under a heavy workload, if some processes are running it is not a problem. Avoid the time period expire or reclamation. I haven’t done it, yet. The server in question is busy all day long every day. Josef Od: Rhodes, Richard L. rrho...@firstenergycorp.com Komu: ADSM-L@VM.MARIST.EDU Datum: 16.07.2014 17:08 Předmět:[ADSM-L] TSM server appears to hang Odeslal:ADSM: Dist Stor Manager ADSM-L@VM.MARIST.EDU Hi Everyone, The past couple of days we're had a strange problem with one of our TSM instances (v6.2.5). At times it appears to hang. Last night (and the previous night) it had many servers that got a dozen or more sessions. This is really strange! This morning as I was looking at this, cmds like q vol and q stgpool hang - no response! Commands like q node and q proc work. The server was doing very little I/O. All of a sudden the hung cmds all ran through and the server I/O jumped to 200-400MB/s. Something was locking I/O. I think the many sessions are clients that retry because the server is not responding. In the TSM actlog there are no unusual messages about the time it un-stuck. The only strange entry in the actlog is a ANRD with lockwait error early the previous evening.There are no AIX errors. Any thought? Rick - The information contained in this message is intended only for the personal and confidential use of the recipient(s) named above. If the reader of this message is not the intended recipient or an agent responsible for delivering it to the intended recipient, you are hereby notified that you have received this document in error and that any review, dissemination, distribution, or copying of this message is strictly prohibited. If you have received this communication in error, please notify us immediately, and delete the original message.
Re: TSM server appears to hang
We will be looking at all these things. Right now we did the normal shutdown/reboot just to be sure (not sure of what!). Rick -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Mitchell, Ruth Slovik Sent: Wednesday, July 16, 2014 11:34 AM To: ADSM-L@VM.MARIST.EDU Subject: Re: TSM server appears to hang Hi Rick, Have you tried pinpointing the problem using some of the show commands? I'd take a look at: show resq (to see if there are any waiters) Try to correlate a particular session with the problem using the following: show threads show locks show txnt (I believe those are fairly well discussed in past threads on this list.) Check what's going on on the DB2 side. In most cases you'll need to be the instance owner. Here are a few things to check, but I'm sure it's not exhaustive: -Look at the db2diag.log for errors and warnings. -Use 'db2pd -d yourdbname -utilities' and 'db2pd -d yourdbname -reorg' to see if you have any runstats or reorgs running; the output will show the state of anything out there. -Use 'db2top -d yourdbname' , particularly using the 'B' option to view bottlenecks, and the 'U' option to see locks. There's some reasonable documentation on the db2 commands in the Knowledge Center: http://www-01.ibm.com/support/knowledgecenter/SSEPGG_9.8.0/com.ibm.db2.luw.admin.trb.doc/doc/c0054595.html?lang=en http://www-01.ibm.com/support/knowledgecenter/SSEPGG_9.8.0/com.ibm.db2.luw.admin.cmd.doc/doc/r0025222.html?lang=en HTH, Ruth Mitchell U of I, Urbana -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Rhodes, Richard L. Sent: Wednesday, July 16, 2014 10:08 AM To: ADSM-L@VM.MARIST.EDU Subject: [ADSM-L] TSM server appears to hang Hi Everyone, The past couple of days we're had a strange problem with one of our TSM instances (v6.2.5). At times it appears to hang. Last night (and the previous night) it had many servers that got a dozen or more sessions. This is really strange! This morning as I was looking at this, cmds like q vol and q stgpool hang - no response! Commands like q node and q proc work. The server was doing very little I/O. All of a sudden the hung cmds all ran through and the server I/O jumped to 200-400MB/s. Something was locking I/O. I think the many sessions are clients that retry because the server is not responding. In the TSM actlog there are no unusual messages about the time it un-stuck. The only strange entry in the actlog is a ANRD with lockwait error early the previous evening.There are no AIX errors. Any thought? Rick - The information contained in this message is intended only for the personal and confidential use of the recipient(s) named above. If the reader of this message is not the intended recipient or an agent responsible for delivering it to the intended recipient, you are hereby notified that you have received this document in error and that any review, dissemination, distribution, or copying of this message is strictly prohibited. If you have received this communication in error, please notify us immediately, and delete the original message. - The information contained in this message is intended only for the personal and confidential use of the recipient(s) named above. If the reader of this message is not the intended recipient or an agent responsible for delivering it to the intended recipient, you are hereby notified that you have received this document in error and that any review, dissemination, distribution, or copying of this message is strictly prohibited. If you have received this communication in error, please notify us immediately, and delete the original message.
Windows 2012 native Dedupe
Anyone backing up a Win2012 system that is using its native deduplication ? I took a quick scan of the BA client doc (7.1) and did not see any mention of it. Any information/feedback/references would be appreciated. Thanks Rick Adamson
Re: Windows 2012 native Dedupe
Hi Rick, You can use the backup-archive client to back up files on volumes that are deduplicated by Windows. The files are backed up in their rehydrated (non-deduplicated) state. (Note: The files are not rehydrated on the volume, but the rehydration occurs transparently as the file is read by TSM for backup.) During restore, the volume will need to have enough space to contain the non-deduplicated files until Windows can re-deduplicate them. TSM 6.4 client users will want to make sure they have the fix for IC92388 (6.4.1 or later) installed. This APAR does not occur in 7.1. Best regards, - Andy Andrew Raibeck | Tivoli Storage Manager Level 3 Technical Lead | stor...@us.ibm.com IBM Tivoli Storage Manager links: Product support: http://www.ibm.com/support/entry/portal/Overview/Software/Tivoli/Tivoli_Storage_Manager Online documentation: https://www.ibm.com/developerworks/mydeveloperworks/wikis/home/wiki/Tivoli +Documentation+Central/page/Tivoli+Storage+Manager Product Wiki: https://www.ibm.com/developerworks/mydeveloperworks/wikis/home/wiki/Tivoli +Storage+Manager/page/Home ADSM: Dist Stor Manager ADSM-L@vm.marist.edu wrote on 2014-07-16 16:30:33: From: Rick Adamson rickadam...@biloholdings.com To: ADSM-L@vm.marist.edu Date: 2014-07-16 16:31 Subject: Windows 2012 native Dedupe Sent by: ADSM: Dist Stor Manager ADSM-L@vm.marist.edu Anyone backing up a Win2012 system that is using its native deduplication ? I took a quick scan of the BA client doc (7.1) and did not see any mention of it. Any information/feedback/references would be appreciated. Thanks Rick Adamson
Re: TSM server appears to hang
We're having the exact same problem, have been for quite a few months now. It occurred on 6.3.4.100 and 7.1. Running on AIX 6.1 TL7 SP6 hosted on a P740. It gets so bad on ours that I'll have to halt the dsmserv process, perform a db2stop force and then restart TSM. Because it happens at random times and is totally infrequent, I've written a quick and dirty script to make sure that TSM is running and to do the shutdown/restart if the non-responsive behaviour kicks in again. I don't have a solution for you but we've been all the way up the developer chain without much success. What hardware are you running your server on? Matthew McGeary Technical Specialist PotashCorp - Saskatoon 306.933.8921 From: Rhodes, Richard L. rrho...@firstenergycorp.com To: ADSM-L@VM.MARIST.EDU Date: 07/16/2014 09:08 AM Subject:[ADSM-L] TSM server appears to hang Sent by:ADSM: Dist Stor Manager ADSM-L@VM.MARIST.EDU Hi Everyone, The past couple of days we're had a strange problem with one of our TSM instances (v6.2.5). At times it appears to hang. Last night (and the previous night) it had many servers that got a dozen or more sessions. This is really strange! This morning as I was looking at this, cmds like q vol and q stgpool hang - no response! Commands like q node and q proc work. The server was doing very little I/O. All of a sudden the hung cmds all ran through and the server I/O jumped to 200-400MB/s. Something was locking I/O. I think the many sessions are clients that retry because the server is not responding. In the TSM actlog there are no unusual messages about the time it un-stuck. The only strange entry in the actlog is a ANRD with lockwait error early the previous evening.There are no AIX errors. Any thought? Rick - The information contained in this message is intended only for the personal and confidential use of the recipient(s) named above. If the reader of this message is not the intended recipient or an agent responsible for delivering it to the intended recipient, you are hereby notified that you have received this document in error and that any review, dissemination, distribution, or copying of this message is strictly prohibited. If you have received this communication in error, please notify us immediately, and delete the original message.
Re: Question about NDMP and TSM.
Interesting point about NDMP and dedup. Do you have any experience with it? What kind of dedup ratios did you see? -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Steven Harris Sent: Tuesday, July 15, 2014 9:48 PM To: ADSM-L@VM.MARIST.EDU Subject: Re: [ADSM-L] Question about NDMP and TSM. And as a bonus, ndmp storage pools cannot be reclaimed and this means that they hold tapes until the last data has expired. TSM format storage pools can be reclaimed, and if they are file storage pools can be deduped as well. Regards Steve Steven Harris TSM Admin Canberra Australia On 16 July 2014 05:38, Ron Delaware ron.delaw...@us.ibm.com wrote: Ricky, The configuration that you are referring to is what could be considered the 'Traditional' implementation of NDMP. As you have found for yourself, there are a number of restrictions on how the data can be managed though. If you configure the NDMP environment so that a Tivoli Storage Manager controls the data flow instead of the NetApp Appliance, you have more options This configuration will allow you backup up to TSM storage pools (Disk, VTL, Tape), send copies offsite, because the TSM Server controls the destination. You have the option to use a traditional TSM Client utilizing the NDMP protocol or have the TSM server perform the backup and restores using the BACKUP NODE and RESTORE NODE commands. It a table of contents storage pool (disk based only highly recommended) you can perform single file restores. you can also create virtual filespace pointers to your vfiler that will allow you to run simultaneous backups of the vfiler, that could shorten your backup and restore times. Best Regards, _ * Ronald C. Delaware* IBM Level 2 - IT Plus Certified Specialist – Expert IBM Corporation | Tivoli Software IBM Certified Solutions Advisor - Tivoli Storage IBM Certified Deployment Professional Butterfly Solutions Professional 916-458-5726 (Office 925-457-9221 (cell phone) email: *ron.delaw...@us.ibm.com* ron.delaw...@us.ibm.com *Storage Services Offerings* http://www-01.ibm.com/software/tivoli/services/consulting/offers-stor age-optimization.html From:Schneider, Jim jschnei...@ussco.com To:ADSM-L@vm.marist.edu Date:07/15/2014 12:19 PM Subject:Re: [ADSM-L] Question about NDMP and TSM. Sent by:ADSM: Dist Stor Manager ADSM-L@vm.marist.edu -- Ricky, The Isilon uses the OneFS file system and TSM views it as one huge file system. If backing up to disk, TSM will attempt to preallocate enough space to back up the entire allocated space on the Isilon. Defining Virtual File systems will not help because directory quota information is not passed to TSM, and TSM only sees the total allocated space. We were able to back up the Isilon to disk when we started on a test system with little data on it, around 25 GB. When we attempted to implement the same backups on a second, well-populated Isilon we ran into the space allocation problem. When backing up to tape, TSM assumes you have unlimited storage available and is able to run VFS backups. We use Virtual File Space Mapping (VFS) and back up to tape. Refer to EMC SR#4646, TSM PMR 23808,122,000. Jim Schneider United Stationers -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU ADSM-L@VM.MARIST.EDU] On Behalf Of Plair, Ricky Sent: Tuesday, July 15, 2014 1:21 PM To: ADSM-L@VM.MARIST.EDU Subject: [ADSM-L] Question about NDMP and TSM. I have been asked to look into backing up our EMC Isilon using our TSM server. Everything I read, seems to point to backing this NDMP device to tape. Problem is, we do not use tape to backup production. I have researched and found a few articles about backing the NDMP device to tape but, there seem to be more cons than pros. Is there anybody backing up a NDMP device to disk that can give me some pros and, how they are using disk for this task. I appreciate your time! _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ CONFIDENTIALITY NOTICE: This email message, including any attachments, is for the sole use of the intended recipient(s) and may contain confidential and privileged information and/or Protected Health Information (PHI) subject to protection under the law, including the Health Insurance Portability and Accountability Act of 1996, as amended (HIPAA). If you are not the intended recipient or the person responsible for delivering the email to the intended recipient, be advised that you have received this email in error and that any use, disclosure, distribution, forwarding, printing, or copying of this email is strictly prohibited. If you have received this email in error, please notify the sender
Re: Question about NDMP and TSM.
Wanda, this document will give a bit of insight to deduped NAS data. http://www-05.ibm.com/de/events/breakfast/pdf/TSM_Dedup_Best_Practices_v1_0.pdf Best Regards, _ Ronald C. Delaware IBM Level 2 - IT Plus Certified Specialist – Expert IBM Corporation | Tivoli Software IBM Certified Solutions Advisor - Tivoli Storage IBM Certified Deployment Professional Butterfly Solutions Professional 916-458-5726 (Office 925-457-9221 (cell phone) email: ron.delaw...@us.ibm.com Storage Services Offerings From: Prather, Wanda wanda.prat...@icfi.com To: ADSM-L@vm.marist.edu Date: 07/16/2014 07:53 PM Subject:Re: [ADSM-L] Question about NDMP and TSM. Sent by:ADSM: Dist Stor Manager ADSM-L@vm.marist.edu Interesting point about NDMP and dedup. Do you have any experience with it? What kind of dedup ratios did you see? -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Steven Harris Sent: Tuesday, July 15, 2014 9:48 PM To: ADSM-L@VM.MARIST.EDU Subject: Re: [ADSM-L] Question about NDMP and TSM. And as a bonus, ndmp storage pools cannot be reclaimed and this means that they hold tapes until the last data has expired. TSM format storage pools can be reclaimed, and if they are file storage pools can be deduped as well. Regards Steve Steven Harris TSM Admin Canberra Australia On 16 July 2014 05:38, Ron Delaware ron.delaw...@us.ibm.com wrote: Ricky, The configuration that you are referring to is what could be considered the 'Traditional' implementation of NDMP. As you have found for yourself, there are a number of restrictions on how the data can be managed though. If you configure the NDMP environment so that a Tivoli Storage Manager controls the data flow instead of the NetApp Appliance, you have more options This configuration will allow you backup up to TSM storage pools (Disk, VTL, Tape), send copies offsite, because the TSM Server controls the destination. You have the option to use a traditional TSM Client utilizing the NDMP protocol or have the TSM server perform the backup and restores using the BACKUP NODE and RESTORE NODE commands. It a table of contents storage pool (disk based only highly recommended) you can perform single file restores. you can also create virtual filespace pointers to your vfiler that will allow you to run simultaneous backups of the vfiler, that could shorten your backup and restore times. Best Regards, _ * Ronald C. Delaware* IBM Level 2 - IT Plus Certified Specialist – Expert IBM Corporation | Tivoli Software IBM Certified Solutions Advisor - Tivoli Storage IBM Certified Deployment Professional Butterfly Solutions Professional 916-458-5726 (Office 925-457-9221 (cell phone) email: *ron.delaw...@us.ibm.com* ron.delaw...@us.ibm.com *Storage Services Offerings* http://www-01.ibm.com/software/tivoli/services/consulting/offers-stor age-optimization.html From:Schneider, Jim jschnei...@ussco.com To:ADSM-L@vm.marist.edu Date:07/15/2014 12:19 PM Subject:Re: [ADSM-L] Question about NDMP and TSM. Sent by:ADSM: Dist Stor Manager ADSM-L@vm.marist.edu -- Ricky, The Isilon uses the OneFS file system and TSM views it as one huge file system. If backing up to disk, TSM will attempt to preallocate enough space to back up the entire allocated space on the Isilon. Defining Virtual File systems will not help because directory quota information is not passed to TSM, and TSM only sees the total allocated space. We were able to back up the Isilon to disk when we started on a test system with little data on it, around 25 GB. When we attempted to implement the same backups on a second, well-populated Isilon we ran into the space allocation problem. When backing up to tape, TSM assumes you have unlimited storage available and is able to run VFS backups. We use Virtual File Space Mapping (VFS) and back up to tape. Refer to EMC SR#4646, TSM PMR 23808,122,000. Jim Schneider United Stationers -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU ADSM-L@VM.MARIST.EDU] On Behalf Of Plair, Ricky Sent: Tuesday, July 15, 2014 1:21 PM To: ADSM-L@VM.MARIST.EDU Subject: [ADSM-L] Question about NDMP and TSM. I have been asked to look into backing up our EMC Isilon using our TSM server. Everything I read, seems to point to backing this NDMP device to tape. Problem is, we do not use tape to backup production. I have researched and found a few articles about backing the NDMP device to tape but, there seem to be more cons than pros. Is there anybody backing up a NDMP device to disk that can give me some pros and, how they are using disk for this task. I appreciate your time! _ _ _ _ _ _
