deduplication status
I've searched the archives but I can't really find the answer I'm looking for. Running on version 6.3.1.0. I have a primary storage pool running dedup. I run the ID DEDUP command, the reclamation command, and the expiration command throughout the daily cycle. I run the Q STGP F=D command to check the Duplicate Data Not Stored numbers and I'm getting 39% right now. Which sounds pretty good, I guess. My question is how to I tell if I'm running the dedup processes aggressively enough. Can I do something to increase that number? I realize that the dedup processes are never really finished because of the new data that is constantly coming in and old data is getting expired. Is there something I can look at to be able to tell if I need to adjust the ID DUP commands I'm running? More processes, less processes or change how long I run it... Something that tells me how much data has not been deduped yet versus how much has been processed. Is that kind of info accessible? David Tyree System Administrator South Georgia Medical Center 229.333.1155
Re: deduplication status
39 is actually not a great number; it means you are getting less than 2 for 1 dedup. Unless you have backups running hard 24 hours a day, those dedup processes should finish. When you do Q PROC, if the processes have any work to do, they show as ACTIVE, if not they show IDLE. I'd think that at some point during the day, you should have at least one of them go idle, then you know you have been as aggressive as you can be. If not I'd add processes until you can see some idle time on at least one of them. Just my 2cents. W -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Tyree, David Sent: Monday, July 28, 2014 11:42 AM To: ADSM-L@VM.MARIST.EDU Subject: [ADSM-L] deduplication status I've searched the archives but I can't really find the answer I'm looking for. Running on version 6.3.1.0. I have a primary storage pool running dedup. I run the ID DEDUP command, the reclamation command, and the expiration command throughout the daily cycle. I run the Q STGP F=D command to check the Duplicate Data Not Stored numbers and I'm getting 39% right now. Which sounds pretty good, I guess. My question is how to I tell if I'm running the dedup processes aggressively enough. Can I do something to increase that number? I realize that the dedup processes are never really finished because of the new data that is constantly coming in and old data is getting expired. Is there something I can look at to be able to tell if I need to adjust the ID DUP commands I'm running? More processes, less processes or change how long I run it... Something that tells me how much data has not been deduped yet versus how much has been processed. Is that kind of info accessible? David Tyree System Administrator South Georgia Medical Center 229.333.1155
Deduplication Status
I have been looking through the commands and outputs of commands, trying to find something to tell me how much deduplication has occurred. Is there one there I am missing? Thanks. -- Andy Carlson --- Gamecube:$150,PSO:$50,Broadband Adapter: $35, Hunters License: $8.95/month, The feeling of seeing the red box with the item you want in it:Priceless.
Re: Deduplication Status
Hi Andy, Are you doing server- or client-side deduplication? What are the versions of your TSM Client and Server? Regards, Mark L. Yakushev From: Andrew Carlson naclos...@gmail.com To: ADSM-L@vm.marist.edu Date: 04/21/2010 12:36 PM Subject:[ADSM-L] Deduplication Status I have been looking through the commands and outputs of commands, trying to find something to tell me how much deduplication has occurred. Is there one there I am missing? Thanks. -- Andy Carlson --- Gamecube:$150,PSO:$50,Broadband Adapter: $35, Hunters License: $8.95/month, The feeling of seeing the red box with the item you want in it:Priceless.
Re: Deduplication Status
Server side dedup, Server V6.2, client V6.2. On Wed, Apr 21, 2010 at 2:39 PM, Mark Yakushev bar...@us.ibm.com wrote: Hi Andy, Are you doing server- or client-side deduplication? What are the versions of your TSM Client and Server? Regards, Mark L. Yakushev From: Andrew Carlson naclos...@gmail.com To: ADSM-L@vm.marist.edu Date: 04/21/2010 12:36 PM Subject: [ADSM-L] Deduplication Status I have been looking through the commands and outputs of commands, trying to find something to tell me how much deduplication has occurred. Is there one there I am missing? Thanks. -- Andy Carlson --- Gamecube:$150,PSO:$50,Broadband Adapter: $35, Hunters License: $8.95/month, The feeling of seeing the red box with the item you want in it:Priceless. -- Andy Carlson --- Gamecube:$150,PSO:$50,Broadband Adapter: $35, Hunters License: $8.95/month, The feeling of seeing the red box with the item you want in it:Priceless.
Re: Deduplication Status
Hi Andy, there are 2 sources for this information. A column in the stgpools table has the MB saved - tsm: select cast(stgpool_name as char(20)) as Name, - cast(space_saved_mb / 1024.0 / 1024.0 as decimal(6,2)) as T Saved from stgpools Name T Saved - - BKP_0 BKP_1A0.00 BKP_1B0.00 BKP_2 24.38 Or 'q stg f=d' will show it - tsm: q stg bkp_2 f=d Storage Pool Name: BKP_2 Storage Pool Type: Primary Device Class Name: VT01_50GB Estimated Capacity: 50,775 G ... ... ... Deduplicate Data?: Yes Processes For Identifying Duplicates: 0 Duplicate Data Not Stored: 24,972 G (56%) Hope this helps, Bill Colwell Draper Lab -Original Message- From: ADSM: Dist Stor Manager [mailto:ads...@vm.marist.edu] On Behalf Of Andrew Carlson Sent: Wednesday, April 21, 2010 4:13 PM To: ADSM-L@VM.MARIST.EDU Subject: Re: Deduplication Status Server side dedup, Server V6.2, client V6.2. On Wed, Apr 21, 2010 at 2:39 PM, Mark Yakushev bar...@us.ibm.com wrote: Hi Andy, Are you doing server- or client-side deduplication? What are the versions of your TSM Client and Server? Regards, Mark L. Yakushev From: Andrew Carlson naclos...@gmail.com To: ADSM-L@vm.marist.edu Date: 04/21/2010 12:36 PM Subject: [ADSM-L] Deduplication Status I have been looking through the commands and outputs of commands, trying to find something to tell me how much deduplication has occurred. Is there one there I am missing? Thanks. -- Andy Carlson --- Gamecube:$150,PSO:$50,Broadband Adapter: $35, Hunters License: $8.95/month, The feeling of seeing the red box with the item you want in it:Priceless. -- Andy Carlson --- Gamecube:$150,PSO:$50,Broadband Adapter: $35, Hunters License: $8.95/month, The feeling of seeing the red box with the item you want in it:Priceless.
Re: Deduplication Status
Thanks for all the answers. I finally figured out why I wasn't seeing anything . . . it helps to read everything . . . I didn't realize the the duplicate data is not released until reclamation processing. Thanks all. On Wed, Apr 21, 2010 at 4:40 PM, Colwell, William F. bcolw...@draper.com wrote: Hi Andy, there are 2 sources for this information. A column in the stgpools table has the MB saved - tsm: select cast(stgpool_name as char(20)) as Name, - cast(space_saved_mb / 1024.0 / 1024.0 as decimal(6,2)) as T Saved from stgpools Name T Saved - - BKP_0 BKP_1A 0.00 BKP_1B 0.00 BKP_2 24.38 Or 'q stg f=d' will show it - tsm: q stg bkp_2 f=d Storage Pool Name: BKP_2 Storage Pool Type: Primary Device Class Name: VT01_50GB Estimated Capacity: 50,775 G ... ... ... Deduplicate Data?: Yes Processes For Identifying Duplicates: 0 Duplicate Data Not Stored: 24,972 G (56%) Hope this helps, Bill Colwell Draper Lab -Original Message- From: ADSM: Dist Stor Manager [mailto:ads...@vm.marist.edu] On Behalf Of Andrew Carlson Sent: Wednesday, April 21, 2010 4:13 PM To: ADSM-L@VM.MARIST.EDU Subject: Re: Deduplication Status Server side dedup, Server V6.2, client V6.2. On Wed, Apr 21, 2010 at 2:39 PM, Mark Yakushev bar...@us.ibm.com wrote: Hi Andy, Are you doing server- or client-side deduplication? What are the versions of your TSM Client and Server? Regards, Mark L. Yakushev From: Andrew Carlson naclos...@gmail.com To: ADSM-L@vm.marist.edu Date: 04/21/2010 12:36 PM Subject: [ADSM-L] Deduplication Status I have been looking through the commands and outputs of commands, trying to find something to tell me how much deduplication has occurred. Is there one there I am missing? Thanks. -- Andy Carlson --- Gamecube:$150,PSO:$50,Broadband Adapter: $35, Hunters License: $8.95/month, The feeling of seeing the red box with the item you want in it:Priceless. -- Andy Carlson --- Gamecube:$150,PSO:$50,Broadband Adapter: $35, Hunters License: $8.95/month, The feeling of seeing the red box with the item you want in it:Priceless. -- Andy Carlson --- Gamecube:$150,PSO:$50,Broadband Adapter: $35, Hunters License: $8.95/month, The feeling of seeing the red box with the item you want in it:Priceless.
