Re: DEVCLASS=FILE - what am I missing
One thing that hasn't been mentioned yet is how the use of FILE or DISK impacts server recovery. If you have to restore your database, you will have to audit all of your DISK volumes. You can avoid auditing FILE or TAPE volumes through the use of REUSEDELAY. ..Paul At 01:52 PM 2/13/2015, Zoltan Forray wrote: Thanks for all the replies. Pretty much confirms that FILE isn't for me. We don't do dedupe and there are a lot of manual/monitoring processes involved (I have enough to do with 8-TSM servers I manage - don't need more). -- Paul ZarnowskiPh: 607-255-4757 Assistant Director for Storage Services Fx: 607-255-8521 IT at Cornell / InfrastructureEm: p...@cornell.edu 719 Rhodes Hall, Ithaca, NY 14853-3801
FW: FW: v6.3.5 hung db2??
IBM thinks we need to upgrade AIX to at least v6.1 TL9 SP2. We completely missed the AIX requirement for upgrading to v6.3.5. In other words, a user problem! Rick -Original Message- From: Rhodes, Richard L. Sent: Monday, February 16, 2015 8:36 AM To: 'ADSM: Dist Stor Manager' Subject: RE: FW: v6.3.5 hung db2?? If you are curious, here are the first of the nasty msgs that started the march toward the crash yesterday. I really like the msgs . . . database in evaluation mode. 02/15/15 12:45:35 ANR0106E cscmdsch.c(555): Unexpected error 4522 fetching row in table Schedule.Pending. 02/15/15 12:45:35 ANRD_4073936223 CsCmdSchedulerThread(cscmdsch.c:317) Thread88: Invalid recovery criteria () in the central sched uler - the task is terminating. 02/15/15 12:45:35 ANRD Thread88 issued message from: 02/15/15 12:45:35 ANRD Thread88 0x00010001ca7c StdPutText 02/15/15 12:45:35 ANRD Thread88 0x00010001d514 OutDiagToCons 02/15/15 12:45:35 ANRD Thread88 0x000190bc outDiagfExt 02/15/15 12:45:35 ANRD Thread88 0x000100bceb7c CsCmdSchedulerThread 02/15/15 12:45:35 ANRD Thread88 0x0001c264 StartThread 02/15/15 12:45:43 ANR0171I csprompt.c(561): Error detected on 32:3, database in evaluation mode. (SESSION: 823) 02/15/15 12:45:43 ANR2183W csprompt.c(664): Transaction 0:49249782 was aborted. (SESSION: 823) 02/15/15 12:45:43 ANR2703E Schedule prompter aborted. (SESSION: 823) 02/15/15 12:46:12 ANR0171I tbrsql.c(2805): Error detected on 3:4, database in evaluation mode. 02/15/15 12:46:12 ANR0171I dbitxn.c(734): Error detected on 0:3, database in evaluation mode. -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of DeGroat, Steve Sent: Monday, February 16, 2015 8:15 AM To: ADSM-L@VM.MARIST.EDU Subject: Re: FW: v6.3.5 hung db2?? Thanks for these updates. We were looking to upgrade from v6.3.4 to v6.3.5 shortly, but will hold off for now. Please keep us posted with your progress. Steve DeGroat Sr Solution Architect for Storage Design Services and Quality Assurance Yale University 203.436.4540 If you build it, they will come. -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@vm.marist.edu] On Behalf Of Rhodes, Richard L. Sent: Monday, February 16, 2015 8:01 AM To: ADSM-L@vm.marist.edu Subject: Re: [ADSM-L] FW: v6.3.5 hung db2?? Well, I thought we had this resolved. Yesterday (Sunday) we had another crash of this TSM instance. I've opened another PMR. We had 2 more instances scheduled to upgraded to v6.3.5 today that are now postponed indefinitely. Rick -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Mitchell, Ruth Slovik Sent: Friday, February 13, 2015 3:13 PM To: ADSM-L@VM.MARIST.EDU Subject: Re: FW: v6.3.5 hung db2?? Rick, Thank you for letting us know about this. It would be interesting to know if related messages were captured in the db2diag.log when this started to manifest itself. Best, Ruth U of I, Urbana, IL -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Rhodes, Richard L. Sent: Friday, February 13, 2015 1:38 PM To: ADSM-L@VM.MARIST.EDU Subject: Re: [ADSM-L] FW: v6.3.5 hung db2?? Working with some good support folks! Looks like we hit this: https://urldefense.proofpoint.com/v2/url?u=http-3A__www-2D01.ibm.com_support_docview.wss-3Fcrawler-3D1-26uid-3Dswg1IT06126d=AwIFAgc=-dg2m7zWuuDZ0MUcV7Sdqwr=cU4lgHg-mogg3FJ7Okdd3I2i9Cl4aPnV7nm0FbEjOWYm=jaMir-5Mj0MJ5eKdK-8UTNsNe9iNYDzZQiuTa22XCgQs=kcZ7t5IEvD_0y2FaFO7NGVEkbZ2fWTs2cziJ2lcxipke= The v6.3.5 and v7.1.0 caused a bug in the rc.dsmserv startup script. The result is that db2 was running on limited memory - 32MB in our case. This was the default value in /etc/security/limits. Lvl 2 had me change /etc/security/limits default to unlimited memory. Lvl 1 had this above APAR and I fixed the rc.dsmserv script per the instructions. So it looks like our problems were caused by very low db2 memory. I believe it was restricted to 32mb! Rick -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Rainer Tammer Sent: Friday, February 13, 2015 11:53 AM To: ADSM-L@VM.MARIST.EDU Subject: Re: FW: v6.3.5 hung db2?? Hello, please keep us posted. I will have to go from 6.3.4-300 to a higher version because of the NDMP dump 2TB overwrite problem... Bye Rainer On 13.02.2015 17:05, Rhodes, Richard L. wrote: Yea. I opened a Sev 1. Thanks! Rick -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Andrew Raibeck Sent: Friday, February 13, 2015 10:57 AM To: ADSM-L@VM.MARIST.EDU Subject: Re: FW: v6.3.5 hung db2?? Hi Rick, Off-hand I am not sure what the problem is, I think it
Re: FW: v6.3.5 hung db2??
If you are curious, here are the first of the nasty msgs that started the march toward the crash yesterday. I really like the msgs . . . database in evaluation mode. 02/15/15 12:45:35 ANR0106E cscmdsch.c(555): Unexpected error 4522 fetching row in table Schedule.Pending. 02/15/15 12:45:35 ANRD_4073936223 CsCmdSchedulerThread(cscmdsch.c:317) Thread88: Invalid recovery criteria () in the central sched uler - the task is terminating. 02/15/15 12:45:35 ANRD Thread88 issued message from: 02/15/15 12:45:35 ANRD Thread88 0x00010001ca7c StdPutText 02/15/15 12:45:35 ANRD Thread88 0x00010001d514 OutDiagToCons 02/15/15 12:45:35 ANRD Thread88 0x000190bc outDiagfExt 02/15/15 12:45:35 ANRD Thread88 0x000100bceb7c CsCmdSchedulerThread 02/15/15 12:45:35 ANRD Thread88 0x0001c264 StartThread 02/15/15 12:45:43 ANR0171I csprompt.c(561): Error detected on 32:3, database in evaluation mode. (SESSION: 823) 02/15/15 12:45:43 ANR2183W csprompt.c(664): Transaction 0:49249782 was aborted. (SESSION: 823) 02/15/15 12:45:43 ANR2703E Schedule prompter aborted. (SESSION: 823) 02/15/15 12:46:12 ANR0171I tbrsql.c(2805): Error detected on 3:4, database in evaluation mode. 02/15/15 12:46:12 ANR0171I dbitxn.c(734): Error detected on 0:3, database in evaluation mode. -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of DeGroat, Steve Sent: Monday, February 16, 2015 8:15 AM To: ADSM-L@VM.MARIST.EDU Subject: Re: FW: v6.3.5 hung db2?? Thanks for these updates. We were looking to upgrade from v6.3.4 to v6.3.5 shortly, but will hold off for now. Please keep us posted with your progress. Steve DeGroat Sr Solution Architect for Storage Design Services and Quality Assurance Yale University 203.436.4540 If you build it, they will come. -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@vm.marist.edu] On Behalf Of Rhodes, Richard L. Sent: Monday, February 16, 2015 8:01 AM To: ADSM-L@vm.marist.edu Subject: Re: [ADSM-L] FW: v6.3.5 hung db2?? Well, I thought we had this resolved. Yesterday (Sunday) we had another crash of this TSM instance. I've opened another PMR. We had 2 more instances scheduled to upgraded to v6.3.5 today that are now postponed indefinitely. Rick -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Mitchell, Ruth Slovik Sent: Friday, February 13, 2015 3:13 PM To: ADSM-L@VM.MARIST.EDU Subject: Re: FW: v6.3.5 hung db2?? Rick, Thank you for letting us know about this. It would be interesting to know if related messages were captured in the db2diag.log when this started to manifest itself. Best, Ruth U of I, Urbana, IL -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Rhodes, Richard L. Sent: Friday, February 13, 2015 1:38 PM To: ADSM-L@VM.MARIST.EDU Subject: Re: [ADSM-L] FW: v6.3.5 hung db2?? Working with some good support folks! Looks like we hit this: https://urldefense.proofpoint.com/v2/url?u=http-3A__www-2D01.ibm.com_support_docview.wss-3Fcrawler-3D1-26uid-3Dswg1IT06126d=AwIFAgc=-dg2m7zWuuDZ0MUcV7Sdqwr=cU4lgHg-mogg3FJ7Okdd3I2i9Cl4aPnV7nm0FbEjOWYm=jaMir-5Mj0MJ5eKdK-8UTNsNe9iNYDzZQiuTa22XCgQs=kcZ7t5IEvD_0y2FaFO7NGVEkbZ2fWTs2cziJ2lcxipke= The v6.3.5 and v7.1.0 caused a bug in the rc.dsmserv startup script. The result is that db2 was running on limited memory - 32MB in our case. This was the default value in /etc/security/limits. Lvl 2 had me change /etc/security/limits default to unlimited memory. Lvl 1 had this above APAR and I fixed the rc.dsmserv script per the instructions. So it looks like our problems were caused by very low db2 memory. I believe it was restricted to 32mb! Rick -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Rainer Tammer Sent: Friday, February 13, 2015 11:53 AM To: ADSM-L@VM.MARIST.EDU Subject: Re: FW: v6.3.5 hung db2?? Hello, please keep us posted. I will have to go from 6.3.4-300 to a higher version because of the NDMP dump 2TB overwrite problem... Bye Rainer On 13.02.2015 17:05, Rhodes, Richard L. wrote: Yea. I opened a Sev 1. Thanks! Rick -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Andrew Raibeck Sent: Friday, February 13, 2015 10:57 AM To: ADSM-L@VM.MARIST.EDU Subject: Re: FW: v6.3.5 hung db2?? Hi Rick, Off-hand I am not sure what the problem is, I think it would be a good idea to open a PMR if you have not already done so. Best regards, - Andy __ __ Andrew Raibeck | Tivoli Storage Manager Level 3 Technical Lead | stor...@us.ibm.com IBM Tivoli Storage Manager links: Product support:
Re: FW: v6.3.5 hung db2??
Well, I thought we had this resolved. Yesterday (Sunday) we had another crash of this TSM instance. I've opened another PMR. We had 2 more instances scheduled to upgraded to v6.3.5 today that are now postponed indefinitely. Rick -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Mitchell, Ruth Slovik Sent: Friday, February 13, 2015 3:13 PM To: ADSM-L@VM.MARIST.EDU Subject: Re: FW: v6.3.5 hung db2?? Rick, Thank you for letting us know about this. It would be interesting to know if related messages were captured in the db2diag.log when this started to manifest itself. Best, Ruth U of I, Urbana, IL -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Rhodes, Richard L. Sent: Friday, February 13, 2015 1:38 PM To: ADSM-L@VM.MARIST.EDU Subject: Re: [ADSM-L] FW: v6.3.5 hung db2?? Working with some good support folks! Looks like we hit this: http://www-01.ibm.com/support/docview.wss?crawler=1uid=swg1IT06126 The v6.3.5 and v7.1.0 caused a bug in the rc.dsmserv startup script. The result is that db2 was running on limited memory - 32MB in our case. This was the default value in /etc/security/limits. Lvl 2 had me change /etc/security/limits default to unlimited memory. Lvl 1 had this above APAR and I fixed the rc.dsmserv script per the instructions. So it looks like our problems were caused by very low db2 memory. I believe it was restricted to 32mb! Rick -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Rainer Tammer Sent: Friday, February 13, 2015 11:53 AM To: ADSM-L@VM.MARIST.EDU Subject: Re: FW: v6.3.5 hung db2?? Hello, please keep us posted. I will have to go from 6.3.4-300 to a higher version because of the NDMP dump 2TB overwrite problem... Bye Rainer On 13.02.2015 17:05, Rhodes, Richard L. wrote: Yea. I opened a Sev 1. Thanks! Rick -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Andrew Raibeck Sent: Friday, February 13, 2015 10:57 AM To: ADSM-L@VM.MARIST.EDU Subject: Re: FW: v6.3.5 hung db2?? Hi Rick, Off-hand I am not sure what the problem is, I think it would be a good idea to open a PMR if you have not already done so. Best regards, - Andy __ __ Andrew Raibeck | Tivoli Storage Manager Level 3 Technical Lead | stor...@us.ibm.com IBM Tivoli Storage Manager links: Product support: http://www.ibm.com/support/entry/portal/Overview/Software/Tivoli/Tivol i_Storage_Manager Online documentation: http://www.ibm.com/support/knowledgecenter/SSGSG7/welcome Product Wiki: https://www.ibm.com/developerworks/community/wikis/home/wiki/Tivoli%20 Storage%20Manager ADSM: Dist Stor Manager ADSM-L@VM.MARIST.EDU wrote on 2015-02-13 10:41:55: From: Rhodes, Richard L. rrho...@firstenergycorp.com To: ADSM-L@VM.MARIST.EDU Date: 2015-02-13 10:44 Subject: FW: v6.3.5 hung db2?? Sent by: ADSM: Dist Stor Manager ADSM-L@VM.MARIST.EDU Now this is really weird. TSM came up after we rebooted. But it threw a bunch of ANR msgs, then QUIT LOGGING. It seems to be running - I go onto a server and did a incr bkup, but nothing is logging in the actlog. 02/13/15 10:00:22 ANRD_2891663292 GetDomainByNodeId (pmcache.c:2645) Thread280: Node id 626 not found in table Policy.Domain.Members. (SESSION: 125) 02/13/15 10:00:22 ANRD Thread280 issued message from: (SESSION: 125) 02/13/15 10:00:22 ANRD Thread280 0x00010001ca7c StdPutText (SESSION: 125) 02/13/15 10:00:22 ANRD Thread280 0x00010001d514 OutDiagToCons (SESSION: 125) 02/13/15 10:00:22 ANRD Thread280 0x000190bc outDiagfExt (SESSION: 125) 02/13/15 10:00:22 ANRD Thread280 0x0001004bf254 GetDomainByNodeId (SESSION: 125) 02/13/15 10:00:22 ANRD Thread280 0x0001004beeec pmOpenDomain (SESSION: 125) 02/13/15 10:00:22 ANRD Thread280 0x0001006ac78c BeginVbTxn (SESSION: 125) 02/13/15 10:00:22 ANRD Thread280 0x0001006a4068 SmNodeSession (SESSION: 125) 02/13/15 10:00:22 ANRD Thread280 0x00010053ca64 SmSchedSession (SESSION: 125) 02/13/15 10:00:22 ANRD Thread280 0x0001005525d8 HandleNodeSession (SESSION: 125) 02/13/15 10:00:22 ANRD Thread280 0x000100549c54 DoNodeSched (SESSION: 125) 02/13/15 10:00:22 ANRD Thread280 0x000100544900 smExecuteSession (SESSION: 125) 02/13/15 10:00:22 ANRD Thread280 0x000100078a7c psSessionThread (SESSION: 125) 02/13/15 10:00:22 ANRD Thread280 0x0001c264 StartThread (SESSION: 125) 02/13/15 10:00:22 ANRD_3095886799 HandleShortCircuitCodes (dbieval.c:1072) Thread280: Invalid handle used from tbtbl.c (10153). (SESSION:
Re: FW: v6.3.5 hung db2??
Thanks for these updates. We were looking to upgrade from v6.3.4 to v6.3.5 shortly, but will hold off for now. Please keep us posted with your progress. Steve DeGroat Sr Solution Architect for Storage Design Services and Quality Assurance Yale University 203.436.4540 If you build it, they will come. -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@vm.marist.edu] On Behalf Of Rhodes, Richard L. Sent: Monday, February 16, 2015 8:01 AM To: ADSM-L@vm.marist.edu Subject: Re: [ADSM-L] FW: v6.3.5 hung db2?? Well, I thought we had this resolved. Yesterday (Sunday) we had another crash of this TSM instance. I've opened another PMR. We had 2 more instances scheduled to upgraded to v6.3.5 today that are now postponed indefinitely. Rick -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Mitchell, Ruth Slovik Sent: Friday, February 13, 2015 3:13 PM To: ADSM-L@VM.MARIST.EDU Subject: Re: FW: v6.3.5 hung db2?? Rick, Thank you for letting us know about this. It would be interesting to know if related messages were captured in the db2diag.log when this started to manifest itself. Best, Ruth U of I, Urbana, IL -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Rhodes, Richard L. Sent: Friday, February 13, 2015 1:38 PM To: ADSM-L@VM.MARIST.EDU Subject: Re: [ADSM-L] FW: v6.3.5 hung db2?? Working with some good support folks! Looks like we hit this: https://urldefense.proofpoint.com/v2/url?u=http-3A__www-2D01.ibm.com_support_docview.wss-3Fcrawler-3D1-26uid-3Dswg1IT06126d=AwIFAgc=-dg2m7zWuuDZ0MUcV7Sdqwr=cU4lgHg-mogg3FJ7Okdd3I2i9Cl4aPnV7nm0FbEjOWYm=jaMir-5Mj0MJ5eKdK-8UTNsNe9iNYDzZQiuTa22XCgQs=kcZ7t5IEvD_0y2FaFO7NGVEkbZ2fWTs2cziJ2lcxipke= The v6.3.5 and v7.1.0 caused a bug in the rc.dsmserv startup script. The result is that db2 was running on limited memory - 32MB in our case. This was the default value in /etc/security/limits. Lvl 2 had me change /etc/security/limits default to unlimited memory. Lvl 1 had this above APAR and I fixed the rc.dsmserv script per the instructions. So it looks like our problems were caused by very low db2 memory. I believe it was restricted to 32mb! Rick -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Rainer Tammer Sent: Friday, February 13, 2015 11:53 AM To: ADSM-L@VM.MARIST.EDU Subject: Re: FW: v6.3.5 hung db2?? Hello, please keep us posted. I will have to go from 6.3.4-300 to a higher version because of the NDMP dump 2TB overwrite problem... Bye Rainer On 13.02.2015 17:05, Rhodes, Richard L. wrote: Yea. I opened a Sev 1. Thanks! Rick -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Andrew Raibeck Sent: Friday, February 13, 2015 10:57 AM To: ADSM-L@VM.MARIST.EDU Subject: Re: FW: v6.3.5 hung db2?? Hi Rick, Off-hand I am not sure what the problem is, I think it would be a good idea to open a PMR if you have not already done so. Best regards, - Andy __ __ Andrew Raibeck | Tivoli Storage Manager Level 3 Technical Lead | stor...@us.ibm.com IBM Tivoli Storage Manager links: Product support: https://urldefense.proofpoint.com/v2/url?u=http-3A__www.ibm.com_suppor t_entry_portal_Overview_Software_Tivoli_Tivold=AwIFAgc=-dg2m7zWuuDZ0 MUcV7Sdqwr=cU4lgHg-mogg3FJ7Okdd3I2i9Cl4aPnV7nm0FbEjOWYm=jaMir-5Mj0MJ 5eKdK-8UTNsNe9iNYDzZQiuTa22XCgQs=0FHAerXtIarScvH_uCSwm1_6fcvnwOZkJn0a JVxX8lIe= i_Storage_Manager Online documentation: https://urldefense.proofpoint.com/v2/url?u=http-3A__www.ibm.com_suppor t_knowledgecenter_SSGSG7_welcomed=AwIFAgc=-dg2m7zWuuDZ0MUcV7Sdqwr=c U4lgHg-mogg3FJ7Okdd3I2i9Cl4aPnV7nm0FbEjOWYm=jaMir-5Mj0MJ5eKdK-8UTNsNe 9iNYDzZQiuTa22XCgQs=z6-KhygfJ8cQDURcjUIT7KQ90l7u4VzmOw8W522aB7Ue= Product Wiki: https://urldefense.proofpoint.com/v2/url?u=https-3A__www.ibm.com_devel operworks_community_wikis_home_wiki_Tivoli-2520d=AwIFAgc=-dg2m7zWuuD Z0MUcV7Sdqwr=cU4lgHg-mogg3FJ7Okdd3I2i9Cl4aPnV7nm0FbEjOWYm=jaMir-5Mj0 MJ5eKdK-8UTNsNe9iNYDzZQiuTa22XCgQs=ap1r_YAKONXTJN1XAZO-DhocN1rgS298b0 4t05J9Ai4e= Storage%20Manager ADSM: Dist Stor Manager ADSM-L@VM.MARIST.EDU wrote on 2015-02-13 10:41:55: From: Rhodes, Richard L. rrho...@firstenergycorp.com To: ADSM-L@VM.MARIST.EDU Date: 2015-02-13 10:44 Subject: FW: v6.3.5 hung db2?? Sent by: ADSM: Dist Stor Manager ADSM-L@VM.MARIST.EDU Now this is really weird. TSM came up after we rebooted. But it threw a bunch of ANR msgs, then QUIT LOGGING. It seems to be running - I go onto a server and did a incr bkup, but nothing is logging in the actlog. 02/13/15 10:00:22 ANRD_2891663292 GetDomainByNodeId (pmcache.c:2645) Thread280: Node id 626 not found in table Policy.Domain.Members. (SESSION: 125) 02/13/15 10:00:22 ANRD Thread280
