TSM Server 5.5.4.1 under AIX 5.3-12-01.
TSM Client 6.2.1.1 under AIX 5.3-12-01 TDP for Oracle 5.5.2.0 - Oracle 10.2.0.4 I am trying to duplicate database from production to test with point in time recovery. It restores level 0 backups (13/10/10) and incremental backups from 14/10/10 till 18/10/10 successfully, but for incremental backup from 19/10/10 I have got error: channel t1: reading from backup piece /LPAR11/pibs.18.1.1798.1.732727838 channel t1: restored backup piece 1 piece handle=/LPAR11/pibs.18.1.1798.1.732727838 tag=DATABASE_PIBS.LEVEL_1.DATE_18 channel t1: restore complete, elapsed time: 00:02:06 channel t1: starting incremental datafile backupset restore channel t1: specifying datafile(s) to restore from backup set destination for restore of datafile 00001: /home/oracle/DIBS/ibssys1 destination for restore of datafile 00002: /home/oracle/DIBS/ibsrbs1 destination for restore of datafile 00003: /home/oracle/DIBS/ibsaux1 destination for restore of datafile 00004: /home/oracle/DIBS/ibstls1 destination for restore of datafile 00005: /home/oracle/DIBS/ibsusr1 destination for restore of datafile 00007: /home/oracle/DIBS/ibsdphx1 destination for restore of datafile 00008: /home/oracle/DIBS/ibsiphx1 destination for restore of datafile 00009: /home/oracle/DIBS/ibsatm1 destination for restore of datafile 00010: /home/oracle/DIBS/ibsibs1 destination for restore of datafile 00011: /home/oracle/DIBS/ibsgfs1 channel t1: reading from backup piece /LPAR11/pibs.19.1.1802.1.732814241 released channel: t1 RMAN-00571: =========================================================== RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS =============== RMAN-00571: =========================================================== RMAN-03002: failure of Duplicate Db command at 10/26/2010 09:42:55 RMAN-03015: error occurred in stored script Memory Script ORA-19870: error reading backup piece /LPAR11/pibs.19.1.1802.1.732814241 ORA-19501: read error on file "/LPAR11/pibs.19.1.1802.1.732814241", blockno 1 (blocksize=512) ORA-27190: skgfrd: sbtread2 returned error ORA-19511: Error received from media manager layer, error text: ANS1314E (RC14) File data currently unavailable on server RMAN> It looks like required file is not found in the primary pool. It is very strange, because I could see required file on TSM Server: LPAR11_ORA /pibs_pibs /LPAR11/pibs.18.1.1798.1.732727838 2010-10-18 15:30:39 ACTIVE_VERSION DBLPAR11 537320262 LPAR11_ORA /pibs_pibs /LPAR11/pibs.19.1.1802.1.732814241 2010-10-19 15:30:43 ACTIVE_VERSION DBLPAR11 537500861 LPAR11_ORA /pibs_pibs /LPAR11/pibs.20.1.1806.1.732900640 2010-10-20 15:30:42 ACTIVE_VERSION DBLPAR11 537684112 In addition, I have found that TSM Server is trying to restore data from available copy pools (automatically): 26/10/2010 09:42:54 ANR0403I Session 1082 ended for node LPAR11_ORA (TDP Oracle AIX). (SESSION: 1082) 26/10/2010 09:42:54 ANE4991I (Session: 1082, Node: LPAR11_ORA) TDP Oracle AIX ANU0599 TDP for Oracle: (389236): =>(LPAR11_ORA) ANU2527I Restore details for backup piece /pibs_pibs///LPAR11/pibs.19.1.1802.1.732814241. Total bytes received: 0. Total processing time: 00:00:01. Throughput rate: 0.00 Kb/Sec. (SESSION: 1082) 26/10/2010 09:42:54 ANE4991I (Session: 1082, Node: LPAR11_ORA) TDP Oracle AIX ANU0599 TDP for Oracle: (389236): =>(LPAR11_ORA) ANU2536I File /pibs_pibs///LPAR11/pibs.19.1.1802.1.732814241 = 0 bytes recieved(SESSION: 1082) 26/10/2010 09:42:54 ANR0565W Retrieve or restore failed for session 1082 for node LPAR11_ORA (TDP Oracle AIX). The storage volume CP2B145A is inaccessible. (SESSION: 1082) 26/10/2010 09:42:54 ANR1422W Read access denied for volume CP2B145A - volume access mode="offsite". (SESSION: 1082) 26/10/2010 09:42:54 ANR1401W Mount request denied for volume /DCP3_DR/DCP30018 - mount failed. (SESSION: 1082) 26/10/2010 09:42:54 ANR0406I Session 1082 started for node LPAR11_ORA (TDP Oracle AIX) (Tcp/Ip LPAR03(61008)). (SESSION: 1082) 26/10/2010 09:42:44 ANR0403I Session 1049 ended for node LPAR11_ORA (TDP Oracle AIX). (SESSION: 1049) 26/10/2010 09:42:44 ANR0514I Session 1049 closed volume /DAILY_2/DAY20020. (SESSION: 1049) 26/10/2010 09:42:44 ANE4991I (Session: 1049, Node: LPAR11_ORA) TDP Oracle AIX ANU0599 TDP for Oracle: (389236): =>(LPAR11_ORA) ANU2527I Restore details for backup piece /pibs_pibs///LPAR11/pibs.18.1.1798.1.732727838. Total bytes received: 1967652864. Total processing time: 00:01:56. Throughput rate: 16564.97 Kb/Sec. (SESSION: 1049) 26/10/2010 09:42:44 ANE4991I (Session: 1049, Node: LPAR11_ORA) TDP Oracle AIX ANU0599 TDP for Oracle: (389236): =>(LPAR11_ORA) ANU2536I File /pibs_pibs///LPAR11/pibs.18.1.1798.1.732727838 = 1967652864 bytes recieved(SESSION: 1049) As you see TSM Server is trying to mount copy volume CP2B145A from out-of country copy pool and then trying to mount volume DCP3_DR/DCP30018 from disaster site, which was unreachable due to Disaster Site testing. I have checked and found no problems in primary pools. In addition, we have mounted remote Disaster Site copy pool (type FILE) and repeated duplicate operation successfully (with reading data from Disaster Site copy pool !!!!!!). What does it mean? Database corruption? Primary pool corruption? There are no error messages at all!!!! I will deeply appreciate any comments. Grigori G. Solonovitch Senior Technical Architect Information Technology Ahli United Bank Kuwait http://www.ahliunited.com.kw Phone: (+965) 2231-2274 Mobile: (+965) 99798073 E-Mail: [email protected] Please consider the environment before printing this Email ________________________________ CONFIDENTIALITY AND WAIVER: The information contained in this electronic mail message and any attachments hereto may be legally privileged and confidential. The information is intended only for the recipient(s) named in this message. If you are not the intended recipient you are notified that any use, disclosure, copying or distribution is prohibited. If you have received this in error please contact the sender and delete this message and any attachments from your computer system. We do not guarantee that this message or any attachment to it is secure or free from errors, computer viruses or other conditions that may damage or interfere with data, hardware or software. Please consider the environment before printing this Email.
