Re: [Veritas-vx] Vxdg issue after Storage Problem
Hi Sigmund, I would try initialising the disk group from scratch again, but don't mkfs the filesystem. Chances are that the dg info has gone west, but the filesystem maybe intact. Also, if the dg has gone, then it won't let you create the dg with the same name. Then a restore might be needed. Good luck, Greg. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Sigmund Brandstaetter Sent: Sunday, 11 May 2008 4:37 AM To: veritas-vx@mailman.eng.auburn.edu Subject: [Veritas-vx] Vxdg issue after Storage Problem Importance: High Hi all, After a serious Storage Problem (one Symmetrix Box was offline after a power issue) we had vx issues on several Veritas Clusters (5.0SP1) We managed to get them all online again but on one system, 2 diskgroups are no longer in the configuration obviously... Has anybody expirienced something similar and has anybody got an idea about how to get to work with such a situation.. output: [EMAIL PROTECTED]:~# vxdisk -o alldgs list DEVICE TYPEDISK GROUPSTATUS c0t0d0s2 auto:none --online invalid c0t1d0s2 auto:none --online invalid emcpower0s2 auto:cdsdisk-(aaadata_dg) online emcpower1s2 auto:cdsdisk-(xxxdata_dg) online emcpower2s2 auto:cdsdisk-(xxxdata_dg) online emcpower3s2 auto:cdsdisk-(aaaredo_dg) online emcpower4s2 auto:cdsdisk-(rch_dg) online emcpower5s2 auto:cdsdisk-(dmin_dg) online emcpower6s2 auto:cdsdisk-(xxxarch_dg) online emcpower7s2 auto:cdsdisk--online invalid emcpower8s2 auto:cdsdisk--online invalid emcpower9s2 auto:cdsdisk-(aaadata_dg) online The missing groups would be Xxxredo_dg and xxxadmin_dg EMC says that the disks are all right, however I have not yet seen such a behavior. VXVM 5.0 MP1 VXCS 5.0 MP1 To me it looks like the config was somehow corrupted and these 2 disks do no longer appear under VXVM control. Thanks for any hints Cheers Sigi ___ Veritas-vx maillist - Veritas-vx@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-vx IMPORTANT: This email remains the property of the Australian Defence Organisation and is subject to the jurisdiction of section 70 of the CRIMES ACT 1914. If you have received this email in error, you are requested to contact the sender and delete the email. ___ Veritas-vx maillist - Veritas-vx@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-vx
Re: [Veritas-vx] Vxdg issue after Storage Problem
Hi Sigmund, since you know which disk did belong to which disk group and you can easily restore data from a backup, you can try the following: supposing the disk are: emcpower7s2 auto:cdsdisk - - online invalid <--- belonging to xxxredo_dg emcpower8s2 auto:cdsdisk - - online invalid <--- belonging to xxxadmin_dg initialize the disks: # vxdisk -f init emcpower7s2 # vxdisk -f init emcpower8s2 then, from the old vxprint output construct all the old objects such as subdisks, plex and volumes for diskgroups: # vxdg init xxxredo_dg OldXxxredoDiskName=emcpower7s2 # vxdg init xxxadmin_dg OldXxxadminDiskName=emcpower8s2 for subdisks: # vxmake -g xxxredo_dg sd OldXxxredoDiskName-01 OldXxxredoDiskName,Offset,Lenght # vxmake -g xxxadmin_dg sd OldXxxadminDiskName-01 OldXxxadminDiskName,Offset,Lenght for plexes: # vxmake -g xxxredo_dg plex OldXxxredoPlexName sd=OldXxxredoDiskName-01 # vxmake -g xxxadmin_dg plex OldXxxadminPlexName sd=OldXxxadminDiskName-01 for volumes: # vxmake -g xxxredo_dg -U fsgen vol OldXxxredoVolName plex=OldXxxredoPlexName # vxmake -g xxxadmin_dg -U fsgen vol OldXxxadminVolName plex=OldXxxadminPlexName # vxvol -g xxxredo init active OldXxxredoVolName for filesystems: # fstyp -v /dev/vx/dsk/xxxredo_dg/OldXxxredoVolName # fsck -F vxfs -y /dev/vx/dsk/xxxredo_dg/OldXxxredoVolName # fstyp -v /dev/vx/dsk/xxxredo_dg/OldXxxredoVolName # fsck -F vxfs -y /dev/vx/dsk/xxxredo_dg/OldXxxredoVolName Hope this helps Marujio > Hi, > > 1)yes, we do > 2)we know which disks did belong to which diskgroups > 3)the disks are visible to the system > 4)no, these disks are part of an srdf group and they are not imported > on any other server > 5)no scsi errors, we checked > > The status is that we could restore the vxvm config but it seems that > during the process of validating and destaging data, these > Disks where somehow corrupted (or the header at least) > > We have a case oüen with Veritas but so far they could not do much. > > In any case, luckily these 2 dg’s contain data that can be easily > restored from a backup. > > Cheers and thanks for suggestions > > > On 5/11/08 7:34 PM, "capri dsouza" <[EMAIL PROTECTED]> wrote: > > Hi Sigmund, > > 1)Do you have an old "vxprint -htg dg" of the 2 disk groups > 2)If you do have then you need to check the disks that belong to > these diskgroups > 3)Check if you can see these disks in the format > 4)Have you checked if these disks are imported on any other server > 5)Check the /var/adm/messages for any scsi related errrors or > /etc/vx/dmpevents.log (i think ) > > Let me know if this helps > > > Regards > Capri > On Sun, May 11, 2008 at 12:36 AM, Sigmund Brandstaetter > <[EMAIL PROTECTED]> wrote: > > Hi all, > > After a serious Storage Problem (one Symmetrix Box was offline > after a power > issue) we had vx issues on several Veritas Clusters (5.0SP1) > > We managed to get them all online again but on one system, 2 > diskgroups are > no longer in the configuration obviously... > > Has anybody expirienced something similar and has anybody got > an idea about > how to get to work with such a situation.. > > output: > > [EMAIL PROTECTED]:~# vxdisk -o alldgs list > DEVICE TYPE DISK GROUP STATUS > c0t0d0s2 auto:none - - online invalid > c0t1d0s2 auto:none - - online invalid > emcpower0s2 auto:cdsdisk - (aaadata_dg) online > emcpower1s2 auto:cdsdisk - (xxxdata_dg) online > emcpower2s2 auto:cdsdisk - (xxxdata_dg) online > emcpower3s2 auto:cdsdisk - (aaaredo_dg) online > emcpower4s2 auto:cdsdisk - (rch_dg) online > emcpower5s2 auto:cdsdisk - (dmin_dg) online > emcpower6s2 auto:cdsdisk - (xxxarch_dg) online > emcpower7s2 auto:cdsdisk - - online invalid > emcpower8s2 auto:cdsdisk - - online invalid > emcpower9s2 auto:cdsdisk - (aaadata_dg) online > > The missing groups would be > > Xxxredo_dg and xxxadmin_dg > > EMC says that the disks are all right, however I have not yet > seen such a > behavior. > > VXVM 5.0 MP1 > VXCS 5.0 MP1 > > To me it looks like the config was somehow corrupted and these > 2 disks do no > longer appear under VXVM control. > > Thanks for any hints > > Cheers > Sigi > > > ___ > Veritas-vx maillist - Veritas-vx@mailman.eng.auburn.edu > http://mailman.eng.auburn.edu/mailman/listinfo/veritas-vx > > > > > ___ > Veritas-vx maillist - Veritas-vx@mailman.eng.auburn.edu > http://mailman.eng.auburn.edu/mailman/listinfo/veritas-vx > ___ Veritas-vx maillist - Ver
Re: [Veritas-vx] Vxdg issue after Storage Problem
Hi, 1)yes, we do 2)we know which disks did belong to which diskgroups 3)the disks are visible to the system 4)no, these disks are part of an srdf group and they are not imported on any other server 5)no scsi errors, we checked The status is that we could restore the vxvm config but it seems that during the process of validating and destaging data, these Disks where somehow corrupted (or the header at least) We have a case oüen with Veritas but so far they could not do much. In any case, luckily these 2 dg¹s contain data that can be easily restored from a backup. Cheers and thanks for suggestions On 5/11/08 7:34 PM, "capri dsouza" <[EMAIL PROTECTED]> wrote: > Hi Sigmund, > > 1)Do you have an old "vxprint -htg dg" of the 2 disk groups > 2)If you do have then you need to check the disks that belong to these > diskgroups > 3)Check if you can see these disks in the format > 4)Have you checked if these disks are imported on any other server > 5)Check the /var/adm/messages for any scsi related errrors or > /etc/vx/dmpevents.log (i think ) > > Let me know if this helps > > > Regards > Capri > On Sun, May 11, 2008 at 12:36 AM, Sigmund Brandstaetter <[EMAIL PROTECTED]> > wrote: >> Hi all, >> >> After a serious Storage Problem (one Symmetrix Box was offline after a power >> issue) we had vx issues on several Veritas Clusters (5.0SP1) >> >> We managed to get them all online again but on one system, 2 diskgroups are >> no longer in the configuration obviously... >> >> Has anybody expirienced something similar and has anybody got an idea about >> how to get to work with such a situation.. >> >> output: >> >> [EMAIL PROTECTED]:~# vxdisk -o alldgs list >> DEVICE TYPEDISK GROUPSTATUS >> c0t0d0s2 auto:none --online invalid >> c0t1d0s2 auto:none --online invalid >> emcpower0s2 auto:cdsdisk-(aaadata_dg) online >> emcpower1s2 auto:cdsdisk-(xxxdata_dg) online >> emcpower2s2 auto:cdsdisk-(xxxdata_dg) online >> emcpower3s2 auto:cdsdisk-(aaaredo_dg) online >> emcpower4s2 auto:cdsdisk-(rch_dg) online >> emcpower5s2 auto:cdsdisk-(dmin_dg) online >> emcpower6s2 auto:cdsdisk-(xxxarch_dg) online >> emcpower7s2 auto:cdsdisk--online invalid >> emcpower8s2 auto:cdsdisk--online invalid >> emcpower9s2 auto:cdsdisk-(aaadata_dg) online >> >> The missing groups would be >> >> Xxxredo_dg and xxxadmin_dg >> >> EMC says that the disks are all right, however I have not yet seen such a >> behavior. >> >> VXVM 5.0 MP1 >> VXCS 5.0 MP1 >> >> To me it looks like the config was somehow corrupted and these 2 disks do no >> longer appear under VXVM control. >> >> Thanks for any hints >> >> Cheers >> Sigi >> >> >> ___ >> Veritas-vx maillist - Veritas-vx@mailman.eng.auburn.edu >> http://mailman.eng.auburn.edu/mailman/listinfo/veritas-vx >> >> ___ Veritas-vx maillist - Veritas-vx@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-vx
Re: [Veritas-vx] Vxdg issue after Storage Problem
Hi Sigmund, 1)Do you have an old "vxprint -htg dg" of the 2 disk groups 2)If you do have then you need to check the disks that belong to these diskgroups 3)Check if you can see these disks in the format 4)Have you checked if these disks are imported on any other server 5)Check the /var/adm/messages for any scsi related errrors or /etc/vx/dmpevents.log (i think ) Let me know if this helps Regards Capri On Sun, May 11, 2008 at 12:36 AM, Sigmund Brandstaetter <[EMAIL PROTECTED]> wrote: > Hi all, > > After a serious Storage Problem (one Symmetrix Box was offline after a > power > issue) we had vx issues on several Veritas Clusters (5.0SP1) > > We managed to get them all online again but on one system, 2 diskgroups > are > no longer in the configuration obviously... > > Has anybody expirienced something similar and has anybody got an idea > about > how to get to work with such a situation.. > > output: > > [EMAIL PROTECTED]:~# vxdisk -o alldgs list > DEVICE TYPEDISK GROUPSTATUS > c0t0d0s2 auto:none --online invalid > c0t1d0s2 auto:none --online invalid > emcpower0s2 auto:cdsdisk-(aaadata_dg) online > emcpower1s2 auto:cdsdisk-(xxxdata_dg) online > emcpower2s2 auto:cdsdisk-(xxxdata_dg) online > emcpower3s2 auto:cdsdisk-(aaaredo_dg) online > emcpower4s2 auto:cdsdisk-(rch_dg) online > emcpower5s2 auto:cdsdisk-(dmin_dg) online > emcpower6s2 auto:cdsdisk-(xxxarch_dg) online > emcpower7s2 auto:cdsdisk--online invalid > emcpower8s2 auto:cdsdisk--online invalid > emcpower9s2 auto:cdsdisk-(aaadata_dg) online > > The missing groups would be > > Xxxredo_dg and xxxadmin_dg > > EMC says that the disks are all right, however I have not yet seen such a > behavior. > > VXVM 5.0 MP1 > VXCS 5.0 MP1 > > To me it looks like the config was somehow corrupted and these 2 disks do > no > longer appear under VXVM control. > > Thanks for any hints > > Cheers > Sigi > > > ___ > Veritas-vx maillist - Veritas-vx@mailman.eng.auburn.edu > http://mailman.eng.auburn.edu/mailman/listinfo/veritas-vx > ___ Veritas-vx maillist - Veritas-vx@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-vx
[Veritas-vx] Vxdg issue after Storage Problem
Hi all, After a serious Storage Problem (one Symmetrix Box was offline after a power issue) we had vx issues on several Veritas Clusters (5.0SP1) We managed to get them all online again but on one system, 2 diskgroups are no longer in the configuration obviously... Has anybody expirienced something similar and has anybody got an idea about how to get to work with such a situation.. output: [EMAIL PROTECTED]:~# vxdisk -o alldgs list DEVICE TYPEDISK GROUPSTATUS c0t0d0s2 auto:none --online invalid c0t1d0s2 auto:none --online invalid emcpower0s2 auto:cdsdisk-(aaadata_dg) online emcpower1s2 auto:cdsdisk-(xxxdata_dg) online emcpower2s2 auto:cdsdisk-(xxxdata_dg) online emcpower3s2 auto:cdsdisk-(aaaredo_dg) online emcpower4s2 auto:cdsdisk-(rch_dg) online emcpower5s2 auto:cdsdisk-(dmin_dg) online emcpower6s2 auto:cdsdisk-(xxxarch_dg) online emcpower7s2 auto:cdsdisk--online invalid emcpower8s2 auto:cdsdisk--online invalid emcpower9s2 auto:cdsdisk-(aaadata_dg) online The missing groups would be Xxxredo_dg and xxxadmin_dg EMC says that the disks are all right, however I have not yet seen such a behavior. VXVM 5.0 MP1 VXCS 5.0 MP1 To me it looks like the config was somehow corrupted and these 2 disks do no longer appear under VXVM control. Thanks for any hints Cheers Sigi ___ Veritas-vx maillist - Veritas-vx@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-vx
