Sarah, That makes sense. I'll try to reproduce the issue here as well as talking to other SVM gurus (aka Jerry :^)
Richard, if you still have a system experiencing fsck error, would you do a svcs -a | egrep "md|meta". I'd like to eliminate the mdmonitord not starting theory. Thanks, tony Sarah Jelinek wrote: > Hi Tony, > > I asked Richard to do it this way, specifically to only have a 1-way > mirror to test to see if the filesystem itself got out of sync > regardless. Jumpstart allows a 2-way to be setup prior to installation. > So, we have no trouble with the install when you start with a 1-way and > do the install. It appears to me that we have a resync issue when you > have a 2-way mirror setup prior to the install. The reason I say this is > that when you have both sides of a mirror attached during an install, we > then have trouble with the first fsck, but when run manually the fsck > shows no issues. However, when Richard runs the install with a 1-way > mirror we don't fail. > > Where do we go from here? > > thanks, > sarah > **** > > Tony Nguyen wrote: > >> Excellent. Does this mean jumpstart profile only allows 1-way mirror? >> Do users need to attach second submirrors and await the resyncs? If >> yes, it sounds like a bug. >> >> btw, use >> >> set md_mirror:md_resync_bufsz = 2048 or 1024 >> >> as suggested in the metasync man page before attaching submirrors to >> improve resync performance. >> >> -tony >> >> Richard Skelton wrote: >> >>> Hi Sarah, >>> OK I modified the jumpstart profile :- >>> install_type initial_install >>> system_type standalone >>> partitioning explicit >>> #filesys mirror:d10 c0t0d0s0 c1t4d0s0 256 / logging >>> #filesys mirror:d20 c0t0d0s3 c1t4d0s3 4096 /var logging >>> #filesys mirror:d30 c0t0d0s4 c1t4d0s4 4096 /usr logging >>> #filesys mirror:d40 c0t0d0s5 c1t4d0s5 1536 /opt logging >>> #filesys mirror:d50 c0t0d0s7 c1t4d0s7 15360 /tmp2 logging >>> #filesys mirror:d60 c0t0d0s1 c1t4d0s1 free swap >>> filesys mirror:d10 c0t0d0s0 256 / logging >>> filesys mirror:d20 c0t0d0s3 4096 /var logging >>> filesys mirror:d30 c0t0d0s4 4096 /usr logging >>> filesys mirror:d40 c0t0d0s5 1536 /opt logging >>> filesys mirror:d50 c0t0d0s7 15360 /tmp2 logging >>> filesys mirror:d60 c0t0d0s1 free swap >>> metadb c0t0d0s6 size 8192 count 4 >>> metadb c1t4d0s6 size 8192 count 4 >>> cluster SUNWCXall >>> locale en_GB >>> >>> >>> The install works fine now :- >>> Rebooting with command: boot net - install >>> Boot device: /sbus at 3,0/network at 0,100000 File and args: - install >>> 38a00 Server IP address: 172.29.216.237 Client IP address: >>> 172.29.216.181 SunOS Release 5.11 Version snv_19 64-bit >>> Copyright 1983-2005 Sun Microsystems, Inc. All rights reserved. >>> Use is subject to license terms. >>> SUNW,sbus-gem0: Using Gigabit SERDES Interface >>> SUNW,sbus-gem0: Auto-Negotiated 1000 Mbps Full-Duplex Link Up >>> Aug 15 04:44:33 svc.startd[7]: Could not log for >>> svc:/network/datalink:default: >>> open(/var/svc/log//network-datalink:default.log) failed with >>> Read-only file system. >>> Configuring devices. >>> Using RPC Bootparams for network configuration information. >>> Attempting to configure interface hme0... >>> WARNING: hme0: fault detected in device; service degraded >>> WARNING: hme0: No response from Ethernet network : Link down -- cable >>> problem? >>> Skipped interface hme0 >>> Attempting to configure interface ge0... >>> Configured interface ge0 >>> Beginning system identification... >>> Searching for configuration file(s)... >>> Using sysid configuration file >>> 172.29.216.237:/Jump/Profiles/E3500_sysidcfg/sysidcfg >>> Search complete. >>> Discovering additional network configuration... >>> Completing system identification... >>> Starting remote procedure call (RPC) services: done. >>> NIS domain name is brs.infineon.com >>> System identification complete. >>> Starting Solaris installation program... >>> Searching for JumpStart directory... >>> Using rules.ok from 172.29.216.237:/Jump/Profiles. >>> Checking rules.ok file... >>> Using begin script: pre_install.sh >>> Using profile: E3500+mirror >>> Using finish script: E3500+login.sh >>> Executing JumpStart preinstall phase... >>> Executing begin script "pre_install.sh"... >>> Mon Aug 15 12:48:16 BST 2005 >>> Begin script pre_install.sh execution completed. >>> Searching for SolStart directory... >>> Checking rules.ok file... >>> Using begin script: install_begin >>> Using finish script: patch_finish >>> Executing SolStart preinstall phase... >>> Executing begin script "install_begin"... >>> Begin script install_begin execution completed. >>> >>> Processing default locales >>> >>> Processing profile >>> - Selecting cluster (SUNWCXall) >>> - Selecting locale (en_GB.ISO8859-1) >>> - Selecting locale (en_GB) >>> - Selecting all disks >>> - Configuring boot device >>> - Configuring SVM State Database Replica on (c0t0d0s6) >>> - Configuring SVM State Database Replica on (c1t4d0s6) >>> - Configuring SVM Mirror Volume d10 on / (c0t0d0s0) >>> - Configuring SVM Mirror Volume d20 on /var (c0t0d0s3) >>> - Configuring SVM Mirror Volume d30 on /usr (c0t0d0s4) >>> - Configuring SVM Mirror Volume d40 on /opt (c0t0d0s5) >>> - Configuring SVM Mirror Volume d50 on /tmp2 (c0t0d0s7) >>> - Configuring SVM Mirror Volume d60 on swap (c0t0d0s1) >>> >>> Verifying disk configuration >>> - WARNING: Unused disk space (c1t4d0) >>> >>> Verifying space allocation >>> - Total software size: 3228.85 Mbytes >>> >>> Preparing system for Solaris install >>> >>> Configuring disk (c0t0d0) >>> - Creating Solaris disk label (VTOC) >>> >>> Configuring disk (c1t4d0) >>> - Creating Solaris disk label (VTOC) >>> >>> Creating and checking UFS file systems >>> - Creating / (c0t0d0s0) >>> - Creating /var (c0t0d0s3) >>> - Creating /usr (c0t0d0s4) >>> - Creating /opt (c0t0d0s5) >>> - Creating /tmp2 (c0t0d0s7) >>> >>> Creating SVM Meta Devices >>> - Creating SVM State Replica on disk c0t0d0s6 >>> - metadb: brscs02: network/rpc/meta:default: failed to >>> enable/disable SVM service >>> - Creating SVM State Replica on disk c1t4d0s6 >>> - metadb: waiting on /etc/lvm/lock >>> - Creating SVM Mirror Volume d10 (/) >>> - Creating SVM Mirror Volume d20 (/var) >>> - Creating SVM Mirror Volume d30 (/usr) >>> - Creating SVM Mirror Volume d40 (/opt) >>> - Creating SVM Mirror Volume d50 (/tmp2) >>> - Creating SVM Mirror Volume d60 (swap) >>> >>> Beginning Solaris software installation >>> >>> Starting software installation >>> SUNWocfd.........................done. 3228.50 Mbytes >>> remaining. >>> SUNWcsu..........................done. 3214.44 Mbytes >>> remaining. >>> SUNWcsr..........................done. 3210.25 Mbytes >>> remaining. >>> . >>> . >>> . >>> SUNWsshdu........................done. 1.68 Mbytes remaining. >>> SUNWsshr.........................done. 1.57 Mbytes remaining. >>> SUNWsshu.........................done. 1.00 Mbytes remaining. >>> >>> Completed software installation >>> >>> Solaris 11 software installation succeeded >>> >>> Customizing system files >>> - Mount points table (/etc/vfstab) >>> - Network host addresses (/etc/hosts) >>> - Network host addresses (/etc/hosts) >>> - Environment variables (/etc/default/init) >>> >>> Cleaning devices >>> >>> Customizing system devices >>> - Physical devices (/devices) >>> - Logical devices (/dev) >>> >>> Installing boot information >>> - Installing boot blocks (c0t0d0s0) >>> >>> Installation log location >>> - /a/var/sadm/system/logs/install_log (before reboot) >>> - /var/sadm/system/logs/install_log (after reboot) >>> >>> Installation complete >>> - Making SVM Mirror Volume as boot device (/dev/md/dsk/d10) >>> Executing SolStart postinstall phase... >>> Executing finish script "patch_finish"... >>> >>> >>> Finish script patch_finish execution completed. >>> Executing JumpStart postinstall phase... >>> Executing finish script "E3500+login.sh"... >>> >>> Mon Aug 15 13:46:18 BST 2005 >>> ******************************************************************************* >>> >>> >>> Creating Display metat data >>> >>> /sbin/metastat >>> metastat: brscs02: system/metainit:default >>> system/mdmonitor:default >>> network/rpc/meta:default: service(s) not online in SMF >>> >>> d60: Mirror >>> Submirror 0: d61 >>> State: Okay Pass: 1 >>> Read option: roundrobin (default) >>> Write option: parallel (default) >>> Size: 19182960 blocks (9.1 GB) >>> >>> d61: Submirror of d60 >>> State: Okay Size: 19182960 blocks (9.1 GB) >>> Stripe 0: >>> Device Start Block Dbase State Reloc Hot Spare >>> c0t0d0s1 0 No Okay Yes >>> >>> d50: Mirror >>> Submirror 0: d51 >>> State: Okay Pass: 1 >>> Read option: roundrobin (default) >>> Write option: parallel (default) >>> Size: 31458321 blocks (15 GB) >>> >>> d51: Submirror of d50 >>> State: Okay Size: 31458321 blocks (15 GB) >>> Stripe 0: >>> Device Start Block Dbase State Reloc Hot Spare >>> c0t0d0s7 0 No Okay Yes >>> >>> d40: Mirror >>> Submirror 0: d41 >>> State: Okay Pass: 1 >>> Read option: roundrobin (default) >>> Write option: parallel (default) >>> Size: 3146121 blocks (1.5 GB) >>> >>> d41: Submirror of d40 >>> State: Okay Size: 3146121 blocks (1.5 GB) >>> Stripe 0: >>> Device Start Block Dbase State Reloc Hot Spare >>> c0t0d0s5 0 No Okay Yes >>> >>> d30: Mirror >>> Submirror 0: d31 >>> State: Okay Pass: 1 >>> Read option: roundrobin (default) >>> Write option: parallel (default) >>> Size: 8389656 blocks (4.0 GB) >>> >>> d31: Submirror of d30 >>> State: Okay Size: 8389656 blocks (4.0 GB) >>> Stripe 0: >>> Device Start Block Dbase State Reloc Hot Spare >>> c0t0d0s4 0 No Okay Yes >>> >>> d20: Mirror >>> Submirror 0: d21 >>> State: Okay Pass: 1 >>> Read option: roundrobin (default) >>> Write option: parallel (default) >>> Size: 8389656 blocks (4.0 GB) >>> >>> d21: Submirror of d20 >>> State: Okay Size: 8389656 blocks (4.0 GB) >>> Stripe 0: >>> Device Start Block Dbase State Reloc Hot Spare >>> c0t0d0s3 0 No Okay Yes >>> >>> d10: Mirror >>> Submirror 0: d11 >>> State: Okay Pass: 1 >>> Read option: roundrobin (default) >>> Write option: parallel (default) >>> Size: 525798 blocks (256 MB) >>> >>> d11: Submirror of d10 >>> State: Okay Size: 525798 blocks (256 MB) >>> Stripe 0: >>> Device Start Block Dbase State Reloc Hot Spare >>> c0t0d0s0 0 No Okay Yes >>> >>> Device Relocation Information: >>> Device Reloc Device ID >>> c0t0d0 Yes id1,ssd at n2000002037a13604 >>> Sleep!!!! >>> /sbin/metastat >>> metastat: brscs02: system/metainit:default >>> system/mdmonitor:default >>> network/rpc/meta:default: service(s) not online in SMF >>> >>> d60: Mirror >>> Submirror 0: d61 >>> State: Okay Pass: 1 >>> Read option: roundrobin (default) >>> Write option: parallel (default) >>> Size: 19182960 blocks (9.1 GB) >>> >>> d61: Submirror of d60 >>> State: Okay Size: 19182960 blocks (9.1 GB) >>> Stripe 0: >>> Device Start Block Dbase State Reloc Hot Spare >>> c0t0d0s1 0 No Okay Yes >>> >>> d50: Mirror >>> Submirror 0: d51 >>> State: Okay Pass: 1 >>> Read option: roundrobin (default) >>> Write option: parallel (default) >>> Size: 31458321 blocks (15 GB) >>> >>> d51: Submirror of d50 >>> State: Okay Size: 31458321 blocks (15 GB) >>> Stripe 0: >>> Device Start Block Dbase State Reloc Hot Spare >>> c0t0d0s7 0 No Okay Yes >>> >>> d40: Mirror >>> Submirror 0: d41 >>> State: Okay Pass: 1 >>> Read option: roundrobin (default) >>> Write option: parallel (default) >>> Size: 3146121 blocks (1.5 GB) >>> >>> d41: Submirror of d40 >>> State: Okay Size: 3146121 blocks (1.5 GB) >>> Stripe 0: >>> Device Start Block Dbase State Reloc Hot Spare >>> c0t0d0s5 0 No Okay Yes >>> >>> d30: Mirror >>> Submirror 0: d31 >>> State: Okay Pass: 1 >>> Read option: roundrobin (default) >>> Write option: parallel (default) >>> Size: 8389656 blocks (4.0 GB) >>> >>> d31: Submirror of d30 >>> State: Okay Size: 8389656 blocks (4.0 GB) >>> Stripe 0: >>> Device Start Block Dbase State Reloc Hot Spare >>> c0t0d0s4 0 No Okay Yes >>> >>> d20: Mirror >>> Submirror 0: d21 >>> State: Okay Pass: 1 >>> Read option: roundrobin (default) >>> Write option: parallel (default) >>> Size: 8389656 blocks (4.0 GB) >>> >>> d21: Submirror of d20 >>> State: Okay Size: 8389656 blocks (4.0 GB) >>> Stripe 0: >>> Device Start Block Dbase State Reloc Hot Spare >>> c0t0d0s3 0 No Okay Yes >>> >>> d10: Mirror >>> Submirror 0: d11 >>> State: Okay Pass: 1 >>> Read option: roundrobin (default) >>> Write option: parallel (default) >>> Size: 525798 blocks (256 MB) >>> >>> d11: Submirror of d10 >>> State: Okay Size: 525798 blocks (256 MB) >>> Stripe 0: >>> Device Start Block Dbase State Reloc Hot Spare >>> c0t0d0s0 0 No Okay Yes >>> >>> Device Relocation Information: >>> Device Reloc Device ID >>> c0t0d0 Yes id1,ssd at n2000002037a13604 >>> Mon Aug 15 13:48:41 BST 2005 >>> >>> Finish script E3500+login.sh execution completed. >>> >>> The begin script log 'begin.log' >>> is located in /var/sadm/system/logs after reboot. >>> >>> The finish script log 'finish.log' >>> is located in /var/sadm/system/logs after reboot. >>> >>> syncing file systems... done >>> rebooting... >>> Resetting... Software Power ON >>> 5-slot Sun Enterprise E3500, No Keyboard >>> OpenBoot 3.2.30, 2048 MB memory installed, Serial #11240214. >>> Copyright 2002 Sun Microsystems, Inc. All rights reserved >>> Ethernet address 8:0:20:ab:83:16, Host ID: 80ab8316. >>> >>> >>> >>> Rebooting with command: boot >>> >>> Port#0 received soc-status=14 Port#1 received soc-status=14 loop 0 is >>> ONLINE >>> Boot device: disk File and args: Loading ufs-file-system package 1.4 >>> 04 Aug 1995 13:02:54. FCode UFS Reader 1.13 05/06/08 08:30:31. >>> Loading: /platform/SUNW,Ultra-Enterprise/ufsboot >>> Loading: /platform/sun4u/ufsboot >>> SunOS Release 5.11 Version snv_19 64-bit >>> Copyright 1983-2005 Sun Microsystems, Inc. All rights reserved. >>> Use is subject to license terms. >>> SUNW,sbus-gem0: Using Gigabit SERDES Interface >>> SUNW,sbus-gem0: Auto-Negotiated 1000 Mbps Full-Duplex Link Up >>> Hostname: brscs02 >>> Configuring devices. >>> Loading smf(5) service descriptions: 130/130 >>> NIS domain name is brs.infineon.com >>> Aug 15 14:01:00 svc.startd[7]: Lost repository event due to >>> disconnection. >>> checking ufs filesystems >>> /dev/md/rdsk/d50: is logging. >>> /dev/md/rdsk/d40: is logging. >>> Creating new rsa public/private host key pair >>> Creating new dsa public/private host key pair >>> >>> brscs02 console login: >>> >>> I have run the jumpstart twice and got the above results. >>> >>> What next :-) >>> >>> Cheers >>> Richard. >>> This message posted from opensolaris.org
