[ufs-discuss] Re: [lvm-discuss] Re: Re: Re: Mirrored File systems failf fsck for snv_16 Solaris 64

[Tony Nguyen]

Sarah,

That makes sense.  I'll try to reproduce the issue here as well as 
talking to other SVM gurus (aka Jerry :^)

Richard, if you still have a system experiencing fsck error, would you 
do a svcs -a | egrep "md|meta". I'd like to eliminate the mdmonitord not 
starting theory.

Thanks,
tony

Sarah Jelinek wrote:
Hi Tony,

I asked Richard to do it this way, specifically to only have a 1-way 
mirror to test to see if the filesystem itself got out of sync 
regardless. Jumpstart allows a 2-way to be setup prior to installation.  
So, we have no trouble with the install when you start with a 1-way and 
do the install. It appears to me that  we have a resync issue when you 
have a 2-way mirror setup prior to the install. The reason I say this is 
that when you have both sides of a mirror attached during an install, we 
then have trouble with the first fsck, but when run manually the fsck 
shows no issues. However, when Richard runs the install with a 1-way 
mirror we don't fail.

Where do we go from here?

thanks,
sarah
****

Tony Nguyen wrote:

Excellent. Does this mean jumpstart profile only allows 1-way mirror? 
Do users need to attach second submirrors and await the resyncs? If 
yes, it sounds like a bug.

btw, use

set md_mirror:md_resync_bufsz = 2048 or 1024

as suggested in the metasync man page before attaching submirrors to 
improve resync performance.

-tony

Richard Skelton wrote:

Hi Sarah,
OK I modified the jumpstart profile :-
install_type    initial_install
system_type     standalone
partitioning    explicit
#filesys         mirror:d10 c0t0d0s0 c1t4d0s0 256       /       logging
#filesys         mirror:d20 c0t0d0s3 c1t4d0s3 4096      /var    logging
#filesys         mirror:d30 c0t0d0s4 c1t4d0s4 4096      /usr    logging
#filesys         mirror:d40 c0t0d0s5 c1t4d0s5 1536      /opt    logging
#filesys         mirror:d50 c0t0d0s7 c1t4d0s7 15360     /tmp2   logging
#filesys         mirror:d60 c0t0d0s1 c1t4d0s1 free swap
filesys         mirror:d10 c0t0d0s0 256       /       logging
filesys         mirror:d20 c0t0d0s3 4096      /var    logging
filesys         mirror:d30 c0t0d0s4 4096      /usr    logging
filesys         mirror:d40 c0t0d0s5 1536      /opt    logging
filesys         mirror:d50 c0t0d0s7 15360     /tmp2   logging
filesys         mirror:d60 c0t0d0s1 free swap
metadb          c0t0d0s6 size 8192 count 4
metadb          c1t4d0s6 size 8192 count 4
cluster         SUNWCXall
locale          en_GB


The install works fine now :-
Rebooting with command: boot net - install
Boot device: /[EMAIL PROTECTED],0/[EMAIL PROTECTED],100000  File and args: - 
install
38a00 Server IP address: 172.29.216.237 Client IP address: 
172.29.216.181 SunOS Release 5.11 Version snv_19 64-bit
Copyright 1983-2005 Sun Microsystems, Inc.  All rights reserved.
Use is subject to license terms.
SUNW,sbus-gem0: Using Gigabit SERDES Interface
SUNW,sbus-gem0: Auto-Negotiated 1000 Mbps Full-Duplex Link Up
Aug 15 04:44:33 svc.startd[7]: Could not log for 
svc:/network/datalink:default: 
open(/var/svc/log//network-datalink:default.log) failed with 
Read-only file system.
Configuring devices.
Using RPC Bootparams for network configuration information.
Attempting to configure interface hme0...
WARNING: hme0: fault detected in device; service degraded
WARNING: hme0: No response from Ethernet network : Link down -- cable 
problem?
Skipped interface hme0
Attempting to configure interface ge0...
Configured interface ge0
Beginning system identification...
Searching for configuration file(s)...
Using sysid configuration file 
172.29.216.237:/Jump/Profiles/E3500_sysidcfg/sysidcfg
Search complete.
Discovering additional network configuration...
Completing system identification...
Starting remote procedure call (RPC) services: done.
NIS domain name is brs.infineon.com
System identification complete.
Starting Solaris installation program...
Searching for JumpStart directory...
Using rules.ok from 172.29.216.237:/Jump/Profiles.
Checking rules.ok file...
Using begin script: pre_install.sh
Using profile: E3500+mirror
Using finish script: E3500+login.sh
Executing JumpStart preinstall phase...
Executing begin script "pre_install.sh"...
Mon Aug 15 12:48:16 BST 2005
Begin script pre_install.sh execution completed.
Searching for SolStart directory...
Checking rules.ok file...
Using begin script: install_begin
Using finish script: patch_finish
Executing SolStart preinstall phase...
Executing begin script "install_begin"...
Begin script install_begin execution completed.

Processing default locales

Processing profile
        - Selecting cluster (SUNWCXall)
        - Selecting locale (en_GB.ISO8859-1)
        - Selecting locale (en_GB)
        - Selecting all disks
        - Configuring boot device
        - Configuring SVM State Database Replica on  (c0t0d0s6)
        - Configuring SVM State Database Replica on  (c1t4d0s6)
        - Configuring SVM Mirror Volume d10 on / (c0t0d0s0)
        - Configuring SVM Mirror Volume d20 on /var (c0t0d0s3)
        - Configuring SVM Mirror Volume d30 on /usr (c0t0d0s4)
        - Configuring SVM Mirror Volume d40 on /opt (c0t0d0s5)
        - Configuring SVM Mirror Volume d50 on /tmp2 (c0t0d0s7)
        - Configuring SVM Mirror Volume d60 on swap (c0t0d0s1)

Verifying disk configuration
        - WARNING: Unused disk space (c1t4d0)

Verifying space allocation
        - Total software size:  3228.85 Mbytes

Preparing system for Solaris install

Configuring disk (c0t0d0)
        - Creating Solaris disk label (VTOC)

Configuring disk (c1t4d0)
        - Creating Solaris disk label (VTOC)

Creating and checking UFS file systems
        - Creating / (c0t0d0s0)
        - Creating /var (c0t0d0s3)
        - Creating /usr (c0t0d0s4)
        - Creating /opt (c0t0d0s5)
        - Creating /tmp2 (c0t0d0s7)

Creating SVM Meta Devices
        - Creating SVM State Replica on disk c0t0d0s6
        - metadb: brscs02: network/rpc/meta:default: failed to 
enable/disable SVM service
        - Creating SVM State Replica on disk c1t4d0s6
        - metadb: waiting on /etc/lvm/lock
        - Creating SVM Mirror Volume d10 (/)
        - Creating SVM Mirror Volume d20 (/var)
        - Creating SVM Mirror Volume d30 (/usr)
        - Creating SVM Mirror Volume d40 (/opt)
        - Creating SVM Mirror Volume d50 (/tmp2)
        - Creating SVM Mirror Volume d60 (swap)

Beginning Solaris software installation

Starting software installation
        SUNWocfd.........................done.  3228.50 Mbytes 
remaining.
        SUNWcsu..........................done.  3214.44 Mbytes 
remaining.
        SUNWcsr..........................done.  3210.25 Mbytes 
remaining.
.
.
.
        SUNWsshdu........................done.    1.68 Mbytes remaining.
        SUNWsshr.........................done.    1.57 Mbytes remaining.
        SUNWsshu.........................done.    1.00 Mbytes remaining.

Completed software installation

Solaris 11 software installation succeeded

Customizing system files
        - Mount points table (/etc/vfstab)
        - Network host addresses (/etc/hosts)
        - Network host addresses (/etc/hosts)
        - Environment variables (/etc/default/init)

Cleaning devices

Customizing system devices
        - Physical devices (/devices)
        - Logical devices (/dev)

Installing boot information
        - Installing boot blocks (c0t0d0s0)

Installation log location
        - /a/var/sadm/system/logs/install_log (before reboot)
        - /var/sadm/system/logs/install_log (after reboot)

Installation complete
        - Making SVM Mirror Volume as boot device (/dev/md/dsk/d10)
Executing SolStart postinstall phase...
Executing finish script "patch_finish"...


Finish script patch_finish execution completed.
Executing JumpStart postinstall phase...
Executing finish script "E3500+login.sh"...

Mon Aug 15 13:46:18 BST 2005
******************************************************************************* 

Creating Display metat data

/sbin/metastat
metastat: brscs02:         system/metainit:default
        system/mdmonitor:default
        network/rpc/meta:default: service(s) not online in SMF

d60: Mirror
    Submirror 0: d61
      State: Okay             Pass: 1
    Read option: roundrobin (default)
    Write option: parallel (default)
    Size: 19182960 blocks (9.1 GB)

d61: Submirror of d60
    State: Okay             Size: 19182960 blocks (9.1 GB)
    Stripe 0:
        Device     Start Block  Dbase        State Reloc Hot Spare
        c0t0d0s1          0     No            Okay   Yes

d50: Mirror
    Submirror 0: d51
      State: Okay             Pass: 1
    Read option: roundrobin (default)
    Write option: parallel (default)
    Size: 31458321 blocks (15 GB)

d51: Submirror of d50
    State: Okay             Size: 31458321 blocks (15 GB)
    Stripe 0:
        Device     Start Block  Dbase        State Reloc Hot Spare
        c0t0d0s7          0     No            Okay   Yes

d40: Mirror
    Submirror 0: d41
      State: Okay             Pass: 1
    Read option: roundrobin (default)
    Write option: parallel (default)
    Size: 3146121 blocks (1.5 GB)

d41: Submirror of d40
    State: Okay             Size: 3146121 blocks (1.5 GB)
    Stripe 0:
        Device     Start Block  Dbase        State Reloc Hot Spare
        c0t0d0s5          0     No            Okay   Yes

d30: Mirror
    Submirror 0: d31
      State: Okay             Pass: 1
    Read option: roundrobin (default)
    Write option: parallel (default)
    Size: 8389656 blocks (4.0 GB)

d31: Submirror of d30
    State: Okay             Size: 8389656 blocks (4.0 GB)
    Stripe 0:
        Device     Start Block  Dbase        State Reloc Hot Spare
        c0t0d0s4          0     No            Okay   Yes

d20: Mirror
    Submirror 0: d21
      State: Okay             Pass: 1
    Read option: roundrobin (default)
    Write option: parallel (default)
    Size: 8389656 blocks (4.0 GB)

d21: Submirror of d20
    State: Okay             Size: 8389656 blocks (4.0 GB)
    Stripe 0:
        Device     Start Block  Dbase        State Reloc Hot Spare
        c0t0d0s3          0     No            Okay   Yes

d10: Mirror
    Submirror 0: d11
      State: Okay             Pass: 1
    Read option: roundrobin (default)
    Write option: parallel (default)
    Size: 525798 blocks (256 MB)

d11: Submirror of d10
    State: Okay             Size: 525798 blocks (256 MB)
    Stripe 0:
        Device     Start Block  Dbase        State Reloc Hot Spare
        c0t0d0s0          0     No            Okay   Yes

Device Relocation Information:
Device   Reloc  Device ID
c0t0d0   Yes    id1,[EMAIL PROTECTED]
Sleep!!!!
/sbin/metastat
metastat: brscs02:         system/metainit:default
        system/mdmonitor:default
        network/rpc/meta:default: service(s) not online in SMF

d60: Mirror
    Submirror 0: d61
      State: Okay             Pass: 1
    Read option: roundrobin (default)
    Write option: parallel (default)
    Size: 19182960 blocks (9.1 GB)

d61: Submirror of d60
    State: Okay             Size: 19182960 blocks (9.1 GB)
    Stripe 0:
        Device     Start Block  Dbase        State Reloc Hot Spare
        c0t0d0s1          0     No            Okay   Yes

d50: Mirror
    Submirror 0: d51
      State: Okay             Pass: 1
    Read option: roundrobin (default)
    Write option: parallel (default)
    Size: 31458321 blocks (15 GB)

d51: Submirror of d50
    State: Okay             Size: 31458321 blocks (15 GB)
    Stripe 0:
        Device     Start Block  Dbase        State Reloc Hot Spare
        c0t0d0s7          0     No            Okay   Yes

d40: Mirror
    Submirror 0: d41
      State: Okay             Pass: 1
    Read option: roundrobin (default)
    Write option: parallel (default)
    Size: 3146121 blocks (1.5 GB)

d41: Submirror of d40
    State: Okay             Size: 3146121 blocks (1.5 GB)
    Stripe 0:
        Device     Start Block  Dbase        State Reloc Hot Spare
        c0t0d0s5          0     No            Okay   Yes

d30: Mirror
    Submirror 0: d31
      State: Okay             Pass: 1
    Read option: roundrobin (default)
    Write option: parallel (default)
    Size: 8389656 blocks (4.0 GB)

d31: Submirror of d30
    State: Okay             Size: 8389656 blocks (4.0 GB)
    Stripe 0:
        Device     Start Block  Dbase        State Reloc Hot Spare
        c0t0d0s4          0     No            Okay   Yes

d20: Mirror
    Submirror 0: d21
      State: Okay             Pass: 1
    Read option: roundrobin (default)
    Write option: parallel (default)
    Size: 8389656 blocks (4.0 GB)

d21: Submirror of d20
    State: Okay             Size: 8389656 blocks (4.0 GB)
    Stripe 0:
        Device     Start Block  Dbase        State Reloc Hot Spare
        c0t0d0s3          0     No            Okay   Yes

d10: Mirror
    Submirror 0: d11
      State: Okay             Pass: 1
    Read option: roundrobin (default)
    Write option: parallel (default)
    Size: 525798 blocks (256 MB)

d11: Submirror of d10
    State: Okay             Size: 525798 blocks (256 MB)
    Stripe 0:
        Device     Start Block  Dbase        State Reloc Hot Spare
        c0t0d0s0          0     No            Okay   Yes

Device Relocation Information:
Device   Reloc  Device ID
c0t0d0   Yes    id1,[EMAIL PROTECTED]
Mon Aug 15 13:48:41 BST 2005

Finish script E3500+login.sh execution completed.

The begin script log 'begin.log'
is located in /var/sadm/system/logs after reboot.

The finish script log 'finish.log'
is located in /var/sadm/system/logs after reboot.

syncing file systems... done
rebooting...
Resetting... Software Power ON
5-slot Sun Enterprise E3500, No Keyboard
OpenBoot 3.2.30, 2048 MB memory installed, Serial #11240214.
Copyright 2002 Sun Microsystems, Inc.  All rights reserved
Ethernet address 8:0:20:ab:83:16, Host ID: 80ab8316.



Rebooting with command: boot

Port#0 received soc-status=14 Port#1 received soc-status=14 loop 0 is 
ONLINE
Boot device: disk  File and args: Loading ufs-file-system package 1.4 
04 Aug 1995 13:02:54. FCode UFS Reader 1.13 05/06/08 08:30:31. 
Loading: /platform/SUNW,Ultra-Enterprise/ufsboot
Loading: /platform/sun4u/ufsboot
SunOS Release 5.11 Version snv_19 64-bit
Copyright 1983-2005 Sun Microsystems, Inc.  All rights reserved.
Use is subject to license terms.
SUNW,sbus-gem0: Using Gigabit SERDES Interface
SUNW,sbus-gem0: Auto-Negotiated 1000 Mbps Full-Duplex Link Up
Hostname: brscs02
Configuring devices.
Loading smf(5) service descriptions: 130/130
NIS domain name is brs.infineon.com
Aug 15 14:01:00 svc.startd[7]: Lost repository event due to 
disconnection.
checking ufs filesystems
/dev/md/rdsk/d50: is logging.
/dev/md/rdsk/d40: is logging.
Creating new rsa public/private host key pair
Creating new dsa public/private host key pair

brscs02 console login:

I have run the jumpstart twice and got the above results.

What next :-)

Cheers
Richard.
This message posted from opensolaris.org

_______________________________________________
ufs-discuss mailing list
ufs-discuss@opensolaris.org