Hi,
Customer is having trouble mounting a disk from local zone after zone
resource group is failed over to another node.
disk can be mounted from local zone on primary node. disk can be mounted from
global zone on either node A or B.
Here are the details:
- a pair of e2900's with Solaris 10 and SunCluster 3.1 installed,
server names are prs179 and prs180
- see attachement 1 for SunCluster scstat output
- two zones were created each with its own shared XP SAN disk as a
whole disk boot disk, zone names are prsgdmsz01 and prsgdmsz02
- both zones exhibit the same problem so I'll just use prsgdmsz02 as
the example to work this case
- see attachment 2 for the prsgdmsz02 zone configs on prs179
- see attachment 3 for the prsgdmsz02 zone configs on prs180
- the SunCluster resource group for prsgdmsz02 is appZONE02rg1
- SunCluster scswitch can successfully move appZONE02rg1 to either
prs179 or prs180 thereby booting the zone on either server.
- attachment 1 shows appZONE02rg1 (zone prsgdmsz02) running on prs179
- attachment 4 shows appZONE02rg1 (zone prsgdmsz02) running on prs180
- attachment 5 shows the dsk/rdsk device info from prs179 for a disk to
be made available within prsgdmsz02 and also shows that the disk can be
mounted within the global zone on prs179 and within the local prsgdmsz02
zone when running on prs179
- attachment 6 shows the same device info for the same SAN disk from
prs180 and also that the disk can be mounted within the global zone on
prs180 but cannot be mounted within the local prsgdmsz02 zone when
running on prs180
Let me know what else you might want to see. Thanks.
Rich
prs179 # scstat
------------------------------------------------------------------
-- Cluster Nodes --
Node name Status
--------- ------
Cluster node: prs179 Online
Cluster node: prs180 Online
------------------------------------------------------------------
-- Cluster Transport Paths --
Endpoint Endpoint Status
-------- -------- ------
Transport path: prs179:ce1 prs180:ce3 Path online
Transport path: prs179:ce3 prs180:ce1 Path online
------------------------------------------------------------------
-- Quorum Summary --
Quorum votes possible: 3
Quorum votes needed: 2
Quorum votes present: 3
-- Quorum Votes by Node --
Node Name Present Possible Status
--------- ------- -------- ------
Node votes: prs179 1 1 Online
Node votes: prs180 1 1 Online
-- Quorum Votes by Device --
Device Name Present Possible Status
----------- ------- -------- ------
Device votes: /dev/did/rdsk/d8s2 1 1 Online
------------------------------------------------------------------
-- Device Group Servers --
Device Group Primary Secondary
------------ ------- ---------
Device group servers: vgZONE01 prs179 prs180
Device group servers: vgZONE02 prs179 prs180
-- Device Group Status --
Device Group Status
------------ ------
Device group status: vgZONE01 Online
Device group status: vgZONE02 Online
-- Multi-owner Device Groups --
Device Group Online Status
------------ -------------
------------------------------------------------------------------
-- Resource Groups and Resources --
Group Name Resources
---------- ---------
Resources: appZONE01rg1 zone01-storplus-res zone01-boot-res
Resources: appZONE02rg1 zone02-storplus-res zone02-boot-res
-- Resource Groups --
Group Name Node Name State
---------- --------- -----
Group: appZONE01rg1 prs179 Online
Group: appZONE01rg1 prs180 Offline
Group: appZONE02rg1 prs179 Online
Group: appZONE02rg1 prs180 Offline
-- Resources --
Resource Name Node Name State Status Message
------------- --------- ----- --------------
Resource: zone01-storplus-res prs179 Online Online
Resource: zone01-storplus-res prs180 Offline Offline
Resource: zone01-boot-res prs179 Online Online
Resource: zone01-boot-res prs180 Offline Offline
Resource: zone02-storplus-res prs179 Online Online
Resource: zone02-storplus-res prs180 Offline Offline
Resource: zone02-boot-res prs179 Online Online
Resource: zone02-boot-res prs180 Offline Offline
------------------------------------------------------------------
-- IPMP Groups --
Node Name Group Status Adapter Status
--------- ----- ------ ------- ------
IPMP Group: prs179 production Online ce2 Standby
IPMP Group: prs179 production Online ce0 Online
IPMP Group: prs180 production Online ce2 Standby
IPMP Group: prs180 production Online ce0 Online
------------------------------------------------------------------
prs179 #
prs179 # zonecfg -z prsgdmsz02 export
create -b
set zonepath=/global/prsgdmsz02
set autoboot=false
set pool=pool_prsgdmsz02
add net
set address=10.228.172.5
set physical=ce0
end
add device
set match=/dev/rdsk/c5t50060E80032A200000002A2000000C0Ad0s7
end
add device
set match=/dev/dsk/c5t50060E80032A200000002A2000000C0Ad0s7
end
prs179 # poolcfg -c "info pset pset_prsgdmsz02"
pset pset_prsgdmsz02
int pset.sys_id -2
boolean pset.default false
uint pset.min 1
uint pset.max 2
string pset.units population
uint pset.load 0
uint pset.size 0
string pset.comment
prs179 # poolcfg -c "info pool pool_prsgdmsz02"
pool pool_prsgdmsz02
boolean pool.active true
boolean pool.default false
int pool.importance 1
string pool.comment
pset pset_prsgdmsz02
pset pset_prsgdmsz02
int pset.sys_id -2
boolean pset.default false
uint pset.min 1
uint pset.max 2
string pset.units population
uint pset.load 0
uint pset.size 0
string pset.comment
prs179 # zoneadm list -iv
ID NAME STATUS PATH
0 global running /
24 prsgdmsz01 running /global/prsgdmsz01
26 prsgdmsz02 running /global/prsgdmsz02
prs179 #
prs180 # zonecfg -z prsgdmsz02 export
create -b
set zonepath=/global/prsgdmsz02
set autoboot=false
set pool=pool_prsgdmsz02
add net
set address=10.228.172.5
set physical=ce0
end
add device
set match=/dev/rdsk/c5t50060E80032A200000002A2000000C0Ad0s7
end
add device
set match=/dev/dsk/c5t50060E80032A200000002A2000000C0Ad0s7
end
prs180 # poolcfg -c "info pset pset_prsgdmsz02"
pset pset_prsgdmsz02
int pset.sys_id -2
boolean pset.default false
uint pset.min 1
uint pset.max 2
string pset.units population
uint pset.load 0
uint pset.size 0
string pset.comment
prs180 # poolcfg -c "info pool pool_prsgdmsz02"
pool pool_prsgdmsz02
boolean pool.active true
boolean pool.default false
int pool.importance 1
string pool.comment
pset pset_prsgdmsz02
pset pset_prsgdmsz02
int pset.sys_id -2
boolean pset.default false
uint pset.min 1
uint pset.max 2
string pset.units population
uint pset.load 0
uint pset.size 0
string pset.comment
prs180 # zoneadm list -iv
ID NAME STATUS PATH
0 global running /
- prsgdmsz01 installed /global/prsgdmsz01
- prsgdmsz02 installed /global/prsgdmsz02
prs180 #
prs179 # scswitch -z -g appZONE02rg1 -h prs180
prs179 # scstat
------------------------------------------------------------------
-- Cluster Nodes --
Node name Status
--------- ------
Cluster node: prs179 Online
Cluster node: prs180 Online
------------------------------------------------------------------
-- Cluster Transport Paths --
Endpoint Endpoint Status
-------- -------- ------
Transport path: prs179:ce1 prs180:ce3 Path online
Transport path: prs179:ce3 prs180:ce1 Path online
------------------------------------------------------------------
-- Quorum Summary --
Quorum votes possible: 3
Quorum votes needed: 2
Quorum votes present: 3
-- Quorum Votes by Node --
Node Name Present Possible Status
--------- ------- -------- ------
Node votes: prs179 1 1 Online
Node votes: prs180 1 1 Online
-- Quorum Votes by Device --
Device Name Present Possible Status
----------- ------- -------- ------
Device votes: /dev/did/rdsk/d8s2 1 1 Online
------------------------------------------------------------------
-- Device Group Servers --
Device Group Primary Secondary
------------ ------- ---------
Device group servers: vgZONE01 prs179 prs180
Device group servers: vgZONE02 prs180 prs179
-- Device Group Status --
Device Group Status
------------ ------
Device group status: vgZONE01 Online
Device group status: vgZONE02 Online
-- Multi-owner Device Groups --
Device Group Online Status
------------ -------------
------------------------------------------------------------------
-- Resource Groups and Resources --
Group Name Resources
---------- ---------
Resources: appZONE01rg1 zone01-storplus-res zone01-boot-res
Resources: appZONE02rg1 zone02-storplus-res zone02-boot-res
-- Resource Groups --
Group Name Node Name State
---------- --------- -----
Group: appZONE01rg1 prs179 Online
Group: appZONE01rg1 prs180 Offline
Group: appZONE02rg1 prs179 Offline
Group: appZONE02rg1 prs180 Online
-- Resources --
Resource Name Node Name State Status Message
------------- --------- ----- --------------
Resource: zone01-storplus-res prs179 Online Online
Resource: zone01-storplus-res prs180 Offline Offline
Resource: zone01-boot-res prs179 Online Online
Resource: zone01-boot-res prs180 Offline Offline
Resource: zone02-storplus-res prs179 Offline Offline
Resource: zone02-storplus-res prs180 Online Online
Resource: zone02-boot-res prs179 Offline Offline
Resource: zone02-boot-res prs180 Online Online
------------------------------------------------------------------
-- IPMP Groups --
Node Name Group Status Adapter Status
--------- ----- ------ ------- ------
IPMP Group: prs179 production Online ce2 Standby
IPMP Group: prs179 production Online ce0 Online
IPMP Group: prs180 production Online ce2 Standby
IPMP Group: prs180 production Online ce0 Online
------------------------------------------------------------------
prs179 #
prs179 # scdidadm -l
1 prs179:/dev/rdsk/c0t0d0 /dev/did/rdsk/d1
2 prs179:/dev/rdsk/c1t0d0 /dev/did/rdsk/d2
3 prs179:/dev/rdsk/c1t1d0 /dev/did/rdsk/d3
4 prs179:/dev/rdsk/c5t50060E80032A200000002A2000000C0Ad0 /dev/did/rdsk/d4
5 prs179:/dev/rdsk/c5t50060E80032A200000002A2000000C09d0 /dev/did/rdsk/d5
6 prs179:/dev/rdsk/c5t50060E80032A200000002A2000000C28d0 /dev/did/rdsk/d6
7 prs179:/dev/rdsk/c5t50060E80032A200000002A2000000C0Bd0 /dev/did/rdsk/d7
8 prs179:/dev/rdsk/c5t50060E80032A200000002A200000073Dd0 /dev/did/rdsk/d8
prs179 # mount /dev/dsk/c5t50060E80032A200000002A2000000C0Ad0s7 /mnt
prs179 # ls -al /mnt
total 20
drwxr-xr-x 3 oracle dba 512 Oct 31 22:12 .
drwxr-xr-x 29 root root 1024 Nov 1 11:48 ..
drwx------ 2 root root 8192 Oct 31 22:12 lost+found
prs179 # df -k /mnt
Filesystem kbytes used avail capacity Mounted on
/dev/dsk/c5t50060E80032A200000002A2000000C0Ad0s7
42031434 41697 41569423 1% /mnt
prs179 # umount /mnt
prs179 #
*Note: the disk above matches the dsk/rdsk defined in the prsgdmsz02 config
prs179 # zlogin prsgdmsz02
[Connected to zone 'prsgdmsz02' pts/5]
Last login: Wed Nov 1 08:06:15 from gvhhpov1.gv.us.
Sun Microsystems Inc. SunOS 5.10 Generic January 2005
You have new mail.
prsgdmsz02 # mount /dev/dsk/c5t50060E80032A200000002A2000000C0Ad0s7
/u00/app/oracle
prsgdmsz02 # ls -al /u00/app/oracle
total 20
drwxr-xr-x 3 oracle dba 512 Oct 31 22:12 .
drwxr-xr-x 3 root root 512 Oct 31 17:40 ..
drwx------ 2 root root 8192 Oct 31 22:12 lost+found
prsgdmsz02 # df -k /u00/app/oracle
Filesystem kbytes used avail capacity Mounted on
/dev/dsk/c5t50060E80032A200000002A2000000C0Ad0s7
42031434 41697 41569423 1% /u00/app/oracle
prsgdmsz02 # umount /u00/app/oracle
prsgdmsz02 # ^D
[Connection to zone 'prsgdmsz02' pts/5 closed]
prs179 #
prs180 # scdidadm -l
4 prs180:/dev/rdsk/c5t50060E80032A200000002A2000000C0Ad0 /dev/did/rdsk/d4
5 prs180:/dev/rdsk/c5t50060E80032A200000002A2000000C09d0 /dev/did/rdsk/d5
6 prs180:/dev/rdsk/c5t50060E80032A200000002A2000000C28d0 /dev/did/rdsk/d6
7 prs180:/dev/rdsk/c5t50060E80032A200000002A2000000C0Bd0 /dev/did/rdsk/d7
8 prs180:/dev/rdsk/c5t50060E80032A200000002A200000073Dd0 /dev/did/rdsk/d8
9 prs180:/dev/rdsk/c0t0d0 /dev/did/rdsk/d9
10 prs180:/dev/rdsk/c1t0d0 /dev/did/rdsk/d10
11 prs180:/dev/rdsk/c1t1d0 /dev/did/rdsk/d11
prs180 # scswitch -z -g appZONE02rg1 -h prs180
prs180 # mount /dev/dsk/c5t50060E80032A200000002A2000000C0Ad0s7 /mnt
prs180 # ls -al /mnt
total 20
drwxr-xr-x 3 oracle dba 512 Oct 31 22:12 .
drwxr-xr-x 29 root root 1024 Oct 31 14:13 ..
drwx------ 2 root root 8192 Oct 31 22:12 lost+found
prs180 # df -k /mnt
Filesystem kbytes used avail capacity Mounted on
/dev/dsk/c5t50060E80032A200000002A2000000C0Ad0s7
42031434 41697 41569423 1% /mnt
prs180 # umount /mnt
prs180 #
*Note: the disk above matches the dsk/rdsk defined in the prsgdmsz02 config
prs180 # zlogin prsgdmsz02
[Connected to zone 'prsgdmsz02' pts/2]
Last login: Wed Nov 1 15:00:37 on pts/5
Sun Microsystems Inc. SunOS 5.10 Generic January 2005
You have new mail.
prsgdmsz02 # mount /dev/dsk/c5t50060E80032A200000002A2000000C0Ad0s7 /mnt
mount: /dev/dsk/c5t50060E80032A200000002A2000000C0Ad0s7 no such device
prsgdmsz02 # ls -l /dev/dsk/c5*
brw-r----- 1 root sys 118, 87 Oct 31 22:15
/dev/dsk/c5t50060E80032A200000002A2000000C0Ad0s7
prsgdmsz02 # ^D
[Connection to zone 'prsgdmsz02' pts/2 closed]
prs180 #
_______________________________________________
zones-discuss mailing list
zones-discuss@opensolaris.org
