After installing the entire cluster express packages/agents on nv_68
machines I cannot seem to get it working correctly. The install works
fine, sccheck completes without errors, and I can get through scinstall
without any problems.
However, after rebooting and attempting to join/create the cluster I get
CCR errors and I have no DID devices. I can't seem to figure out what is
going wrong with Cluster Express... using an earlier version of Nevada
and Sun Cluster 3.2 worked fine, oddly enough.
Any suggestions appreciated...
My node names are eq1-zfs1 and eq1-zfs2. Both have 2 local SATA disks
and both are connected to shared iSCSI disks. After reboot from
scinstall I get the following messages:
Aug 30 13:21:42 eq1-zfs2 genunix: [ID 843983 kern.notice] NOTICE: CMM:
Node eq1-zfs2: attempting to join cluster.
Aug 30 13:21:42 eq1-zfs2 genunix: [ID 525628 kern.notice] NOTICE: CMM:
Cluster has reached quorum.
Aug 30 13:21:42 eq1-zfs2 genunix: [ID 108990 kern.notice] NOTICE: CMM:
Cluster members: eq1-zfs2.
Aug 30 13:21:44 eq1-zfs2 genunix: [ID 787893 kern.notice] NOTICE: Failed
to initiate the task of registering CMM version key
cluster.nodes.1.cmm_version, version 1 in the CCR
Aug 30 13:21:45 eq1-zfs2 genunix: [ID 499756 kern.notice] NOTICE: CMM:
Node eq1-zfs2: joined cluster.
Aug 30 13:22:05 eq1-zfs2 Cluster.devices.did: [ID 355593 daemon.notice]
/usr/cluster/bin/scdidadm: Inquiry on device "/dev/rdsk/c2d0s2" failed.
Aug 30 13:22:05 eq1-zfs2 Cluster.devices.did: [ID 226611 daemon.notice]
/usr/cluster/bin/scdidadm: Inquiry on device "/dev/rdsk/c1d0s2" failed.
Aug 30 13:22:05 eq1-zfs2 Cluster.devices.did: [ID 812720 daemon.notice]
/usr/cluster/bin/scdidadm: Error in discover_paths(): Could not allocate
instances.
Aug 30 13:22:19 eq1-zfs2 Cluster.CCR: [ID 382955 daemon.error] Cannot
reconfig Solaris namespace.
Aug 30 13:22:20 eq1-zfs2 Cluster.CCR: [ID 914260 daemon.warning] Failed
to retrieve global fencing status from the global name server
Aug 30 13:22:26 eq1-zfs2 genunix: [ID 108990 kern.notice] NOTICE: CMM:
Cluster members: eq1-zfs2.
Aug 30 13:22:37 eq1-zfs2 Cluster.CCR: [ID 409585 daemon.error]
/usr/cluster/bin/scgdevs: Cannot register devices as HA.
Aug 30 13:22:41 eq1-zfs2 svc.startd[8]: [ID 748625 daemon.error]
system/cluster/scdpm:default failed repeatedly: transitioned to
maintenance (see 'svcs -xv' for details)
Aug 30 13:23:41 eq1-zfs2 Cluster.RGM.rgmd: [ID 525628 daemon.notice]
CMM: Cluster has reached quorum.
Aug 30 13:23:41 eq1-zfs2 Cluster.RGM.rgmd: [ID 377347 daemon.notice]
CMM: Node eq1-zfs2 (nodeid = 1) is up; new incarnation number = 1188501761.
Aug 30 13:24:47 eq1-zfs2 genunix: [ID 108990 kern.notice] NOTICE: CMM:
Cluster members: eq1-zfs2 eq1-zfs1.
Aug 30 13:24:47 eq1-zfs2 Cluster.Framework: [ID 801593 daemon.notice]
stdout: releasing reservations for scsi-2 disks shared with eq1-zfs1
Aug 30 13:24:47 eq1-zfs2 Cluster.CCR: [ID 914260 daemon.warning] Failed
to retrieve global fencing status from the global name server
Aug 30 13:25:22 eq1-zfs2 Cluster.Framework: [ID 801593 daemon.notice]
stdout: releasing reservations for scsi-2 disks shared with
eq1-zfs1-e1000g2-compa.equest.com
Aug 30 13:25:23 eq1-zfs2 Cluster.CCR: [ID 914260 daemon.warning] Failed
to retrieve global fencing status from the global name server
Aug 30 13:25:34 eq1-zfs2 Cluster.RGM.rgmd: [ID 537175 daemon.notice]
CMM: Node eq1-zfs1 (nodeid: 2, incarnation #: 1188501933) has become
reachable.
Aug 30 13:25:34 eq1-zfs2 Cluster.RGM.rgmd: [ID 377347 daemon.notice]
CMM: Node eq1-zfs1 (nodeid = 2) is up; new incarnation number = 1188501933.
Aug 30 13:34:33 eq1-zfs2 Cluster.devices.did: [ID 229793 daemon.notice]
cldev: (C507896) Inquiry on device "/dev/rdsk/c2d0s2" failed.
Aug 30 13:34:33 eq1-zfs2 Cluster.devices.did: [ID 358774 daemon.notice]
cldev: (C507896) Inquiry on device "/dev/rdsk/c1d0s2" failed.
Aug 30 13:34:33 eq1-zfs2 Cluster.devices.did: [ID 149270 daemon.notice]
cldev: (C494808) Error in discover_paths(): Could not allocate instances.
Aug 30 13:34:48 eq1-zfs2 Cluster.CCR: [ID 382955 daemon.error] Cannot
reconfig Solaris namespace.
bash-3.00# svcs -xv
svc:/system/cluster/scdpm:default (Sun Cluster Disk Path Monitoring Daemon)
State: maintenance since Thu Aug 30 13:22:41 2007
Reason: Restarting too quickly.
See: http://sun.com/msg/SMF-8000-L5
See: man -M /usr/cluster/man -s 1M scdpm
See: /var/svc/log/system-cluster-scdpm:default.log
Impact: 2 dependent services are not running:
svc:/system/cluster/cl-svc-cluster-milestone:default
svc:/system/cluster/sckeysync:default
svc:/system/cluster/scsymon-srv:default (Sun Cluster SyMON Server Daemon)
State: offline since Thu Aug 30 13:21:19 2007
Reason: Dependency svc:/application/management/sunmcagent:default is absent.
See: http://sun.com/msg/SMF-8000-E2
Impact: This service is not running.
