Sun Cluster 3.0 U1 Sun Microsystems, Inc. 901 San Antonio Road Palo Alto,, CA 94303-4900 U.S.A. 650-960-1300 : 816-1967-10 2001 8, Revision A
Copyright 2001 Sun Microsystems, Inc. 901 San Antonio Road, Palo Alto, California 94303-4900 U.S.A..,,,. Sun ( ). Sun. Berkeley BSD. UNIX X/Open Company, Ltd.. Netscape Communicator TM. (c) Copyright 1995 Netscape Communications Corporation. All rights reserved. Sun, Sun Microsystems, Sun, AnswerBook2, docs.sun.com, Solstice DiskSuite, Sun Enterprise, Sun Enterprise SyMON, JumpStart, StorEdge, Sun Management Center, OpenBoot Solaris Sun Microsystems, Inc.. SPARC SPARC International, Inc.. SPARC Sun Microsystems, Inc.. OPEN LOOK Sun TM GUI( ) Sun Microsystems, Inc.. Sun Xerox. Sun Xerox Xerox. OPEN LOOK GUI Sun Sun. : FAR 52.227-14(g)(2)(6/87) FAR 52.227-19(6/87) DFAR 252.227-7015(b)(6/95) DFAR 227.7202-3(a).,,,.. Copyright 2001 Sun Microsystems, Inc., 901 San Antonio Road, Palo Alto, Californie 94303 Etats-Unis. Tous droits réservés. Ce produit ou document est protégé par un copyright et distribué avec des licences qui en restreignent l utilisation, la copie, la distribution, et la décompilation. Aucune partie de ce produit ou document ne peut être reproduite sous aucune forme, par quelque moyen que ce soit, sans l autorisation préalable et écrite de Sun et de ses bailleurs de licence, s il y en a. Le logiciel détenu par des tiers, et qui comprend la technologie relative aux polices de caractères, est protégé par un copyright et licencié par des fournisseurs de Sun. Des parties de ce produit pourront être dérivées des systèmes Berkeley BSD licenciés par l Université de Californie. UNIX est une marque déposée aux Etats-Unis et dans d autres pays et licenciée exclusivement par X/Open Company, Ltd. La notice suivante est applicable à Netscape Communicator TM : (c) Copyright 1995 Netscape Communications Corporation. Tous droits réservés. Sun, Sun Microsystems, le logo Sun, AnswerBook2, docs.sun.com, Solstice DiskSuite, Sun Enterprise, Sun Enterprise SyMON, OpenBoot, et Solaris sont des marques de fabrique ou des marques déposées, ou marques de service, de Sun Microsystems, Inc. aux Etats-Unis et dans d autres pays. Toutes les marques SPARC sont utilisées sous licence et sont des marques de fabrique ou des marques déposées de SPARC International, Inc. aux Etats-Unis et dans d autres pays. Les produits portant les marques SPARC sont basés sur une architecture développée par Sun Microsystems, Inc. L interface d utilisation graphique OPEN LOOK et Sun TM a été développée par Sun Microsystems, Inc. pour ses utilisateurs et licenciés. Sun reconnaît les efforts de pionniers de Xerox pour la recherche et le développement du concept des interfaces d utilisation visuelle ou graphique pour l industrie de l informatique. Sun détient une licence non exclusive de Xerox sur l interface d utilisation graphique Xerox, cette licence couvrant également les licenciés de Sun qui mettent en place l interface d utilisation graphique OPEN LOOK et qui en outre se conforment aux licences écrites de Sun. CETTE PUBLICATION EST FOURNIE "EN L ETAT" ET AUCUNE GARANTIE, EXPRESSE OU IMPLICITE, N EST ACCORDEE, Y COMPRIS DES GARANTIES CONCERNANT LA VALEUR MARCHANDE, L APTITUDE DE LA PUBLICATION A REPONDRE A UNE UTILISATION PARTICULIERE, OU LE FAIT QU ELLE NE SOIT PAS CONTREFAISANTE DE PRODUIT DE TIERS. CE DENI DE GARANTIE NE S APPLIQUERAIT PAS, DANS LA MESURE OU IL SERAIT TENU JURIDIQUEMENT NUL ET NON AVENU.
9 1. Sun Cluster 13 1.1 Sun Cluster 13 1.2 14 1.2.1 14 1.2.2 14 1.3 16 1.3.1 Sun Cluster 16 1.3.2 16 1.3.3 17 1.4 17 Sun Cluster 19 scsetup 20 Sun Cluster 21, 22 23 25 26 3
2. 29 2.1 29 31 32 33 2.2 35 36 37 39 40 2.3 /var 41 /var 42 3. 43 3.1 44 3.1.1 Solstice DiskSuite 44 3.1.2 VERITAS Volume Manager 45 3.2 45 3.3 46 48 (Solstice DiskSuite) 49 (Solstice DiskSuite) 50 3.3.1 (Solstice DiskSuite) 50 (VERITAS Volume Manager) 51 (VERITAS Volume Manager) 52 (VERITAS Volume Manager) 53 4 Sun Cluster 3.0 U1 2001 8, Revision A
(VERITAS Volume Manager) 54 (VERITAS Volume Manager) 55 (VERITAS Volume Manager) 56 (VERITAS Volume Manager) 58 (VERITAS Volume Manager) 59 (VERITAS Volume Manager) 60 (VERITAS Volume Manager) 61 3.3.2 (VERITAS Volume Manager) 62 63 64 1 66 3.3.3 67 3.4 68 69 72 74 4. 77 4.1 77 79 4.1.1 80 4.1.2 82 83 84 85 86 5
5. 89 5.1 90 91, 92, 94 96 97 5.2 99 NAFO 100 NAFO 102 NAFO 103 NAFO 105 NAFO 106 NAFO 107 108 6. 111 6.1 111 112 ID 113 114 115 OBP(OpenBoot PROM) 116 6.1.1 117 119 121 6.2 122 6.2.1 124 6.2.2 126 6 Sun Cluster 3.0 U1 2001 8, Revision A
7. Sun Cluster 129 7.1 Sun Cluster 129 7.1.1 Sun Cluster 130 7.2 Sun Cluster 131 ( ) 131 ( ) 134 Sun Cluster 135 Sun Cluster 136 8. 141 8.1 141 142 143 (/) 143 (Solstice DiskSuite) 145 (VERITAS Volume Manager) 148 8.2 152 8.3 153 (Solstice DiskSuite) 153 (/) (Solstice DiskSuite) 154 (/) (Solstice DiskSuite) 157 (/) (VERITAS Volume Manager) 162 (/) (VERITAS Volume Manager) 165 9. GUI Sun Cluster 171 9.1 Sun Management Center 171 9.2 SunPlex Manager 172 9.3 SunPlex Manager 172 9.4 SunPlex Manager 173 7
9.4.1 SunPlex Manager 174 9.4.2 SunPlex Manager 174 9.4.3 175 9.5 SunPlex Manager 176 9.5.1 SunPlex Manager 176 9.6 SunPlex Manager 178 9.6.1 RBAC 178 9.6.2 RBAC 179 8 Sun Cluster 3.0 U1 2001 8, Revision A
Sun Cluster 3.0 U1 Sun TM. Cluster 3.0 Sun... Solaris TM, Sun Cluster. UNIX Sun Cluster. UNIX.. 4 Solaris AnswerBook2 TM 4 4 Solaris 9
AaBbCc123,,.login. ls -a. % You have mail. AaBbCc123 % su Password: AaBbCc123,, User s Guide 6. class.. rm filename. C machine_name% C machine_name# Bourne Korn $ Bourne Korn # 10 Sun Cluster 3.0 U1 2001 8, Revision A
Sun Cluster 3.0 U1 Hardware Guide Sun Cluster 3.0 U1 Sun Cluster 3.0 U1 Data Services Installation and Configuration Guide API Sun Cluster 3.0 Data Services Developers Guide Sun Cluster 3.0 U1 Sun Cluster 3.0 U1 Error Messages Manual Sun Cluster 3.0 U1 Sun Fatbrain.com Sun Microsystems, Inc.. Fatbrain.com Sun Documentation Center. http://www1.fatbrain.com/documentation/sun Sun docs.sun.com SM Sun. docs.sun.com. 11
http://docs.sun.com Sun Cluster.. 4 ( ) 4, 4 4 ( : Solaris 8) 4 Sun Cluster ( : Sun Cluster 3.0). prtconf -v psrinfo -v showrev --p prtdiag -v /usr/cluster/bin/scinstall -pv.... Sun Cluster. /var/adm/messages. 12 Sun Cluster 3.0 U1 2001 8, Revision A
1 Sun Cluster Sun Cluster.. 4 (19 ) Sun Cluster 4 (20 ) scsetup 4 (21 ) Sun Cluster 4 (22 ), 4 (23 ) 4 (25 ) 4 (26 ) 1.1Sun Cluster Sun Cluster. Sun Cluster. Sun Cluster 3.0 U1 Sun Cluster 3.0 U1. Sun Cluster. 4.. 13
4,. Sun Cluster 3.0 U1 Data Services Installation and Configuration Guide. 4. Sun Cluster 3.0 U1 Hardware Guide., Sun Cluster... 1.2 GUI Sun Cluster.. 1.2.1 Sun Cluster GUI. GUI SunPlex Manager Sun Management Center. SunPlex Manager Sun Management Center 9. GUI. 1.2.2 scsetup(1m) Sun Cluster. scsetup. scsetup. 4 4 4 4 4 4 4 14 Sun Cluster 3.0 U1 2001 8, Revision A
Sun Cluster.. 1 1 Sun Cluster ccp(1m). pmfadm(1m). pnmset(1m) PNM(Public Network Management). pnmstat(1m) sccheck(1m) scconf(1m) scdidadm(1m) PNM NAFO(Network Adapter Failover). /etc/vfstab. Sun Cluster. -p. ID. scgdevs(1m). scinstall(1m) scrgadm(1m) scsetup(1m) Sun Cluster. -p Sun Cluster.,. -p,. scconf. scshutdown(1m). scstat(1m). scswitch(1m). Sun Cluster 15
Sun Cluster., Solstice DiskSuite TM VERITAS Volume Manager. 1.3. 1.3.1Sun Cluster Sun Cluster... 1.3.2 SPARCstation. CCP(Cluster Control Panel) GUI. CCP (19 ) Sun Cluster. Sun Management Center SunPlex Manager GUI Sun Cluster 3.0 U1... Sun Enterprise TM 10000 SSP(System Service Processor) netcon(1m). netcon Sun Enterprise 10000. (cconsole). exclusive netcon., f netcon ~*.. netcon(1m). Sun Cluster. 16 Sun Cluster 3.0 U1 2001 8, Revision A
4. 4 Enterprise Services. 1.3.3. Sun Cluster HA. Sun Cluster,... 4 4 DBMS 4 4 Solstice DiskSuite md.tab 1.4 1 2. 1 2 Sun Cluster 3.0 ccp CCP(Cluster Control Panel). cconsole, crlogin ctelnet. (19 ) Sun Cluster scsetup. (20 ) scsetup Sun Cluster 17
1 2 Sun Cluster 3.0 Sun Cluster -p -pv scinstall. (21 ) Sun Cluster, scrgadm -p. (22 ), SunPlex Manager Sun Management Center Sun Cluster. SunPlex Manager Sun Management Center Sun Cluster. SunPlex Manager Sun Management Center Sun Cluster SunPlex Manager Sun Management Center Sun Cluster scstat. (23 ) scconf -p. (25 ) sccheck. (26 ) 18 Sun Cluster 3.0 U1 2001 8, Revision A
1 2 Sun Cluster 3.0 Sun Cluster Solstice DiskSuite VERITAS Volume Manager /var/adm/messages. metastat. vxstat vxva. Solaris Solstice DiskSuite VERITAS Volume Manager Sun Cluster CCP(Cluster Control Panel) cconsole, crlogin ctelnet.... ccp(1m) cconsole(1m). 1. CCP. 4 Sun Cluster (SUNWccon ). 4 PATH Sun Cluster, /opt/sunwcluster/ bin /usr/cluster/bin. $CLUSTER_HOME. 4 clusters, serialports nsswitch.conf. /etc NIS/NIS+. clusters(4) serialports(4). 2. Sun Enterprise E10000 server. 4 (19 ) 3. 4 SSP(System Service Processor) netcon. Shift~@. 3. CCP.. # ccp clustername Sun Cluster 19
CCP. 4. CCP (cconsole, crlogin ctelnet). 1.4.0.1 CCP(Cluster Control Panel). 1 1 CCP(Cluster Control Panel) 1.4.0.2 cconsole, crlogin ctelnet. cconsole(1m). scsetup scsetup(1m),,,,. 1.. 2. scsetup. # scsetup 20 Sun Cluster 3.0 U1 2001 8, Revision A
Main Menu. 3.. scsetup. Sun Cluster. Sun Cluster. Sun Cluster. Sun Cluster 3.0 U1 110648-05. % showrev -p Sun Cluster Sun Cluster. % scinstall -pv 1.4.0.1 : Sun Cluster. % showrev -p grep 110648 Patch: 110648-05 Obsoletes: Requires: Incompatibles: Packages: 1.4.0.2 : Sun Cluster. % scinstall -pv SunCluster 3.0 SUNWscr: 3.0.0,REV=2000.10.01.01.00 SUNWscdev: 3.0.0,REV=2000.10.01.01.00 SUNWscu: 3.0.0,REV=2000.10.01.01.00 SUNWscman: 3.0.0,REV=2000.10.01.01.00 SUNWscsal: 3.0.0,REV=2000.10.01.01.00 SUNWscsam: 3.0.0,REV=2000.10.01.01.00 SUNWscvm: 3.0.0,REV=2000.10.01.01.00 ( ) Sun Cluster 21
( ) SUNWmdm: 4.2.1,REV=2000.08.08.10.01, SunPlex Manager GUI. SunPlex Manager..,. % scrgadm -p 1.4.0.1 :, schost (RT Name), (RG Name<) (RS Name). % scrgadm -p RT Name: SUNW.SharedAddress RT Description: HA Shared Address Resource Type RT Name: SUNW.LogicalHostname RT Description: Logical Hostname Resource Type RG Name: schost-sa-1 RG Description: RS Name: schost-1 RS Description: RS Type: SUNW.SharedAddress RS Resource Group: schost-sa-1 RG Name: schost-lh-1 RG Description: RS Name: schost-3 RS Description: RS Type: SUNW.LogicalHostname RS Resource Group: schost-lh-1 22 Sun Cluster 3.0 U1 2001 8, Revision A
SunPlex Manager GUI. SunPlex Manager.. % scstat -p % scstat -p -- Cluster Nodes -- 1.4.0.1 : scstat(1m). Node name Status --------- ------ Cluster node: phys-schost-1 Online Cluster node: phys-schost-2 Online Cluster node: phys-schost-3 Online Cluster node: phys-schost-4 Online ------------------------------------------------------------------ -- Cluster Transport Paths -- Transport path: Transport path:... Endpoint Endpoint Status -------- -------- ------ phys-schost-1:qfe1 phys-schost-4:qfe1 Path online phys-schost-1:hme1 phys-schost-4:hme1 Path online ------------------------------------------------------------------ -- Quorum Summary -- Quorum votes possible: 6 Quorum votes needed: 4 Quorum votes present: 6 -- Quorum Votes by Node -- Node Name Present Possible Status --------- ------- -------- ------ Node votes: phys-schost-1 1 1 Online Node votes: phys-schost-2 1 1 Online... ( ) Sun Cluster 23
( ) -- Quorum Votes by Device -- Device Name Present Possible Status ----------- ------- -------- ------ Device votes: /dev/did/rdsk/d2s2 1 1 Online Device votes: /dev/did/rdsk/d8s2 1 1 Online... -- Device Group Servers -- Device Group Primary Secondary ------------ ------- --------- Device group servers: rmt/1 - - Device group servers: rmt/2 - - Device group servers: schost-1 phys-schost-2 phys-schost-1 Device group servers: schost-3 - - -- Device Group Status -- Device Group Status ------------ ------ Device group status: rmt/1 Offline Device group status: rmt/2 Offline Device group status: schost-1 Online Device group status: schost-3 Offline ------------------------------------------------------------------ -- Resource Groups and Resources -- Group Name Resources ---------- --------- Resources: test-rg test_1 Resources: real-property-rg - Resources: failover-rg - Resources: descript-rg-1 -... -- Resource Groups --... Group Name Node Name State ---------- --------- ----- Group: test-rg phys-schost-1 Offline Group: test-rg phys-schost-2 Offline -- Resources -- Resource Name Node Name State Status Message ------------- --------- ----- -------------- Resource: test_1 phys-schost-1 Offline Offline Resource: test_1 phys-schost-2 Offline Offline 24 Sun Cluster 3.0 U1 2001 8, Revision A
SunPlex Manager GUI. SunPlex Manager... % scconf -p 1.4.0.1 :. % scconf -p Cluster name: cluster-1 Cluster ID: 0x3908EE1C Cluster install mode: disabled Cluster private net: 172.16.0.0 Cluster private netmask: 255.255.0.0 Cluster new node authentication: unix Cluster new node list: <NULL - Allow any node> Cluster nodes: phys-schost-1 phys-schost-2 phys-schost-3 phys-schost-4 Cluster node name: phys-schost-1 Node ID: 1 Node enabled: yes Node private hostname: clusternode1-priv Node quorum vote count: 1 Node reservation key: 0x3908EE1C00000001 Node transport adapters: hme1 qfe1 qfe2 Node transport adapter: Adapter enabled: Adapter transport type: Adapter property: Adapter property: Adapter property:... Cluster transport junctions: hme1 yes dlpi device_name=hme device_instance=1 dlpi_heartbeat_timeout=10000 hub0 hub1 hub2 Cluster transport junction: hub0 Junction enabled: yes Junction type: switch Junction port names: 1 2 3 4... Junction port: 1 Port enabled: yes ( ) Sun Cluster 25
( ) Junction port: 2 Port enabled: yes... Cluster transport cables Endpoint Endpoint State -------- -------- ----- Transport cable: phys-schost-1:hme1@0 hub0@1 Enabled Transport cable: phys-schost-1:qfe1@0 hub1@1 Enabled Transport cable: phys-schost-1:qfe2@0 hub2@1 Enabled Transport cable: phys-schost-2:hme1@0 hub0@2 Enabled... Quorum devices: d2 d8 Quorum device name: d2 Quorum device votes: 1 Quorum device enabled: yes Quorum device name: /dev/did/rdsk/d2s2 Quorum device hosts (enabled): phys-schost-1 phys-schost-2 Quorum device hosts (disabled):... Device group name: schost-3 Device group type: SDS Device group failback enabled: no Device group node list: phys-schost-3, phys-schost-4 Diskset name: schost-3 sccheck(1m) /etc/vfstab. sccheck. sccheck. : sccheck. 1.. 2.. # sccheck 26 Sun Cluster 3.0 U1 2001 8, Revision A
1.4.0.1 : phys-schost-3 /global/schost-1. # sccheck vfstab-check: WARNING - phys-schost-3 - Missing mount point /global/schost-1 Sun Cluster 27
28 Sun Cluster 3.0 U1 2001 8, Revision A
2.. 4 (31 ) 4 (32 ) 4 (33 ) 4 (36 ) 4 (37 ) 4 (39 ) 4 (40 ) 4 (42 ) /var 2 1 2 2. 2.1 Sun Cluster scshutdown(1m).. 29
: shutdown halt scshutdown. scswitch Solaris shutdown. (31 ) 2.2 (35 ). scshutdown. 1. 2. 3. 4. init 0 OBPok :.. (40 ). 2 1 : - scshutdown (31 ). - scshutdown (32 ) (33 ) ok boot.. 30 Sun Cluster 3.0 U1 2001 8, Revision A
: send brk.. send brk ok go. 1. OPS(Oracle Parallel Server) OPS. Oracle Parallel Server. 2.. 3. OBP.. # scshutdown -g0 -y 4. ok. ok. 5.. 2.1.0.1 : ok. g 0 0, -y yes.. # scshutdown -g0 -y May 2 10:08:46 phys-schost-1 cl_runtime: WARNING: CMM monitoring disabled. phys-schost-1# INIT: New run level: 0 The system is coming down. Please wait. System services are now being stopped. /etc/rc0.d/k05initrgm: Calling scswitch -S (evacuate) The system is down. syncing file systems... done Program terminated ok 31
2.1.0.2 (32 ). 1. ok... ok boot. :. 2.. scstat(1m). # scstat -n : /var Sun Cluster. (42 ) /var. 2.1.0.1 : phys-schost-1.. ok boot Rebooting with command: boot... Hostname: phys-schost-1 Booting as part of a cluster NOTICE: Node 1 with votecount = 1 added. NOTICE: Node 2 with votecount = 1 added. NOTICE: Node 3 with votecount = 1 added. ( ) 32 Sun Cluster 3.0 U1 2001 8, Revision A
( )... NOTICE: Node 1: attempting to join cluster... NOTICE: Node 2 (incarnation # 937690106) has become reachable. NOTICE: Node 3 (incarnation # 937690290) has become reachable. NOTICE: cluster has reached quorum. NOTICE: node 1 is up; new incarnation number = 937846227. NOTICE: node 2 is up; new incarnation number = 937690106. NOTICE: node 3 is up; new incarnation number = 937690290. NOTICE: Cluster members: 1 2 3... scshutdown(1m) boot. 1. OPS(Oracle Parallel Server) OPS ( ). Oracle Parallel Server. 2.. 3. OBP.. # scshutdown -g0 -y ok. :. 4.... ok boot 33
. 5.. scstat. # scstat -n : /var Sun Cluster. (42 ) /var. 2.1.0.1 : ok. g 0 0, -y yes.. # scshutdown -g0 -y May 2 10:08:46 phys-schost-1 cl_runtime: WARNING: CMM monitoring disabled. phys-schost-1# INIT: New run level: 0 The system is coming down. Please wait.... The system is down. syncing file systems... done Program terminated ok boot Rebooting with command: boot... Hostname: phys-schost-1 Booting as part of a cluster... NOTICE: Node 1: attempting to join cluster... NOTICE: Node 2 (incarnation # 937690106) has become reachable. NOTICE: Node 3 (incarnation # 937690290) has become reachable. NOTICE: cluster has reached quorum.... NOTICE: Cluster members: 1 2 3... NOTICE: Node 1: joined cluster... The system is coming up. Please wait. checking ufs filesystems... reservation program successfully exiting Print services started. ( ) 34 Sun Cluster 3.0 U1 2001 8, Revision A
( ) volume management starting. The system is ready. phys-schost-1 console login: NOTICE: Node 1: joined cluster... The system is coming up. Please wait. checking ufs filesystems... reservation program successfully exiting Print services started. volume management starting. The system is ready. phys-schost-1 console login: 2.2 : Solaris shutdown scswitch. scshutdown. 2 2 : - scswitch(1m) shutdown(1m). (36 ) (37 ) 35
2 2 : - scswitch shutdown. (39 ) - scswitch shutdown boot -x (40 ) : send brk. send brk ok go.. 1. OPS(Oracle Parallel Server) OPS. Oracle Parallel Server. 2.. 3.,.. # scswitch -S -h nodelist -S. -h nodelist. 4. OBP.. 36 Sun Cluster 3.0 U1 2001 8, Revision A
# shutdown -g0 -y -i0 5. ok. 6.. 2.2.0.1 : phys-schost-1. g0 0, y yes, i0 0.. # scswitch -S -h phys-schost-1 # shutdown -g0 -y -i0 May 2 10:08:46 phys-schost-1 cl_runtime: WARNING: CMM monitoring disabled.phys-schost-1# INIT: New run level: 0 The system is coming down. Please wait. Notice: rgmd is being stopped. Notice: rpc.pmfd is being stopped. Notice: rpc.fed is being stopped. umount: /global/.devices/node@1 busy umount: /global/phys-schost-1 busy The system is down. syncing file systems... done Program terminated ok 2.2.0.2 (37 ). :. 3.,.. (2). 1.. 37
ok boot. :. 2.. scstat(1m). # scstat -n : /var Sun Cluster. (42 ) /var. 2.2.0.1 : phys-schost-1. ok boot Rebooting with command: boot... Hostname: phys-schost-1 Booting as part of a cluster... NOTICE: Node 1: attempting to join cluster... NOTICE: Node 1: joined cluster... The system is coming up. Please wait. checking ufs filesystems... reservation program successfully exiting Print services started. volume management starting. The system is ready. phys-schost-1 console login: 38 Sun Cluster 3.0 U1 2001 8, Revision A
1. OPS(Oracle Parallel Server) OPS. Oracle Parallel Server. 2.. 3. scswitch shutdown.. shutdown -i 6 ok. # scswitch -S -h nodelist # shutdown -g0 -y -i6 :. 4.. # scstat -n 2.2.0.1 : phys-schost-1.. # scswitch -S -h phys-schost-1 # shutdown -g0 -y -i6 May 2 10:08:46 phys-schost-1 cl_runtime: WARNING: CMM monitoring disabled. phys-schost-1# INIT: New run level: 6 The system is coming down. Please wait. System services are now being stopped. Notice: rgmd is being stopped. Notice: rpc.pmfd is being stopped. Notice: rpc.fed is being stopped. umount: /global/.devices/node@1 busy umount: /global/phys-schost-1 busy ( ) 39
( ) The system is down. syncing file systems... done rebooting... Resetting...,,, Sun Ultra 1 SBus (UltraSPARC 143MHz), No Keyboard OpenBoot 3.11, 128 MB memory installed, Serial #5932401. Ethernet address 8:8:20:99:ab:77, Host ID: 8899ab77.... Rebooting with command: boot... Hostname: phys-schost-1 Booting as part of a cluster... NOTICE: Node 1: attempting to join cluster... NOTICE: Node 1: joined cluster... The system is coming up. Please wait. The system is ready. phys-schost-1 console login:.. 1.. 2. scswitch shutdown. # scswitch -S -h nodelist # shutdown -g0 -y -i0 3. ok. 4. boot(1m) -x. ok boot -x 40 Sun Cluster 3.0 U1 2001 8, Revision A
. 2.2.0.1 : phys-schost-1. g0 0, y yes, i0 0.. # scswitch -S -h phys-schost-1 # shutdown -g0 -y -i0 May 2 10:08:46 phys-schost-1 cl_runtime: WARNING: CMM monitoring disabled. phys-schost-1#... rg_name = schost-sa-1... offline node = phys-schost-2... num of node = 0... phys-schost-1# INIT: New run level: 0 The system is coming down. Please wait. System services are now being stopped. Print services stopped. syslogd: going down on signal 15... The system is down. syncing file systems... done WARNING: node 1 is being shut down. Program terminated ok boot -x... Not booting as part of cluster... The system is ready. phys-schost-1 console login: 2.3 /var Solaris Sun Cluster /var/adm/messages /var. /var Sun Cluster.. 41
/var /var Sun Cluster. 1. /var. 2..,. 42 Sun Cluster 3.0 U1 2001 8, Revision A
3.. 4 (48 ) 4 (49 ) (Solstice DiskSuite) 4 (50 ) (Solstice DiskSuite) 4 3.3.1 (Solstice DiskSuite) (50 ) 4 (51 ) (VERITAS Volume Manager) 4 (52 ) (VERITAS Volume Manager) 4 (53 ) (VERITAS Volume Manager) 4 (54 ) (VERITAS Volume Manager) 4 (55 ) (VERITAS Volume Manager) 4 (56 ) (VERITAS Volume Manager) 4 (58 ) (VERITAS Volume Manager) 4 (59 ) (VERITAS Volume Manager) 4 (60 ) (VERITAS Volume Manager) 43
4 (61 ) (VERITAS Volume Manager) 4 3.3.2 (VERITAS Volume Manager) (62 ) 4 (63 ) 4 (64 ) 4 (66 ) 1 4 3.3.3 (67 ) 4 (69 ) 4 (72 ) 4 (74 ) 3 1.,, Sun Cluster 3.0 U1. 3.1 Sun Cluster. Solstice DiskSuite " ", Solstice DiskSuite metaset(1m). VERITAS Volume Manager(VxVM) VxVM. scsetup(1m) Sun Cluster. VxVM scsetup VxVM. 1. Solaris. scgdevs(1m).. 3.1.1Solstice DiskSuite Solstice DiskSuite. 44 Sun Cluster 3.0 U1 2001 8, Revision A
., /dev/global/dsk/d3s0 644. # chmod 644 /dev/global/dsk/d3s0 VxVM chmod. VxVM VxVM. 3.1.2VERITAS Volume Manager Sun Cluster VxVM VxVM Sun Cluster.., ID. : Sun Cluster VxVM VxVM. Sun Cluster. VxVM. VxVM 1000... Sun Cluster. Sun Cluster. DRL(Dirty Region Logging). DRL I/O. 3.2 mount, newfs Solaris. mount -g.. 45
: Sun Cluster. Solaris. 3.3 scsetup(1m) scconf(1m). scsetup scconf.. 3 1 : ( ) - scgdevs (48 ) Solstice DiskSuite - metaset (49 ) (Solstice DiskSuite) Solstice DiskSuite - metaset metaclear (50 ) (Solstice DiskSuite) Solstice DiskSuite - metaset 3.3.1 (Solstice DiskSuite) (50 ) 46 Sun Cluster 3.0 U1 2001 8, Revision A
3 1 : VERITAS Volume Manager - VxVM scsetup (51 ) (VERITAS Volume Manager) (52 ) (VERITAS Volume Manager) (53 ) (VERITAS Volume Manager) (54 ) (VERITAS Volume Manager) (55 ) (VERITAS Volume Manager) (56 ) (VERITAS Volume Manager) (58 ) (VERITAS Volume Manager) VERITAS Volume Manager - scsetup (scconf ) (59 ) (VERITAS Volume Manager) (60 ) (VERITAS Volume Manager) VERITAS Volume Manager - scsetup (scconf ) VERITAS Volume Manager - scsetup (scconf ) (61 ) (VERITAS Volume Manager) 3.3.2 (VERITAS Volume Manager) (62 ) 47
3 1 : - scsetup (scconf ) - scconf (63 ) (64 ) 1 - scswitch (66 ) 1 - metaset vxdg 3.3.3 (67 ) scgdevs(1m). : /global/.devices/node@nodeid scgdevs. 1.. 2. scgdevs. # scgdevs 3.3.0.1 : scgdevs. # scgdevs Configuring the /dev/global directory (global devices)... obtaining access to all attached disks ( ) 48 Sun Cluster 3.0 U1 2001 8, Revision A
( ) reservation program successfully exiting (Solstice DiskSuite) Solstice DiskSuite Sun Cluster metaset(1m).. 1.. 2. metaset Solstice DiskSuite Sun Cluster. # metaset -s diskset a h nodelist -s diskset. -a -h nodelist. 3.. metaset. # scconf -p grep disk-device-group 3.3.0.1 : Solstice DiskSuite. # metaset -s dg-schost-1 # scconf -p grep dg-schost-1 Device group name: dg-schost-1 49
(Solstice DiskSuite) Sun Cluster Solstice DiskSuite. metaclear(1m) metaset(1m).. Solstice DiskSuite. 3.3.1 (Solstice DiskSuite) Solstice DiskSuite 1. metaset. 1.. # scstat -D 2.. 3.. # metaset -s setname -d -f -h nodelist -s setname -d -h -f -h nodelist. :. 4. 1 (50 ) 3. 50 Sun Cluster 3.0 U1 2001 8, Revision A
5.. metaset. # scstat -D 3.3.1.1 : (SDS) phys-schost-2. 1 phys-schost-2. scstat -D. [Determine the disk device group(s) for the node:] # scstat -D -- Device Group Servers -- Device Group Primary Secondary ------------ ------- --------- Device group servers: dg-schost-1 phys-schost-1 phys-schost-2 [Become superuser.] [Remove the hostname from all disk device groups:] # metaset -s dg-schost-1 -d -f -h phys-schost-2 [Verify removal of the node:] # scstat -D -- Device Group Servers -- Device Group Primary Secondary ------------ ------- --------- Device group servers: dg-schost-1 phys-schost-1 - (VERITAS Volume Manager) :. (52 ) (VERITAS Volume Manager). VxVM. 1.. 2. VxVM.. 51
: DRL(Dirty Region Logging). DRL I/ O. VERITAS Volume Manager. Oracle Parallel Server VERITAS Volume Manager Administrator s Reference Guide VxVM VxVM. VERITAS VxVM. 3. VxVM Sun Cluster. (56 ) (VERITAS Volume Manager). (VERITAS Volume Manager) :. (51 ) (VERITAS Volume Manager). VxVM Sun Cluster Sun Cluster. VxVM. VxVM Sun Cluster. 1.. 2. /etc/vfstab mount at boot no. Sun Cluster yes. 3.. vxdiskadm. VxVM. 2. vxdiskadm(1m). 52 Sun Cluster 3.0 U1 2001 8, Revision A
4.. scswitch(1m) 1. shutdown(1m). # scswitch -S -h nodelist # shutdown -g0 -y -i6 5.,. 1. # scswitch -z -h nodelist -D disk-device-group # scswitch -z -h nodelist -g resource-group 6. VxVM Sun Cluster. (56 ) (VERITAS Volume Manager). (VERITAS Volume Manager) : (58 ) (VERITAS Volume Manager). VxVM 1 1.. 2. 1. # scstat -D 53
3.. # scswitch -z -D disk-device-group -h nodelist -z -D disk-device-group. -h nodelist. 1. 4. 1 ( ) VxVM. VxVM VERITAS Volume Manager. 5. VxVM.. (58 ) (VERITAS Volume Manager). (VERITAS Volume Manager) Sun Cluster VxVM Sun Cluster. 1.. 2. VxVM. # vxdg import diskgroup 3. VxVM Sun Cluster. (56 ) (VERITAS Volume Manager). 54 Sun Cluster 3.0 U1 2001 8, Revision A
(VERITAS Volume Manager). Sun Cluster. 1.. 2.. # ls -l /global/.devices/node@nodeid/dev/vx/dsk/* 3. 1000. 4.. # vxdg reminor diskgroup base-minor-number 5. VxVM Sun Cluster. (56 ) (VERITAS Volume Manager). 3.3.1.1 : 16000-16002 4000-4001. vxdg reminor 5000. # ls -l /global/.devices/node@nodeid/dev/vx/dsk/* /global/.devices/node@nodeid/dev/vx/dsk/dg1 brw------- 1 root root 56,16000 Oct 7 11:32 dg1v1 brw------- 1 root root 56,16001 Oct 7 11:32 dg1v2 brw------- 1 root root 56,16002 Oct 7 11:32 dg1v3 /global/.devices/node@nodeid/dev/vx/dsk/dg2 brw------- 1 root root 56,4000 Oct 7 11:32 dg2v1 brw------- 1 root root 56,4001 Oct 7 11:32 dg2v2 # vxdg reminor dg3 5000 55
(VERITAS Volume Manager) scsetup(1m) VxVM Sun Cluster : VxVM VxVM. VxVM (58 ) (VERITAS Volume Manager).. VxVM. 4 4 VxVM 4 scconf(1m). 1.. 2. scsetup(1m). # scsetup Main Menu. 3. VxVM 4( ). Device Groups Menu. 4. VxVM 1(VxVM ). Sun Cluster VxVM. 5.. scconf: Failed to add device group - in use 56 Sun Cluster 3.0 U1 2001 8, Revision A
(55 ) (VERITAS Volume Manager).. 6... # scstat -D : VxVM scsetup.,.. (48 ). 3.3.1.1 : VERITAS Volume Manager VxVM (dg1) scsetup scconf. VxVM. # scsetup scconf -a -D type=vxvm,name=dg1,nodelist=phys-schost-1:phys-schost-2 # scstat -D -- Device Group Servers -- Device Group Primary Secondary ------------ ------- --------- Device group servers: dg1 phys-schost-1 phys-schost-2 -- Device Group Status -- Device Group Status ------------ ------ Device group status: dg1 Online 3.3.1.2 VxVM (69 ). 57
(55 ) (VERITAS Volume Manager). (VERITAS Volume Manager) VxVM, Sun Cluster.. 1.. 2. scsetup(1m). # scsetup Main Menu. 3. VxVM 4( ). Device Groups Menu. 4. 2(VxVM ). VxVM 3.3.1.1 : VERITAS Volume Manager VxVM (dg1) scsetup scconf. VxVM. # scsetup scconf -c -D name=dg1,sync 58 Sun Cluster 3.0 U1 2001 8, Revision A
(VERITAS Volume Manager) : (58 )" (VERITAS Volume Manager)". 1.. 2. 1. # scstat -D 3.. # scswitch -z -D disk-device-group -h nodelist -z. -D disk-device-group. -h nodelist. 1. 4. 1 ( ) VxVM. # vxedit -g diskgroup -rf rm volume -g diskgroup VxVM. -rf rm volume. 5. scsetup. (58 ) (VERITAS Volume Manager). 59
(VERITAS Volume Manager) Sun Cluster VxVM. VxVM. scsetup(1m) VxVM Sun Cluster. 1.. 2.. # scswitch -F -D disk-device-group -F. -D disk-device-group. 3. scsetup. Main Menu. # scsetup 4. VxVM 4( ). Device Groups Menu. 5. VxVM 3(VxVM ). VxVM. 3.3.1.1 : VERITAS Volume Manager scsetup scconf(1m) VxVM dg1. # scswitch -F -D dg1 # scsetup scconf -r -D name=dg1 60 Sun Cluster 3.0 U1 2001 8, Revision A
(VERITAS Volume Manager) scsetup(1m). VxVM. 4 4 VxVM 4 ID 1.. 2. scsetup(1m). Main Menu. # scsetup 3. VxVM 4( ). Device Groups Menu. 4. VxVM 4(VxVM ).. 5... # scconf -p 3.3.1.1 : VERITAS Volume Manager VxVM (dg1) (phys-schost-3) scsetup scconf. # scsetup ( ) 61
( ) scconf a D type=vxvm,name=dg1,nodelist=phys-schost-3 # scconf -p Device group name: Device group type: Device group failback enabled: Device group node list: dg1 VXVM yes phys-schost-1, phys-schost-3 3.3.2 (VERITAS Volume Manager) VxVM(VERITAS Volume Manager) ( ). 1.. # scstat -D 2.. 3. scsetup(1m). # scsetup Main Menu. 4. 4( ). 5. VxVM 5(VxVM )... VxVM 6. VxVM. # scconf -p grep Device 62 Sun Cluster 3.0 U1 2001 8, Revision A
3.3.2.1 : (VxVM) dg1 VxVM phys-schost-4. [Determine the disk device group for the node:] # scstat -D -- Device Group Servers -- Device Group Primary Secondary ------------ ------- --------- Device group servers: dg-schost-1 phys-schost-1 phys-schost-2 [Become superuser and execute the scsetup utility:] # scsetup Select Device groups and volumes>remove a node from a VxVM device group. Answer the questions when prompted. You will need the following information. You Will Need: Example: VxVM device group name dg1 node names phys-schost-1 [Verify that the scconf command executed properly:] scconf -r -D name=dg1,nodelist=phys-schost-4 Command completed successfully. Quit the scsetup Device Groups Menu and Main Menu. [Verify that the node was removed:] # scconf -p grep Device Device group name: dg1 Device group type: VxVM Device group failback enabled: no Device group node list: phys-schost-3 Device group diskset name: dg1 1 preferenced. 1.. preferenced failback. preferenced failback. preferenced 1. scsetup(1m) Solstice DiskSuite VxVM preferenced failback. 63
. 1.. 2. scsetup(1m). Main Menu. # scsetup 3. 4( ). Device Groups Menu. 4. 6(VxVM Solstice DiskSuite ). preferenced failback. 5... # scconf -p 3.3.2.1 : (dg-schost-1) scsetup scconf. # scconf c D name=dg-schost-1,nodelist=phys-schost-1 :phys-schost-2,\ preferenced=true,failback=enabled # scconf -p grep Device Device group name: dg-schost-1 Device group type: SDS Device group failback enabled: yes Device group node list: phys-schost-1, phys-schost-2 Device group ordered node list: yes Device group diskset name: dg-schost-1.. 1. SunPlex Manager GUI. 64 Sun Cluster 3.0 U1 2001 8, Revision A
SunPlex Manager. 1. scstat(1m). % scstat -D scconf(1m). % scconf -p 3.3.2.1 : scstat scstat -D. -- Device Group Servers -- Device Group Primary Secondary ------------ ------- --------- Device group servers: schost-2 - - Device group servers: schost-1 phys-schost-2 phys-schost-3 Device group servers: schost-3 - - -- Device Group Status -- Device Group Status ------------ ------ Device group status: schost-2 Offline Device group status: schost-1 Online Device group status: schost-3 Offline 3.3.2.2 : scconf scconf. # scconf -p... Device group name: dg-schost-1 Device group type: Device group failback enabled: Device group node list: Device group diskset name: SDS yes phys-schost-2, phys-schost-3 dg-schost-1 65
1 ( ). SunPlex Manager GUI 1. SunPlex Manager. 1.. 2. scswitch(1m) 1. # scswitch z D disk-device-group h nodelist -z. -D disk-device-group. -h nodelist. 1. 3. 1.. # scstat D 3.3.2.1 : 1 1. # scswitch -z -D dg-schost-1 -h phys-schost-1 # scstat -D -- Device Group Servers -- Device Group Primary Secondary ------------ ------- --------- Device group servers: dg1 phys-schost-1 phys-schost-2 -- Device Group Status -- Device Group Status ------------ ------ Device group status: dg1 Online 66 Sun Cluster 3.0 U1 2001 8, Revision A
3.3.3. I/O.. 1.. # scswitch -m -D disk-device-group 2.. 4 Solstice DiskSuite : # metaset -C take -f -s diskset : SDS metaset -C take. metaset -t. VxVM t.. 4 VERITAS Volume Manager : # vxdg -t import disk-group-name 3.. 4.. :.. 4 Solstice DiskSuite : 67
# metaset -C release -s diskset 4 VERITAS Volume Manager : # vxdg deport disk-group-name 5.. # scswitch -z -D disk-device-group -h nodelist 3.3.3.1 : dg-schost-1. [Place the disk device group in maintenance state.] # scswitch -m -D dg-schost-1 [If needed, manually import the diskset or disk group.] For Solstice DiskSuite: # metaset -C take -f -s dg-schost-1 For VERITAS Volume Manager: # vxdg -t import dg1 [Complete all necessary repair procedures.] [Release ownership.] For Solstice DiskSuite: # metaset -C release -s dg-schost-1 For VERITAS Volume Manager: # vxdg deport dg1 [Bring the disk device group online.] # scswitch -z -D dg-schost-1 -h phys-schost-1 3.4 68 Sun Cluster 3.0 U1 2001 8, Revision A
3 2 : Sun Cluster - newfs makedir (69 ) - fuser umount (72 ) - sccheck (74 ) Sun Cluster. :.... 4 4 (Solstice DiskSuite VxVM ). 1.. : 1. 2. newfs(1m). # newfs raw-disk-device 69
raw-disk-device.. 3 3 Solstice DiskSuite /dev/md/oracle/rdsk/d1 oracle d1 VERITAS Volume Manager /dev/vx/rdsk/oradg/vol01 oradg vol01 /dev/global/rdsk/d1s3 d1s3 3... # mkdir -p /global/device-group/mount-point device-group mount-point : /global/device-group.. 4. /etc/vfstab. a.. :. 70 Sun Cluster 3.0 U1 2001 8, Revision A
4 Solaris UFS logging global,logging. UFS mount_ufs(1m). : UFS syncdir. syncdir POSIX. UFS. syncdir. syncdir. syncdir. syncdir( POSIX ). 4 Solstice DiskSuite trans metadevice logging global. Solstice DiskSuite b. mount at boot yes. c. /etc/vfstab. d. /etc/vfstab. e.., phys-schost-1 d0 /global/oracle phys-schost-2 d1 /global/oracle/logs. phys-schost-1 / global/oracle phys-schost-2 /global/ oracle/logs. vfstab(4). 5. /etc/vfstab. # sccheck. 6.. 71
# mount /global/device-group/mount-point 7.. df(1m) mount(1m). 3.4.0.1 : Solstice DiskSuite /dev/md/oracle/rdsk/d1 UFS. # newfs /dev/md/oracle/rdsk/d1... [on each node:] # mkdir -p /global/oracle/d1 # vi /etc/vfstab #device device mount FS fsck mount mount #to mount to fsck point type pass at boot options # /dev/md/oracle/dsk/d1 /dev/md/oracle/rdsk/d1 /global/oracle/d1 ufs 2 yes global,logging [save and exit] [on one node:] # sccheck # mount /global/oracle/d1 # mount... /global/oracle/d1 on /dev/md/oracle/dsk/d1 read/write/setuid/global/logging/ largefiles on Sun May 3 08:56:16 2001. ( ). : scshutdown(1m). shutdown... 4 72 Sun Cluster 3.0 U1 2001 8, Revision A
4.... 1.. 2.. # mount -v 3... # fuser -c [ -u ] mount-point -c. -u ID ( ). mount-point. 4.... # fuser -c -k mount-point SIGKILL. 5.. # fuser -c mount-point 6.. # umount mount-point mount-point.. 73
7. /etc/vfstab ( ). /etc/vfstab. 8. group/metadevice/plex ( ).. 3.4.0.1 : Solstice DiskSuite /dev/md/oracle/rdsk/d1 UFS. # mount -v... /global/oracle/d1 on /dev/md/oracle/dsk/d1 read/write/setuid/global/logging/ largefiles on Sun Oct 3 08:56:16 1999 # fuser -c /global/oracle/d1 /global/oracle/d1: 4006c # fuser -c -k /global/oracle/d1 /global/oracle/d1: 4006c # fuser -c /global/oracle/d1 /global/oracle/d1: # umount /global/oracle/d1 (on each node, remove the highlighted entry:) # vi /etc/vfstab #device device mount FS fsck mount mount #to mount to fsck point type pass at boot options # /dev/md/oracle/dsk/d1 /dev/md/oracle/rdsk/d1 /global/oracle/d1 ufs 2 yes global,logging [Save and exit.] :.. sccheck(1m) /etc/vfstab.. : ( : ) sccheck. 1.. 74 Sun Cluster 3.0 U1 2001 8, Revision A
2.. # sccheck 75
76 Sun Cluster 3.0 U1 2001 8, Revision A
4 Sun Cluster.. 4 (79 ) 4 4.1.1 (80 ) 4 4.1.2 (82 ) 4 (83 ) 4 (84 ) 4 (85 ) 4 (86 ). Sun Cluster 3.0 U1. 4.1 scconf(1m). scsetup(1m) SunPlex Manager GUI. scsetup. SunPlex Manager GUI. scconf. scconf reset. 77
: scsetup(1m) scconf(1m). scsetup, scconf.. scstat -q scconf -p. scconf scstat -q. 4 1 : - scsetup (79 ) - scsetup (scconf ) - scsetup (scconf ) -. - scsetup (scconf ) - scsetup (scconf ) - scconf 4.1.1 (80 ) 4.1.2 (82 ) (83 ) (84 ) (85 ) (86 ) 78 Sun Cluster 3.0 U1 2001 8, Revision A
SunPlex Manager GUI. SunPlex Manager. DID( ID). scdidadm -L DID. scdidadm(1m). scsetup(1m) scconf(1m). 1.. 2. scsetup. # scsetup Main Menu. 3. 1( ). Quorum Menu. 4. 1( ).. 5.. # scstat q 6. (79 ) 3 (79 ) 5. 4.1.0.1 : scsetup scconf. Become superuser on any cluster node. [Execute the scsetup utility:] # scsetup Select Quorum>Add a quorum disk. Answer the questions when prompted. [Verify that the scconf command completed successfully:] ( ) 79
( ) scconf -a -q globaldev=d20 Command completed successfully. Quit the scsetup Quorum Menu and Main Menu. [Verify the quorum device is removed:] # scstat -q -- Quorum Summary -- Quorum votes possible: 4 Quorum votes needed: 3 Quorum votes present: 4 -- Quorum Votes by Node -- Node Name Present Possible Status --------- ------- -------- ------ Node votes: phys-schost-1 1 1 Online Node votes: phys-schost-2 1 1 Online -- Quorum Votes by Device -- Device Name Present Possible Status ----------- ------- -------- ------ Device votes: /dev/did/rdsk/d3s2 1 1 Online Device votes: /dev/did/rdsk/d4s2 1 1 Online 4.1.1 SunPlex Manager GUI. SunPlex Manager... scconf(1m). : 4.1.2 (82 ). 1.. 2.. # scconf -pv grep Quorum 80 Sun Cluster 3.0 U1 2001 8, Revision A
3. scsetup(1m). # scsetup Main Menu. 4. 1( ). 5. 2( ).. 6. scsetup. 7.. # scstat -q 4.1.1.1 :. Become superuser on any node and place the node to be removed in maintenance state. [Determine the quorum device to be removed:] # scconf -pv grep Quorum [Execute the scsetup utility:] # scsetup Select Quorum>Remove a quorum disk. Answer the questions when prompted. [Verify that the scconf command completed successfully:] scconf -r -q globaldev=d4 Command completed successfully. Quit the scsetup Quorum Menu and Main Menu. [Verify the quorum device is removed:] # scstat -q -- Quorum Summary -- Quorum votes possible: 3 Quorum votes needed: 2 Quorum votes present: 3 -- Quorum Votes by Node -- ( ) Node Name Present Possible Status --------- ------- -------- ------ 81
( ) Node votes: phys-schost-1 1 1 Online Node votes: phys-schost-2 1 1 Online -- Quorum Votes by Device -- Device Name Present Possible Status ----------- ------- -------- ------ Device votes: /dev/did/rdsk/d3s2 1 1 Online 4.1.2 4.1.1 (80 ). :. scconf(1m).. 1.. (119 ). 2.. # scconf -c -q installmode 3. scconf. # scconf -r -q globaldev=device 4.. # scstat -q 82 Sun Cluster 3.0 U1 2001 8, Revision A
4.1.2.1 :. [Become superuser on any node.] [Place the cluster in install mode:] # scconf -c -q installmode [Remove the quorum device:] # scconf -r -q globaldev=d3 [Verify the quorum device has been removed:] # scstat -q -- Quorum Summary -- Quorum votes possible: 2 Quorum votes needed: 2 Quorum votes present: 2 -- Quorum Votes by Node -- Node Name Present Possible Status --------- ------- -------- ------ Node votes: phys-schost-1 1 1 Online Node votes: phys-schost-2 1 1 Online -- Quorum Votes by Device -- Device Name Present Possible Status ----------- ------- -------- ------ 1... (79 ). 2.. 4.1.1 (80 ). 3.. Sun Cluster 3.0 U1 Hardware Guide. 83
SunPlex Manager GUI. SunPlex Manager.. 0. scconf(1m). scsetup. :. scconf. (119 ). 1.. 2.. # scconf -c -q globaldev=device,maintstate -c scconf. -q. globaldev=device DID., d4. maintstate. 3.. Quorum Device Votes 0. # scconf p grep -i quorum 4.1.2.1 :. 84 Sun Cluster 3.0 U1 2001 8, Revision A
# scconf -c -q globaldev=d20,maintstate # scconf -p grep -i quorum Node quorum vote count: 1 Node quorum vote count: 1 Quorum devices: d20 Quorum device name: d20 Quorum device votes: 0 Quorum device enabled: no Quorum device name: /dev/did/rdsk/d20s2 Quorum device hosts (enabled): phys-schost-2 phys-schost-3 Quorum device hosts (disabled): 4.1.2.2 (85 ). (119 )... N-1, N 0.. : globaldev node. (121 ). 1.. 2.. # scconf -c -q globaldev=device,reset -c scconf. -q. globaldev=device DID., d4. 85
reset. 3.. 4.. # scconf p grep -i quorum 4.1.2.1 : ( ). # scconf -c -q globaldev=d20,reset # scconf -p grep -i quorum Node quorum vote count: 1 Node quorum vote count: 1 Quorum devices: d20 Quorum device name: d20 Quorum device votes: 1 Quorum device enabled: yes Quorum device name: /dev/did/rdsk/d20s2 Quorum device hosts (enabled): phys-schost-2 phys-schost-3 Quorum device hosts (disabled): SunPlex Manager GUI. SunPlex Manager.. scconf(1m). # scconf p grep -i quorum 86 Sun Cluster 3.0 U1 2001 8, Revision A
4.1.2.1 : # scconf -p grep Quorum vote Node quorum vote count: 1 Node quorum vote count: 1 Quorum devices: d20 Quorum device name: d20 Quorum device votes: 1 Quorum device enabled: yes Quorum device name: /dev/did/rdsk/d20s2 Quorum device hosts (enabled): phys-schost-2 phys-schost-3 Quorum device hosts (disabled): 87
88 Sun Cluster 3.0 U1 2001 8, Revision A
5 Sun Cluster.. NAFO... 4 (91 ) 4 (92 ), 4 (94 ), 4 (96 ) 4 (97 ) 4 (100 ) NAFO 4 (102 ) NAFO 4 (103 ) NAFO 4 (105 ) NAFO 4 (106 ) NAFO 4 (107 ) NAFO 4 (108 ) 89
5 1 5 2. Sun Cluster 3.0 U1. 5.1. Sun Cluster. scsetup. scsetup(1m). Sun Cluster 3.0 U1. Sun Cluster 3.0 U1 Hardware Guide. 5 1 : - scsetup - scstat (20 ) scsetup (91 ), - scsetup, - scsetup (92 ), (94 ), 90 Sun Cluster 3.0 U1 2001 8, Revision A
5 1 : - scsetup - scsetup (96 ) (97 ) SunPlex Manager GUI. SunPlex Manager.. 1.. # scstat -W 2.. Path online.. Path waiting.. Path faulted.. scstat -W. 5.1.0.1 :. # scstat -W -- Cluster Transport Paths -- ( ) 91
( ) Endpoint Endpoint Status -------- -------- ------ Transport path: phys-schost-1:qfe1 phys-schost-2:qfe1 Path online Transport path: phys-schost-1:qfe0 phys-schost-2:qfe0 Path online Transport path: phys-schost-1:qfe1 phys-schost-3:qfe1 Path online Transport path: phys-schost-1:qfe0 phys-schost-3:qfe0 Path online Transport path: phys-schost-2:qfe1 phys-schost-3:qfe1 Path online Transport path: phys-schost-2:qfe0 phys-schost-3:qfe0 Path online, SunPlex Manager GUI. SunPlex Manager. 1.. cluster transport cable Sun Cluster 3.0 U1 Hardware Guide. 2.. 3. scsetup(1m). # scsetup Main Menu. 4. 3( ). 5. 1( ).. 6. 2( ).. 7. 3( ).. 8.,. 92 Sun Cluster 3.0 U1 2001 8, Revision A
# scconf -p grep cable # scconf -p grep adapter # scconf -p grep junction 5.1.0.1 :, scsetup,. [Ensure the physical cable is installed.] Become superuser on any node and place the node to be removed in maintenance state. # scsetup Select Cluster interconnect. Select either Add a transport cable, Add a transport adapter to a node, or Add a transport junction. Answer the questions when prompted. You Will Need: Example: node names phys-schost-1 adapter names qfe2 junction names hub2 transport type dlpi [Verify that the scconf command completed successfully:] Command completed successfully. Quit the scsetup Cluster Interconnect Menu and Main Menu. [Verify that the cable, adapter, and junction are added:] # scconf -p grep cable Transport cable: phys-schost-2:qfe0@1 ethernet-1@2 Enabled Transport cable: phys-schost-3:qfe0@1 ethernet-1@3 Enabled Transport cable: phys-schost-1:qfe0@0 ethernet-1@1 Enabled # scconf -p grep adapter Node transport adapters: qfe2 hme1 qfe0 Node transport adapter: qfe0 Node transport adapters: qfe0 qfe2 hme1 Node transport adapter: qfe0 Node transport adapters: qfe0 qfe2 hme1 Node transport adapter: qfe0 # scconf -p grep junction Cluster transport junctions: hub0 hub1 hub2 Cluster transport junction: hub0 Cluster transport junction: hub1 Cluster transport junction: hub2 93
, SunPlex Manager GUI. SunPlex Manager.,... :.... 1.. 2.. # scstat -W : path faulted... 3. scsetup. # scsetup Main Menu. 4. 3( ). 5. 4( ).. 94 Sun Cluster 3.0 U1 2001 8, Revision A
:. 6. 5( ).. : Sun Cluster 3.0 U1 Hardware Guide. 7. 6( ).. :. 8.. # scconf -p grep cable # scconf -p grep adapter # scconf -p grep junction. 5.1.0.1 :, scsetup,. [Become superuser on any node in the cluster.] [Enter the scsetup utility:] # scsetup Select Cluster interconnect. Select either Add a transport cable, Add a transport adapter to a node, or Add a transport junction. ( ) 95
( ) Answer the questions when prompted. You Will Need: Example: node names phys-schost-1 adapter names qfe1 junction names hub1 [Verify that the scconf command completed successfully:] Command completed successfully. Quit the scsetup Cluster Interconnect Menu and Main Menu. [Verify that the cable, adapter, or junction is removed:] # scconf -p grep cable Transport cable: phys-schost-2:qfe0@1 ethernet-1@2 Enabled Transport cable: phys-schost-3:qfe0@1 ethernet-1@3 Enabled Transport cable: phys-schost-1:qfe0@0 ethernet-1@1 Enabled # scconf -p grep adapter Node transport adapters: qfe2 hme1 qfe0 Node transport adapter: qfe0 Node transport adapters: qfe0 qfe2 hme1 Node transport adapter: qfe0 Node transport adapters: qfe0 qfe2 hme1 Node transport adapter: qfe0 # scconf -p grep junction Cluster transport junctions: hub0 hub2 Cluster transport junction: hub0 Cluster transport junction: hub2 SunPlex Manager GUI. SunPlex Manager.. 1.. 2. scsetup. # scsetup Main Menu. 3. 2( ). 4. 7( )... 96 Sun Cluster 3.0 U1 2001 8, Revision A
5.. # scconf -p grep cable 5.1.0.1 : phys-schost-2 qfe-1. [Become superuser on any node.] [Enter the scsetup utility:] # scsetup Select Cluster interconnect>enable a transport cable. Answer the questions when prompted. You will need the following information. You Will Need: Example: node names phys-schost-2 adapter names qfe1 junction names hub1 [Verify that the scconf command completed successfully:] scconf -c -m endpoint=phys-schost-2:qfe1,state=enabled Command completed successfully. Quit the scsetup Cluster Interconnect Menu and Main Menu. [Verify that the cable is enabled:] # scconf -p grep cable Transport cable: phys-schost-2:qfe1@0 ethernet-1@2 Enabled Transport cable: phys-schost-3:qfe0@1 ethernet-1@3 Enabled Transport cable: phys-schost-1:qfe0@0 ethernet-1@1 Enabled SunPlex Manager GUI. SunPlex Manager..... 97
:.... 1.. 2.. # scstat -W : path faulted... 3. scsetup. # scsetup Main Menu. 4. 3( ). 5. 8( ).... 6.. # scconf -p grep cable 5.1.0.1 : phys-schost-2 qfe-1. 98 Sun Cluster 3.0 U1 2001 8, Revision A
[Become superuser on any node.] [Enter the scsetup utility:] # scsetup Select Cluster interconnect>disable a transport cable. Answer the questions when prompted. You will need the following information. You Will Need: Example: node names phys-schost-2 adapter names qfe1 junction names hub1 [Verify that the scconf command completed successfully:] scconf -c -m endpoint=phys-schost-2:qfe1,state=disabled Command completed successfully. Quit the scsetup Cluster Interconnect Menu and Main Menu. [Verify that the cable is disabled:] # scconf -p grep cable Transport cable: phys-schost-2:qfe1@0 ethernet-1@2 Disabled Transport cable: phys-schost-3:qfe0@1 ethernet-1@3 Enabled Transport cable: phys-schost-1:qfe0@0 ethernet-1@1 Enabled 5.2.. 4 NAFO ( ). (106 ) NAFO. 4 NAFO. 4. 4.. Sun Cluster 3.0 U1. Sun Cluster 3.0 U1 Hardware Guide. 99
5 2 : NAFO (100 ) NAFO (102 ) NAFO NAFO (103 ) NAFO NAFO (105 ) NAFO (106 ) NAFO NAFO (107 ) NAFO PNM (108 ) NAFO SunPlex Manager GUI. SunPlex Manager. 1. NAFO. 4 NAFO. 4 NAFO. 4 NAFO. 4 NAFO, /etc/ hostname.adapter. 4 NAFO. 2. NAFO. 100 Sun Cluster 3.0 U1 2001 8, Revision A
3.. NAFO. 4. /etc/hostname.adapter. NAFO. # vi /etc/hostname.<adapter> phys-schost-1 5. /etc/inet/hosts IP. /etc/inet/hosts IP 192.29.75.101 phys-schost-1. # vi /etc/inet/hosts 192.29.75.101 phys-schost-1 :. 6. NAFO. # pnmset -c nafo-group -o create adapter [adapter...] -c nafo-group NAFO. NAFO nafon. N.. NAFO. -o create NAFO. adapter [ adapter... ]. (101 ) 3. 101
: pnmset. NAFO /etc/hostname. adapter IP. 7. NAFO. # pnmstat -l 5.2.0.1 : NAFO (qfe0 qfe1) NAFO (nafo0). # pnmstat -l # vi /etc/hostname.qfe0 phys-schost-1 # vi /etc/inet/hosts 192.29.75.101 phys-schost-1 # pnmset -c nafo0 -o create qfe0 qfe1 # pnmstat -l group adapters status fo_time act_adp nafo0 qfe0:qfe1 OK NEVER qfe0 NAFO NAFO NAFO. SunPlex Manager GUI. SunPlex Manager. 1.? 4 Sun Cluster 3.0 U1 Hardware Guide. 4 (102 ) 2. 2. NAFO NAFO. 3. /etc/ hostname.adapter. 102 Sun Cluster 3.0 U1 2001 8, Revision A
4. NAFO. 5. NAFO. # pnmset -c nafo-group -o add adapter -c nafo-group NAFO. -o add adapter NAFO. 6. NAFO. # pnmstat -l 5.2.0.1 : NAFO (qfe0, qfe1) NAFO nafo0 qfe2. # pnmstat -l group adapters status fo_time act_adp nafo0 qfe0:qfe1 OK NEVER qfe0 # pnmset -c nafo0 -o add qfe2 # pnmstat -l group adapters status fo_time act_adp nafo0 qfe0:qfe1:qfe2 OK NEVER qfe0 NAFO NAFO. NAFO. SunPlex Manager GUI. SunPlex Manager. 1. NAFO. 2. NAFO. # scrgadm -pv 103
scrgadm -pvv( v ) NAFO. 3. NAFO. # scswitch -z -g resource-group -h nodelist -z -g resource-group. -h nodelist. 4. NAFO. # pnmset -c nafo-group -o delete -c nafo-group NAFO. -o delete NAFO. 5. NAFO. NAFO. # pnmstat -l 5.2.0.1 : NAFO NAFO nafo1. NAFO lh-rg-1. # scswitch -z -g lh-rg-1 -h phys-schost-2 # pnmstat -l group adapters status fo_time act_adp nafo0 qfe0:qfe1 OK NEVER qfe0 nafo1 qfe2 OK NEVER qfe2 # pnmset -c nafo1 -o delete # pnmstat -l group adapters status fo_time act_adp nafo0 qfe0:qfe1 OK NEVER qfe0 104 Sun Cluster 3.0 U1 2001 8, Revision A
NAFO NAFO NAFO. SunPlex Manager GUI. SunPlex Manager. : NAFO. 1.. (106 ) NAFO. 2. NAFO. # pnmset -c nafo-group -o remove adapter -c nafo-group NAFO. -o remove adapter NAFO. 3. NAFO. NAFO. # pnmstat -l 5.2.0.1 : NAFO NAFO nafo0 qfe2. # pnmstat -l group adapters status fo_time act_adp nafo0 qfe0:qfe1:qfe2 OK NEVER qfe0 # pnmset -c nafo0 -o remove qfe2 # pnmstat -l group adapters status fo_time act_adp nafo0 qfe0:qfe1 OK NEVER qfe0 105
NAFO NAFO. pnmd(1m) IP. SunPlex Manager GUI. SunPlex Manager. :... 1.. IP IP. 2. NAFO. 3.. # pnmset -c nafo-group -o switch adapter -c nafo-group NAFO. -o switch adapter NAFO. 4 (106 ) 5. 4 (106 ) 4. 4. /etc/hostname.adapter. # mv /etc/hostname.<old_adapter> /etc/hostname.<new_adapter> 5. NAFO. switched-to. # pnmstat -l 106 Sun Cluster 3.0 U1 2001 8, Revision A
5.2.0.1 : NAFO qfe0 qfe1. # pnmstat -l group adapters status fo_time act_adp nafo0 qfe0:qfe1 OK NEVER qfe0 # pnmset -c nafo0 -o switch qfe1 # mv /etc/hostname.qfe0 /etc/hostname.qfe1 # pnmstat -l group adapters status fo_time act_adp nafo0 qfe0:qfe1 OK 11 qfe1 NAFO SunPlex Manager GUI. SunPlex Manager. NAFO pnmstat(1m). # pnmstat -l pnmptor(1m) pnmrtop(1m). 5.2.0.1 : NAFO NAFO. # pnmstat -l Group adapters status fo_time act_adp nafo0 qfe5 OK NEVER qfe5 nafo1 qfe6 OK NEVER qfe6 nafo2 qfe7 OK NEVER qfe7 5.2.0.2 : NAFO NAFO nafo0 qfe5. 107