Copyright 2000, 2011, Oracle and/or its affiliates. All rights reserved.,.,,,,,,,,,,,,.,...,. U.S. GOVERNMENT RIGHTS Programs, software, databases, an

Transcription

1 Oracle Solaris Cluster : E , A

2 Copyright 2000, 2011, Oracle and/or its affiliates. All rights reserved.,.,,,,,,,,,,,,.,...,. U.S. GOVERNMENT RIGHTS Programs, software, databases, and related documentation and technical data delivered to U.S. Government customers are "commercial computer software" or "commercial technical data" pursuant to the applicable Federal Acquisition Regulation and agency-specific supplemental regulations. As such, the use, duplication, disclosure, modification, and adaptation shall be subject to the restrictions and license terms set forth in the applicable Government contract, and, to the extent applicable by the terms of the Government contract, the additional rights set forth in FAR , Commercial Computer Software License (December 2007). Oracle America, Inc., 500 Oracle Parkway, Redwood City, CA , -,,. Oracle Corporation. Oracle Java Oracle Corporation /.. Intel Intel Xeon Intel Corporation. SPARC SPARC International, Inc.. AMD, Opteron, AMD, AMD Opteron Advanced Micro Devices. UNIX X/Open Company, Ltd.. ( )3,. Oracle Corporation 3,. Oracle Corporation 3,, @25097

3 Oracle Solaris Cluster Oracle Solaris Cluster Oracle Solaris OS Oracle Solaris Cluster Oracle Solaris Cluster Oracle Solaris Cluster... 26, Oracle Solaris Cluster

4 2 Oracle Solaris Cluster RBAC Oracle Solaris Cluster RBAC Oracle Solaris Cluster RBAC Oracle Solaris Cluster Management RBAC RBAC RBAC RBAC /var /var , Solaris Volume Manager Oracle Solaris Cluster , A

5 Veritas Volume Manager(VERITAS ) Hitachi TrueCopy EMC Symmetrix Remote Data Facility VxFS lofi lofi lofi (Solaris Volume Manager) ( ) (ZFS) (Veritas Volume Manager(VERITAS )) (Solaris Volume Manager) (Solaris Volume Manager) (Veritas Volume Manager(VERITAS )) (Veritas Volume Manager(VERITAS )) (Veritas Volume Manager(VERITAS )) (Veritas Volume Manager(VERITAS )) (Veritas Volume Manager(VERITAS )) (Veritas Volume Manager(VERITAS ))

6 (VxVM) (VxVM) (Veritas Volume Manager(VERITAS )) (Veritas Volume Manager(VERITAS )) (Veritas Volume Manager(VERITAS )) (Veritas Volume Manager(VERITAS )) SCSI SCSI SCSI (fencing) (fencing) Oracle Solaris Cluster , A

7 Oracle Solaris Cluster , , IP Network Multipathing ()

8 () Veritas CVM ID SPARC: OBP(OpenBoot PROM) Oracle Solaris Cluster Oracle Solaris Cluster Oracle Solaris Cluster SNMP MIB, Oracle Solaris Cluster , A

9 10 CPU CPU CPU CPU CPU CPU Oracle Solaris Cluster Oracle Solaris Cluster Oracle Solaris Cluster Oracle Solaris Cluster () () Oracle Solaris Cluster Oracle Solaris Cluster (/) (Solaris Volume Manager) (Veritas Volume Manager(VERITAS )) (Solaris Volume Manager) (/) (Solaris Volume Manager) Solaris Volume Manager (/) (/) (Veritas Volume Manager(VERITAS ))

10 (/) (Veritas Volume Manager(VERITAS )) Oracle Solaris Cluster Oracle Solaris Cluster Manager SPARC: Sun Management Center Oracle Solaris Cluster Manager RBAC Oracle Solaris Cluster Manager Oracle Solaris Cluster Manager Oracle Solaris Cluster Manager A Sun StorageTek Availability Suite Sun StorageTek Availability Suite : Oracle Solaris Cluster , A

11 Oracle Solaris Cluster SPARC x86 Oracle Solaris Cluster. Oracle Solaris Cluster UltraSPARC, SPARC64, AMD64, Intel 64 SPARC x86. x86 64 x86.. Oracle.. Oracle Solaris Oracle Solaris Cluster. UNIX Oracle Solaris Cluster, UNIX.. Oracle Solaris Oracle Solaris (Oracle Solaris OS) 11

12 . P 1 AaBbCc123 AaBbCc123 AaBbCc123, ;..,...login. ls -a. machine_name% you have mail. machine_name% su Password: rm filename. AaBbCc123,, 6... :. Oracle Solaris OS UNIX. Oracle Solaris. P 2 Bash, Korn Bourne $ Bash, Korn Bourne # C C machine_name% machine_name# 12 Oracle Solaris Cluster , A

13 Oracle Solaris Cluster. Oracle Solaris Cluster documentation/index.html. Oracle Solaris Cluster Concepts Guide Oracle Solaris Cluster 3.3 Hardware Administration Manual Oracle Solaris Cluster Oracle Solaris Cluster Data Services Planning and Administration Guide Oracle Solaris Cluster Data Services Developer s Guide Oracle Solaris Cluster Oracle Solaris Cluster Quick Reference ( E /pdf/ pdf) Oracle Solaris Cluster Upgrade Guide Oracle Solaris Cluster Error Messages Guide Oracle Solaris Cluster Reference Manual Oracle Solaris Cluster Data Services Reference Manual Oracle Solaris Cluster Oracle Solaris Cluster.. ( ( 13

14 Oracle Oracle Technology Network(Oracle )( technetwork/index.html) Oracle. Discussion Forums( )( Oracle By Example(Oracle )( index.html). Oracle Solaris Cluster.., ( : Oracle Solaris 10) Oracle Solaris Cluster ( : Oracle Solaris Cluster 3.3). prtconf -v psrinfo -v showrev -p SPARC: prtdiag -v /usr/cluster/bin/clnode show-rev.... Oracle Solaris Cluster. /var/adm/messages. 14 Oracle Solaris Cluster , A

15 1 Oracle Solaris Cluster Oracle Solaris Cluster. 16 Oracle Solaris Cluster 17 Oracle Solaris OS Oracle Solaris LINUX OS ().. Oracle Solaris Cluster Concepts Guide

16 Oracle Solaris Cluster Oracle Solaris Cluster Oracle Solaris Cluster. Oracle Solaris Cluster. Oracle Solaris Cluster Oracle Solaris Cluster Concepts Guide. Oracle Solaris Cluster. Oracle Solaris Cluster...,. Oracle Solaris Cluster Data Services Planning and Administration Guide.. Oracle Solaris Cluster 3.3 Hardware Administration Manual. Oracle Solaris Cluster.. Oracle Solaris Cluster... Oracle Solaris Cluster (cluster clnode).., cluster. cluster. clzonecluster.. RGM(Resource Group Manager). 16 Oracle Solaris Cluster , A

17 Oracle Solaris OS... clzonecluster configure. Oracle Solaris Cluster. 3,. 8, ,. Oracle Solaris OS (Service Management Facility, SMF) Oracle Solaris Cluster. 1 1 Oracle Solaris Cluster Oracle Solaris Cluster pnm cl_event cl_eventlog rpc_pmf rpc_fed rgm scdpm cl_ccra scsymon_srv spm cl_svc_cluster_milestone FMRI svc:/system/cluster/pnm:default svc:/system/cluster/cl_event:default svc:/system/cluster/cl_eventlog:default svc:/system/cluster/rpc_pmf:default svc:/system/cluster/rpc_fed:default svc:/system/cluster/rgm:default svc:/system/cluster/scdpm:default svc:/system/cluster/cl_ccra:default svc:/system/cluster/scsymon_srv:default svc:/system/cluster/spm:default svc:/system/cluster/cl_svc_cluster_milestone:default 1 Oracle Solaris Cluster 17

18 1 1 Oracle Solaris Cluster () Oracle Solaris Cluster FMRI cl_svc_enable network-multipathing svc:/system/cluster/cl_svc_enable:default svc:/system/cluster/network-multipathing (Graphical User Interface, GUI) Oracle Solaris Cluster. GUI. Oracle Solaris Cluster GUI. GUI Oracle Solaris Cluster Manager, SPARC Oracle Solaris Cluster Sun Management Center GUI. Oracle Solaris Cluster Manager Sun Management Center 13, Oracle Solaris Cluster. Oracle Solaris Cluster Manager GUI. clsetup(1cl) Oracle Solaris Cluster., clsetup. clsetup. Oracle Solaris Cluster.. 18 Oracle Solaris Cluster , A

19 ccp(1m) if_mpadm(1m) claccess(1cl) cldevice(1cl) cldevicegroup(1cl) clinterconnect(1cl) clnasdevice(1cl) clnode(1cl) clquorum(1cl) clreslogicalhostname(1cl) clresource(1cl) clresourcegroup(1cl) clresourcetype(1cl) clressharedaddress(1cl) clsetup(1cl) clsnmphost(1cl) clsnmpmib(1cl) clsnmpuser(1cl) cltelemetryattribute(1cl) cluster(1cl) clvxvm(1cl) clzonecluster(1cl). IP Network Multipathing IP. Oracle Solaris Cluster. Oracle Solaris Cluster. Oracle Solaris Cluster. Oracle Solaris Cluster. Oracle Solaris Cluster NAS. Oracle Solaris Cluster. Oracle Solaris Cluster. Oracle Solaris Cluster. Oracle Solaris Cluster. Oracle Solaris Cluster. Oracle Solaris Cluster. Oracle Solaris Cluster. Oracle Solaris Cluster. Oracle Solaris Cluster SNMP. Oracle Solaris Cluster SNMP MIB. Oracle Solaris Cluster SNMP.. Oracle Solaris Cluster. Oracle Solaris Cluster VxVM(Veritas Volume Manager).. 1 Oracle Solaris Cluster 19

20 Oracle Solaris Cluster. Veritas Volume Manager(VERITAS ) Solaris Volume Manager.. Oracle Solaris Cluster Oracle Solaris Cluster..... CCP(Cluster Control Panel) (Grahpical User Interface, GUI).CCP 23. Sun Management Center Cluster Control Panel Oracle Solaris Cluster Manager GUI Oracle Solaris Cluster... SPARC Oracle Sun Enterprise SSP(System Service Processor). netcon. netcon Sun Enterprise f "" netcon. netcon ~*.. Oracle Solaris Cluster. 20 Oracle Solaris Cluster , A

21 ... Oracle Solaris Cluster. Oracle Solaris Cluster... DBMS 1 2. Oracle Solaris Cluster. Oracle Solaris Cluster. 1 2 Oracle Solaris Cluster ccp CCP(Cluster Control Panel). cconsole, crlogin, cssh ctelnet. clzonecluster(1cl) clsetup(1cl) Oracle Solaris Cluster 21

22 1 2 Oracle Solaris Cluster () Oracle Solaris Cluster, show-rev -v -node clnode(1cl).. clresource(1cl) clresourcegroup(1cl) clresourcetype(1cl) Oracle Solaris Cluster Manager. 26 Oracle Solaris Cluster 28, Sun Management Center Oracle Solaris Cluster Manager Oracle Solaris Cluster (SPARC Oracle Solaris Cluster ). Oracle Solaris Cluster Manager. Sun Management Center Sun Management Center. status cluster(1cl). 29 IP. -m clnode(1cl) status. clzonecluster(1cl) show. show cluster(1cl). show clzonecluster(1cl) NAS show clzonecluster(1cl). clnasdevice(1cl) 22 Oracle Solaris Cluster , A

23 1 2 Oracle Solaris Cluster () Oracle Solaris Cluster Oracle Solaris Cluster check cluster(1cl)cluster (1CL). clzonecluster(1cl) verify. /var/cluster/logs/ commandlog. /var/adm/messages Oracle Solaris Cluster : Solaris Volume Manager metastat. Solaris Volume Manager Administration Guide CCP(Cluster Control Panel) cconsole, crlogin, cssh ctelnet.... cconsole, crlogin, cssh ctelnet. cconsole telnet. (Secure Shell) cconsole Use SSH. ccp cconsole -s. ccp(1m) cconsole(1m). phys-schost#.. Oracle Solaris Cluster... CCP. SUNWccon. 1 Oracle Solaris Cluster 23

24 PATH Oracle Solaris Cluster /opt/sunwcluster/bin /usr/cluster/bin. $CLUSTER_HOME. clusters, serialports nsswitch.conf. /etc NIS/ NIS+. clusters(4) serialports(4). 1 Sun Enterprise server, SSP(System Service Processor). a. netcon. b. Shift~@. 2 3 CCP. phys-schost# ccp clustername CCP. CCP cconsole, crlogin, cssh ctelnet.. clusters, serialports nsswitch.conf. /etc NIS/ NIS+. serialports. 22. clusters(4) serialports(4) cconsole. # cconsole -s [-l username] [-p ssh-port] 24 Oracle Solaris Cluster , A

25 -s. -l username. -l cconsole. -p ssh-port. -p 22. clsetup,,,,. clzonecluster. clsetup(1cl) clzonecluster(1cl). phys-schost#.. Oracle Solaris Cluster phys-schost# clsetup clsetup. phys-schost# clsetup. clzonecluster. sczone. phys-schost# clzonecluster configure sczone. clzc:sczone>? 3.. Oracle Solaris Cluster. clsetup clzonecluster. 1 Oracle Solaris Cluster 25

26 Oracle Solaris Cluster. phys-schost#.. Oracle Solaris Cluster Oracle Solaris Cluster phys-schost# showrev -p Oracle Solaris Cluster. Oracle Solaris Cluster phys-schost# showrev -p grep Patch: Obsoletes: Requires: Incompatibles: Packages: Oracle Solaris Cluster.. phys-schost#.. Oracle Solaris Cluster Oracle Solaris Cluster phys-schost# clnode show-rev -v -node Oracle Solaris Cluster Oracle Solaris Cluster. Oracle Solaris Cluster. 26 Oracle Solaris Cluster , A

27 phys-schost# clnode show-rev 3.2 phys-schost#% clnode show-rev -v Oracle Solaris Cluster 3.3 for Solaris 10 sparc SUNWscu: 3.3.0,REV= SUNWsccomu: 3.3.0,REV= SUNWsczr: 3.3.0,REV= SUNWsccomzu: 3.3.0,REV= SUNWsczu: 3.3.0,REV= SUNWscsckr: 3.3.0,REV= SUNWscscku: 3.3.0,REV= SUNWscr: 3.3.0,REV= SUNWscrtlh: 3.3.0,REV= SUNWscnmr: 3.3.0,REV= SUNWscnmu: 3.3.0,REV= SUNWscdev: 3.3.0,REV= SUNWscgds: 3.3.0,REV= SUNWscsmf: 3.3.0,REV= SUNWscman: 3.3.0,REV= SUNWscsal: 3.3.0,REV= SUNWscsam: 3.3.0,REV= SUNWscvm: 3.3.0,REV= SUNWmdmr: 3.3.0,REV= SUNWmdmu: 3.3.0,REV= SUNWscmasa: 3.3.0,REV= SUNWscmasar: 3.3.0,REV= SUNWscmasasen: 3.3.0,REV= SUNWscmasazu: 3.3.0,REV= SUNWscmasau: 3.3.0,REV= SUNWscmautil: 3.3.0,REV= SUNWscmautilr: 3.3.0,REV= SUNWjfreechart: 3.3.0,REV= SUNWscspmr: 3.3.0,REV= SUNWscspmu: 3.3.0,REV= SUNWscderby: 3.3.0,REV= SUNWsctelemetry: 3.3.0,REV= SUNWscgrepavs: 3.2.3,REV= SUNWscgrepsrdf: 3.2.3,REV= SUNWscgreptc: 3.2.3,REV= SUNWscghb: 3.2.3,REV= SUNWscgctl: 3.2.3,REV= SUNWscims: 6.0,REV= SUNWscics: 6.0,REV= SUNWscapc: 3.2.0,REV= SUNWscdns: 3.2.0,REV= SUNWschadb: 3.2.0,REV= SUNWschtt: 3.2.0,REV= SUNWscs1as: 3.2.0,REV= SUNWsckrb5: 3.2.0,REV= SUNWscnfs: 3.2.0,REV= SUNWscor: 3.2.0,REV= SUNWscs1mq: 3.2.0,REV= SUNWscsap: 3.2.0,REV= SUNWsclc: 3.2.0,REV= SUNWscsapdb: 3.2.0,REV= SUNWscsapenq: 3.2.0,REV= SUNWscsaprepl: 3.2.0,REV= Oracle Solaris Cluster 27

28 SUNWscsapscs: 3.2.0,REV= SUNWscsapwebas: 3.2.0,REV= SUNWscsbl: 3.2.0,REV= SUNWscsyb: 3.2.0,REV= SUNWscwls: 3.2.0,REV= SUNWsc9ias: 3.2.0,REV= SUNWscPostgreSQL: 3.2.0,REV= SUNWsczone: 3.2.0,REV= SUNWscdhc: 3.2.0,REV= SUNWscebs: 3.2.0,REV= SUNWscmqi: 3.2.0,REV= SUNWscmqs: 3.2.0,REV= SUNWscmys: 3.2.0,REV= SUNWscsge: 3.2.0,REV= SUNWscsaa: 3.2.0,REV= SUNWscsag: 3.2.0,REV= SUNWscsmb: 3.2.0,REV= SUNWscsps: 3.2.0,REV= SUNWsctomcat: 3.2.0,REV= , Oracle Solaris Cluster Manager GUI. 13, Oracle Solaris Cluster Oracle Solaris Cluster Manager. phys-schost#.. Oracle Solaris Cluster... solaris.cluster.read RBAC.,.. phys-schost# cluster show -t resource,resourcetype,resourcegroup, show. resource resource group resourcetype 28 Oracle Solaris Cluster , A

29 1 3, schost (RT Name), (RG Name) (RS Name). phys-schost# cluster show -t resource,resourcetype,resourcegroup === Registered Resource Types === Resource Type: SUNW.qfs RT_description: SAM-QFS Agent on Oracle Solaris Cluster RT_version: 3.1 API_version: 3 RT_basedir: /opt/sunwsamfs/sc/bin Single_instance: False Proxy: False Init_nodes: All potential masters Installed_nodes: <All> Failover: True Pkglist: <NULL> RT_system: False === Resource Groups and Resources === Resource Group: RG_description: RG_mode: RG_state: Failback: Nodelist: qfs-rg <NULL> Failover Managed False phys-schost-2 phys-schost Resources for Group qfs-rg --- Resource: qfs-res Type: SUNW.qfs Type_version: 3.1 Group: qfs-rg R_description: Resource_project_name: default Enabled{phys-schost-2}: True Enabled{phys-schost-1}: True Monitored{phys-schost-2}: True Monitored{phys-schost-1}: True Oracle Solaris Cluster Manager GUI. Oracle Solaris Cluster Manager. cluster status. 1 Oracle Solaris Cluster 29

30 phys-schost#.. Oracle Solaris Cluster status solaris.cluster.read RBAC... phys-schost# cluster status cluster(1cl) status. phys-schost# cluster status === Cluster Nodes === --- Node Status --- Node Name Status phys-schost-1 Online phys-schost-2 Online === Cluster Transport Paths === Endpoint1 Endpoint2 Status phys-schost-1:qfe1 phys-schost-4:qfe1 Path online phys-schost-1:hme1 phys-schost-4:hme1 Path online === Cluster Quorum === --- Quorum Votes Summary --- Needed Present Possible Quorum Votes by Node --- Node Name Present Possible Status phys-schost Online 30 Oracle Solaris Cluster , A

31 phys-schost Online --- Quorum Votes by Device --- Device Name Present Possible Status /dev/did/rdsk/d2s2 1 1 Online /dev/did/rdsk/d8s2 0 1 Offline === Cluster Device Groups === --- Device Group Status --- Device Group Name Primary Secondary Status schost-2 phys-schost-2 - Degraded --- Spare, Inactive, and In Transition Nodes --- Device Group Name Spare Nodes Inactive Nodes In Transistion Nodes schost === Cluster Resource Groups === Group Name Node Name Suspended Status test-rg phys-schost-1 No Offline phys-schost-2 No Online test-rg phys-schost-1 No Offline phys-schost-2 No Error--stop failed test-rg phys-schost-1 No Online phys-schost-2 No Online === Cluster Resources === Resource Name Node Name Status Message test_1 phys-schost-1 Offline Offline phys-schost-2 Online Online test_1 phys-schost-1 Offline Offline phys-schost-2 Stop failed Faulted test_1 phys-schost-1 Online Online phys-schost-2 Online Online Device Instance Node Status /dev/did/rdsk/d2 phys-schost-1 Ok 1 Oracle Solaris Cluster 31

32 /dev/did/rdsk/d3 phys-schost-1 Ok phys-schost-2 Ok /dev/did/rdsk/d4 phys-schost-1 Ok phys-schost-2 Ok /dev/did/rdsk/d6 phys-schost-2 Ok === Zone Clusters === --- Zone Cluster Status --- Name Node Name Zone HostName Status Zone Status sczone schost-1 sczone-1 Online Running schost-2 sczone-2 Online Running Oracle Solaris Cluster Manager GUI. Oracle Solaris Cluster Manager. phys-schost#.. Oracle Solaris Cluster... IP Network Multipathing status clnode(1cl). 1 5 solaris.cluster.read RBAC... phys-schost# clnode status -m clnode status. % clnode status -m --- Node IPMP Group Status Oracle Solaris Cluster , A

33 Node Name Group Name Status Adapter Status phys-schost-1 test-rg Online qfe1 Online phys-schost-2 test-rg Online qfe1 Online Oracle Solaris Cluster Manager GUI. Oracle Solaris Cluster Manager. phys-schost#.. Oracle Solaris Cluster status solaris.cluster.read RBAC... % cluster show cluster show. clzonecluster show.,ip,. show. clzonecluster show. cluster. cluster(1cl). clzonecluster clzonecluster(1cl)... phys-schost# cluster show === Cluster === 1 Oracle Solaris Cluster 33

34 Cluster Name: cluster-1 installmode: disabled heartbeat_timeout: heartbeat_quantum: 1000 private_netaddr: private_netmask: max_nodes: 64 max_privatenets: 10 global_fencing: Unknown Node List: phys-schost-1 Node Zones: phys_schost-2:za === Host Access Control === Cluster name: Allowed hosts: Authentication Protocol: clustser-1 phys-schost-1, phys-schost-2:za sys === Cluster Nodes === Node Name: phys-schost-1 Node ID: 1 Type: cluster Enabled: yes privatehostname: clusternode1-priv reboot_on_path_failure: disabled globalzoneshares: 3 defaultpsetmin: 1 quorum_vote: 1 quorum_defaultvote: 1 quorum_resv_key: 0x43CB1E Transport Adapter List: qfe3, hme0 --- Transport Adapters for phys-schost Transport Adapter: qfe3 Adapter State: Enabled Adapter Transport Type: dlpi Adapter Property(device_name): qfe Adapter Property(device_instance): 3 Adapter Property(lazy_free): 1 Adapter Property(dlpi_heartbeat_timeout): Adapter Property(dlpi_heartbeat_quantum): 1000 Adapter Property(nw_bandwidth): 80 Adapter Property(bandwidth): 10 Adapter Property(ip_address): Adapter Property(netmask): Adapter Port Names: 0 Adapter Port State(0): Enabled Transport Adapter: hme0 Adapter State: Enabled Adapter Transport Type: dlpi Adapter Property(device_name): hme Adapter Property(device_instance): 0 Adapter Property(lazy_free): 0 Adapter Property(dlpi_heartbeat_timeout): Adapter Property(dlpi_heartbeat_quantum): Oracle Solaris Cluster , A

35 Adapter Property(nw_bandwidth): 80 Adapter Property(bandwidth): 10 Adapter Property(ip_address): Adapter Property(netmask): Adapter Port Names: 0 Adapter Port State(0): Enabled --- SNMP MIB Configuration on phys-schost SNMP MIB Name: State: Protocol: Event Disabled SNMPv2 --- SNMP Host Configuration on phys-schost SNMP User Configuration on phys-schost SNMP User Name: Authentication Protocol: Default User: foo MD5 No Node Name: phys-schost-2:za Node ID: 2 Type: cluster Enabled: yes privatehostname: clusternode2-priv reboot_on_path_failure: disabled globalzoneshares: 1 defaultpsetmin: 2 quorum_vote: 1 quorum_defaultvote: 1 quorum_resv_key: 0x43CB1E Transport Adapter List: hme0, qfe3 --- Transport Adapters for phys-schost Transport Adapter: hme0 Adapter State: Enabled Adapter Transport Type: dlpi Adapter Property(device_name): hme Adapter Property(device_instance): 0 Adapter Property(lazy_free): 0 Adapter Property(dlpi_heartbeat_timeout): Adapter Property(dlpi_heartbeat_quantum): 1000 Adapter Property(nw_bandwidth): 80 Adapter Property(bandwidth): 10 Adapter Property(ip_address): Adapter Property(netmask): Adapter Port Names: 0 Adapter Port State(0): Enabled Transport Adapter: qfe3 Adapter State: Enabled Adapter Transport Type: dlpi Adapter Property(device_name): qfe Adapter Property(device_instance): 3 Adapter Property(lazy_free): 1 Adapter Property(dlpi_heartbeat_timeout): Oracle Solaris Cluster 35

36 Adapter Property(dlpi_heartbeat_quantum): 1000 Adapter Property(nw_bandwidth): 80 Adapter Property(bandwidth): 10 Adapter Property(ip_address): Adapter Property(netmask): Adapter Port Names: 0 Adapter Port State(0): Enabled --- SNMP MIB Configuration on phys-schost SNMP MIB Name: State: Protocol: Event Disabled SNMPv2 --- SNMP Host Configuration on phys-schost SNMP User Configuration on phys-schost === Transport Cables === Transport Cable: Cable Endpoint1: Cable Endpoint2: Cable State: Transport Cable: Cable Endpoint1: Cable Endpoint2: Cable State: Transport Cable: Cable Endpoint1: Cable Endpoint2: Cable State: Transport Cable: Cable Endpoint1: Cable Endpoint2: Cable State: phys-schost-1:qfe3,switch2@1 phys-schost-1:qfe3 switch2@1 Enabled phys-schost-1:hme0,switch1@1 phys-schost-1:hme0 switch1@1 Enabled phys-schost-2:hme0,switch1@2 phys-schost-2:hme0 switch1@2 Enabled phys-schost-2:qfe3,switch2@2 phys-schost-2:qfe3 switch2@2 Enabled === Transport Switches === Transport Switch: switch2 Switch State: Enabled Switch Type: switch Switch Port Names: 1 2 Switch Port State(1): Enabled Switch Port State(2): Enabled Transport Switch: switch1 Switch State: Enabled Switch Type: switch Switch Port Names: 1 2 Switch Port State(1): Enabled Switch Port State(2): Enabled === Quorum Devices === 36 Oracle Solaris Cluster , A

37 Quorum Device Name: d3 Enabled: yes Votes: 1 Global Name: /dev/did/rdsk/d3s2 Type: scsi Access Mode: scsi2 Hosts (enabled): phys-schost-1, phys-schost-2 Quorum Device Name: qs1 Enabled: yes Votes: 1 Global Name: qs1 Type: quorum_server Hosts (enabled): phys-schost-1, phys-schost-2 Quorum Server Host: Port: 9000 === Device Groups === Device Group Name: testdg3 Type: SVM failback: no Node List: phys-schost-1, phys-schost-2 preferenced: yes numsecondaries: 1 diskset name: testdg3 === Registered Resource Types === Resource Type: SUNW.LogicalHostname:2 RT_description: Logical Hostname Resource Type RT_version: 2 API_version: 2 RT_basedir: /usr/cluster/lib/rgm/rt/hafoip Single_instance: False Proxy: False Init_nodes: All potential masters Installed_nodes: <All> Failover: True Pkglist: SUNWscu RT_system: True Resource Type: SUNW.SharedAddress:2 RT_description: HA Shared Address Resource Type RT_version: 2 API_version: 2 RT_basedir: /usr/cluster/lib/rgm/rt/hascip Single_instance: False Proxy: False Init_nodes: <Unknown> Installed_nodes: <All> Failover: True Pkglist: SUNWscu RT_system: True Resource Type: SUNW.HAStoragePlus:4 1 Oracle Solaris Cluster 37

38 RT_description: HA Storage Plus RT_version: 4 API_version: 2 RT_basedir: /usr/cluster/lib/rgm/rt/hastorageplus Single_instance: False Proxy: False Init_nodes: All potential masters Installed_nodes: <All> Failover: False Pkglist: SUNWscu RT_system: False Resource Type: SUNW.haderby RT_description: haderby server for Oracle Solaris Cluster RT_version: 1 API_version: 7 RT_basedir: /usr/cluster/lib/rgm/rt/haderby Single_instance: False Proxy: False Init_nodes: All potential masters Installed_nodes: <All> Failover: False Pkglist: SUNWscderby RT_system: False Resource Type: SUNW.sctelemetry RT_description: sctelemetry service for Oracle Solaris Cluster RT_version: 1 API_version: 7 RT_basedir: /usr/cluster/lib/rgm/rt/sctelemetry Single_instance: True Proxy: False Init_nodes: All potential masters Installed_nodes: <All> Failover: False Pkglist: SUNWsctelemetry RT_system: False === Resource Groups and Resources === Resource Group: RG_description: RG_mode: RG_state: Failback: Nodelist: HA_RG <Null> Failover Managed False phys-schost-1 phys-schost Resources for Group HA_RG --- Resource: HA_R Type: SUNW.HAStoragePlus:4 Type_version: 4 Group: HA_RG R_description: Resource_project_name: SCSLM_HA_RG Enabled{phys-schost-1}: True Enabled{phys-schost-2}: True Monitored{phys-schost-1}: True 38 Oracle Solaris Cluster , A

39 Monitored{phys-schost-2}: Resource Group: RG_description: RG_mode: RG_state: Failback: Nodelist: True cl-db-rg <Null> Failover Managed False phys-schost-1 phys-schost Resources for Group cl-db-rg --- Resource: cl-db-rs Type: SUNW.haderby Type_version: 1 Group: cl-db-rg R_description: Resource_project_name: default Enabled{phys-schost-1}: True Enabled{phys-schost-2}: True Monitored{phys-schost-1}: True Monitored{phys-schost-2}: True Resource Group: RG_description: RG_mode: RG_state: Failback: Nodelist: cl-tlmtry-rg <Null> Scalable Managed False phys-schost-1 phys-schost Resources for Group cl-tlmtry-rg --- Resource: cl-tlmtry-rs Type: SUNW.sctelemetry Type_version: 1 Group: cl-tlmtry-rg R_description: Resource_project_name: default Enabled{phys-schost-1}: True Enabled{phys-schost-2}: True Monitored{phys-schost-1}: True Monitored{phys-schost-2}: True === DID Device Instances === DID Device Name: Full Device Path: Replication: default_fencing: DID Device Name: Full Device Path: Replication: default_fencing: DID Device Name: Full Device Path: Full Device Path: Replication: /dev/did/rdsk/d1 phys-schost-1:/dev/rdsk/c0t2d0 none global /dev/did/rdsk/d2 phys-schost-1:/dev/rdsk/c1t0d0 none global /dev/did/rdsk/d3 phys-schost-2:/dev/rdsk/c2t1d0 phys-schost-1:/dev/rdsk/c2t1d0 none 1 Oracle Solaris Cluster 39

40 default_fencing: DID Device Name: Full Device Path: Full Device Path: Replication: default_fencing: DID Device Name: Full Device Path: Replication: default_fencing: DID Device Name: Full Device Path: Replication: default_fencing: global /dev/did/rdsk/d4 phys-schost-2:/dev/rdsk/c2t2d0 phys-schost-1:/dev/rdsk/c2t2d0 none global /dev/did/rdsk/d5 phys-schost-2:/dev/rdsk/c0t2d0 none global /dev/did/rdsk/d6 phys-schost-2:/dev/rdsk/c1t0d0 none global === NAS Devices === Nas Device: Type: User ID: Nas Device: Type: User ID: 1 7 nas_filer1 netapp root nas2 netapp llai. % clzonecluster show === Zone Clusters === Zone Cluster Name: zonename: zonepath: autoboot: ip-type: enable_priv_net: sczone sczone /zones/sczone TRUE shared TRUE --- Solaris Resources for sczone --- Resource Name: net address: physical: auto Resource Name: net address: physical: auto Resource Name: dir: special: raw: fs /gz/db_qfs/crshome CrsHome 40 Oracle Solaris Cluster , A

41 type: samfs options: [] Resource Name: fs dir: /gz/db_qfs/crsdata special: CrsData raw: type: samfs options: [] Resource Name: fs dir: /gz/db_qfs/orahome special: OraHome raw: type: samfs options: [] Resource Name: fs dir: /gz/db_qfs/oradata special: OraData raw: type: samfs options: [] --- Zone Cluster Nodes for sczone --- Node Name: physical-host: hostname: sczone-1 sczone-1 lzzone-1 Node Name: physical-host: hostname: sczone-2 sczone-2 lzzone-2 clnasdevice show Oracle Solaris Cluster Manager NAS. clnasdevice(1cl). cluster(1cl) check. cluster check. cluster check. cluster check cluster check. cluster list-checks. 1 Oracle Solaris Cluster 41

42 Oracle Solaris Cluster 3.3 5/11 cluster check.. -k keyword... -k interactive... -k functional check-id.... % cluster list-checks -v -C checkid -v cluster check., Oracle Solaris Cluster cluster check. clzonecluster(1cl). clzonecluster verify. clzonecluster verify. clzonecluster verify. verify phys-schost# su. My Oracle Support( Oracle ) Patches & Updates( & ). Advanced Search( ) "Solaris Cluster" 42 Oracle Solaris Cluster , A

43 Description "check" Oracle Solaris Cluster # cluster check -v -o outputdir -v -o outputdir outputdir.... # cluster check -v -k interactive -o outputdir -k interactive.... a.. # cluster list-checks -k functional b... # cluster list-checks -v -C checkid -C checkid. c.. d.. # cluster check -v -k functional -C checkid -o outputdir -k functional.. e. c d. 1 Oracle Solaris Cluster 43

44 outputdir. outputdir outputdir phys-schost# clzonecluster verify zoneclustername. Oracle Solaris Cluster. 1 8 phys-schost-1 phys-schost-2 cluster check. phys-schost# cluster check -v -h phys-schost-1, phys-schost-2 cluster check: Requesting explorer data and node report from phys-schost-1. cluster check: Requesting explorer data and node report from phys-schost-2. cluster check: phys-schost-1: Explorer finished. cluster check: phys-schost-1: Starting single-node checks. cluster check: phys-schost-1: Single-node checks finished. cluster check: phys-schost-2: Explorer finished. cluster check: phys-schost-2: Starting single-node checks. cluster check: phys-schost-2: Single-node checks finished. cluster check: Starting multi-node checks. cluster check: Multi-node checks finished # # cluster list-checks -k interactive Some checks might take a few moments to run (use -v to see progress)... I : (Moderate) Fix for GLDv3 interfaces on cluster transport vulnerability applied? F ,.. 44 Oracle Solaris Cluster , A

45 funct.test.f jan # cluster list-checks -k functional F : (Critical) Perform resource group switchover F : (Critical) Induce cluster transport network failure - single adapter. F : (Critical) Perform cluster shutdown F : (Critical) Induce node panic... # cluster list-checks -v -C F F : (Critical) Perform resource group switchover Keywords: SolarisCluster3.x, functional Applicability: Applicable if multi-node cluster running live. Check Logic: Select a resource group and destination node. Perform /usr/cluster/bin/clresourcegroup switch on specified resource group either to specified node or to all nodes in succession. Version: 1.2 Revision Date: 12/10/10 Take the cluster out of production # cluster check -k functional -C F o funct.test.f jan2011 F initializing... initializing xml output... loading auxiliary data... starting check run... pschost1, pschost2, pschost3, pschost4: F starting: Perform resource group switchover ============================================================ >>> Functional Check <<< Functional checks exercise cluster behavior. It is recommended that you do not run this check on a cluster in production mode. It is recommended that you have access to the system console for each cluster node and observe any output on the consoles while the check is executed. If the node running this check is brought down during execution the check must be rerun from this same node after it is rebooted into the cluster in order for the check to be completed. Select continue for more details on this check. 1) continue 2) exit 1 Oracle Solaris Cluster 45

46 choice: 1 ============================================================ >>> Check Description <<<... Follow onscreen directions 1 11 /global/phys-schost-1 suncluster phys-schost-2. /var/cluster/logs/cluster_check/<timestamp>. phys-schost# cluster check -v -h phys-schost-1, phys-schost-2 -o /var/cluster/logs/cluster_check/dec5/ cluster check: Requesting explorer data and node report from phys-schost-1. cluster check: Requesting explorer data and node report from phys-schost-2. cluster check: phys-schost-1: Explorer finished. cluster check: phys-schost-1: Starting single-node checks. cluster check: phys-schost-1: Single-node checks finished. cluster check: phys-schost-2: Explorer finished. cluster check: phys-schost-2: Starting single-node checks. cluster check: phys-schost-2: Single-node checks finished. cluster check: Starting multi-node checks. cluster check: Multi-node checks finished. cluster check: One or more checks failed. cluster check: The greatest severity of all check failures was 3 (HIGH). cluster check: Reports are in /var/cluster/logs/cluster_check/<dec5>. # # cat /var/cluster/logs/cluster_check/dec5/cluster_check-results.suncluster.txt... =================================================== = ANALYSIS DETAILS = =================================================== CHECK ID : 3065 SEVERITY : HIGH FAILURE : Global filesystem /etc/vfstab entries are not consistent across all Oracle Solaris Cluster 3.x nodes. ANALYSIS : The global filesystem /etc/vfstab entries are not consistent across all nodes in this cluster. Analysis indicates: FileSystem /global/phys-schost-1 is on phys-schost-1 but missing from phys-schost-2. RECOMMEND: Ensure each node has the correct /etc/vfstab entry for the filesystem(s) in question.... # 46 Oracle Solaris Cluster , A

47 cluster(1cl) /etc/vfstab. cluster check % su. phys-schost# cluster check /global/schost-1 suncluster phys-schost-2. /var/cluster/logs/cluster_check/<timestamp>/. phys-schost# cluster check -v1 -h phys-schost-1,phys-schost-2 -o /var/cluster//logs/cluster_check/dec5/ cluster check: Requesting explorer data and node report from phys-schost-1. cluster check: Requesting explorer data and node report from phys-schost-2. cluster check: phys-schost-1: Explorer finished. cluster check: phys-schost-1: Starting single-node checks. cluster check: phys-schost-1: Single-node checks finished. cluster check: phys-schost-2: Explorer finished. cluster check: phys-schost-2: Starting single-node checks. cluster check: phys-schost-2: Single-node checks finished. cluster check: Starting multi-node checks. cluster check: Multi-node checks finished. cluster check: One or more checks failed. cluster check: The greatest severity of all check failures was 3 (HIGH). cluster check: Reports are in /var/cluster/logs/cluster_check/dec5. # # cat /var/cluster/logs/cluster_check/dec5/cluster_check-results.suncluster.txt... =================================================== = ANALYSIS DETAILS = =================================================== CHECK ID : 3065 SEVERITY : HIGH FAILURE : Global filesystem /etc/vfstab entries are not consistent across all Oracle Solaris Cluster 3.x nodes. ANALYSIS : The global filesystem /etc/vfstab entries are not consistent across 1 Oracle Solaris Cluster 47

48 all nodes in this cluster. Analysis indicates: FileSystem /global/phys-schost-1 is on phys-schost-1 but missing from phys-schost-2. RECOMMEND: Ensure each node has the correct /etc/vfstab entry for the filesystem(s) in question.... # # cat /var/cluster/logs/cluster_check/dec5/cluster_check-results.phys-schost-1.txt... =================================================== = ANALYSIS DETAILS = =================================================== CHECK ID : 1398 SEVERITY : HIGH FAILURE : An unsupported server is being used as an Oracle Solaris Cluster 3.x node. ANALYSIS : This server may not been qualified to be used as an Oracle Solaris Cluster 3.x node. Only servers that have been qualified with Oracle Solaris Cluster 3.x are supported as Oracle Solaris Cluster 3.x nodes. RECOMMEND: Because the list of supported servers is always being updated, check with your Oracle representative to get the latest information on what servers are currently supported and only use a server that is supported with Oracle Solaris Cluster 3.x.... # Oracle Solaris Cluster /var/cluster/logs/commandlog ASCII Oracle Solaris Cluster..... claccess cldevice cldevicegroup clinterconnect clnasdevice clnode clquorum clreslogicalhostname clresource clresourcegroup clresourcetype 48 Oracle Solaris Cluster , A

49 clressharedaddress clsetup clsnmphost clsnmpmib clnsmpuser cltelemetryattribute cluster clzonecluster scdidadm commandlog. ID, commandlog., Oracle Solaris Cluster commandlog. commandlog. commandlog, crontab. crontab(1). Oracle Solaris Cluster 8 commandlog. commandlog commandlog. commandlog.0. commandlog.7. commandlog. phys-schost# more /var/cluster/logs/commandlog 1 Oracle Solaris Cluster 49

50 1 13 Oracle Solaris Cluster more commandlog. more -lines10 /var/cluster/logs/commandlog 11/11/ :42:51 phys-schost root START - clsetup 11/11/ :43:36 phys-schost root START - clrg add "app-sa-1" 11/11/ :43:36 phys-schost root END 0 11/11/ :43:36 phys-schost root START - clrg set -y "RG_description=Department Shared Address RG" "app-sa-1" 11/11/ :43:37 phys-schost root END 0 11/11/ :44:15 phys-schost root START - clrg online "app-sa-1" 11/11/ :44:15 phys-schost root END 0 11/11/ :44:19 phys-schost root END /02/ :37:21 phys-schost jbloggs START - clrg -c -g "app-sa-1" -y "RG_description=Joe Bloggs Shared Address RG" 12/02/ :37:22 phys-schost jbloggs END 0 50 Oracle Solaris Cluster , A

51 2 2 Oracle Solaris Cluster RBAC Oracle Solaris Cluster (Role-Based Access Control, RBAC).. 51 Oracle Solaris Cluster RBAC 52 Oracle Solaris Cluster RBAC 53 Oracle Solaris Cluster Management RBAC 56 RBAC Oracle Solaris Cluster RBAC RBAC. Oracle Solaris Cluster RBAC. RBAC RBAC, RBAC System Administration Guide: Security Services 8, Using Roles and Privileges (Overview) System Administration Guide: Security Services 9, Using Role-Based Access Control (Tasks) System Administration Guide: Security Services 10, Role-Based Access Control (Reference) 51

52 Oracle Solaris Cluster RBAC Oracle Solaris Cluster RBAC Oracle Solaris Cluster Manager Oracle Solaris Cluster RBAC.RBAC Oracle Solaris Cluster. Oracle Solaris Cluster RBAC. solaris.cluster.read list, show solaris.cluster.admin solaris.cluster.modify Oracle Solaris Cluster RBAC. RBAC RBAC. Oracle Solaris Cluster. Oracle Oracle Solaris Cluster. RBAC Oracle Solaris Cluster RBAC. Oracle Solaris Cluster Oracle Solaris. euid=0 Oracle Solaris Cluster. Oracle Solaris Oracle Solaris. Oracle Solaris Cluster Oracle Solaris Cluster. list show status scha_control(1ha) scha_resource_get(1ha) scha_resource_setstatus(1ha) scha_resourcegroup_get(1ha) scha_resourcetype_get(1ha) 52 Oracle Solaris Cluster , A

53 Oracle Solaris Cluster Management RBAC solaris.cluster.read Oracle Solaris Cluster list, show read Oracle Solaris Cluster Manager GUI. Oracle Solaris Cluster. solaris.cluster.read solaris.cluster.admin Oracle Solaris.. solaris.cluster.modify list, show, export, status read Oracle Solaris Cluster Manager GUI.. ID. ID. Oracle Solaris Cluster Management RBAC Oracle Solaris Cluster Management RBAC. 1 2 root.. System Administration Guide: Security Services How to Assume a Role in the Solaris Management Console Solaris Management Console Oracle Solaris Cluster RBAC 53

54 Oracle Solaris Cluster Management RBAC 3...,..... ID UID. : C, Bourne Korn.. / Oracle Solaris Cluster Manager Oracle Solaris Cluster. useradd(1m). -P.. root. 54 Oracle Solaris Cluster , A

55 Oracle Solaris Cluster Management RBAC 7.. root. # /etc/init.d/nscd stop # /etc/init.d/nscd start solaris.cluster.admin RBAC.. roleadd(1m). user_attr(4) type=role.. smrole(1m).. smrole. Solaris Management Console... root. # /etc/init.d/nscd stop # /etc/init.d/nscd start smrole smrole.. % su primaryadmin # /usr/sadm/bin/smrole add -H myhost -- -c "Custom Operator" -n oper2 -a johndoe \ -d /export/home/oper2 -F "Backup/Restore Operator" -p "Operator" -p "Media Restore" Authenticating as user: primaryadmin Type /? for help, pressing <enter> accepts the default denoted by [ ] Please enter a string value for: password :: <type primaryadmin password> 2 Oracle Solaris Cluster RBAC 55

56 RBAC Loading Tool: com.sun.admin.usermgr.cli.role.usermgrrolecli from myhost Login to myhost as user primaryadmin was successful. Download of com.sun.admin.usermgr.cli.role.usermgrrolecli from myhost was successful. Type /? for help, pressing <enter> accepts the default denoted by [ ] Please enter a string value for: password :: <type oper2 password> # /etc/init.d/nscd stop # /etc/init.d/nscd start smrole list. # /usr/sadm/bin/smrole list -- Authenticating as user: primaryadmin Type /? for help, pressing <enter> accepts the default denoted by [ ] Please enter a string value for: password :: <type primaryadmin password> Loading Tool: com.sun.admin.usermgr.cli.role.usermgrrolecli from myhost Login to myhost as user primaryadmin was successful. Download of com.sun.admin.usermgr.cli.role.usermgrrolecli from myhost was successful. root 0 Super-User primaryadmin 100 Most powerful role sysadmin 101 Performs non-security admin tasks oper2 102 Custom Operator RBAC RBAC. RBAC. 56 RBAC 57 RBAC RBAC. 56 Oracle Solaris Cluster , A

57 RBAC System Administration Guide: Security Services How to Assume a Role in the Solaris Management Console Solaris Management Console RBAC solaris.cluster.modify RBAC.., usermod(1m)., user_attr.., smuser(1m).. smuser. smuser Solaris Management Console. 2 Oracle Solaris Cluster RBAC 57

58 58

59 3 3,. System Administration Guide: Oracle Solaris Containers-Resource Management and Oracle Solaris Zones 18, Planning and Configuring Non-Global Zones (Tasks) /var Oracle Solaris Cluster cluster(1cl) shutdown. cluster shutdown. clzonecluster halt. cluster shutdown. phys-schost#. clzonecluster clzc:schost>. 59

60 cluster shutdown. Oracle Solaris shutdown clnode(1cl) evacuate cluster shutdown clzonecluster halt cluster shutdown. 4. cluster shutdown init 0 SPARC OpenBoot PROM ok Press any key to continue x86 GRUB. GRUB System Administration Guide: Basic Administration Booting an x86 Based System by Using GRUB (Task Map). clzonecluster halt zoneadm - z zoneclustername halt ( ) : Oracle Solaris Cluster , A

61 send brk.. phys-schost#.. Oracle Solaris Cluster Oracle RAC(Real Application Clusters). Oracle RAC. solaris.cluster.admin RBAC..... phys-schost# cluster shutdown -g0 -y. phys-schost# clzonecluster halt zoneclustername. phys-schost# clzonecluster halt + cluster shutdown. 4 ok (SPARC ) GRUB (x86 ). ok (SPARC ) (x86 ). ok (SPARC ) Press any key to continue (GRUB x86 ). phys-schost# cluster status -t node status. phys-schost# clzonecluster status

62 3 1 sparse-sczone. phys-schost# clzonecluster halt sparse-sczone Waiting for zone halt commands to complete on all the nodes of the zone cluster "sparse-sczone"... Sep 5 19:06:01 schost-4 cl_runtime: NOTICE: Membership : Node 2 of cluster sparse-sczone died. Sep 5 19:06:01 schost-4 cl_runtime: NOTICE: Membership : Node 4 of cluster sparse-sczone died. Sep 5 19:06:01 schost-4 cl_runtime: NOTICE: Membership : Node 3 of cluster sparse-sczone died. Sep 5 19:06:01 schost-4 cl_runtime: NOTICE: Membership : Node 1 of cluster sparse-sczone died. phys-schost# 3 2 SPARC: ok. -g 0 0, -y yes.. phys-schost# cluster shutdown -g0 -y Wed Mar 10 13:47:32 phys-schost-1 cl_runtime: WARNING: CMM monitoring disabled. phys-schost-1# INIT: New run level: 0 The system is coming down. Please wait. System services are now being stopped. /etc/rc0.d/k05initrgm: Calling clnode evacuate The system is down. syncing file systems... done Program terminated ok 3 3 x86:. ok. -g 0 0, -y yes.. phys-schost# cluster shutdown -g0 -y May 2 10:32:57 phys-schost-1 cl_runtime: WARNING: CMM: Monitoring disabled. root@phys-schost-1# INIT: New run level: 0 The system is coming down. Please wait. System services are now being stopped. /etc/rc0.d/k05initrgm: Calling clnode evacuate failfasts already disabled on node 1 Print services already stopped. May 2 10:33:13 phys-schost-1 syslogd: going down on signal 15 The system is down. syncing file systems... done Type any key to continue 62 Oracle Solaris Cluster , A

63 63.. ok (SPARC ) Press any key to continue (GRUB x86 ). phys-schost#.. Oracle Solaris Cluster... Oracle Solaris Cluster. 1.. SPARC. ok boot x86. GRUB Oracle Solaris Enter. GRUB. GNU GRUB version 0.95 (631K lower / K upper memory) Solaris 10 /sol_10_x86 Solaris failsafe Use the ^ and v keys to select which entry is highlighted. Press enter to boot the selected OS, e to edit the commands before booting, or c for a command-line. GRUB System Administration Guide: Basic Administration Booting an x86 Based System by Using GRUB (Task Map)

64 . phys-schost# clzonecluster boot zoneclustername. zoneclustername cluster(1cl) status. phys-schost# cluster status -t node clzonecluster(1cl) status. phys-schost# clzonecluster status /var Oracle Solaris Cluster. 81 /var. 3 4 SPARC: phys-schost-1.. autoboot true.. autoboot true. ok boot Rebooting with command: boot... Hostname: phys-schost-1 Booting as part of a cluster NOTICE: Node phys-schost-1 with votecount = 1 added. NOTICE: Node phys-schost-2 with votecount = 1 added. NOTICE: Node phys-schost-3 with votecount = 1 added.... NOTICE: Node phys-schost-1: attempting to join cluster... NOTICE: Node phys-schost-2 (incarnation # ) has become reachable. NOTICE: Node phys-schost-3 (incarnation # ) has become reachable. NOTICE: cluster has reached quorum. NOTICE: node phys-schost-1 is up; new incarnation number = NOTICE: node phys-schost-2 is up; new incarnation number = NOTICE: node phys-schost-3 is up; new incarnation number = NOTICE: Cluster members: phys-schost-1 phys-schost-2 phys-schost Oracle Solaris Cluster , A

65 1 2 3 cluster shutdown boot. clzonecluster halt clzonecluster boot. clzonecluster reboot. cluster(1cl), boot(1m) clzonecluster(1cl). phys-schost#.. Oracle Solaris Cluster... Oracle RAC. Oracle RAC. solaris.cluster.admin RBAC.... phys-schost# cluster shutdown -g0 -y. phys-schost# clzonecluster halt zoneclustername. cluster shutdown SPARC. ok boot x86. GRUB Oracle Solaris OS Enter. GRUB. 3 65

66 GNU GRUB version 0.95 (631K lower / K upper memory) Solaris 10 /sol_10_x86 Solaris failsafe Use the ^ and v keys to select which entry is highlighted. Press enter to boot the selected OS, e to edit the commands before booting, or c for a command-line.. GRUB System Administration Guide: Basic Administration Booting an x86 Based System by Using GRUB (Task Map).. phys-schost# clzonecluster boot zoneclustername. 5. clnode status. phys-schost# clnode status clzonecluster status. phys-schost# clzonecluster status cluster status. /var Oracle Solaris Cluster. 81 /var. 3 5 sparse-sczone. clzonecluster reboot. phys-schost# clzonecluster halt sparse-sczone Waiting for zone halt commands to complete on all the nodes of the zone cluster "sparse-sczone"... Sep 5 19:17:46 schost-4 cl_runtime: NOTICE: Membership : Node 4 of cluster sparse-sczone died. 66 Oracle Solaris Cluster , A

67 Sep 5 19:17:46 schost-4 cl_runtime: NOTICE: Membership : Node 2 of cluster sparse-sczone died. Sep 5 19:17:46 schost-4 cl_runtime: NOTICE: Membership : Node 1 of cluster sparse-sczone died. Sep 5 19:17:46 schost-4 cl_runtime: NOTICE: Membership : Node 3 of cluster sparse-sczone died. phys-schost# phys-schost# clzonecluster boot sparse-sczone Waiting for zone boot commands to complete on all the nodes of the zone cluster "sparse-sczone"... phys-schost# Sep 5 19:18:23 schost-4 cl_runtime: NOTICE: Membership : Node 1 of cluster sparse-sczone joined. Sep 5 19:18:23 schost-4 cl_runtime: NOTICE: Membership : Node 2 of cluster sparse-sczone joined. Sep 5 19:18:23 schost-4 cl_runtime: NOTICE: Membership : Node 3 of cluster sparse-sczone joined. Sep 5 19:18:23 schost-4 cl_runtime: NOTICE: Membership : Node 4 of cluster sparse-sczone joined. phys-schost# phys-schost# clzonecluster status === Zone Clusters === --- Zone Cluster Status --- Name Node Name Zone HostName Status Zone Status sparse-sczone schost-1 sczone-1 Online Running schost-2 sczone-2 Online Running schost-3 sczone-3 Online Running schost-4 sczone-4 Online Running phys-schost# 3 6 SPARC: ok. -g 0 0, -y yes.. phys-schost# cluster shutdown -g0 -y Wed Mar 10 13:47:32 phys-schost-1 cl_runtime: WARNING: CMM monitoring disabled. phys-schost-1# INIT: New run level: 0 The system is coming down. Please wait.... The system is down. syncing file systems... done Program terminated ok boot Rebooting with command: boot... Hostname: phys-schost-1 Booting as part of a cluster... NOTICE: Node phys-schost-1: attempting to join cluster... NOTICE: Node phys-schost-2 (incarnation # ) has become reachable. NOTICE: Node phys-schost-3 (incarnation # ) has become reachable. NOTICE: cluster has reached quorum. 3 67