Oracle Solaris 11.1 : ZFS : E36657 02 2012 11
Copyright 2006, 2012, Oracle and/or its affiliates. All rights reserved.,.,,,,,,,,,,,,.,...,. U.S. GOVERNMENT END USERS: Oracle programs, including any operating system, integrated software, any programs installed on the hardware, and/or documentation, delivered to U.S. Government end users are "commercial computer software" pursuant to the applicable Federal Acquisition Regulation and agency-specific supplemental regulations. As such, use, duplication, disclosure, modification, and adaptation of the programs, including any operating system, integrated software, any programs installed on the hardware, and/or documentation, shall be subject to license terms and license restrictions applicable to the programs. No other rights are granted to the U.S. Government..., -,,. Oracle Corporation. Oracle Java Oracle Corporation /.. Intel Intel Xeon Intel Corporation. SPARC SPARC International, Inc.. AMD, Opteron, AMD, AMD Opteron Advanced Micro Devices. UNIX The Open Group. ( ) 3,. Oracle Corporation 3,. Oracle Corporation 3,,. 121210@25097
...11 1 Oracle Solaris ZFS ( )... 15 ZFS... 15 ZFS... 16 ZFS... 16 var... 17 EFI(GPT)... 17 ZFS... 18 ZFS... 18 ZFS (zfs.1m)... 19 aclmode... 19... 20 ZFS... 20 ZFS... 21 ZFS... 21 ZFS (zfs diff)...21 ZFS... 22 ZFS... 22 ZFS... 23 ZFS ACL... 24 ZFS (zpool split)...25 ZFS iscsi... 25 ZFS... 25 ZFS... 26 Oracle Solaris ZFS?... 26 ZFS... 26... 27 3
... 27... 28 ZFS... 28... 28 ZFS... 29 ZFS... 30 Oracle Solaris ZFS... 31 ZFS... 31 ZFS... 31 ZFS... 33... 33 NFSv4 Solaris ACL... 34 2 Oracle Solaris ZFS...35 ZFS... 35 ZFS... 36 ZFS... 36 ZFS... 37 ZFS... 37 ZFS... 38 ZFS... 38 ZFS... 39 ZFS... 39 3 Oracle Solaris ZFS... 43 ZFS... 43 ZFS... 43 ZFS... 45 ZFS... 46 ZFS... 46 ZFS... 47... 47 RAID-Z... 48 ZFS... 49... 49 4 Oracle Solaris 11.1 : ZFS 2012 11
... 49 ZFS... 50 ZFS... 50... 56 ZFS... 57 ZFS... 59 ZFS... 60... 61... 65 ZFS... 67... 70... 72... 73... 75 ZFS... 80 ZFS... 83 ZFS... 83 ZFS I/O... 87 ZFS... 90 ZFS... 95 ZFS... 95 ZFS... 95... 96 ZFS... 98 ZFS... 98 ZFS... 101 ZFS... 103 4 ZFS... 107 ZFS ( )... 107 ZFS... 108 ZFS... 109 ZFS... 109 ZFS... 110 BE... 111 5
(SPARC x86/vtoc)... 112 (x86/efi(gpt))... 113 ZFS (SPARC x86/vtoc)... 115 ZFS (x86/efi(gpt))... 117 BE (SPARC x86/vtoc)... 119 BE (x86/efi(gpt))... 120 ZFS... 121 ZFS... 122 ZFS... 123 ZFS... 124 ZFS... 124 SPARC ZFS... 126 x86 ZFS... 127 ZFS... 128 5 Oracle Solaris ZFS... 133 ZFS ( )... 133 ZFS,... 134 ZFS... 134 ZFS... 135 ZFS... 136 ZFS... 137 ZFS... 149 ZFS... 150 ZFS... 156 ZFS... 157 ZFS... 157 ZFS... 158 ZFS... 160 ZFS... 160 ZFS... 161 ZFS... 162 ZFS... 165 ZFS... 165 ZFS... 167 6 Oracle Solaris 11.1 : ZFS 2012 11
... 168 ZFS... 169 ZFS... 170 ZFS... 171 ZFS... 171 ZFS /... 177 ZFS... 178 ZFS... 179 ZFS... 180 ZFS... 183 ZFS... 185 ZFS... 187 ZFS... 189 ZFS... 189 ZFS,... 190 ZFS... 190 ZFS... 192 ZFS... 193 ZFS... 195 ZFS... 195 6 Oracle Solaris ZFS... 197 ZFS... 197 ZFS... 198 ZFS... 201 ZFS... 202 ZFS (zfs diff)... 203 ZFS... 204 ZFS... 205 ZFS... 205 ZFS ZFS... 205 ZFS... 206 ZFS... 207 ZFS... 207 ZFS... 209 7
ZFS... 210 ZFS... 211 ZFS... 213 ZFS... 216 7 ACL Oracle Solaris ZFS...217 Solaris ACL... 217 ACL... 218 ACL... 222 ACL... 223 ZFS ACL... 224 Verbose ZFS ACL... 226 Verbose ZFS ACL... 231 Compact ZFS ACL... 236 ZFS... 242 8 Oracle Solaris ZFS...245 ZFS... 245 ZFS... 246 ZFS... 246 ZFS (zfs allow)... 249 ZFS (zfs unallow)... 249 ZFS ( )... 250 ZFS ( )... 254 ZFS ( )... 255 9 Oracle Solaris ZFS...257 ZFS... 257 ZFS... 258 ZFS iscsi LUN... 259 Solaris ZFS... 260 ZFS... 261... 261 ZFS... 262 8 Oracle Solaris 11.1 : ZFS 2012 11
ZFS... 263 ZFS... 263 zoned... 264... 265 ZFS... 265 ZFS... 266... 266 10 Oracle Solaris ZFS... 267 ZFS... 267 ZFS... 267 ZFS... 268 ZFS... 269 ZFS... 269 ZFS... 270 ZFS... 270 ZFS... 270... 270... 271 ZFS... 271 ZFS... 273 ZFS... 274 zpool status... 274 ZFS... 277 ZFS... 278... 278... 281 ZFS... 281... 282... 282... 283 ZFS... 284... 291... 292... 293 9
ZFS... 294... 296 11... 297 ZFS... 297 ZFS... 298 ZFS... 298 ZFS... 299... 300... 300 12 Oracle Solaris ZFS...305... 305... 305 ZFS... 306... 310 ZFS... 310... 312... 312 ZFS... 312 A Oracle Solaris ZFS...315 ZFS... 315 ZFS... 315 ZFS... 317... 319 10 Oracle Solaris 11.1 : ZFS 2012 11
Oracle Solaris 11.1 ZFS Oracle Solaris ZFS. SPARC x86. Oracle Solaris SPARC x86. http://www.oracle.com/webfolder/technetwork/ hcl/index.html Oracle Solaris.. Oracle Solaris ZFS. Oracle Solaris OS( ) UNIX.. 1, Oracle Solaris ZFS ( ) 2, Oracle Solaris ZFS 3, Oracle Solaris ZFS 4, ZFS ZFS.. ZFS. ZFS. ZFS., ZFS, ZFS. 11
5, Oracle Solaris ZFS 6, Oracle Solaris ZFS 7, ACL Oracle Solaris ZFS 8, Oracle Solaris ZFS 9, Oracle Solaris ZFS 10, Oracle Solaris ZFS 11, 12, Oracle Solaris ZFS A, Oracle Solaris ZFS ZFS.,,. ZFS. (ACL) UNIX ZFS. ZFS ZFS. ZFS, Oracle Solaris ZFS,. ZFS... ZFS. ZFS,, ZFS Solaris OS. Oracle Solaris. Oracle Solaris 11.1, Oracle Solaris 11.1 Oracle Solaris 11.1 : Oracle Solaris 11.1 : Oracle Support Oracle My Oracle Support. http://www.oracle.com/pls/topic/lookup?ctx=acc&id=info, http://www.oracle.com/pls/topic/lookup?ctx=acc&id=trs. 12 Oracle Solaris 11.1 : ZFS 2012 11
. P 1 AaBbCc123 AaBbCc123 AaBbCc123 AaBbCc123, ;.. :.,,..login. ls -a. machine_name% you have mail. machine_name% su Password: rm filename. 6... :. Oracle Solaris OS UNIX.. P 2 Bash, Korn Bourne $ Bash, Korn Bourne # C C machine_name% machine_name# 13
14
1 Oracle Solaris ZFS ( ) ZFS Oracle Solaris ZFS... 15 ZFS 26 Oracle Solaris ZFS? 29 ZFS 30 ZFS 31 Oracle Solaris ZFS ZFS. 16 ZFS 16 ZFS 17 var 17 EFI(GPT) 18 ZFS 18 ZFS 19 ZFS (zfs.1m) 19 aclmode 20 20 ZFS 21 ZFS 21 ZFS 21 ZFS (zfs diff) 22 ZFS 22 ZFS 15
ZFS 23 ZFS 24 ZFS ACL 25 ZFS (zpool split) 25 ZFS iscsi 25 ZFS 26 ZFS ZFS Oracle Solaris 11.1: zpool status. zpool status UNAVAIL (c0t5000c500335f907fd0). # zpool status -v pond pool: pond state: DEGRADED status: One or more devices are unavailable in response to persistent errors. Sufficient replicas exist for the pool to continue functioning in a degraded state. action: Determine if the device needs to be replaced, and clear the errors using zpool clear or fmadm repaired, or replace the device with zpool replace. scan: scrub repaired 0 in 0h0m with 0 errors on Wed Jun 20 15:38:08 2012 config: device details: NAME STATE READ WRITE CKSUM pond DEGRADED 0 0 0 mirror-0 DEGRADED 0 0 0 c0t5000c500335f95e3d0 ONLINE 0 0 0 c0t5000c500335f907fd0 UNAVAIL 0 0 0 mirror-1 ONLINE 0 0 0 c0t5000c500335bd117d0 ONLINE 0 0 0 c0t5000c500335dc60fd0 ONLINE 0 0 0 c0t5000c500335f907fd0 UNAVAIL cannot open status: ZFS detected errors on this device. The device was missing. see: http://support.oracle.com/msg/zfs-8000-lr for recovery errors: No known data errors ZFS Oracle Solaris 11.1: ZFS.. share.nfs share.smb. 16 Oracle Solaris 11.1 : ZFS 2012 11
ZFS. 34. 170 ZFS. var Oracle Solaris 11.1: Oracle Solaris 11.1 /var/share rpool/varshare. /var BE.. # ls /var/share audit cores crash mail /var /var/share. /var. Oracle Solaris 11 Oracle Solaris 11.1 /var /var/share. EFI(GPT) Oracle Solaris 11.1: x86 ZFS EFI(GPT).. # zpool status rpool pool: rpool state: ONLINE scan: none requested config: NAME STATE READ WRITE CKSUM rpool ONLINE 0 0 0 c2t0d0 ONLINE 0 0 0 errors: No known data errors SPARC. x86 EFI(GPT). zpool create -B EFI(GPT) zpool.. 119 BE (SPARC x86/vtoc). 1 Oracle Solaris ZFS ( ) 17
ZFS EFI(GPT) zpool replace. # bootadm install-bootloader Oracle Solaris x86 2TiB. ZFS Oracle Solaris 11: zfs zpool zfs zpool help.. # zfs help The following commands are supported: allow clone create destroy diff get groupspace help hold holds inherit list mount promote receive release rename rollback send set share snapshot unallow unmount unshare upgrade userspace For more info, run: zfs help <command> # zfs help create usage: create [-p] [-o property=value]... <filesystem> create [-ps] [-b blocksize] [-o property=value]... -V <size> <volume> # zpool help The following commands are supported: add attach clear create destroy detach export get help history import iostat list offline online remove replace scrub set split status upgrade For more info, run: zpool help <command> # zpool help attach usage: attach [-f] <pool> <device> <new-device> zfs(1m) zpool(1m). ZFS Oracle Solaris 11: ZFS. zfs snapshot snap.. # zfs snap -r users/home@snap1 zfs diff -e... 18 Oracle Solaris 11.1 : ZFS 2012 11
ZFS # zfs diff -e tank/cindy@yesterday tank/cindy@now + /tank/cindy/ + /tank/cindy/file.1 -o.. # zfs diff -e -o size -o name tank/cindy@yesterday tank/cindy@now + 7 /tank/cindy/ + 206695 /tank/cindy/file.1 ZFS 6, Oracle Solaris ZFS. ZFS (zfs.1m) Oracle Solaris 11: ZFS zfs.1m zfs.1m,,,. zfs_allow(1m) zfs_encrypt(1m) zfs_share(1m) aclmode Oracle Solaris 11: aclmode chmod ACL ACL( ). aclmode. discard aclmode discard ACL.. mask aclmode mask. UID. ACL. ACL ACL. passthrough aclmode passthrough ACL ACL. 7 14. 1 Oracle Solaris ZFS ( ) 19
ZFS Oracle Solaris 11: Solaris zpool status -l /dev/chassis.,. fmadm add-alias.. # fmadm add-alias SUN-Storage-J4400.0912QAJ001 SUN-Storage-J4400.rack22. % zpool status -l export pool: export state: ONLINE scan: resilvered 492G in 8h22m with 0 errors on Wed Aug 1 17:22:11 2012 config: NAME STATE READ WRITE CKSUM export ONLINE 0 0 0 mirror-0 ONLINE 0 0 0 /dev/chassis/sun-storage-j4400.rack22/scsi_device 2/disk ONLINE 0 0 0 /dev/chassis/sun-storage-j4400.rack22/scsi_device 3/disk ONLINE 0 0 0 mirror-1 ONLINE 0 0 0 /dev/chassis/sun-storage-j4400.rack22/scsi_device 4/disk ONLINE 0 0 0 /dev/chassis/sun-storage-j4400.rack22/scsi_device 5/disk ONLINE 0 0 0 mirror-2 ONLINE 0 0 0 /dev/chassis/sun-storage-j4400.rack22/scsi_device 6/disk ONLINE 0 0 0 /dev/chassis/sun-storage-j4400.rack22/scsi_device 7/disk ONLINE 0 0 0 mirror-3 ONLINE 0 0 0 /dev/chassis/sun-storage-j4400.rack22/scsi_device 8/disk ONLINE 0 0 0 /dev/chassis/sun-storage-j4400.rack22/scsi_device 9/disk ONLINE 0 0 0 mirror-4 ONLINE 0 0 0 /dev/chassis/sun-storage-j4400.rack22/scsi_device 10/disk ONLINE 0 0 0 /dev/chassis/sun-storage-j4400.rack22/scsi_device 11/disk ONLINE 0 0 0 spares /dev/chassis/sun-storage-j4400.rack22/scsi_device 0/disk AVAIL /dev/chassis/sun-storage-j4400.rack22/scsi_device 1/disk AVAIL errors: No known data errors zpool iostat. diskinfo, format prtconf. diskinfo(1m). ZFS Oracle Solaris 11:. 20 Oracle Solaris 11.1 : ZFS 2012 11
ZFS ZFS shadow. shadow. file:///path nfs://host:path 192 ZFS. ZFS Oracle Solaris 11: ZFS., tank/cindy encryption.. 8. # zfs create -o encryption=on tank/cindy Enter passphrase for tank/cindy : xxx Enter again: xxx ZFS.. 185 ZFS. ZFS Oracle Solaris 11:. mountpoint. 211 ZFS. ZFS (zfs diff) Oracle Solaris 11: zfs diff ZFS.,. $ ls /tank/cindy filea $ zfs snapshot tank/cindy@0913 1 Oracle Solaris ZFS ( ) 21
ZFS $ ls /tank/cindy filea fileb $ zfs snapshot tank/cindy@0914,. $ zfs diff tank/cindy@0913 tank/cindy@0914 M /tank/cindy/ + /tank/cindy/fileb M. + fileb. 203 ZFS (zfs diff). ZFS Oracle Solaris 11: ZFS. zpool import -m. 99.... 100. RAID-Z(raidz1, raidz2 raidz3) I/O. 29 RAID-Z. RAID-Z. RAID-Z.. ZFS Oracle Solaris 11: sync ZFS.... sync... 22 Oracle Solaris 11.1 : ZFS 2012 11
ZFS # zfs set sync=always tank/neil zil_disable sync Oracle Solaris. 5 1. ZFS Oracle Solaris 11: -T zpool list zpool status. zpool status... scan: resilver in progress since Thu Jun 7 14:41:11 2012 3.83G scanned out of 73.3G at 106M/s, 0h11m to go 3.80G resilvered, 5.22% done.. scan: scrub in progress since Thu Jun 7 14:59:25 2012 1.95G scanned out of 73.3G at 118M/s, 0h10m to go 0 repaired, 2.66% done.. resilvered 73.3G in 0h13m with 0 errors on Thu Jun 7 14:54:16 2012.. scan: scrub repaired 512B in 1h2m with 0 errors on Thu Jun 7 15:10:32 2012.. scan: scrub canceled on Thu Jun 7 15:19:20 MDT 2012.. -T d -T u. # zpool status -T d tank 3 2 Thu Jun 14 14:08:21 MDT 2012 pool: tank state: DEGRADED status: One or more devices is currently being resilvered. The pool will continue to function in a degraded state. action: Wait for the resilver to complete. Run zpool status -v to see device specific details. scan: resilver in progress since Thu Jun 14 14:08:05 2012 1 Oracle Solaris ZFS ( ) 23
ZFS 2.96G scanned out of 4.19G at 189M/s, 0h0m to go 1.48G resilvered, 70.60% done config: NAME STATE READ WRITE CKSUM tank DEGRADED 0 0 0 mirror-0 ONLINE 0 0 0 c0t5000c500335f95e3d0 ONLINE 0 0 0 c0t5000c500335f907fd0 ONLINE 0 0 0 mirror-1 DEGRADED 0 0 0 c0t5000c500335bd117d0 ONLINE 0 0 0 c0t5000c500335dc60fd0 DEGRADED 0 0 0 (resilvering) errors: No known data errors ZFS ACL Oracle Solaris 11: ACL. ACL deny ACE( )., 0644, 0755 0664 deny ACE 0705, 0060 deny ACE. ACL( : 644) deny ACE.. # ls -v file.1 -rw-r--r-- 1 root root 206663 Jun 14 11:52 file.1 0:owner@:execute:deny 1:owner@:read_data/write_data/append_data/write_xattr/write_attributes /write_acl/write_owner:allow 2:group@:write_data/append_data/execute:deny 3:group@:read_data:allow 4:everyone@:write_data/append_data/write_xattr/execute/write_attributes /write_acl/write_owner:deny 5:everyone@:read_data/read_xattr/read_attributes/read_acl/synchronize :allow ACL( : 644) deny ACE.. # ls -v file.1 -rw-r--r-- 1 root root 206663 Jun 22 14:30 file.1 0:owner@:read_data/write_data/append_data/read_xattr/write_xattr /read_attributes/write_attributes/read_acl/write_acl/write_owner /synchronize:allow 1:group@:read_data/read_xattr/read_attributes/read_acl/synchronize:allow 2:everyone@:read_data/read_xattr/read_attributes/read_acl/synchronize :allow ACL ACE.,. aclinherit restricted.,acl ACE. 24 Oracle Solaris 11.1 : ZFS 2012 11
ZFS ACL chmod(2). ZFS aclmode.,acl user ACE. group ACE. 7, ACL Oracle Solaris ZFS. ZFS (zpool split) Oracle Solaris 11: zpool split.. 67 ZFS. ZFS iscsi Oracle Solaris 11: iscsi COMSTAR(Common Multiprotocol SCSI Target). ZFS iscsi LUN shareiscsi. ZFS iscsi LUN stmfadm. 259 ZFS iscsi LUN. ZFS Oracle Solaris 11: ZFS zpool-poolname. I/O I/O. CPU. ps prstat.. SDC(7). 1 Oracle Solaris ZFS ( ) 25
Oracle Solaris ZFS? ZFS Oracle Solaris 11: (dedup) ZFS. dedup.,.. # zfs set dedup=on tank/home.,. # zpool list tank NAME SIZE ALLOC FREE CAP DEDUP HEALTH ALTROOT tank 556G 4.19G 552G 0% 1.00x ONLINE - zpool list. 154 dedup. dedup.... 154 dedup. Oracle Solaris ZFS? Oracle Solaris ZFS. ZFS,,. ZFS ZFS.... 26 Oracle Solaris 11.1 : ZFS 2012 11
Oracle Solaris ZFS? ZFS. ZFS. (, )..... DIMM.. ZFS.,..,. fsck.., fsck..,.,..,... (O_DSYNC ). ZFS... ZFS 1 Oracle Solaris ZFS ( ) 27
Oracle Solaris ZFS?.. ZFS. ZFS. ZFS. ZFS. 128, 256. inode.. 2 48 (256 ). ZFS..... ZFS.,, NFS ZFS.,,... ZFS,,..,,.. 28 Oracle Solaris 11.1 : ZFS 2012 11
ZFS ZFS. ZFS Oracle Solaris.. 256. fletcher4( ) SHA256. clone. 204 ZFS.,, ZFS. ZFS.. pool/path[ @snapshot] pool. path. snapshot. 5, Oracle Solaris ZFS. filesystem ZFS. 5, Oracle Solaris ZFS..... 1 Oracle Solaris ZFS ( ) 29
ZFS RAID-Z snapshot volume 3, Oracle Solaris ZFS.. RAID-Z 48 RAID-Z..,.. ZFS 289.. 197 ZFS.,. 56.. ZFS. ZFS 257 ZFS. ZFS ZFS.. (_) (-) (:) (.), (_), (-) (.).. c[0-9]. log. 30 Oracle Solaris 11.1 : ZFS 2012 11
Oracle Solaris ZFS mirror, raidz, raidz1, raidz2, raidz3 spare. (%).. (%).. Oracle Solaris ZFS 31 ZFS 31 ZFS 33 ZFS 33 34 NFSv4 Solaris ACL ZFS,... ZFS. ZFS. ( : /export/home).. 38 ZFS. ZFS ZFS., ZFS. 1 Oracle Solaris ZFS ( ) 31
Oracle Solaris ZFS ( : df).. 180 ZFS.. 183 ZFS. ( : /home) NFS. ZFS,.,. ZFS. ZFS df -g. total files. ZFS...,.. fsync(3c) O_SYNC. UFS du. ZFS du.. " ". ZFS UFS. df zfs list df. df., ZFS df.. recordsize 1/2. recordsize 128KB 64KB. RFE 6812608.. 0. 32 Oracle Solaris 11.1 : ZFS 2012 11
Oracle Solaris ZFS RAIDZ-2 2 (512 ).. recordsize 512, 512 1.5KB( 3 ). recordsize (128KB) ( lzjb). df. ZFS. ZFS. ZFS 6, Oracle Solaris ZFS......, ENOSPC EDQUOT. ZFS ZFS., /etc/vfstab. ZFS. /etc/vfstab ZFS. ZFS 165 ZFS. 26 ZFS ZFS Volume Manager. ZFS. ZFS 1 Oracle Solaris ZFS ( ) 33
Oracle Solaris ZFS.. NFSv4 Solaris ACL Solaris OS POSIX ACL ACL. POSIX ACL UFS. NFSv4 Solaris ACL ZFS. Solaris ACL. NFSv4 NT ACL.. ACL setfacl getfacl chmod ls.. ZFS ACL 7, ACL Oracle Solaris ZFS. 34 Oracle Solaris 11.1 : ZFS 2012 11
2 2 Oracle Solaris ZFS Oracle Solaris ZFS. ZFS... 35 ZFS 36 ZFS 36 ZFS 37 ZFS 38 ZFS ZFS ( ) ZFS ZFS. ZFS ZFS,. ZFS ZFS,. Oracle Solaris 11.1 :. ZFS RBAC, ZFS ZFS. 8, Oracle Solaris ZFS. 35
ZFS ZFS ZFS. Oracle Solaris SPARC x86. 64MB. 128MB. ZFS.. ZFS ZFS.., ZFS. tank tank ZFS. /dev/dsk/c1t0d0 /dev/dsk/c2t0d0. # zpool create tank mirror c1t0d0 c2t0d0 ZFS 47 ZFS. ZFS tank /tank. # mkfile 100m /tank/foo # df -h /tank Filesystem size used avail capacity Mounted on tank 80G 100M 80G 1% /tank.. tank fs. # zfs create tank/fs ZFS tank/fs /tank/fs. 36 Oracle Solaris 11.1 : ZFS 2012 11
ZFS # mkfile 100m /tank/fs/foo # df -h /tank/fs Filesystem size used avail capacity Mounted on tank/fs 80G 100M 80G 1% /tank/fs. ZFS 38 ZFS. ZFS ZFS.... 1 2 ZFS.. 128MB. ZFS. 38 ZFS /dev/dsk/c1t0d0 /dev/dsk/c2t0d0. 43 ZFS.. ZFS. ZFS ( ) RAID-Z(RAID-5 ). 38 ZFS. ZFS 47 ZFS. 2 Oracle Solaris ZFS 37
ZFS 1 2 3 4 ZFS ZFS. ZFS 35 ZFS.. zpool zfs.., 30 ZFS.., tank. # zpool create tank mirror c1t0d0 c2t0d0. 50 ZFS. 57.. zpool list. # zpool list NAME SIZE ALLOC FREE CAP HEALTH ALTROOT tank 80G 137K 80G 0% ONLINE - 83 ZFS. ZFS.,. ZFS.. ZFS. 38 Oracle Solaris 11.1 : ZFS 2012 11
ZFS 1 2 3 ZFS. ZFS,..,. 39 ZFS ZFS jeff bill. 5, Oracle Solaris ZFS.. ZFS... 39 ZFS home...,,,. 39 ZFS /export/zfs/ user NFS. jeff 10GB. 137 ZFS. 1 2 ZFS ZFS. ZFS 35 ZFS... # zfs create tank/home 2 Oracle Solaris ZFS 39
ZFS 3.. # zfs set mountpoint=/export/zfs tank/home # zfs set share.nfs=on tank/home # zfs set compression=on tank/home # zfs get compression tank/home NAME PROPERTY VALUE SOURCE tank/home compression on local.. # zfs create -o mountpoint=/export/zfs -o share.nfs=on -o compression=on tank/home 137 ZFS. tank home. 4. home.. # zfs create tank/home/jeff # zfs create tank/home/bill /export/zfs/ user NFS. /etc/vfstab /etc/dfs/dfstab. 134 ZFS. 165 ZFS. 5 6. jeff 10GB.. # zfs set quota=10g tank/home/jeff. zfs list. # zfs list NAME USED AVAIL REFER MOUNTPOINT tank 92.0K 67.0G 9.5K /tank tank/home 24.0K 67.0G 8K /export/zfs tank/home/bill 8K 67.0G 8K /export/zfs/bill tank/home/jeff 8K 10.0G 8K /export/zfs/jeff jeff 10GB, bill (67GB). 40 Oracle Solaris 11.1 : ZFS 2012 11
ZFS 157 ZFS. 31 ZFS. 2 Oracle Solaris ZFS 41
42
3 3 Oracle Solaris ZFS Oracle Solaris ZFS.. 43 ZFS 47 ZFS 50 ZFS 60 ZFS 80 ZFS 83 ZFS 95 ZFS 103 ZFS ZFS. 43 ZFS 45 ZFS 46 ZFS ZFS. 128MB. /dev/dsk. (c1t0d0) (c0t0d0s7)., 43
ZFS. ZFS EFI. format. Current partition table (original): Total disk sectors available: 143358287 + 16384 (reserved sectors) Part Tag Flag First Sector Size Last Sector 0 usr wm 256 68.36GB 143358320 1 unassigned wm 0 0 0 2 unassigned wm 0 0 0 3 unassigned wm 0 0 0 4 unassigned wm 0 0 0 5 unassigned wm 0 0 0 6 unassigned wm 0 0 0 8 reserved wm 143358321 8.00MB 143374704 Oracle Solaris 11.1 EFI(GPT) x86. Current partition table (original): Total disk sectors available: 27246525 + 16384 (reserved sectors) Part Tag Flag First Sector Size Last Sector 0 BIOS_boot wm 256 256.00MB 524543 1 usr wm 524544 12.74GB 27246558 2 unassigned wm 0 0 0 3 unassigned wm 0 0 0 4 unassigned wm 0 0 0 5 unassigned wm 0 0 0 6 unassigned wm 0 0 0 8 reserved wm 27246559 8.00MB 27262942 0(BIOS boot) GPT. 8. 1. ZFS. /dev/dsk/cntndn. /dev/dsk. ZFS. x86 Solaris fdisk. Solaris fdisk Oracle Solaris 11.1 : ZFS ( ). ZFS EFI. EFI Oracle Solaris 11.1 : EFI(GPT). 44 Oracle Solaris 11.1 : ZFS 2012 11
ZFS Oracle Solaris 11.1 x86 EFI(GPT). 108 ZFS. ( : /dev/dsk/c1t0d0) /dev/dsk ( : c1t0d0).,. c1t0d0 /dev/dsk/c1t0d0 /dev/foo/disk ZFS Solaris VTOC(SMI). format SPARC 72GB 68GB 0. # format... Specify disk (enter its number): 4 selecting c1t1d0 partition> p Current partition table (original): Total disk cylinders available: 14087 + 2 (reserved cylinders) Part Tag Flag Cylinders Size Blocks 0 root wm 0-14086 68.35GB (14087/0/0) 143349312 1 unassigned wm 0 0 (0/0/0) 0 2 backup wm 0-14086 68.35GB (14087/0/0) 143349312 3 unassigned wm 0 0 (0/0/0) 0 4 unassigned wm 0 0 (0/0/0) 0 5 unassigned wm 0 0 (0/0/0) 0 6 unassigned wm 0 0 (0/0/0) 0 7 unassigned wm 0 0 (0/0/0) 0 format x86 72GB 68GB 0. 8. 8. # format... selecting c1t0d0 3 Oracle Solaris ZFS 45
ZFS partition> p Current partition table (original): Total disk cylinders available: 49779 + 2 (reserved cylinders) Part Tag Flag Cylinders Size Blocks 0 root wm 1-49778 68.36GB (49778/0/0) 143360640 1 unassigned wu 0 0 (0/0/0) 0 2 backup wm 0-49778 68.36GB (49779/0/0) 143363520 3 unassigned wu 0 0 (0/0/0) 0 4 unassigned wu 0 0 (0/0/0) 0 5 unassigned wu 0 0 (0/0/0) 0 6 unassigned wu 0 0 (0/0/0) 0 7 unassigned wu 0 0 (0/0/0) 0 8 boot wu 0-0 1.41MB (1/0/0) 2880 9 unassigned wu 0 0 (0/0/0) 0 x86 fdisk. fdisk /dev/dsk/cn[tn]dnpn,. ZFS cn[tn]dnpn. ZFS ZFS.. UFS ZFS UFS. ZFS ZFS. ZFS. 64MB. ZFS ZFS. ZFS., RAID LUN, ZFS. ZFS. RAID LUN ZFS ZFS.,. 46 Oracle Solaris 11.1 : ZFS 2012 11
ZFS ZFS.. ZFS. 12, Oracle Solaris ZFS. ID ( ). ID ZFS. ID. ZFS ID. ZFS ZFS RAID-Z. 47 48 RAID-Z 49 49 49 ZFS.... mirror c1t0d0 c2t0d0. mirror c1t0d0 c2t0d0 c3t0d0 mirror c4t0d0 c5t0d0 c6t0d0 50. 3 Oracle Solaris ZFS 47
ZFS RAID-Z ZFS, RAID-Z. RAID-Z(raidz raidz1) RAID-5. RAID-Z(raidz2) RAID-6. RAIDZ-3(raidz3). http://blogs.oracle.com/ahl/entry/triple_parity_raid_z RAID-5 ( : RAID-4, RAID-6, RDP EVEN-ODD) RAID-5. RAID-5 ( ). RAID-Z ZFS RAID. RAID ZFS. RAID-Z RAID-5. X N P RAID-Z (N-P)*X P. RAID-Z 2, RAID-Z 3., RAID-Z 3 3. RAID-Z. 3 RAID-Z. raidz c1t0d0 c2t0d0 c3t0d0 RAID-Z. raidz c1t0d0 c2t0d0 c3t0d0 c4t0d0 c5t0d0 c6t0d0 c7t0d0 raidz c8t0d0 c9t0d0 c10t0d0 c11t0d0c12t0d0 c13t0d0 c14t0d0 RAID-Z.,14 RAID-Z 7. RAID-Z. RAID-Z 52 RAID-Z. RAID-Z. 48 Oracle Solaris 11.1 : ZFS 2012 11
ZFS http://blogs.oracle.com/roch/entry/when_to_and_not_to RAID-Z 12, Oracle Solaris ZFS. ZFS Oracle Sun Storage 7000 ZFS DRAM, SSD HDD. ZFS. Sun Storage Unified Storage System Administration Guide. ZFS RAID-Z. ZFS. ZFS.. ZFS. RAID-Z..,4. 4 1 RAID-Z 2 ZFS., RAID-Z. RAID-Z.. 3 Oracle Solaris ZFS 49
ZFS ZFS ZFS. 50 ZFS 56 57 ZFS 59 ZFS.. ZFS.. zpool destroy.. ZFS zpool create.. 30 ZFS. c1t0d0 c1t1d0 tank. # zpool create tank c1t0d0 c1t1d0 /dev/dsk, ZFS.. mirror. mirror. 2. # zpool create tank mirror c1d0 c2d0 mirror c3d0 c4d0 mirror.,. 12, Oracle Solaris ZFS. ZFS. 50 Oracle Solaris 11.1 : ZFS 2012 11
ZFS (vdev). 61... 65. ( ). 73. ( ). 65.. 67 ZFS.,. ZFS. Oracle Solaris 11.1 x86 EFI(GPT), SPARC SMI(VTOC). Oracle Solaris 11.1 EFI(GPT). ZFS EFI(GPT). # zpool create -B rpool2 c1t0d0. zpool add, zpool attach. RAID-Z... ERROR: ZFS pool <pool-name> does not support boot environments # zpool add -f rpool log c0t6d0s0 cannot add to rpool : root pool can not have multiple vdevs or separate logs ZFS 4, ZFS. 3 Oracle Solaris ZFS 51
ZFS RAID-Z RAID-Z raidz raidz1 mirror. 5 RAID-Z. # zpool create tank raidz c1t0d0 c2t0d0 c3t0d0 c4t0d0 /dev/dsk/c5t0d0. /dev/dsk/c5t0d0 c5t0d0. raidz2 raidz3 RAID-Z. : # zpool create tank raidz2 c1t0d0 c2t0d0 c3t0d0 c4t0d0 c5t0d0 # zpool status -v tank pool: tank state: ONLINE scrub: none requested config: NAME STATE READ WRITE CKSUM tank ONLINE 0 0 0 raidz2-0 ONLINE 0 0 0 c1t0d0 ONLINE 0 0 0 c2t0d0 ONLINE 0 0 0 c3t0d0 ONLINE 0 0 0 c4t0d0 ONLINE 0 0 0 c5t0d0 ONLINE 0 0 0 errors: No known data errors # zpool create tank raidz3 c0t0d0 c1t0d0 c2t0d0 c3t0d0 c4t0d0 c5t0d0 c6t0d0 c7t0d0 c8t0d0 # zpool status -v tank pool: tank state: ONLINE scrub: none requested config: NAME STATE READ WRITE CKSUM tank ONLINE 0 0 0 raidz3-0 ONLINE 0 0 0 c0t0d0 ONLINE 0 0 0 c1t0d0 ONLINE 0 0 0 c2t0d0 ONLINE 0 0 0 c3t0d0 ONLINE 0 0 0 c4t0d0 ONLINE 0 0 0 c5t0d0 ONLINE 0 0 0 c6t0d0 ONLINE 0 0 0 c7t0d0 ONLINE 0 0 0 c8t0d0 ONLINE 0 0 0 errors: No known data errors ZFS RAID-Z. 52 Oracle Solaris 11.1 : ZFS 2012 11
ZFS RAID-Z. 61. RAID-Z ( ). 73. RAID-Z. RAID-Z RAID-Z ( ) RAID-Z. RFE. RAID-Z 48 RAID-Z. ZFS POSIX ZIL(ZFS ).,. NFS fsync(). ZIL. NVRAM. ZFS. ZFS.,.. http://blogs.oracle.com/perrin/entry/slog_blog_or_blogging_on RAID-Z..,,,,,... (64MB). in-play. ( ). 3 Oracle Solaris ZFS 53
ZFS in-play 1/2. 16GB 8GB. ZFS.. # zpool create datap mirror c0t5000c500335f95e3d0 c0t5000c500335f907fd0 mirror c0t5000c500335bd117d0 c0t5000c500335dc60fd0 log mirror c0t5000c500335e106bd0 c0t5000c500335fc3e7d0 # zpool status datap pool: datap state: ONLINE scrub: none requested config: NAME STATE READ WRITE CKSUM datap ONLINE 0 0 0 mirror-0 ONLINE 0 0 0 c0t5000c500335f95e3d0 ONLINE 0 0 0 c0t5000c500335f907fd0 ONLINE 0 0 0 mirror-1 ONLINE 0 0 0 c0t5000c500335bd117d0 ONLINE 0 0 0 c0t5000c500335dc60fd0 ONLINE 0 0 0 logs mirror-2 ONLINE 0 0 0 c0t5000c500335e106bd0 ONLINE 0 0 0 c0t5000c500335fc3e7d0 ONLINE 0 0 0 errors: No known data errors 10 2. ZFS... : # zpool create tank mirror c2t0d0 c2t1d0 c2t3d0 cache c2t5d0 c2t8d0 # zpool status tank pool: tank state: ONLINE scrub: none requested config: NAME STATE READ WRITE CKSUM tank ONLINE 0 0 0 mirror-0 ONLINE 0 0 0 c2t0d0 ONLINE 0 0 0 c2t1d0 ONLINE 0 0 0 54 Oracle Solaris 11.1 : ZFS 2012 11
ZFS c2t3d0 ONLINE 0 0 0 cache c2t5d0 ONLINE 0 0 0 c2t8d0 ONLINE 0 0 0 errors: No known data errors. 1. zpool iostat. # zpool iostat -v pool 5. ZFS.. zpool iostat... 3 4. RAID-Z. I/O RAID-Z.. ZFS.. OS. ( : )..... ZFS (RAIDZ ).. ZFS,... 3 Oracle Solaris ZFS 55
ZFS. ZFS.... ( vdev ). RAID-Z.,.. 2. # zpool create tank mirror c1d0 c2d0 mirror c3d0 c4d0 4. # zpool create mypool raidz2 c1d0 c2d0 c3d0 c4d0 zpool add.. # zpool add mypool raidz2 c2d1 c3d1 c4d1 c5d1,.. ZFS. ZFS zpool status.. # zpool status tank pool: tank state: ONLINE scrub: none requested config: NAME STATE READ WRITE CKSUM tank ONLINE 0 0 0 mirror-0 ONLINE 0 0 0 c0t1d0 ONLINE 0 0 0 c1t1d0 ONLINE 0 0 0 mirror-1 ONLINE 0 0 0 56 Oracle Solaris 11.1 : ZFS 2012 11
ZFS c0t2d0 ONLINE 0 0 0 c1t2d0 ONLINE 0 0 0 mirror-2 ONLINE 0 0 0 c0t3d0 ONLINE 0 0 0 c1t3d0 ONLINE 0 0 0 errors: No known data errors ZFS.,. ZFS ZFS.. # zpool create tank c1t0d0 c1t1d0 invalid vdev specification use -f to override the following errors: /dev/dsk/c1t0d0s0 is currently mounted on /. Please see umount(1m). /dev/dsk/c1t0d0s1 is currently mounted on swap. Please see swap(1m). /dev/dsk/c1t1d0s0 is part of active ZFS pool zeepool. Please see zpool(1m). -f,. -f. /etc/vfstab ZFS. umount. /etc/vfstab,. /etc/vfstab.. dumpadm. ZFS. zpool destroy ( ). zpool detach.. -f. 3 Oracle Solaris ZFS 57
ZFS ZFS. Solaris Volume Manager.... -f. # zpool create tank c1t0d0 invalid vdev specification use -f to override the following errors: /dev/dsk/c1t0d0s0 contains a ufs filesystem. # zpool create -f tank c1t0d0 -f.. zpool.. # zpool create tank c1t0d0 mirror c2t0d0 c3t0d0 invalid vdev specification use -f to override the following errors: mismatched replication level: both disk and mirror vdevs are present # zpool create tank mirror c1t0d0 c2t0d0 mirror c3t0d0 c4t0d0 c5t0d0 invalid vdev specification use -f to override the following errors: mismatched replication level: 2-way mirror and 3-way mirror vdevs are present -f,. RAID-Z.,. -f. Dry Run,. zpool create -n. dry run.. 58 Oracle Solaris 11.1 : ZFS 2012 11
ZFS # zpool create -n tank mirror c1t0d0 c1t1d0 would create tank with the following layout: tank mirror c1t0d0 c1t1d0.. zpool create -n,. /pool-name.... zpool create -m. : # zpool create home c1t0d0 default mountpoint /home exists and is not empty use -m option to provide a different default # zpool create -m /export/zfs home c1t0d0 /export/zfs home home. 165 ZFS. ZFS zpool destroy.. # zpool destroy tank... 101 ZFS. zpool destroy 101 ZFS. 3 Oracle Solaris ZFS 59
ZFS. format analyze->purge. ZFS.. 185 ZFS....... UNAVAIL UNAVAIL ( UNAVAIL ),, -f... # zpool destroy tank cannot destroy tank : pool is faulted use -f to force destruction anyway # zpool destroy -f tank 90 ZFS. 98 ZFS. ZFS 43 ZFS.. 61 65 67 ZFS 70 72 60 Oracle Solaris 11.1 : ZFS 2012 11
ZFS 73 75.. zpool add. : # zpool add zeepool mirror c2t1d0 c2t2d0 zpool create., -f. dry run -n.. # zpool add -n zeepool mirror c3t1d0 c3t2d0 would update zeepool to the following configuration: zeepool mirror c1t0d0 c1t1d0 mirror c2t1d0 c2t2d0 mirror c3t1d0 c3t2d0 c3t1d0 c3t2d0 zeepool. 57. 3 1 ZFS ZFS. # zpool status tank pool: tank state: ONLINE scrub: none requested config: NAME STATE READ WRITE CKSUM tank ONLINE 0 0 0 mirror-0 ONLINE 0 0 0 c0t1d0 ONLINE 0 0 0 c1t1d0 ONLINE 0 0 0 mirror-1 ONLINE 0 0 0 c0t2d0 ONLINE 0 0 0 3 Oracle Solaris ZFS 61
ZFS 3 1 ZFS ( ) c1t2d0 ONLINE 0 0 0 errors: No known data errors # zpool add tank mirror c0t3d0 c1t3d0 # zpool status tank pool: tank state: ONLINE scrub: none requested config: NAME STATE READ WRITE CKSUM tank ONLINE 0 0 0 mirror-0 ONLINE 0 0 0 c0t1d0 ONLINE 0 0 0 c1t1d0 ONLINE 0 0 0 mirror-1 ONLINE 0 0 0 c0t2d0 ONLINE 0 0 0 c1t2d0 ONLINE 0 0 0 mirror-2 ONLINE 0 0 0 c0t3d0 ONLINE 0 0 0 c1t3d0 ONLINE 0 0 0 errors: No known data errors 3 2 RAID-Z RAID-Z. 3 RAID-Z 3 RAID-Z. # zpool status rzpool pool: rzpool state: ONLINE scrub: none requested config: NAME STATE READ WRITE CKSUM rzpool ONLINE 0 0 0 raidz1-0 ONLINE 0 0 0 c1t2d0 ONLINE 0 0 0 c1t3d0 ONLINE 0 0 0 c1t4d0 ONLINE 0 0 0 errors: No known data errors # zpool add rzpool raidz c2t2d0 c2t3d0 c2t4d0 # zpool status rzpool pool: rzpool state: ONLINE scrub: none requested config: NAME STATE READ WRITE CKSUM rzpool ONLINE 0 0 0 raidz1-0 ONLINE 0 0 0 62 Oracle Solaris 11.1 : ZFS 2012 11
ZFS 3 2 RAID-Z ( ) c1t0d0 ONLINE 0 0 0 c1t2d0 ONLINE 0 0 0 c1t3d0 ONLINE 0 0 0 raidz1-1 ONLINE 0 0 0 c2t2d0 ONLINE 0 0 0 c2t3d0 ONLINE 0 0 0 c2t4d0 ONLINE 0 0 0 errors: No known data errors 3 3. # zpool status newpool pool: newpool state: ONLINE scrub: none requested config: NAME STATE READ WRITE CKSUM newpool ONLINE 0 0 0 mirror-0 ONLINE 0 0 0 c0t4d0 ONLINE 0 0 0 c0t5d0 ONLINE 0 0 0 errors: No known data errors # zpool add newpool log mirror c0t6d0 c0t7d0 # zpool status newpool pool: newpool state: ONLINE scrub: none requested config: NAME STATE READ WRITE CKSUM newpool ONLINE 0 0 0 mirror-0 ONLINE 0 0 0 c0t4d0 ONLINE 0 0 0 c0t5d0 ONLINE 0 0 0 logs mirror-1 ONLINE 0 0 0 c0t6d0 ONLINE 0 0 0 c0t7d0 ONLINE 0 0 0 errors: No known data errors.. zpool remove. mirror-1.. 3 Oracle Solaris ZFS 63
ZFS 3 3 ( ) # zpool remove newpool mirror-1 # zpool status newpool pool: newpool state: ONLINE scrub: none requested config: NAME STATE READ WRITE CKSUM newpool ONLINE 0 0 0 mirror-0 ONLINE 0 0 0 c0t4d0 ONLINE 0 0 0 c0t5d0 ONLINE 0 0 0 errors: No known data errors.. # zpool status pool pool: pool state: ONLINE scrub: none requested config: NAME STATE READ WRITE CKSUM pool ONLINE 0 0 0 raidz1-0 ONLINE 0 0 0 c0t8d0 ONLINE 0 0 0 c0t9d0 ONLINE 0 0 0 logs c0t10d0 ONLINE 0 0 0 errors: No known data errors # zpool remove pool c0t10d0 3 4 ZFS. zpool add. : # zpool add tank cache c2t5d0 c2t8d0 # zpool status tank pool: tank state: ONLINE scrub: none requested config: NAME STATE READ WRITE CKSUM tank ONLINE 0 0 0 mirror-0 ONLINE 0 0 0 c2t0d0 ONLINE 0 0 0 c2t1d0 ONLINE 0 0 0 64 Oracle Solaris 11.1 : ZFS 2012 11
ZFS 3 4 ( ) c2t3d0 ONLINE 0 0 0 cache c2t5d0 ONLINE 0 0 0 c2t8d0 ONLINE 0 0 0 errors: No known data errors RAID-Z. zpool remove.. # zpool remove tank c2t5d0 c2t8d0 # zpool status tank pool: tank state: ONLINE scrub: none requested config: NAME STATE READ WRITE CKSUM tank ONLINE 0 0 0 mirror-0 ONLINE 0 0 0 c2t0d0 ONLINE 0 0 0 c2t1d0 ONLINE 0 0 0 c2t3d0 ONLINE 0 0 0 errors: No known data errors zpool remove,. zpool detach. RAID-Z. ZFS 54 ZFS. zpool add zpool attach. 112 (SPARC x86/vtoc). ZFS 115 ZFS (SPARC x86/vtoc). 3 Oracle Solaris ZFS 65
ZFS 3 5 zeepool, c2t1d0 c1t1d0. # zpool status zeepool pool: zeepool state: ONLINE scrub: none requested config: NAME STATE READ WRITE CKSUM zeepool ONLINE 0 0 0 mirror-0 ONLINE 0 0 0 c0t1d0 ONLINE 0 0 0 c1t1d0 ONLINE 0 0 0 errors: No known data errors # zpool attach zeepool c1t1d0 c2t1d0 # zpool status zeepool pool: zeepool state: ONLINE scrub: resilver completed after 0h0m with 0 errors on Fri Jan 8 12:59:20 2010 config: NAME STATE READ WRITE CKSUM zeepool ONLINE 0 0 0 mirror-0 ONLINE 0 0 0 c0t1d0 ONLINE 0 0 0 c1t1d0 ONLINE 0 0 0 c2t1d0 ONLINE 0 0 0 592K resilvered errors: No known data errors,.. 3 6 ZFS ZFS zpool attach.. # zpool create tank c0t1d0 # zpool status tank pool: tank state: ONLINE scrub: none requested config: NAME STATE READ WRITE CKSUM tank ONLINE 0 0 0 c0t1d0 ONLINE 0 0 0 errors: No known data errors # zpool attach tank c0t1d0 c1t1d0 # zpool status tank 66 Oracle Solaris 11.1 : ZFS 2012 11
ZFS 3 6 ZFS ZFS ( ) pool: tank state: ONLINE scrub: resilver completed after 0h0m with 0 errors on Fri Jan 8 14:28:23 2010 config: NAME STATE READ WRITE CKSUM tank ONLINE 0 0 0 mirror-0 ONLINE 0 0 0 c0t1d0 ONLINE 0 0 0 c1t1d0 ONLINE 0 0 0 73.5K resilvered errors: No known data errors zpool detach.. # zpool detach zeepool c2t1d0. : # zpool detach newpool c1t2d0 cannot detach c1t2d0: only applicable to mirror and replacing vdevs ZFS zpool split ZFS.. zpool split ZFS. ZFS. zpool split... # zpool status tank pool: tank state: ONLINE scrub: none requested config: NAME STATE READ WRITE CKSUM 3 Oracle Solaris ZFS 67
ZFS tank ONLINE 0 0 0 mirror-0 ONLINE 0 0 0 c1t0d0 ONLINE 0 0 0 c1t2d0 ONLINE 0 0 0 errors: No known data errors # zpool split tank tank2 # zpool import tank2 # zpool status tank tank2 pool: tank state: ONLINE scrub: none requested config: NAME STATE READ WRITE CKSUM tank ONLINE 0 0 0 c1t0d0 ONLINE 0 0 0 errors: No known data errors pool: tank2 state: ONLINE scrub: none requested config: NAME STATE READ WRITE CKSUM tank2 ONLINE 0 0 0 c1t2d0 ONLINE 0 0 0 errors: No known data errors zpool split.. # zpool split tank tank2 c1t0d0. GUID. GUID. zpool split -R.. # zpool split -R /tank2 tank tank2 zpool split -R -R.. 68 Oracle Solaris 11.1 : ZFS 2012 11
ZFS zpool split. 3 7 RAID-Z. zpool split.. 2~3.. zpool attach. ( ) zpool split.. 2 2 2. 2. 3 2.. 305. ZFS mothership. mothership luna.. luna. luna mothership.. # zpool status mothership pool: mothership state: ONLINE scan: none requested config: NAME STATE READ WRITE CKSUM mothership ONLINE 0 0 0 mirror-0 ONLINE 0 0 0 c0t5000c500335f95e3d0 ONLINE 0 0 0 c0t5000c500335bd117d0 ONLINE 0 0 0 c0t5000c500335f907fd0 ONLINE 0 0 0 3 Oracle Solaris ZFS 69
ZFS 3 7 ZFS ( ) errors: No known data errors # zpool split mothership luna # zpool import luna # zpool status mothership luna pool: luna state: ONLINE scan: none requested config: NAME STATE READ WRITE CKSUM luna ONLINE 0 0 0 c0t5000c500335f907fd0 ONLINE 0 0 0 errors: No known data errors pool: mothership state: ONLINE scan: none requested config: NAME STATE READ WRITE CKSUM mothership ONLINE 0 0 0 mirror-0 ONLINE 0 0 0 c0t5000c500335f95e3d0 ONLINE 0 0 0 c0t5000c500335bd117d0 ONLINE 0 0 0 errors: No known data errors ZFS. ZFS. ZFS. ZFS.. zpool offline. ( ).. # zpool offline tank c0t5000c500335f95e3d0 70 Oracle Solaris 11.1 : ZFS 2012 11
ZFS. UNAVAIL., raidz1 2,. # zpool offline tank c0t5000c500335f95e3d0 cannot offline c0t5000c500335f95e3d0: no valid replicas OFFLINE.. zpool offline -t.. # zpool offline -t tank c1t0d0 bringing device c1t0d0 offline ONLINE... device is part of exported or potentially active ZFS pool. Please see zpool(1m).. 73. OFFLINE. 83 ZFS. 90 ZFS. zpool online.. # zpool online tank c0t5000c500335f95e3d0.. UNAVAIL. 3 Oracle Solaris ZFS 71
ZFS UNAVAIL. /var/adm/messages.. SUNW-MSG-ID: ZFS-8000-LR, TYPE: Fault, VER: 1, SEVERITY: Major EVENT-TIME: Wed Jun 20 11:35:26 MDT 2012 PLATFORM: ORCL,SPARC-T3-4, CSN: 1120BDRCCD, HOSTNAME: tardis SOURCE: zfs-diagnosis, REV: 1.0 EVENT-ID: fb6699c8-6bfb-eefa-88bb-81479182e3b7 DESC: ZFS device id1,sd@n5000c500335dc60f/a in pool pond failed to open. AUTO-RESPONSE: An attempt will be made to activate a hot spare if available. IMPACT: Fault tolerance of the pool may be compromised. REC-ACTION: Use fmadm faulty to provide a more detailed view of this event. Run zpool status -lx for more information. Please refer to the associated reference document at http://support.oracle.com/msg/zfs-8000-lr for the latest service procedures and policies regarding this diagnosis. 278. zpool online -e LUN. LUN autoexpand.lun LUN zpool online -e LUN.. # zpool online -e tank c0t5000c500335f95e3d0 zpool status zpool clear... # zpool clear tank.. # zpool clear tank c0t5000c500335f95e3d0 zpool 283. 72 Oracle Solaris 11.1 : ZFS 2012 11
ZFS zpool replace.. ZFS., (c1t1d0). # zpool replace tank c1t1d0.. # zpool replace tank c1t1d0 c1t2d0 ZFS 115 ZFS (SPARC x86/vtoc).. 1. zpool offline. 2.. 3.. 4. format. ID. WWN ID. 5. ZFS.. # zpool replace tank c1t1d0 ID ID. # zpool replace tank c0t5000c500335fc3e7d0 c0t5000c500335ba8c3d0 6. zpool online. 7. FMA. fmadm faulty Affects: zfs://pool=name/vdev=guid fmadm repaired. # fmadm faulty # fmadm repaired zfs://pool=name/vdev=guid SATA. zpool replace. 3 Oracle Solaris ZFS 73
ZFS SATA 10 1. ZFS. autoreplace on. zpool replace.. REMOVED.,..,.., USB. cfgadm -c configure SATA.. RAID-Z.. autoexpand LUN. autoexpand. LUN LUN. 16GB 72GB.. autoexpand. # zpool create pool mirror c1t16d0 c1t17d0 # zpool status pool: pool state: ONLINE scrub: none requested config: NAME STATE READ WRITE CKSUM pool ONLINE 0 0 0 mirror ONLINE 0 0 0 c1t16d0 ONLINE 0 0 0 c1t17d0 ONLINE 0 0 0 zpool list pool NAME SIZE ALLOC FREE CAP HEALTH ALTROOT pool 16.8G 76.5K 16.7G 0% ONLINE - # zpool replace pool c1t16d0 c1t1d0 # zpool replace pool c1t17d0 c1t2d0 74 Oracle Solaris 11.1 : ZFS 2012 11
ZFS # zpool list pool NAME SIZE ALLOC FREE CAP HEALTH ALTROOT pool 16.8G 88.5K 16.7G 0% ONLINE - # zpool set autoexpand=on pool # zpool list pool NAME SIZE ALLOC FREE CAP HEALTH ALTROOT pool 68.2G 117K 68.2G 0% ONLINE -. zpool scrub.. zpool detach RAID-Z. 77. 278 282..,.. zpool create zpool add. # zpool create zeepool mirror c0t5000c500335f95e3d0 c0t5000c500335f907fd0 mirror c0t5000c500335bd117d0 c0t5000c500335dc60fd0 spare c0t5000c500335e106bd0 c0t5000c500335fc3e7d0 # zpool status zeepool pool: zeepool state: ONLINE scan: none requested config: NAME STATE READ WRITE CKSUM zeepool ONLINE 0 0 0 mirror-0 ONLINE 0 0 0 c0t5000c500335f95e3d0 ONLINE 0 0 0 c0t5000c500335f907fd0 ONLINE 0 0 0 mirror-1 ONLINE 0 0 0 c0t5000c500335bd117d0 ONLINE 0 0 0 c0t5000c500335dc60fd0 ONLINE 0 0 0 spares 3 Oracle Solaris ZFS 75
ZFS c0t5000c500335e106bd0 c0t5000c500335fc3e7d0 AVAIL AVAIL errors: No known data errors. # zpool add zeepool spare c0t5000c500335e106bd0 c0t5000c500335fc3e7d0 # zpool status zeepool pool: zeepool state: ONLINE scan: none requested config: NAME STATE READ WRITE CKSUM zeepool ONLINE 0 0 0 mirror-0 ONLINE 0 0 0 c0t5000c500335f95e3d0 ONLINE 0 0 0 c0t5000c500335f907fd0 ONLINE 0 0 0 mirror-1 ONLINE 0 0 0 c0t5000c500335bd117d0 ONLINE 0 0 0 c0t5000c500335dc60fd0 ONLINE 0 0 0 spares c0t5000c500335e106bd0 AVAIL c0t5000c500335fc3e7d0 AVAIL errors: No known data errors zpool remove.. # zpool remove zeepool c0t5000c500335fc3e7d0 # zpool status zeepool pool: zeepool state: ONLINE scan: none requested config: NAME STATE READ WRITE CKSUM zeepool ONLINE 0 0 0 mirror-0 ONLINE 0 0 0 c0t5000c500335f95e3d0 ONLINE 0 0 0 c0t5000c500335f907fd0 ONLINE 0 0 0 mirror-1 ONLINE 0 0 0 c0t5000c500335bd117d0 ONLINE 0 0 0 c0t5000c500335dc60fd0 ONLINE 0 0 0 spares c0t5000c500335e106bd0 AVAIL errors: No known data errors. ZFS. 76 Oracle Solaris 11.1 : ZFS 2012 11
ZFS zpool remove,... zpool replace. cannot replace disk3 with disk4: device is too small. zpool replace. FMA.. FMA.. ZFS. zpool detach. autoreplace on. UNAVAIL.. # zpool status -x pool: zeepool state: DEGRADED status: One or more devices are unavailable in response to persistent errors. Sufficient replicas exist for the pool to continue functioning in a degraded state. action: Determine if the device needs to be replaced, and clear the errors using zpool clear or fmadm repaired, or replace the device with zpool replace. Run zpool status -v to see device specific details. scan: resilvered 3.15G in 0h0m with 0 errors on Thu Jun 21 16:46:19 2012 config: NAME STATE READ WRITE CKSUM zeepool DEGRADED 0 0 0 mirror-0 ONLINE 0 0 0 c0t5000c500335f95e3d0 ONLINE 0 0 0 c0t5000c500335f907fd0 ONLINE 0 0 0 3 Oracle Solaris ZFS 77
ZFS mirror-1 DEGRADED 0 0 0 c0t5000c500335bd117d0 ONLINE 0 0 0 spare-1 DEGRADED 449 0 0 c0t5000c500335dc60fd0 UNAVAIL 0 0 0 c0t5000c500335e106bd0 ONLINE 0 0 0 spares c0t5000c500335e106bd0 INUSE errors: No known data errors... 3 8.. 3 9. 3 8 (c0t5000c500335dc60fd0) zpool replace ZFS. # zpool replace zeepool c0t5000c500335dc60fd0 # zpool status zeepool pool: zeepool state: ONLINE scan: resilvered 3.15G in 0h0m with 0 errors on Thu Jun 21 16:53:43 2012 config: NAME STATE READ WRITE CKSUM zeepool ONLINE 0 0 0 mirror-0 ONLINE 0 0 0 c0t5000c500335f95e3d0 ONLINE 0 0 0 c0t5000c500335f907fd0 ONLINE 0 0 0 mirror-1 ONLINE 0 0 0 c0t5000c500335bd117d0 ONLINE 0 0 0 c0t5000c500335dc60fd0 ONLINE 0 0 0 spares c0t5000c500335e106bd0 AVAIL zpool detach.. # zpool detach zeepool c0t5000c500335e106bd0 3 9... # zpool status zeepool pool: zeepool 78 Oracle Solaris 11.1 : ZFS 2012 11
ZFS 3 9 ( ) state: DEGRADED status: One or more devices are unavailable in response to persistent errors. Sufficient replicas exist for the pool to continue functioning in a degraded state. action: Determine if the device needs to be replaced, and clear the errors using zpool clear or fmadm repaired, or replace the device with zpool replace. Run zpool status -v to see device specific details. scan: scrub in progress since Thu Jun 21 17:01:49 2012 1.07G scanned out of 6.29G at 220M/s, 0h0m to go 0 repaired, 17.05% done config: NAME STATE READ WRITE CKSUM zeepool DEGRADED 0 0 0 mirror-0 ONLINE 0 0 0 c0t5000c500335f95e3d0 ONLINE 0 0 0 c0t5000c500335f907fd0 ONLINE 0 0 0 mirror-1 DEGRADED 0 0 0 c0t5000c500335bd117d0 ONLINE 0 0 0 c0t5000c500335dc60fd0 UNAVAIL 0 0 0 spares c0t5000c500335e106bd0 AVAIL errors: No known data errors # zpool detach zeepool c0t5000c500335dc60fd0 # zpool status zeepool pool: zeepool state: ONLINE scan: resilvered 3.15G in 0h0m with 0 errors on Thu Jun 21 17:02:35 2012 config: NAME STATE READ WRITE CKSUM zeepool ONLINE 0 0 0 mirror-0 ONLINE 0 0 0 c0t5000c500335f95e3d0 ONLINE 0 0 0 c0t5000c500335f907fd0 ONLINE 0 0 0 mirror-1 ONLINE 0 0 0 c0t5000c500335bd117d0 ONLINE 0 0 0 c0t5000c500335e106bd0 ONLINE 0 0 0 errors: No known data errors (Original failed disk c0t5000c500335dc60fd0 is physically replaced) # zpool add zeepool spare c0t5000c500335dc60fd0 # zpool status zeepool pool: zeepool state: ONLINE scan: resilvered 3.15G in 0h0m with 0 errors on Thu Jun 21 17:02:35 2012 config: NAME STATE READ WRITE CKSUM zeepool ONLINE 0 0 0 mirror-0 ONLINE 0 0 0 c0t5000c500335f95e3d0 ONLINE 0 0 0 c0t5000c500335f907fd0 ONLINE 0 0 0 3 Oracle Solaris ZFS 79
ZFS 3 9 ( ) mirror-1 ONLINE 0 0 0 c0t5000c500335bd117d0 ONLINE 0 0 0 c0t5000c500335e106bd0 ONLINE 0 0 0 spares c0t5000c500335dc60fd0 AVAIL errors: No known data errors FMA. # fmadm faulty # fmadm repaired zfs://pool=name/vdev=guid ZFS zpool get.. # zpool get all zeepool NAME PROPERTY VALUE SOURCE zeepool allocated 6.29G - zeepool altroot - default zeepool autoexpand off default zeepool autoreplace off default zeepool bootfs - default zeepool cachefile - default zeepool capacity 1% - zeepool dedupditto 0 default zeepool dedupratio 1.00x - zeepool delegation on default zeepool failmode wait default zeepool free 550G - zeepool guid 7543986419840620672 - zeepool health ONLINE - zeepool listshares off default zeepool listsnapshots off default zeepool readonly off - zeepool size 556G - zeepool version 34 default zpool set.. # zpool set autoreplace=on zeepool # zpool get autoreplace zeepool NAME PROPERTY VALUE SOURCE zeepool autoreplace on local 80 Oracle Solaris 11.1 : ZFS 2012 11
ZFS. # zpool set autoreplace=on tank cannot set property for tank : out of space 12, Oracle Solaris ZFS. 3 1 ZFS allocated. altroot off... autoreplace off. off zpool replace. on. replace. bootfs.. cachefile.... zpool import - c. ZFS. capacity. cap. dedupditto,. dedupratio ( ). 3 Oracle Solaris ZFS 81
ZFS 3 1 ZFS ( ) delegation on. 8, Oracle Solaris ZFS. failmode wait... wait zpool clear I/O. I/O. wait. continue I/O EIO.. zpool clear. panic. free. guid. health ONLINE, DEGRADED, SUSPENDED, REMOVED UNAVAIL. listshares Off zfs list. off. listsnapshots Off zfs list. zfslist-tsnapshot. readonly Off.. /. 82 Oracle Solaris 11.1 : ZFS 2012 11
ZFS 3 1 ZFS ( ) size. version. zpool upgrade. 1 zpool upgrade -v. ZFS zpool list., I/O.. 83 ZFS 87 ZFS I/O 90 ZFS ZFS zpool list. zpool list. # zpool list NAME SIZE ALLOC FREE CAP HEALTH ALTROOT tank 80.0G 22.3G 47.7G 28% ONLINE - dozer 1.2T 384G 816G 32% ONLINE -. NAME. SIZE. ALLOC.. 31 ZFS. 3 Oracle Solaris ZFS 83
ZFS FREE CAP (CAPACITY) HEALTH... 90 ZFS. ALTROOT ( ). 265 ZFS.. : # zpool list tank NAME SIZE ALLOC FREE CAP HEALTH ALTROOT tank 80.0G 22.3G 47.7G 28% ONLINE - zpool list. -T.. # zpool list -T d32 Tue Nov 2 10:36:11 MDT 2010 NAME SIZE ALLOC FREE CAP DEDUP HEALTH ALTROOT pool 33.8G 83.5K 33.7G 0% 1.00x ONLINE - rpool 33.8G 12.2G 21.5G 36% 1.00x ONLINE - Tue Nov 2 10:36:14 MDT 2010 pool 33.8G 83.5K 33.7G 0% 1.00x ONLINE - rpool 33.8G 12.2G 21.5G 36% 1.00x ONLINE - zpool status -l.. fmadm add-alias.. # fmadm add-alias SUN-Storage-J4400.1002QCQ015 Lab10Rack5... # zpool status -l tank pool: tank state: ONLINE scan: scrub repaired 0 in 0h0m with 0 errors on Fri Aug 3 16:00:35 2012 config: NAME STATE READ WRITE CKSUM tank ONLINE 0 0 0 84 Oracle Solaris 11.1 : ZFS 2012 11
ZFS mirror-0 ONLINE 0 0 0 /dev/chassis/lab10rack5.../disk_02/disk ONLINE 0 0 0 /dev/chassis/lab10rack5.../disk_20/disk ONLINE 0 0 0 mirror-1 ONLINE 0 0 0 /dev/chassis/lab10rack5.../disk_22/disk ONLINE 0 0 0 /dev/chassis/lab10rack5.../disk_14/disk ONLINE 0 0 0 mirror-2 ONLINE 0 0 0 /dev/chassis/lab10rack5.../disk_10/disk ONLINE 0 0 0 /dev/chassis/lab10rack5.../disk_16/disk ONLINE 0 0 0 mirror-3 ONLINE 0 0 0 /dev/chassis/lab10rack5.../disk_01/disk ONLINE 0 0 0 /dev/chassis/lab10rack5.../disk_21/disk ONLINE 0 0 0 mirror-4 ONLINE 0 0 0 /dev/chassis/lab10rack5.../disk_23/disk ONLINE 0 0 0 /dev/chassis/lab10rack5.../disk_15/disk ONLINE 0 0 0 mirror-5 ONLINE 0 0 0 /dev/chassis/lab10rack5.../disk_09/disk ONLINE 0 0 0 /dev/chassis/lab10rack5.../disk_04/disk ONLINE 0 0 0 mirror-6 ONLINE 0 0 0 /dev/chassis/lab10rack5.../disk_08/disk ONLINE 0 0 0 /dev/chassis/lab10rack5.../disk_05/disk ONLINE 0 0 0 mirror-7 ONLINE 0 0 0 /dev/chassis/lab10rack5.../disk_07/disk ONLINE 0 0 0 /dev/chassis/lab10rack5.../disk_11/disk ONLINE 0 0 0 mirror-8 ONLINE 0 0 0 /dev/chassis/lab10rack5.../disk_06/disk ONLINE 0 0 0 /dev/chassis/lab10rack5.../disk_19/disk ONLINE 0 0 0 mirror-9 ONLINE 0 0 0 /dev/chassis/lab10rack5.../disk_00/disk ONLINE 0 0 0 /dev/chassis/lab10rack5.../disk_13/disk ONLINE 0 0 0 mirror-10 ONLINE 0 0 0 /dev/chassis/lab10rack5.../disk_03/disk ONLINE 0 0 0 /dev/chassis/lab10rack5.../disk_18/disk ONLINE 0 0 0 spares /dev/chassis/lab10rack5.../disk_17/disk AVAIL /dev/chassis/lab10rack5.../disk_12/disk AVAIL errors: No known data errors -o..,. # zpool list -o name,size NAME SIZE tank 80.0G dozer 1.2T 83. 3 Oracle Solaris ZFS 85
ZFS ZFS zpool list. -H.,. # zpool list -Ho name tank dozer. # zpool list -H -o name,size tank 80.0G dozer 1.2T ZFS ZFS zfs zpool. zpool history.,. # zpool history History for rpool : 2012-04-06.14:02:55 zpool create -f rpool c3t0d0s0 2012-04-06.14:02:56 zfs create -p -o mountpoint=/export rpool/export 2012-04-06.14:02:58 zfs set mountpoint=/export rpool/export 2012-04-06.14:02:58 zfs create -p rpool/export/home 2012-04-06.14:03:03 zfs create -p -V 2048m rpool/swap 2012-04-06.14:03:08 zfs set primarycache=metadata rpool/swap 2012-04-06.14:03:09 zfs create -p -V 4094m rpool/dump 2012-04-06.14:26:47 zpool set bootfs=rpool/root/s11u1 rpool 2012-04-06.14:31:15 zfs set primarycache=metadata rpool/swap 2012-04-06.14:31:46 zfs create -o canmount=noauto -o mountpoint=/var/share rpool/varshare 2012-04-06.15:22:33 zfs set primarycache=metadata rpool/swap 2012-04-06.16:42:48 zfs set primarycache=metadata rpool/swap 2012-04-09.16:17:24 zfs snapshot -r rpool/root@yesterday 2012-04-09.16:17:54 zfs snapshot -r rpool/root@now ZFS....,.. 128KB. 32MB. 86 Oracle Solaris 11.1 : ZFS 2012 11
ZFS 1%...,.. # zpool history tank 2012-01-25.16:35:32 zpool create -f tank mirror c3t1d0 c3t2d0 spare c3t3d0 2012-02-17.13:04:10 zfs create tank/test 2012-02-17.13:05:01 zfs snapshot -r tank/test@snap1 -l,.. # zpool history -l tank History for tank : 2012-01-25.16:35:32 zpool create -f tank mirror c3t1d0 c3t2d0 spare c3t3d0 [user root on tardis:global] 2012-02-17.13:04:10 zfs create tank/test [user root on tardis:global] 2012-02-17.13:05:01 zfs snapshot -r tank/test@snap1 [user root on tardis:global] -i.. # zpool history -i tank History for tank : 2012-01-25.16:35:32 zpool create -f tank mirror c3t1d0 c3t2d0 spare c3t3d0 2012-01-25.16:35:32 [internal pool create txg:5] pool spa 33; zfs spa 33; zpl 5; uts tardis 5.11 11.1 sun4v 2012-02-17.13:04:10 zfs create tank/test 2012-02-17.13:04:10 [internal property set txg:66094] $share2=2 dataset = 34 2012-02-17.13:04:31 [internal snapshot txg:66095] dataset = 56 2012-02-17.13:05:01 zfs snapshot -r tank/test@snap1 2012-02-17.13:08:00 [internal user hold txg:66102] <.send-4736-1> temp = 1... ZFS I/O I/O zpool iostat. iostat I/O.. alloc capacity.. 31 ZFS. 3 Oracle Solaris ZFS 87
ZFS free capacity read operations write operations read bandwidth write bandwidth. used. I/O. I/O. ( ).. I/O zpool iostat. : # zpool iostat capacity operations bandwidth pool alloc free read write read write ---------- ----- ----- ----- ----- ----- ----- rpool 6.05G 61.9G 0 0 786 107 tank 31.3G 36.7G 4 1 296K 86.1K ---------- ----- ----- ----- ----- ----- -----... # zpool iostat tank 2 capacity operations bandwidth pool alloc free read write read write ---------- ----- ----- ----- ----- ----- ----- tank 18.5G 49.5G 0 187 0 23.3M tank 18.5G 49.5G 0 464 0 57.7M tank 18.5G 49.5G 0 457 0 56.6M tank 18.8G 49.2G 0 435 0 51.3M Ctrl-C 2 tank. count., zpool iostat 2 3 2 3 6... 88 Oracle Solaris 11.1 : ZFS 2012 11
ZFS I/O I/O zpool iostat I/O. ZFS I/O. I/O zpool iostat -v. : # zpool iostat -v capacity operations bandwidth pool alloc free read write read write ---------- ----- ----- ----- ----- ----- ----- rpool 6.05G 61.9G 0 0 785 107 mirror 6.05G 61.9G 0 0 785 107 c1t0d0s0 - - 0 0 578 109 c1t1d0s0 - - 0 0 595 109 ---------- ----- ----- ----- ----- ----- ----- tank 36.5G 31.5G 4 1 295K 146K mirror 36.5G 31.5G 126 45 8.13M 4.01M c1t2d0 - - 0 3 100K 386K c1t3d0 - - 0 3 104K 386K ---------- ----- ----- ----- ----- ----- ----- I/O.,. RAID-Z.,., RAID-Z. I/O... ( )... # zpool iostat -lv capacity operations bandwidth pool alloc free read write read write ---------- ----- ----- ----- ----- ----- ----- export 2.39T 2.14T 13 27 42.7K 300K mirror 490G 438G 2 5 8.53K 60.3K /dev/chassis/lab10rack15/scsi_device 2/disk - - 1 0 4.47K 60.3K /dev/chassis/lab10rack15/scsi_device 3/disk - - 1 0 4.45K 60.3K mirror 490G 438G 2 5 8.62K 59.9K /dev/chassis/lab10rack15/scsi_device 4/disk - - 1 0 4.52K 59.9K /dev/chassis/lab10rack15/scsi_device 5/disk - - 1 0 4.48K 59.9K mirror 490G 438G 2 5 8.60K 60.2K 3 Oracle Solaris ZFS 89