分类:
2010-09-26 10:40:55
Posted on January 20th, 2010
So, what we got.
Old Sun Enterprise 3500 machine with SVM mirrors. On of them is in the degraded state due to hardware disk errors.
//Sun E3500通过使用SVM做镜像,其中一个硬盘故障。
bash-2.05#dmesg Jan 18 05:07:05 ni5xit socal: [ID 403145 kern.info] ID[SUNWssa.socal.link.5010] socal0: port 0: Fibre Channel is OFFLINE Jan 18 05:07:05 ni5xit socal: [ID 403145 kern.info] ID[SUNWssa.socal.link.6010] socal0: port 0: Fibre Channel Loop is ONLINE Jan 18 05:07:07 ni5xit scsi: [ID 107833 kern.warning] WARNING: /sbus@2,0/SUNW,socal@d,10000/sf@0,0/ssd@w2100000c508510d4,0 (ssd12): Jan 18 05:07:07 ni5xit Error for Command: write(10) Error Level: Retryable Jan 18 05:07:07 ni5xit scsi: [ID 107833 kern.notice] Requested Block: 440704 Error Block: 55834 Jan 18 05:07:07 ni5xit scsi: [ID 107833 kern.notice] Vendor: SEAGATE Serial Number: 0348B6HJEH Jan 18 05:07:07 ni5xit scsi: [ID 107833 kern.notice] Sense Key: Unit Attention Jan 18 05:07:07 ni5xit scsi: [ID 107833 kern.notice] ASC: 0x29 (), ASCQ: 0x2, FRU: 0xcc Jan 18 05:07:07 ni5xit scsi: [ID 107833 kern.warning] WARNING: /sbus@2,0/SUNW,socal@d,10000/sf@0,0/ssd@w21000004cfb56c46,0 (ssd2): Jan 18 05:07:07 ni5xit Error for Command: write(10) Error Level: Retryable Jan 18 05:07:07 ni5xit scsi: [ID 107833 kern.notice] Requested Block: 3913392 Error Block: 3913392 Jan 18 05:07:07 ni5xit scsi: [ID 107833 kern.notice] Vendor: SEAGATE Serial Number: 0243P23MVX Jan 18 05:07:07 ni5xit scsi: [ID 107833 kern.notice] Sense Key: Unit Attention Jan 18 05:07:07 ni5xit scsi: [ID 107833 kern.notice] ASC: 0x29 (power on, reset, or bus reset occurred), ASCQ: 0x0, FRU: 0x3 Jan 18 05:07:08 ni5xit scsi: [ID 243001 kern.info] /sbus@2,0/SUNW,socal@d,10000/sf@0,0 (sf0): Jan 18 05:07:08 ni5xit sf0: Target 0x3 Reset successful Jan 18 05:07:08 ni5xit scsi: [ID 107833 kern.warning] WARNING: /sbus@2,0/SUNW,socal@d,10000/sf@0,0/ssd@w2100000c508510d4,0 (ssd12): Jan 18 05:07:08 ni5xit Error for Command: write(10) Error Level: Retryable Jan 18 05:07:08 ni5xit scsi: [ID 107833 kern.notice] Requested Block: 121203824 Error Block: 121203824 Jan 18 05:07:08 ni5xit scsi: [ID 107833 kern.notice] Vendor: SEAGATE Serial Number: 0348B6HJEH Jan 18 05:07:08 ni5xit scsi: [ID 107833 kern.notice] Sense Key: Hardware Error Jan 18 05:07:08 ni5xit scsi: [ID 107833 kern.notice] ASC: 0x15 (), ASCQ: 0x1, FRU: 0x1 Jan 18 05:07:09 ni5xit scsi: [ID 107833 kern.warning] WARNING: /sbus@2,0/SUNW,socal@d,10000/sf@0,0/ssd@w2100000c508510d4,0 (ssd12): Jan 18 05:07:09 ni5xit SCSI transport failed: reason 'reset': retrying command Jan 18 05:07:09 ni5xit scsi: [ID 107833 kern.warning] WARNING: /sbus@2,0/SUNW,socal@d,10000/sf@0,0/ssd@w2100000c508510d4,0 (ssd12): Jan 18 05:07:09 ni5xit Error for Command: write(10) Error Level: Retryable Jan 18 05:07:09 ni5xit scsi: [ID 107833 kern.notice] Requested Block: 121203824 Error Block: 121203824 Jan 18 05:07:09 ni5xit scsi: [ID 107833 kern.notice] Vendor: SEAGATE Serial Number: 0348B6HJEH Jan 18 05:07:09 ni5xit scsi: [ID 107833 kern.notice] Sense Key: Unit Attention Jan 18 05:07:09 ni5xit scsi: [ID 107833 kern.notice] ASC: 0x29 (), ASCQ: 0x3, FRU: 0x4 Jan 18 05:07:10 ni5xit scsi: [ID 107833 kern.warning] WARNING: /sbus@2,0/SUNW,socal@d,10000/sf@0,0/ssd@w21000004cf83f8f0,0 (ssd3): Jan 18 05:07:10 ni5xit Error for Command: write(10) Error Level: Retryable Jan 18 05:07:10 ni5xit scsi: [ID 107833 kern.notice] Requested Block: 33898960 Error Block: 33898960 Jan 18 05:07:10 ni5xit scsi: [ID 107833 kern.notice] Vendor: SEAGATE Serial Number: 0215P1GHRT Jan 18 05:07:10 ni5xit scsi: [ID 107833 kern.notice] Sense Key: Unit Attention Jan 18 05:07:10 ni5xit scsi: [ID 107833 kern.notice] ASC: 0x29 (power on, reset, or bus reset occurred), ASCQ: 0x0, FRU: 0x3 Jan 18 05:07:10 ni5xit scsi: [ID 107833 kern.warning] WARNING: /sbus@2,0/SUNW,socal@d,10000/sf@0,0/ssd@w2100000c508510d4,0 (ssd12): Jan 18 05:07:10 ni5xit Error for Command: write(10) Error Level: Retryable Jan 18 05:07:10 ni5xit scsi: [ID 107833 kern.notice] Requested Block: 121203824 Error Block: 121203824 Jan 18 05:07:10 ni5xit scsi: [ID 107833 kern.notice] Vendor: SEAGATE Serial Number: 0348B6HJEH Jan 18 05:07:10 ni5xit scsi: [ID 107833 kern.notice] Sense Key: Hardware Error Jan 18 05:07:10 ni5xit scsi: [ID 107833 kern.notice] ASC: 0x15 (), ASCQ: 0x1, FRU: 0x1 Jan 18 05:07:10 ni5xit scsi: [ID 107833 kern.warning] WARNING: /sbus@2,0/SUNW,socal@d,10000/sf@0,0/ssd@w21000004cf9b556c,0 (ssd8): Jan 18 05:07:10 ni5xit Error for Command: write(10) Error Level: Retryable Jan 18 05:07:10 ni5xit scsi: [ID 107833 kern.notice] Requested Block: 69206848 Error Block: 69206848 Jan 18 05:07:10 ni5xit scsi: [ID 107833 kern.notice] Vendor: SEAGATE Serial Number: 0220K1PFKR Jan 18 05:07:10 ni5xit scsi: [ID 107833 kern.notice] Sense Key: Unit Attention Jan 18 05:07:10 ni5xit scsi: [ID 107833 kern.notice] ASC: 0x29 (power on, reset, or bus reset occurred), ASCQ: 0x0, FRU: 0x3 Jan 18 05:07:22 ni5xit scsi: [ID 107833 kern.warning] WARNING: /sbus@2,0/SUNW,socal@d,10000/sf@0,0/ssd@w2100000c508510d4,0 (ssd12): Jan 18 05:07:22 ni5xit Error for Command: write(10) Error Level: Retryable Jan 18 05:07:22 ni5xit scsi: [ID 107833 kern.notice] Requested Block: 69216224 Error Block: 69216224 Jan 18 05:07:22 ni5xit scsi: [ID 107833 kern.notice] Vendor: SEAGATE Serial Number: 0348B6HJEH Jan 18 05:07:22 ni5xit scsi: [ID 107833 kern.notice] Sense Key: Hardware Error Jan 18 05:07:22 ni5xit scsi: [ID 107833 kern.notice] ASC: 0x15 (), ASCQ: 0x1, FRU: 0x1 Jan 18 05:07:22 ni5xit scsi: [ID 243001 kern.info] /sbus@2,0/SUNW,socal@d,10000/sf@0,0 (sf0): Jan 18 05:07:22 ni5xit sf0: Target 0x3 Reset successful Jan 18 05:07:22 ni5xit scsi: [ID 107833 kern.warning] WARNING: /sbus@2,0/SUNW,socal@d,10000/sf@0,0/ssd@w2100000c508510d4,0 (ssd12): Jan 18 05:07:22 ni5xit Error for Command: write(10) Error Level: Retryable Jan 18 05:07:22 ni5xit scsi: [ID 107833 kern.notice] Requested Block: 69216224 Error Block: 69216224 Jan 18 05:07:22 ni5xit scsi: [ID 107833 kern.notice] Vendor: SEAGATE Serial Number: 0348B6HJEH Jan 18 05:07:22 ni5xit scsi: [ID 107833 kern.notice] Sense Key: Hardware Error Jan 18 05:07:22 ni5xit scsi: [ID 107833 kern.notice] ASC: 0x15 (), ASCQ: 0x1, FRU: 0x1 Jan 18 05:07:23 ni5xit scsi: [ID 107833 kern.warning] WARNING: /sbus@2,0/SUNW,socal@d,10000/sf@0,0/ssd@w2100000c508510d4,0 (ssd12): Jan 18 05:07:23 ni5xit Error for Command: write(10) Error Level: Retryable Jan 18 05:07:23 ni5xit scsi: [ID 107833 kern.notice] Requested Block: 69216224 Error Block: 69216224 Jan 18 05:07:23 ni5xit scsi: [ID 107833 kern.notice] Vendor: SEAGATE Serial Number: 0348B6HJEH Jan 18 05:07:23 ni5xit scsi: [ID 107833 kern.notice] Sense Key: Unit Attention Jan 18 05:07:23 ni5xit scsi: [ID 107833 kern.notice] ASC: 0x29 (), ASCQ: 0x3, FRU: 0x4 Jan 18 05:07:24 ni5xit scsi: [ID 107833 kern.warning] WARNING: /sbus@2,0/SUNW,socal@d,10000/sf@0,0/ssd@w2100000c508510d4,0 (ssd12): Jan 18 05:07:24 ni5xit Error for Command: write(10) Error Level: Retryable Jan 18 05:07:24 ni5xit scsi: [ID 107833 kern.notice] Requested Block: 69216224 Error Block: 69216224 Jan 18 05:07:24 ni5xit scsi: [ID 107833 kern.notice] Vendor: SEAGATE Serial Number: 0348B6HJEH Jan 18 05:07:24 ni5xit scsi: [ID 107833 kern.notice] Sense Key: Hardware Error Jan 18 05:07:24 ni5xit scsi: [ID 107833 kern.notice] ASC: 0x15 (), ASCQ: 0x1, FRU: 0x1 Jan 18 05:07:24 ni5xit scsi: [ID 107833 kern.warning] WARNING: /sbus@2,0/SUNW,socal@d,10000/sf@0,0/ssd@w2100000c508510d4,0 (ssd12): Jan 18 05:07:24 ni5xit Error for Command: write(10) Error Level: Fatal Jan 18 05:07:24 ni5xit scsi: [ID 107833 kern.notice] Requested Block: 69216224 Error Block: 69216224 Jan 18 05:07:24 ni5xit scsi: [ID 107833 kern.notice] Vendor: SEAGATE Serial Number: 0348B6HJEH Jan 18 05:07:24 ni5xit scsi: [ID 107833 kern.notice] Sense Key: Hardware Error Jan 18 05:07:24 ni5xit scsi: [ID 107833 kern.notice] ASC: 0x15 (), ASCQ: 0x1, FRU: 0x1 Jan 18 05:07:24 ni5xit md_stripe: [ID 641072 kern.warning] WARNING: md: d17: write error on /dev/dsk/c0t3d0s0 Jan 18 05:07:24 ni5xit md_mirror: [ID 842313 kern.info] NOTICE: md: d17: B_FAILFAST I/O retry Jan 18 05:07:25 ni5xit scsi: [ID 107833 kern.warning] WARNING: /sbus@2,0/SUNW,socal@d,10000/sf@0,0/ssd@w2100000c508510d4,0 (ssd12): Jan 18 05:07:25 ni5xit Error for Command: write(10) Error Level: Retryable Jan 18 05:07:25 ni5xit scsi: [ID 107833 kern.notice] Requested Block: 69216224 Error Block: 69216226 Jan 18 05:07:25 ni5xit scsi: [ID 107833 kern.notice] Vendor: SEAGATE Serial Number: 0348B6HJEH Jan 18 05:07:25 ni5xit scsi: [ID 107833 kern.notice] Sense Key: Hardware Error Jan 18 05:07:25 ni5xit scsi: [ID 107833 kern.notice] ASC: 0x15 (), ASCQ: 0x1, FRU: 0x1 Jan 18 05:07:25 ni5xit md_mirror: [ID 726726 kern.info] NOTICE: md: d17: spurious error; B_FAILFAST I/O retry succeeded Jan 18 05:07:26 ni5xit scsi: [ID 107833 kern.warning] WARNING: /sbus@2,0/SUNW,socal@d,10000/sf@0,0/ssd@w2100000c508510d4,0 (ssd12): Jan 18 05:07:26 ni5xit Error for Command: write(10) Error Level: Retryable Jan 18 05:07:26 ni5xit scsi: [ID 107833 kern.notice] Requested Block: 69216240 Error Block: 69216240 Jan 18 05:07:26 ni5xit scsi: [ID 107833 kern.notice] Vendor: SEAGATE Serial Number: 0348B6HJEH Jan 18 05:07:26 ni5xit scsi: [ID 107833 kern.notice] Sense Key: Hardware Error Jan 18 05:07:26 ni5xit scsi: [ID 107833 kern.notice] ASC: 0x15 (), ASCQ: 0x1, FRU: 0x1 Jan 18 05:07:30 ni5xit scsi: [ID 243001 kern.info] /sbus@2,0/SUNW,socal@d,10000/sf@0,0 (sf0): Jan 18 05:07:30 ni5xit Open failure to target 0x3 forcing LIP Jan 18 05:07:30 ni5xit scsi: [ID 107833 kern.notice] /sbus@2,0/SUNW,socal@d,10000/sf@0,0 (sf0): Jan 18 05:07:30 ni5xit Forcing lip Jan 18 05:07:30 ni5xit socal: [ID 403145 kern.info] ID[SUNWssa.socal.link.5010] socal0: port 0: Fibre Channel is OFFLINE Jan 18 05:07:30 ni5xit socal: [ID 403145 kern.info] ID[SUNWssa.socal.link.6010] socal0: port 0: Fibre Channel Loop is ONLINE Jan 18 05:07:30 ni5xit scsi: [ID 243001 kern.info] /sbus@2,0/SUNW,socal@d,10000/sf@0,0 (sf0): Jan 18 05:07:30 ni5xit target 0x3 al_pa 0xe2 lun 0 offlined Jan 18 05:07:30 ni5xit scsi: [ID 107833 kern.warning] WARNING: /sbus@2,0/SUNW,socal@d,10000/sf@0,0/ssd@w21000004cfb56c46,0 (ssd2): Jan 18 05:07:30 ni5xit Error for Command: write(10) Error Level: Retryable Jan 18 05:07:30 ni5xit scsi: [ID 107833 kern.notice] Requested Block: 51379462 Error Block: 51379462 Jan 18 05:07:30 ni5xit scsi: [ID 107833 kern.notice] Vendor: SEAGATE Serial Number: 0243P23MVX Jan 18 05:07:30 ni5xit scsi: [ID 107833 kern.notice] Sense Key: Unit Attention Jan 18 05:07:30 ni5xit scsi: [ID 107833 kern.notice] ASC: 0x29 (power on, reset, or bus reset occurred), ASCQ: 0x0, FRU: 0x3 Jan 18 05:07:30 ni5xit scsi: [ID 107833 kern.warning] WARNING: /sbus@2,0/SUNW,socal@d,10000/sf@0,0/ssd@w2100000c508510d4,0 (ssd12): Jan 18 05:07:30 ni5xit transport rejected fatal error Jan 18 05:07:30 ni5xit md_stripe: [ID 641072 kern.warning] WARNING: md: d17: write error on /dev/dsk/c0t3d0s0 Jan 18 05:07:30 ni5xit last message repeated 2 times Jan 18 05:07:30 ni5xit md_mirror: [ID 842313 kern.info] NOTICE: md: d17: B_FAILFAST I/O retry Jan 18 05:07:30 ni5xit md_stripe: [ID 641072 kern.warning] WARNING: md: d17: write error on /dev/dsk/c0t3d0s0 Jan 18 05:07:30 ni5xit md: [ID 680156 kern.info] NOTICE: md: d17: B_FAILFAST I/O retry, 2 buf(s) dequeued Jan 18 05:07:31 ni5xit socal: [ID 403145 kern.info] ID[SUNWssa.socal.link.5010] socal0: port 0: Fibre Channel is OFFLINE Jan 18 05:07:31 ni5xit socal: [ID 403145 kern.info] ID[SUNWssa.socal.link.6010] socal0: port 0: Fibre Channel Loop is ONLINE Jan 18 05:07:32 ni5xit scsi: [ID 107833 kern.warning] WARNING: /sbus@2,0/SUNW,socal@d,10000/sf@0,0/ssd@w21000004cfb56c46,0 (ssd2): Jan 18 05:07:32 ni5xit Error for Command: write(10) Error Level: Retryable Jan 18 05:07:32 ni5xit scsi: [ID 107833 kern.notice] Requested Block: 51379462 Error Block: 51379462 Jan 18 05:07:32 ni5xit scsi: [ID 107833 kern.notice] Vendor: SEAGATE Serial Number: 0243P23MVX Jan 18 05:07:32 ni5xit scsi: [ID 107833 kern.notice] Sense Key: Unit Attention Jan 18 05:07:32 ni5xit scsi: [ID 107833 kern.notice] ASC: 0x29 (power on, reset, or bus reset occurred), ASCQ: 0x0, FRU: 0x3 Jan 18 05:07:37 ni5xit md_mirror: [ID 104909 kern.warning] WARNING: md: d17: /dev/dsk/c0t3d0s0 needs maintenance Jan 18 05:07:37 ni5xit scsi: [ID 107833 kern.warning] WARNING: /sbus@2,0/SUNW,socal@d,10000/sf@0,0/ssd@w21000004cf9b556c,0 (ssd8): Jan 18 05:07:37 ni5xit Error for Command: write(10) Error Level: Retryable Jan 18 05:07:37 ni5xit scsi: [ID 107833 kern.notice] Requested Block: 69206544 Error Block: 69206544 Jan 18 05:07:37 ni5xit scsi: [ID 107833 kern.notice] Vendor: SEAGATE Serial Number: 0220K1PFKR Jan 18 05:07:37 ni5xit scsi: [ID 107833 kern.notice] Sense Key: Unit Attention Jan 18 05:07:37 ni5xit scsi: [ID 107833 kern.notice] ASC: 0x29 (power on, reset, or bus reset occurred), ASCQ: 0x0, FRU: 0x3 Jan 18 05:07:37 ni5xit scsi: [ID 107833 kern.warning] WARNING: /sbus@2,0/SUNW,socal@d,10000/sf@0,0/ssd@w21000004cf83f8f0,0 (ssd3): Jan 18 05:07:37 ni5xit Error for Command: write(10) Error Level: Retryable Jan 18 05:07:37 ni5xit scsi: [ID 107833 kern.notice] Requested Block: 33898976 Error Block: 33898976 Jan 18 05:07:37 ni5xit scsi: [ID 107833 kern.notice] Vendor: SEAGATE Serial Number: 0215P1GHRT Jan 18 05:07:37 ni5xit scsi: [ID 107833 kern.notice] Sense Key: Unit Attention Jan 18 05:07:37 ni5xit scsi: [ID 107833 kern.notice] ASC: 0x29 (power on, reset, or bus reset occurred), ASCQ: 0x0, FRU: 0x3 Jan 18 07:24:44 ni5xit xntpd[340]: [ID 774427 daemon.notice] time reset (slew) 0.167736 s Jan 18 09:12:47 ni5xit SAPXIT_00[14294]: [ID 594495 user.error] Unable to open trace file sapstartsrv.log. (Error 11 Resource temporarily unavailable) [ntservsserver.cpp 1909] Jan 18 09:13:18 ni5xit SAPXIT_01[14336]: [ID 594495 user.error] Unable to open trace file sapstartsrv.log. (Error 11 Resource temporarily unavailable) [ntservsserver.cpp 1909] bash-2.05#
Then check svm status:
//确认SVM状态。
bash-2.05# /usr/sbin/metastat d7 d7: Mirror Submirror 0: d27 State: Okay Submirror 1: d17 State: Needs maintenance Pass: 1 Read option: roundrobin (default) Write option: parallel (default) Size: 286678272 blocks (136 GB) d27: Submirror of d7 State: Okay Size: 286678272 blocks (136 GB) Stripe 0: (interlace: 32 blocks) Device Start Block Dbase State Reloc Hot Spare c1t6d0s0 0 No Okay Yes c1t7d0s0 10176 No Okay Yes d17: Submirror of d7 State: Needs maintenance Invoke: metareplace d7 c0t3d0s0 <new device> Size: 286678272 blocks (136 GB) Stripe 0: (interlace: 32 blocks) Device Start Block Dbase State Reloc Hot Spare c0t2d0s0 0 No Okay Yes c0t3d0s0 10176 No Maintenance Yes Device Relocation Information: Device Reloc Device ID c1t6d0 Yes id1,ssd@w20000004cf9b6c14 c1t7d0 Yes id1,ssd@w20000004cf98bfbc c0t2d0 Yes id1,ssd@w20000004cf9b556c c0t3d0 Yes id1,ssd@w2000000c508510d4
As wee can see, c0t3d0s0 is failed disk and needs replacement. Now we determine disk’s wwn and replace it.
//确认故障盘的WWN。
bash-2.05# luxadm probe No Network Array enclosures found in /dev/es Found Fibre Channel device(s): Node WWN:2000000c508510d4 Device Type:Disk device Logical Path:/dev/rdsk/c0t3d0s2 Node WWN:20000004cf9b556c Device Type:Disk device Logical Path:/dev/rdsk/c0t2d0s2 Node WWN:20000004cfb56c46 Device Type:Disk device Logical Path:/dev/rdsk/c0t0d0s2 Node WWN:20000004cf83f8f0 Device Type:Disk device Logical Path:/dev/rdsk/c0t1d0s2 Node WWN:20000004cf7813ec Device Type:Disk device Logical Path:/dev/rdsk/c1t4d0s2 Node WWN:20000004cf683483 Device Type:Disk device Logical Path:/dev/rdsk/c1t5d0s2 Node WWN:20000004cf98bfbc Device Type:Disk device Logical Path:/dev/rdsk/c1t7d0s2 Node WWN:20000004cf9b6c14 Device Type:Disk device Logical Path:/dev/rdsk/c1t6d0s2 bash-2.05# luxadm display 2000000c508510d4 DEVICE PROPERTIES for disk: 2000000c508510d4 Status(Port A): O.K. Vendor: SEAGATE Product ID: ST373307FSUN72G WWN(Node): 2000000c508510d4 WWN(Port A): 2100000c508510d4 Revision: 0307 Serial Num: 3HZ6HJEH0000 Unformatted capacity: 70007.195 MBytes Read Cache: Enabled Minimum prefetch: 0x0 Maximum prefetch: 0xffff Device Type: Disk device Path(s): /dev/rdsk/c0t3d0s2 /devices/sbus@2,0/SUNW,socal@d,10000/sf@0,0/ssd@w2100000c508510d4,0:c,raw bash-2.05#
So, we need brand new 72G FC-AL disk, model ST373307
First try to save old VTOC.
//保持VTOC。如果有必要,应把故障盘的镜像拆除,并清除。
bash-2.05# prtvtoc /dev/rdsk/c0t3d0s2 > /root/c0t3d0s2.vtoc
Now, stop, remove and insert new disk.
sh-2.05# luxadm stop 2000000c508510d4 sh-2.05# luxadm remove_device 2000000c508510d4
//luxadm reove_device -F 也可以接逻辑路径或物理路径。 WARNING!!! Please ensure that no filesystems are mounted on these device(s). All data on these devices should have been backed up. The list of devices which will be removed is: 1: Device name: 2000000c508510d4 Node WWN: 2000000c508510d4 Device Type:Disk device Device Paths: /dev/rdsk/c0t3d0s2 Please verify the above list of devices and then enter 'c' or to Continue or 'q' to Quit. [Default: c]: stopping: /dev/rdsk/c0t3d0s2....Done offlining: /dev/rdsk/c0t3d0s2....Done Hit after removing the device(s).
//注意这个提示。
Device: /dev/rdsk/c0t3d0s2 Logical Nodes being removed under /dev/dsk/ and /dev/rdsk: c0t3d0s0 c0t3d0s1 c0t3d0s2 c0t3d0s3 c0t3d0s4 c0t3d0s5 c0t3d0s6 c0t3d0s7 sh-2.05# luxadm insert_device Please hit when you have finished adding Fibre Channel Enclosure(s)/Device(s): Waiting for Loop Initialization to complete... New Logical Nodes under /dev/dsk and /dev/rdsk : c0t3d0s0 c0t3d0s1 c0t3d0s2 c0t3d0s3 c0t3d0s4 c0t3d0s5 c0t3d0s6 c0t3d0s7 No new enclosure(s) were added!!
Restore VTOC and rebuild degraded mirror.
//回复VTOC
sh-2.05# fmthard -s - /dev/rdsk/c0t3d0s2 < /root/ct3d0s2.vtoc fmthard: New volume table of contents now in place. sh-2.05# metastat d7 d7: Mirror Submirror 0: d27 State: Okay Submirror 1: d17 State: Needs maintenance Pass: 1 Read option: roundrobin (default) Write option: parallel (default) Size: 286678272 blocks (136 GB) d27: Submirror of d7 State: Okay Size: 286678272 blocks (136 GB) Stripe 0: (interlace: 32 blocks) Device Start Block Dbase State Reloc Hot Spare c1t6d0s0 0 No Okay Yes c1t7d0s0 10176 No Okay Yes d17: Submirror of d7 State: Needs maintenance Invoke: metareplace d7 c0t3d0s0 Size: 286678272 blocks (136 GB) Stripe 0: (interlace: 32 blocks) Device Start Block Dbase State Reloc Hot Spare c0t2d0s0 0 No Okay Yes c0t3d0s0 10176 No Maintenance Yes Device Relocation Information: Device Reloc Device ID c1t6d0 Yes id1,ssd@w20000004cf9b6c14 c1t7d0 Yes id1,ssd@w20000004cf98bfbc c0t2d0 Yes id1,ssd@w20000004cf9b556c c0t3d0 Yes id1,ssd@w2000000c508510d4 sh-2.05# metareplace -e d7 c0t3d0s0 d7: device c0t3d0s0 is replaced with c0t3d0s0 sh-2.05# metastat d7 d7: Mirror Submirror 0: d27 State: Okay Submirror 1: d17 State: Resyncing Resync in progress: 0 % done Pass: 1 Read option: roundrobin (default) Write option: parallel (default) Size: 286678272 blocks (136 GB) d27: Submirror of d7 State: Okay Size: 286678272 blocks (136 GB) Stripe 0: (interlace: 32 blocks) Device Start Block Dbase State Reloc Hot Spare c1t6d0s0 0 No Okay Yes c1t7d0s0 10176 No Okay Yes d17: Submirror of d7 State: Resyncing Size: 286678272 blocks (136 GB) Stripe 0: (interlace: 32 blocks) Device Start Block Dbase State Reloc Hot Spare c0t2d0s0 0 No Okay Yes c0t3d0s0 10176 No Resyncing Yes Device Relocation Information: Device Reloc Device ID c1t6d0 Yes id1,ssd@w20000004cf9b6c14 c1t7d0 Yes id1,ssd@w20000004cf98bfbc c0t2d0 Yes id1,ssd@w20000004cf9b556c c0t3d0 Yes id1,ssd@w20000004cfa16daa sh-2.05# sh-2.05# exit