Due to storage outage, some LUNS were disappeared and replaced by spares. When
the original LUNS came back, customer ran "zpool clear zpool05"
(instead of zpool replace) that resulted ZFS clears all the errors on the
original LUN and placed it ONLINE. Now both spare and the original device are
ONLINE:
....
spare ONLINE 0 0 495
c5t600A0B80005BD6FA000002234A9E775Cd0 ONLINE 0 0 0 <<<
Spare
c5t600A0B80005BDF600000027A4A9E7164d0 ONLINE 0 0 0 <<<
original
How one can release the spare? spare cannot be removed because they are in use.
# zpool status zpool05
pool: zpool05
state: ONLINE
scrub: resilver completed after 29h26m with 0 errors on Sat Sep 18
16:37:58 2010
config:
NAME STATE READ
WRITE CKSUM
zpool05 ONLINE 0
0 0
raidz1 ONLINE 0
0 0
c5t600A0B80005BDACC000002974A9E693Ad0 ONLINE 0
0 0
c5t600A0B80005BDF600000026E4A9E7101d0 ONLINE 0
0 0
c5t600A0B80005BD727000003084A9E74C2d0 ONLINE 0
0 0
c5t600A0B80005BDE0B0000023E4A9E74B0d0 ONLINE 0
0 0
c5t600A0B80005BDAB0000003104A9E7389d0 ONLINE 0
0 0
spare ONLINE 0
0 495
c5t600A0B80005BD6FA000002234A9E775Cd0 ONLINE 0
0 0
c5t600A0B80005BDF600000027A4A9E7164d0 ONLINE 0
0 0
c5t600A0B80005BDE70000002334A9E7647d0 ONLINE 0
0 0
spares
c5t600A0B80005BDACC000002A34A9E699Bd0 INUSE in use by
pool ''zpool11''
c5t600A0B80005BDF600000027A4A9E7164d0 INUSE currently
in use
c5t600A0B80005BD6FA0000022F4A9E77AFd0 INUSE in use by
pool ''zpool10''
errors: No known data errors