"Thommy M. Malmström"
2008-May-27 07:09 UTC
[zfs-discuss] USB stick unavailable after restart
On OpenSolaris 2008.05 I''ve attached two USB hubs with 4 USB sticks
each. They
show up nice and I create a pool like this:
pfexec zpool create playpool mirror c17t0d0p0 c13t0d0p0
pfexec zpool add playpool mirror c16t0d0p0 c11t0d0p0
pfexec zpool add playpool mirror c15t0d0p0 c10t0d0p0
pfexec zpool add playpool mirror c14t0d0p0 c12t0d0p0
Everything OK. But after a reboot I get this messages for all of the USB sticks:
May 27 08:51:02 bigblue scsi: [ID 107833 kern.warning] WARNING: /pci at
0,0/pci1458
,5004 at 2,1/hub at 7/storage at 1/disk at 0,0 (sd17):
May 27 08:51:02 bigblue Command failed to complete...Device is gone
However if I pull the sticks and then in again the devices comes back, but I
cannot import the pool. Is this known problems?
Initial error messages:
thommym at bigblue:~$ zpool status -x
pool: playpool
state: FAULTED
status: One or more devices could not be opened. There are insufficient
replicas for the pool to continue functioning.
action: Attach the missing device and online it using ''zpool
online''.
see: http://www.sun.com/msg/ZFS-8000-3C
scrub: none requested
config:
NAME STATE READ WRITE CKSUM
playpool FAULTED 0 0 0 corrupted data
mirror UNAVAIL 0 0 0 insufficient replicas
c17t0d0p0 UNAVAIL 0 0 0 cannot open
c13t0d0p0 UNAVAIL 0 0 0 cannot open
mirror UNAVAIL 0 0 0 insufficient replicas
c16t0d0p0 UNAVAIL 0 0 0 cannot open
c11t0d0p0 UNAVAIL 0 0 0 cannot open
mirror DEGRADED 0 0 0
c15t0d0p0 UNAVAIL 0 0 0 cannot open
c10t0d0p0 ONLINE 0 0 0
mirror ONLINE 0 0 0
c14t0d0p0 ONLINE 0 0 0
c12t0d0p0 ONLINE 0 0 0
Pull out 4 Sticks in one HUB (and insert them again):
thommym at bigblue:~$ zpool status -x
pool: playpool
state: DEGRADED
status: One or more devices could not be opened. Sufficient replicas exist for
the pool to continue functioning in a degraded state.
action: Attach the missing device and online it using ''zpool
online''.
see: http://www.sun.com/msg/ZFS-8000-2Q
scrub: resilver completed after 0h0m with 0 errors on Tue May 27 08:58:06 2008
config:
NAME STATE READ WRITE CKSUM
playpool DEGRADED 0 0 0
mirror DEGRADED 0 0 0
c17t0d0p0 UNAVAIL 0 0 0 cannot open
c13t0d0p0 ONLINE 0 0 0
mirror DEGRADED 0 0 0
c16t0d0p0 UNAVAIL 0 0 0 cannot open
c11t0d0p0 ONLINE 0 0 0
mirror DEGRADED 0 0 0
c15t0d0p0 UNAVAIL 0 0 0 cannot open
c10t0d0p0 ONLINE 0 0 0
mirror ONLINE 0 0 0
c14t0d0p0 ONLINE 0 0 0
c12t0d0p0 ONLINE 0 0 0
errors: No known data errors
Pull out remaining 4 Sticks in other HUB:
thommym at bigblue:~$ zpool status -x
all pools are healthy
thommym at bigblue:~$ pfexec zpool import playpool
cannot import ''playpool'': no such pool available
thommym at bigblue:~$ zdb playpool
version=10
name=''playpool''
state=0
txg=5923
pool_guid=299232141550079931
hostid=369565322
hostname=''bigblue''
vdev_tree
type=''root''
id=0
guid=299232141550079931
children[0]
type=''mirror''
id=0
guid=12254456480300888281
metaslab_array=14
metaslab_shift=22
ashift=9
asize=496500736
is_log=0
children[0]
type=''disk''
id=0
guid=4591441546291216823
path=''/dev/dsk/c17t0d0p0''
phys_path=''/pci at 0,0/pci1458,5004 at 2,1/hub at 7/storage at 1/disk
at 0,0:q''
whole_disk=0
DTL=32
children[1]
type=''disk''
id=1
guid=6026493645354425455
path=''/dev/dsk/c13t0d0p0''
phys_path=''/pci at 0,0/pci1458,5004 at 2,1/hub at 8/storage at 1/disk
at 0,0:q''
whole_disk=0
DTL=38
children[1]
type=''mirror''
id=1
guid=15043746296504027047
metaslab_array=18
metaslab_shift=22
ashift=9
asize=496500736
is_log=0
children[0]
type=''disk''
id=0
guid=13853084128031916973
path=''/dev/dsk/c16t0d0p0''
phys_path=''/pci at 0,0/pci1458,5004 at 2,1/hub at 7/storage at 2/disk
at 0,0:q''
whole_disk=0
DTL=31
children[1]
type=''disk''
id=1
guid=5101459295619981186
path=''/dev/dsk/c11t0d0p0''
phys_path=''/pci at 0,0/pci1458,5004 at 2,1/hub at 8/storage at 2/disk
at 0,0:q''
whole_disk=0
DTL=37
children[2]
type=''mirror''
id=2
guid=16966563321915277313
metaslab_array=21
metaslab_shift=22
ashift=9
asize=496500736
is_log=0
children[0]
type=''disk''
id=0
guid=7525083818472313787
path=''/dev/dsk/c15t0d0p0''
phys_path=''/pci at 0,0/pci1458,5004 at 2,1/hub at 7/storage at 3/disk
at 0,0:q''
whole_disk=0
DTL=36
children[1]
type=''disk''
id=1
guid=10762224811680232076
path=''/dev/dsk/c10t0d0p0''
phys_path=''/pci at 0,0/pci1458,5004 at 2,1/hub at 8/storage at 3/disk
at 0,0:q''
whole_disk=0
DTL=35
children[3]
type=''mirror''
id=3
guid=16966017736868417241
metaslab_array=23
metaslab_shift=22
ashift=9
asize=496500736
is_log=0
children[0]
type=''disk''
id=0
guid=3119162689346439024
path=''/dev/dsk/c14t0d0p0''
phys_path=''/pci at 0,0/pci1458,5004 at 2,1/hub at 7/storage at 4/disk
at 0,0:q''
whole_disk=0
DTL=34
children[1]
type=''disk''
id=1
guid=15561879156394056083
path=''/dev/dsk/c12t0d0p0''
phys_path=''/pci at 0,0/pci1458,5004 at 2,1/hub at 8/storage at 4/disk
at 0,0:q''
whole_disk=0
DTL=33
Uberblock
magic = 0000000000bab10c
version = 10
txg = 5926
guid_sum = 17390380626071961524
timestamp = 1211871526 UTC = Tue May 27 08:58:46 2008
Dataset mos [META], ID 0, cr_txg 4, 237K, 39 objects
Dataset playpool/test [ZPL], ID 27, cr_txg 69, 149K, 5 objects
Dataset playpool [ZPL], ID 5, cr_txg 4, 19.0K, 5 objects
Traversing all blocks to verify checksums and verify nothing leaked ...
No leaks (block sum matches space maps exactly)
bp count: 147
bp logical: 1313280 avg: 8933
bp physical: 482816 avg: 3284 compression: 2.72
bp allocated: 1165824 avg: 7930 compression: 1.13
SPA allocated: 1165824 used: 0.06%
capacity operations bandwidth ---- errors ----
description used avail read write read write read write cksum
playpool 1.11M 1.84G 34 0 84.9K 0 0 0 0
mirror 344K 472M 16 0 22.1K 0 0 0 0
/dev/dsk/c17t0d0p0 144 0 178K 0 0 0 1
/dev/dsk/c13t0d0p0 142 0 172K 0 0 0 0
mirror 302K 472M 4 0 8.75K 0 0 0 0
/dev/dsk/c16t0d0p0 132 0 165K 0 0 0 1
/dev/dsk/c11t0d0p0 131 0 163K 0 0 0 0
mirror 36.5K 472M 2 0 2.38K 0 0 0 0
/dev/dsk/c15t0d0p0 130 0 158K 0 0 0 0
/dev/dsk/c10t0d0p0 130 0 158K 0 0 0 0
mirror 457K 472M 11 0 51.6K 0 0 0 0
/dev/dsk/c14t0d0p0 139 0 208K 0 0 0 0
/dev/dsk/c12t0d0p0 138 0 201K 0 0 0 0
thommym at bigblue:~$
> However if I pull the sticks and then in again the devices comes back, but I> cannot import the pool. Is this known problems? I may not be understanding your question, but the pool seems to be intact, and imported, but degraded with the pulled devices not attached. thommym at bigblue:~$ zpool status -x pool: playpool state: DEGRADED status: One or more devices could not be opened. Sufficient replicas exist for the pool to continue functioning in a degraded state. action: Attach the missing device and online it using ''zpool online''. cfgadm zpool replace playpool c17t0d0p0 zpool replace playpool c16t0d0p0 zpool replace playpool c15t0d0p0
"Thommy M. Malmström"
2008-May-27 13:44 UTC
[zfs-discuss] USB stick unavailable after restart
Rob Logan wrote:> > However if I pull the sticks and then in again the devices comes back, but I > > cannot import the pool. Is this known problems? > > I may not be understanding your question, but the pool > seems to be intact, and imported, but degraded with > the pulled devices not attached.Well, there''s loads of text to follow in my posting, but mainly it''s like this: * When the machine boots up it takes "longer than normal" and loads of errors on the screen (as them from /var/adm/messages) * Then "playpool" is not imported or available and "zpool status -x" shows errors as indicated. * Then I pull out the USB sticks from the HUBs and insert them again and the errors disappears. $ zpool status -x all pools are healthy * Trying to import the pool gives $ pfexec zpool import playpool cannot import ''playpool'': no such pool available So, two questions: 1) Is it common that pools on USB sticks are unavailable after a reboot? Follow up on that: Any other command to "scrub" them that I can use? 2) Why can''t I import when "all pools are healthy", the pool is seen by "zpool list" and the status is ONLINE? And NOW I did the magic trick: zpool export and then import. Questions still stand though, I think. thommym at bigblue:/opt/local/src$ zpool list playpool NAME SIZE USED AVAIL CAP HEALTH ALTROOT playpool 1.84G 372K 1.84G 0% ONLINE - thommym at bigblue:/opt/local/src$ zpool status playpool pool: playpool state: ONLINE scrub: resilver completed after 0h0m with 0 errors on Tue May 27 08:58:38 2008 config: NAME STATE READ WRITE CKSUM playpool ONLINE 0 0 0 mirror ONLINE 0 0 0 c17t0d0p0 ONLINE 0 0 0 c13t0d0p0 ONLINE 0 0 0 mirror ONLINE 0 0 0 c16t0d0p0 ONLINE 0 0 0 c11t0d0p0 ONLINE 0 0 0 mirror ONLINE 0 0 0 c15t0d0p0 ONLINE 0 0 0 c10t0d0p0 ONLINE 0 0 0 mirror ONLINE 0 0 0 c14t0d0p0 ONLINE 0 0 0 c12t0d0p0 ONLINE 0 0 0 errors: No known data errors
Thommy M. Malmstr?m wrote:> Rob Logan wrote: > >> > However if I pull the sticks and then in again the devices comes back, but I >> > cannot import the pool. Is this known problems? >> >> I may not be understanding your question, but the pool >> seems to be intact, and imported, but degraded with >> the pulled devices not attached. >> > > Well, there''s loads of text to follow in my posting, but mainly it''s like this: > > * When the machine boots up it takes "longer than normal" and loads of errors on > the screen (as them from /var/adm/messages) > > * Then "playpool" is not imported or available and "zpool status -x" shows errors > as indicated. > > * Then I pull out the USB sticks from the HUBs and insert them again and the > errors disappears. > > $ zpool status -x > > all pools are healthy > > > * Trying to import the pool gives > > $ pfexec zpool import playpool > cannot import ''playpool'': no such pool available > > > > > So, two questions: > > 1) Is it common that pools on USB sticks are unavailable after a reboot? > Follow up on that: Any other command to "scrub" them that I can use? >IIRC, yes, there are hubs which have this behaviour. You might try another kind of hub. -- richard> 2) Why can''t I import when "all pools are healthy", the pool is seen by "zpool > list" and the status is ONLINE? > > > > And NOW I did the magic trick: zpool export and then import. Questions still stand > though, I think. > > > > > > > > > > > thommym at bigblue:/opt/local/src$ zpool list playpool > NAME SIZE USED AVAIL CAP HEALTH ALTROOT > playpool 1.84G 372K 1.84G 0% ONLINE - > thommym at bigblue:/opt/local/src$ zpool status playpool > pool: playpool > state: ONLINE > scrub: resilver completed after 0h0m with 0 errors on Tue May 27 08:58:38 2008 > config: > > NAME STATE READ WRITE CKSUM > playpool ONLINE 0 0 0 > mirror ONLINE 0 0 0 > c17t0d0p0 ONLINE 0 0 0 > c13t0d0p0 ONLINE 0 0 0 > mirror ONLINE 0 0 0 > c16t0d0p0 ONLINE 0 0 0 > c11t0d0p0 ONLINE 0 0 0 > mirror ONLINE 0 0 0 > c15t0d0p0 ONLINE 0 0 0 > c10t0d0p0 ONLINE 0 0 0 > mirror ONLINE 0 0 0 > c14t0d0p0 ONLINE 0 0 0 > c12t0d0p0 ONLINE 0 0 0 > > errors: No known data errors > > _______________________________________________ > zfs-discuss mailing list > zfs-discuss at opensolaris.org > http://mail.opensolaris.org/mailman/listinfo/zfs-discuss >