zfs discuss - Jun 2010 - Processes hang in /dev/zvol/dsk/poolname

After multiple power outages caused by storms coming through, I can no
longer access /dev/zvol/dsk/poolname, which are hold l2arc and slog devices
in another pool I don''t think this is related, since I the pools are
ofline
pending access to the volumes.

I tried running find /dev/zvol/dsk/poolname -type f and here is the stack,
hopefully this someone a hint at what the issue is, I have scrubbed the pool
and no errors were found, and zdb -l reports no issues that I can see.

::ps ! grep find

R   1248   1243   1248   1243    101 0x4a004000 ffffff02630d5728 find
> ffffff02630d5728::walk thread | ::findstack
stack pointer for thread ffffff025f15b3e0: ffffff000cb54650

[ ffffff000cb54650 _resume_from_idle+0xf1() ]

  ffffff000cb54680 swtch+0x145()

  ffffff000cb546b0 cv_wait+0x61()

  ffffff000cb54700 txg_wait_synced+0x7c()

  ffffff000cb54770 zil_replay+0xe8()

  ffffff000cb54830 zvol_create_minor+0x227()

  ffffff000cb54850 sdev_zvol_create_minor+0x19()

  ffffff000cb549c0 devzvol_create_link+0x49()

  ffffff000cb54ad0 sdev_call_dircallback+0xfe()

  ffffff000cb54c20 devname_lookup_func+0x4cf()

  ffffff000cb54ca0 devzvol_lookup+0xf8()

  ffffff000cb54d20 sdev_iter_datasets+0xb0()

  ffffff000cb54da0 devzvol_readdir+0xd6()

  ffffff000cb54e20 fop_readdir+0xab()

  ffffff000cb54ec0 getdents64+0xbc()

  ffffff000cb54f10 sys_syscall32+0xff()


-- DISK---
-bash-4.0$ sudo /usr/sbin/zdb -l /dev/dsk/c7t1d0s0
--------------------------------------------
LABEL 0
--------------------------------------------
    version: 22
    name: ''puddle''
    state: 0
    txg: 55553139
    pool_guid: 13462109782214169516
    hostid: 4421991
    hostname: ''amd''
    top_guid: 15895240748538558983
    guid: 15895240748538558983
    vdev_children: 2
    vdev_tree:
        type: ''disk''
        id: 0
        guid: 15895240748538558983
        path: ''/dev/dsk/c7t1d0s0''
        devid: ''id1,sd at
SATA_____Hitachi_HDT72101______STF607MH3A3KSK/a''
        phys_path: ''/pci at 0,0/pci1043,8231 at 12/disk at
1,0:a''
        whole_disk: 1
        metaslab_array: 23
        metaslab_shift: 33
        ashift: 9
        asize: 1000191557632
        is_log: 0
        DTL: 605
--------------------------------------------
LABEL 1
--------------------------------------------
    version: 22
    name: ''puddle''
    state: 0
    txg: 55553139
    pool_guid: 13462109782214169516
    hostid: 4421991
    hostname: ''amd''
    top_guid: 15895240748538558983
    guid: 15895240748538558983
    vdev_children: 2
    vdev_tree:
        type: ''disk''
        id: 0
        guid: 15895240748538558983
        path: ''/dev/dsk/c7t1d0s0''
        devid: ''id1,sd at
SATA_____Hitachi_HDT72101______STF607MH3A3KSK/a''
        phys_path: ''/pci at 0,0/pci1043,8231 at 12/disk at
1,0:a''
        whole_disk: 1
        metaslab_array: 23
        metaslab_shift: 33
        ashift: 9
        asize: 1000191557632
        is_log: 0
        DTL: 605
--------------------------------------------
LABEL 2
--------------------------------------------
    version: 22
    name: ''puddle''
    state: 0
    txg: 55553139
    pool_guid: 13462109782214169516
    hostid: 4421991
    hostname: ''amd''
    top_guid: 15895240748538558983
    guid: 15895240748538558983
    vdev_children: 2
    vdev_tree:
        type: ''disk''
        id: 0
        guid: 15895240748538558983
        path: ''/dev/dsk/c7t1d0s0''
        devid: ''id1,sd at
SATA_____Hitachi_HDT72101______STF607MH3A3KSK/a''
        phys_path: ''/pci at 0,0/pci1043,8231 at 12/disk at
1,0:a''
        whole_disk: 1
        metaslab_array: 23
        metaslab_shift: 33
        ashift: 9
        asize: 1000191557632
        is_log: 0
        DTL: 605
--------------------------------------------
LABEL 3
--------------------------------------------
    version: 22
    name: ''puddle''
    state: 0
    txg: 55553139
    pool_guid: 13462109782214169516
    hostid: 4421991
    hostname: ''amd''
    top_guid: 15895240748538558983
    guid: 15895240748538558983
    vdev_children: 2
    vdev_tree:
        type: ''disk''
        id: 0
        guid: 15895240748538558983
        path: ''/dev/dsk/c7t1d0s0''
        devid: ''id1,sd at
SATA_____Hitachi_HDT72101______STF607MH3A3KSK/a''
        phys_path: ''/pci at 0,0/pci1043,8231 at 12/disk at
1,0:a''
        whole_disk: 1
        metaslab_array: 23
        metaslab_shift: 33
        ashift: 9
        asize: 1000191557632
        is_log: 0
        DTL: 605
-bash-4.0$


there is also a volume attached that is part of the roolt pool that is
accessed fine but zdb -l  is not returning from zdb -l

bash-4.0# /usr/sbin/zpool status -v
  pool: puddle
 state: ONLINE
 scrub: none requested
config:

        NAME                               STATE     READ WRITE CKSUM
        puddle                             ONLINE       0     0     0
          c7t1d0                           ONLINE       0     0     0
        logs
          /dev/zvol/dsk/rpool/puddle_slog  ONLINE       0     0     0


zfs list -rt volume puddle
NAME                USED  AVAIL  REFER  MOUNTPOINT
puddle/l2arc       8.25G   538G  7.20G  -
puddle/log_test    1.25G   537G  1.25G  -
puddle/temp_cache  4.13G   537G  4.00G  -




James Dickens
http://uadmin.blogspot.com
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20100628/1d27340f/attachment.html>