I just installed SXCE_b78 while having one SuperMicro AOC-SAT2-MV8 card
installed and disks connected to the first 6 sata ports. Now I''ve
installed two more AOC-SAT2-MV8 cards and added some more drives, but
I''m not getting the whole disk (":wd") links for them. For
instance,
the following shows just the original six drives having ":wd" entries
-
how do I get all 24?
# ls -l /dev/dsk/ | grep ":wd$"
lrwxrwxrwx 1 root root 78 Dec 27 17:32 c3t0d0 ->
../../devices/pci at 0,0/pci10de,376 at a/pci1033,125 at 0,1/pci11ab,11ab at
6/disk at 0,0:wd
lrwxrwxrwx 1 root root 78 Dec 27 17:32 c3t1d0 ->
../../devices/pci at 0,0/pci10de,376 at a/pci1033,125 at 0,1/pci11ab,11ab at
6/disk at 1,0:wd
lrwxrwxrwx 1 root root 78 Dec 27 17:32 c3t2d0 ->
../../devices/pci at 0,0/pci10de,376 at a/pci1033,125 at 0,1/pci11ab,11ab at
6/disk at 2,0:wd
lrwxrwxrwx 1 root root 78 Dec 27 17:32 c3t3d0 ->
../../devices/pci at 0,0/pci10de,376 at a/pci1033,125 at 0,1/pci11ab,11ab at
6/disk at 3,0:wd
lrwxrwxrwx 1 root root 78 Dec 27 17:32 c3t4d0 ->
../../devices/pci at 0,0/pci10de,376 at a/pci1033,125 at 0,1/pci11ab,11ab at
6/disk at 4,0:wd
lrwxrwxrwx 1 root root 78 Dec 27 17:32 c3t5d0 ->
../../devices/pci at 0,0/pci10de,376 at a/pci1033,125 at 0,1/pci11ab,11ab at
6/disk at 5,0:wd
Following are the vdevs for my 24-disk array (6 rows x 4 cols):
c3t0d0 c3t1d0 c3t2d0 c3t3d0
c3t4d0 c3t5d0 c3t6d0 c3t7d0
c4t0d0 c4t1d0 c4t2d0 c4t3d0
c4t4d0 c4t5d0 c4t6d0 c4t7d0
c5t0d0 c5t1d0 c5t2d0 c5t3d0
c5t4d0 c5t5d0 c5t6d0 c5t7d0
The 3 AOC-SAT-MV8 cards are "c3", "c4", and "c5"
(I just added 4 and 5)
Thanks!
Kent
These ''whole disk'' links are an artifact of the Solaris EFI
implementation, so they only appear once you have labeled as disk using
an EFI label. ZFS itself doesn''t need them to exist in order to
automatically slap an EFI label down.
If you''re curious, this comes from the fact that the VTOC label
represents the label portion of the disk within the first slice, so if
you write over the first 8k of your slice, you''ll trash your label
(this
is why ZFS never writes to the first 8k of any device). With EFI, the
goal was to separate out the label area from the slices themselves. But
the label portion of the disk needed to be accessible to utilities, so
the end result was the ''c3t0d0'' links without slices.
If you re-label your disks using EFI labels (''format -e'') you
will see
these links. Or just let ZFS work its magic ;-)
- Eric
On Fri, Dec 28, 2007 at 07:35:09AM -0500, Kent wrote:>
> I just installed SXCE_b78 while having one SuperMicro AOC-SAT2-MV8 card
> installed and disks connected to the first 6 sata ports. Now I''ve
> installed two more AOC-SAT2-MV8 cards and added some more drives, but
> I''m not getting the whole disk (":wd") links for them.
For instance,
> the following shows just the original six drives having ":wd"
entries -
> how do I get all 24?
>
> # ls -l /dev/dsk/ | grep ":wd$"
> lrwxrwxrwx 1 root root 78 Dec 27 17:32 c3t0d0 ->
> ../../devices/pci at 0,0/pci10de,376 at a/pci1033,125 at 0,1/pci11ab,11ab
at 6/disk at 0,0:wd
> lrwxrwxrwx 1 root root 78 Dec 27 17:32 c3t1d0 ->
> ../../devices/pci at 0,0/pci10de,376 at a/pci1033,125 at 0,1/pci11ab,11ab
at 6/disk at 1,0:wd
> lrwxrwxrwx 1 root root 78 Dec 27 17:32 c3t2d0 ->
> ../../devices/pci at 0,0/pci10de,376 at a/pci1033,125 at 0,1/pci11ab,11ab
at 6/disk at 2,0:wd
> lrwxrwxrwx 1 root root 78 Dec 27 17:32 c3t3d0 ->
> ../../devices/pci at 0,0/pci10de,376 at a/pci1033,125 at 0,1/pci11ab,11ab
at 6/disk at 3,0:wd
> lrwxrwxrwx 1 root root 78 Dec 27 17:32 c3t4d0 ->
> ../../devices/pci at 0,0/pci10de,376 at a/pci1033,125 at 0,1/pci11ab,11ab
at 6/disk at 4,0:wd
> lrwxrwxrwx 1 root root 78 Dec 27 17:32 c3t5d0 ->
> ../../devices/pci at 0,0/pci10de,376 at a/pci1033,125 at 0,1/pci11ab,11ab
at 6/disk at 5,0:wd
>
> Following are the vdevs for my 24-disk array (6 rows x 4 cols):
>
> c3t0d0 c3t1d0 c3t2d0 c3t3d0
> c3t4d0 c3t5d0 c3t6d0 c3t7d0
> c4t0d0 c4t1d0 c4t2d0 c4t3d0
> c4t4d0 c4t5d0 c4t6d0 c4t7d0
> c5t0d0 c5t1d0 c5t2d0 c5t3d0
> c5t4d0 c5t5d0 c5t6d0 c5t7d0
>
> The 3 AOC-SAT-MV8 cards are "c3", "c4", and
"c5" (I just added 4 and 5)
>
> Thanks!
> Kent
>
>
>
> _______________________________________________
> zfs-discuss mailing list
> zfs-discuss at opensolaris.org
> http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
--
Eric Schrock, FishWorks http://blogs.sun.com/eschrock
Eric Schrock wrote:> Or just let ZFS work its magic ;-) >Oh, I didn''t realize that `zpool create` could be fed vdevs that didn''t exist in /dev/dsk/ - and, as a bonus, it also creates the /dev/dsk/ links! # zpool create -f tank raidz2 c3t0d0 c3t4d0 c4t0d0 c4t4d0 c5t0d0 c5t4d0z # ls -l /dev/dsk/ | grep ":wd$" lrwxrwxrwx 1 root root 78 Dec 27 17:32 c3t0d0 -> ../../devices/pci at 0,0/pci10de,376 at a/pci1033,125 at 0,1/pci11ab,11ab at 6/disk at 0,0:wd lrwxrwxrwx 1 root root 78 Dec 27 17:32 c3t1d0 -> ../../devices/pci at 0,0/pci10de,376 at a/pci1033,125 at 0,1/pci11ab,11ab at 6/disk at 1,0:wd lrwxrwxrwx 1 root root 78 Dec 27 17:32 c3t2d0 -> ../../devices/pci at 0,0/pci10de,376 at a/pci1033,125 at 0,1/pci11ab,11ab at 6/disk at 2,0:wd lrwxrwxrwx 1 root root 78 Dec 27 17:32 c3t3d0 -> ../../devices/pci at 0,0/pci10de,376 at a/pci1033,125 at 0,1/pci11ab,11ab at 6/disk at 3,0:wd lrwxrwxrwx 1 root root 78 Dec 27 17:32 c3t4d0 -> ../../devices/pci at 0,0/pci10de,376 at a/pci1033,125 at 0,1/pci11ab,11ab at 6/disk at 4,0:wd lrwxrwxrwx 1 root root 78 Dec 27 17:32 c3t5d0 -> ../../devices/pci at 0,0/pci10de,376 at a/pci1033,125 at 0,1/pci11ab,11ab at 6/disk at 5,0:wd lrwxrwxrwx 1 root root 76 Dec 28 12:45 c4t0d0 -> ../../devices/pci at 0,0/pci10de,376 at a/pci1033,125 at 0/pci11ab,11ab at 4/disk at 0,0:wd lrwxrwxrwx 1 root root 76 Dec 27 22:38 c4t1d0 -> ../../devices/pci at 0,0/pci10de,376 at a/pci1033,125 at 0/pci11ab,11ab at 4/disk at 1,0:wd lrwxrwxrwx 1 root root 76 Dec 27 22:38 c4t4d0 -> ../../devices/pci at 0,0/pci10de,376 at a/pci1033,125 at 0/pci11ab,11ab at 4/disk at 4,0:wd lrwxrwxrwx 1 root root 76 Dec 28 12:45 c5t0d0 -> ../../devices/pci at 0,0/pci10de,376 at a/pci1033,125 at 0/pci11ab,11ab at 6/disk at 0,0:wd lrwxrwxrwx 1 root root 76 Dec 28 12:45 c5t4d0 -> ../../devices/pci at 0,0/pci10de,376 at a/pci1033,125 at 0/pci11ab,11ab at 6/disk at 4,0:wd Thanks for the pointer! Kent