I''m trying to configure a DELL R720 (not a pleasant experience) which has an H710p card fitted. The H710p definitely doesn''t support JBOD, but the H310 looks like it might (the data sheet mentions non-RAID). Has anyone used one with ZFS? Thanks, -- Ian.
I am currently trying to get two of these things running Illumian. I don''t have any particular performance requirements, so I''m thinking of using some sort of supported hypervisor, (either RHEL and KVM or VMware ESXi) to get around the driver support issues, and passing the disks through to an Illumian guest. The H310 does indeed support pass-through (the non-raid mode), but one thing to keep in mind is that I was only able to configure a single boot disk. I configured the rear two drives into a hardware raid 1 and set the virtual disk as the boot disk so that I can still boot the system if an OS disk fails. Once Illumos is better supported on the R720 and the PERC H310, I plan to get rid of the hypervisor silliness and run Illumos on bare metal. -Greg Sent from my iPhone
On 05/ 7/12 03:42 PM, Greg Mason wrote:> I am currently trying to get two of these things running Illumian. I don''t have any particular performance requirements, so I''m thinking of using some sort of supported hypervisor, (either RHEL and KVM or VMware ESXi) to get around the driver support issues, and passing the disks through to an Illumian guest. > > The H310 does indeed support pass-through (the non-raid mode), but one thing to keep in mind is that I was only able to configure a single boot disk. I configured the rear two drives into a hardware raid 1 and set the virtual disk as the boot disk so that I can still boot the system if an OS disk fails. > > Once Illumos is better supported on the R720 and the PERC H310, I plan to get rid of the hypervisor silliness and run Illumos on bare metal.Thank you for the feedback Greg. Using a hypervisor layer is our fall-back position. My next attempt would be SmartOs if I can''t get the cards swapped (the R720 currently has a Broadcom 5720 NIC). -- Ian.
Igor Kozhukhov
2012-May-10 04:56 UTC
[zfs-discuss] Has anyone used a Dell with a PERC H310?
Greg Mason <gmason <at> msu.edu> writes:> > I am currently trying to get two of these things running Illumian. I don''thave any particular performance> requirements, so I''m thinking of using some sort of supported hypervisor,(either RHEL and KVM or VMware> ESXi) to get around the driver support issues, and passing the disksthrough to an Illumian guest.> > The H310 does indeed support pass-through (the non-raid mode), butone thing to keep in mind is that I was> only able to configure a single boot disk. I configured the rear two drivesinto a hardware raid 1 and set the> virtual disk as the boot disk so that I can still boot the system if an OSdisk fails.> > Once Illumos is better supported on the R720 and the PERC H310, I planto get rid of the hypervisor silliness> and run Illumos on bare metal. > > -Greg >Hi Greg, could you please reply: what driver you have for this card on illumian ? could you please send me your ''modinfo'' & ''scanpci -v'' I have one chassis Dell R720 with PERC H310, but card not detected by drivers: mr_sas, mega_sas, mpt_sas .. best regards, -Igor
Sašo Kiselkov
2012-May-27 09:24 UTC
[zfs-discuss] Has anyone used a Dell with a PERC H310?
On 05/07/2012 05:42 AM, Greg Mason wrote:> I am currently trying to get two of these things running Illumian. I don''t have any particular performance requirements, so I''m thinking of using some sort of supported hypervisor, (either RHEL and KVM or VMware ESXi) to get around the driver support issues, and passing the disks through to an Illumian guest. > > The H310 does indeed support pass-through (the non-raid mode), but one thing to keep in mind is that I was only able to configure a single boot disk. I configured the rear two drives into a hardware raid 1 and set the virtual disk as the boot disk so that I can still boot the system if an OS disk fails. > > Once Illumos is better supported on the R720 and the PERC H310, I plan to get rid of the hypervisor silliness and run Illumos on bare metal.How about reflashing LSI firmware to the card? I read on Dell''s spec sheets that the card runs an LSISAS2008 chip, so chances are that standard LSI firmware will work on it. I can send you all the required bits to do the reflash, if you like. Cheers, -- Saso
On 05/ 7/12 04:08 PM, Ian Collins wrote:> On 05/ 7/12 03:42 PM, Greg Mason wrote: >> I am currently trying to get two of these things running Illumian. I don''t have any particular performance requirements, so I''m thinking of using some sort of supported hypervisor, (either RHEL and KVM or VMware ESXi) to get around the driver support issues, and passing the disks through to an Illumian guest. >> >> The H310 does indeed support pass-through (the non-raid mode), but one thing to keep in mind is that I was only able to configure a single boot disk. I configured the rear two drives into a hardware raid 1 and set the virtual disk as the boot disk so that I can still boot the system if an OS disk fails. >> >> Once Illumos is better supported on the R720 and the PERC H310, I plan to get rid of the hypervisor silliness and run Illumos on bare metal. > Thank you for the feedback Greg. > > Using a hypervisor layer is our fall-back position. My next attempt > would be SmartOs if I can''t get the cards swapped (the R720 currently > has a Broadcom 5720 NIC). >To follow up, the H310 appears to be useless in non-raid mode. The drives do show up in Solaris 11 format, but they show up as unknown, unformatted drives. One oddity is the box has two SATA SSDs which also show up the card''s BIOS, but present OK to Solaris. I''d like to re-FLASH the cards, but I don''t think Dell would be too happy with me doing that on an evaluation system... -- Ian.
Sašo Kiselkov
2012-May-28 08:55 UTC
[zfs-discuss] Has anyone used a Dell with a PERC H310?
On 05/28/2012 10:48 AM, Ian Collins wrote:> To follow up, the H310 appears to be useless in non-raid mode. > > The drives do show up in Solaris 11 format, but they show up as > unknown, unformatted drives. One oddity is the box has two SATA > SSDs which also show up the card''s BIOS, but present OK to > Solaris. > > I''d like to re-FLASH the cards, but I don''t think Dell would be > too happy with me doing that on an evaluation system...If the drives show up at all, chances are you only need to work around the power-up issue in Dell HDD firmware. Here''s what I had to do to get the drives going in my R515: /kernel/drv/sd.conf sd-config-list = "SEAGATE ST3300657SS", "power-condition:false", "SEAGATE ST2000NM0001", "power-condition:false"; (that''s for Seagate 300GB 15k SAS and 2TB 7k2 SAS drives, depending on your drive model the strings might differ) -- Saso
On 05/28/12 08:55 PM, Sa?o Kiselkov wrote:> On 05/28/2012 10:48 AM, Ian Collins wrote: >> To follow up, the H310 appears to be useless in non-raid mode. >> >> The drives do show up in Solaris 11 format, but they show up as >> unknown, unformatted drives. One oddity is the box has two SATA >> SSDs which also show up the card''s BIOS, but present OK to >> Solaris. >> >> I''d like to re-FLASH the cards, but I don''t think Dell would be >> too happy with me doing that on an evaluation system... > If the drives show up at all, chances are you only need to work around > the power-up issue in Dell HDD firmware. > > Here''s what I had to do to get the drives going in my R515: > /kernel/drv/sd.conf > > sd-config-list = "SEAGATE ST3300657SS", "power-condition:false", > "SEAGATE ST2000NM0001", "power-condition:false"; > > (that''s for Seagate 300GB 15k SAS and 2TB 7k2 SAS drives, depending on > your drive model the strings might differ)How would that work when the drive type is unknown (to format)? I assumed if sd knows the type, so will format. -- Ian.
Sašo Kiselkov
2012-May-28 10:53 UTC
[zfs-discuss] Has anyone used a Dell with a PERC H310?
On 05/28/2012 11:48 AM, Ian Collins wrote:> On 05/28/12 08:55 PM, Sa?o Kiselkov wrote: >> On 05/28/2012 10:48 AM, Ian Collins wrote: >>> To follow up, the H310 appears to be useless in non-raid mode. >>> >>> The drives do show up in Solaris 11 format, but they show up as >>> unknown, unformatted drives. One oddity is the box has two SATA >>> SSDs which also show up the card''s BIOS, but present OK to >>> Solaris. >>> >>> I''d like to re-FLASH the cards, but I don''t think Dell would be >>> too happy with me doing that on an evaluation system... >> If the drives show up at all, chances are you only need to work around >> the power-up issue in Dell HDD firmware. >> >> Here''s what I had to do to get the drives going in my R515: >> /kernel/drv/sd.conf >> >> sd-config-list = "SEAGATE ST3300657SS", "power-condition:false", >> "SEAGATE ST2000NM0001", "power-condition:false"; >> >> (that''s for Seagate 300GB 15k SAS and 2TB 7k2 SAS drives, depending on >> your drive model the strings might differ) > > How would that work when the drive type is unknown (to format)? I > assumed if sd knows the type, so will format.Simply take out the drive and have a look at the label. -- Saso
On 05/28/12 10:53 PM, Sa?o Kiselkov wrote:> On 05/28/2012 11:48 AM, Ian Collins wrote: >> On 05/28/12 08:55 PM, Sa?o Kiselkov wrote: >>> On 05/28/2012 10:48 AM, Ian Collins wrote: >>>> To follow up, the H310 appears to be useless in non-raid mode. >>>> >>>> The drives do show up in Solaris 11 format, but they show up as >>>> unknown, unformatted drives. One oddity is the box has two SATA >>>> SSDs which also show up the card''s BIOS, but present OK to >>>> Solaris. >>>> >>>> I''d like to re-FLASH the cards, but I don''t think Dell would be >>>> too happy with me doing that on an evaluation system... >>> If the drives show up at all, chances are you only need to work around >>> the power-up issue in Dell HDD firmware. >>> >>> Here''s what I had to do to get the drives going in my R515: >>> /kernel/drv/sd.conf >>> >>> sd-config-list = "SEAGATE ST3300657SS", "power-condition:false", >>> "SEAGATE ST2000NM0001", "power-condition:false"; >>> >>> (that''s for Seagate 300GB 15k SAS and 2TB 7k2 SAS drives, depending on >>> your drive model the strings might differ) >> How would that work when the drive type is unknown (to format)? I >> assumed if sd knows the type, so will format. > Simply take out the drive and have a look at the label.Tricky when the machine is on a different continent! Joking aside, *I* know what the drive is, the OS as far as I can tell doesn''t. -- Ian.
Sašo Kiselkov
2012-May-28 11:01 UTC
[zfs-discuss] Has anyone used a Dell with a PERC H310?
On 05/28/2012 12:59 PM, Ian Collins wrote:> On 05/28/12 10:53 PM, Sa?o Kiselkov wrote: >> On 05/28/2012 11:48 AM, Ian Collins wrote: >>> On 05/28/12 08:55 PM, Sa?o Kiselkov wrote: >>>> On 05/28/2012 10:48 AM, Ian Collins wrote: >>>>> To follow up, the H310 appears to be useless in non-raid mode. >>>>> >>>>> The drives do show up in Solaris 11 format, but they show up as >>>>> unknown, unformatted drives. One oddity is the box has two SATA >>>>> SSDs which also show up the card''s BIOS, but present OK to >>>>> Solaris. >>>>> >>>>> I''d like to re-FLASH the cards, but I don''t think Dell would be >>>>> too happy with me doing that on an evaluation system... >>>> If the drives show up at all, chances are you only need to work around >>>> the power-up issue in Dell HDD firmware. >>>> >>>> Here''s what I had to do to get the drives going in my R515: >>>> /kernel/drv/sd.conf >>>> >>>> sd-config-list = "SEAGATE ST3300657SS", "power-condition:false", >>>> "SEAGATE ST2000NM0001", "power-condition:false"; >>>> >>>> (that''s for Seagate 300GB 15k SAS and 2TB 7k2 SAS drives, depending on >>>> your drive model the strings might differ) >>> How would that work when the drive type is unknown (to format)? I >>> assumed if sd knows the type, so will format. >> Simply take out the drive and have a look at the label. > > Tricky when the machine is on a different continent! > > Joking aside, *I* know what the drive is, the OS as far as I can tell > doesn''t.Can you have a look at your /var/adm/messages or dmesg to check whether the OS is complaining about "failed to power up" on the relevant drives? If yes, then the above fix should work for you, all you need to do is determine the exact manufacturer and model to enter into sd.conf and reload the driver via "update_drv -vf sd". Cheers -- Saso
On 05/28/12 11:01 PM, Sa?o Kiselkov wrote:> On 05/28/2012 12:59 PM, Ian Collins wrote: >> On 05/28/12 10:53 PM, Sa?o Kiselkov wrote: >>> On 05/28/2012 11:48 AM, Ian Collins wrote: >>>> On 05/28/12 08:55 PM, Sa?o Kiselkov wrote: >>>>> On 05/28/2012 10:48 AM, Ian Collins wrote: >>>>>> To follow up, the H310 appears to be useless in non-raid mode. >>>>>> >>>>>> The drives do show up in Solaris 11 format, but they show up as >>>>>> unknown, unformatted drives. One oddity is the box has two SATA >>>>>> SSDs which also show up the card''s BIOS, but present OK to >>>>>> Solaris. >>>>>> >>>>>> I''d like to re-FLASH the cards, but I don''t think Dell would be >>>>>> too happy with me doing that on an evaluation system... >>>>> If the drives show up at all, chances are you only need to work around >>>>> the power-up issue in Dell HDD firmware. >>>>> >>>>> Here''s what I had to do to get the drives going in my R515: >>>>> /kernel/drv/sd.conf >>>>> >>>>> sd-config-list = "SEAGATE ST3300657SS", "power-condition:false", >>>>> "SEAGATE ST2000NM0001", "power-condition:false"; >>>>> >>>>> (that''s for Seagate 300GB 15k SAS and 2TB 7k2 SAS drives, depending on >>>>> your drive model the strings might differ) >>>> How would that work when the drive type is unknown (to format)? I >>>> assumed if sd knows the type, so will format. >>> Simply take out the drive and have a look at the label. >> Tricky when the machine is on a different continent! >> >> Joking aside, *I* know what the drive is, the OS as far as I can tell >> doesn''t. > Can you have a look at your /var/adm/messages or dmesg to check whether > the OS is complaining about "failed to power up" on the relevant drives? > If yes, then the above fix should work for you, all you need to do is > determine the exact manufacturer and model to enter into sd.conf and > reload the driver via "update_drv -vf sd".Yes I do see that warning for the non-raid drives. The problem is I''m booting from a remote ISO image, so I can''t alter /kernel/drv/sd.conf. I''ll play more tomorrow, typing on a remote console inside an RDP session running in a VNC session on a virtual machine is "interesting" :) -- Ian.
Sašo Kiselkov
2012-May-28 11:15 UTC
[zfs-discuss] Has anyone used a Dell with a PERC H310?
On 05/28/2012 01:12 PM, Ian Collins wrote:> On 05/28/12 11:01 PM, Sa?o Kiselkov wrote: >> On 05/28/2012 12:59 PM, Ian Collins wrote: >>> On 05/28/12 10:53 PM, Sa?o Kiselkov wrote: >>>> On 05/28/2012 11:48 AM, Ian Collins wrote: >>>>> On 05/28/12 08:55 PM, Sa?o Kiselkov wrote: >>>>>> On 05/28/2012 10:48 AM, Ian Collins wrote: >>>>>>> To follow up, the H310 appears to be useless in non-raid mode. >>>>>>> >>>>>>> The drives do show up in Solaris 11 format, but they show up as >>>>>>> unknown, unformatted drives. One oddity is the box has two SATA >>>>>>> SSDs which also show up the card''s BIOS, but present OK to >>>>>>> Solaris. >>>>>>> >>>>>>> I''d like to re-FLASH the cards, but I don''t think Dell would be >>>>>>> too happy with me doing that on an evaluation system... >>>>>> If the drives show up at all, chances are you only need to work >>>>>> around >>>>>> the power-up issue in Dell HDD firmware. >>>>>> >>>>>> Here''s what I had to do to get the drives going in my R515: >>>>>> /kernel/drv/sd.conf >>>>>> >>>>>> sd-config-list = "SEAGATE ST3300657SS", "power-condition:false", >>>>>> "SEAGATE ST2000NM0001", "power-condition:false"; >>>>>> >>>>>> (that''s for Seagate 300GB 15k SAS and 2TB 7k2 SAS drives, >>>>>> depending on >>>>>> your drive model the strings might differ) >>>>> How would that work when the drive type is unknown (to format)? I >>>>> assumed if sd knows the type, so will format. >>>> Simply take out the drive and have a look at the label. >>> Tricky when the machine is on a different continent! >>> >>> Joking aside, *I* know what the drive is, the OS as far as I can tell >>> doesn''t. >> Can you have a look at your /var/adm/messages or dmesg to check whether >> the OS is complaining about "failed to power up" on the relevant drives? >> If yes, then the above fix should work for you, all you need to do is >> determine the exact manufacturer and model to enter into sd.conf and >> reload the driver via "update_drv -vf sd". > > Yes I do see that warning for the non-raid drives. > > The problem is I''m booting from a remote ISO image, so I can''t alter > /kernel/drv/sd.conf. > > I''ll play more tomorrow, typing on a remote console inside an RDP > session running in a VNC session on a virtual machine is "interesting" :)I''m not sure about the Solaris 11 installer, but OpenIndiana''s installer runs from a ramdisk, so theoretically that should be doable. Other than that you could do it by copying the contents of /kernel from the ISO into a ramdrive and mounting that in place of /kernel and then issue the reload command. In any case, you seem to be having exactly the same issue as I did, so all you need to do is the above magic. -- Saso
Richard Elling
2012-May-28 20:42 UTC
[zfs-discuss] Has anyone used a Dell with a PERC H310?
On May 28, 2012, at 2:48 AM, Ian Collins wrote:> On 05/28/12 08:55 PM, Sa?o Kiselkov wrote: >> On 05/28/2012 10:48 AM, Ian Collins wrote: >>> To follow up, the H310 appears to be useless in non-raid mode. >>> >>> The drives do show up in Solaris 11 format, but they show up as >>> unknown, unformatted drives. One oddity is the box has two SATA >>> SSDs which also show up the card''s BIOS, but present OK to >>> Solaris. >>> >>> I''d like to re-FLASH the cards, but I don''t think Dell would be >>> too happy with me doing that on an evaluation system... >> If the drives show up at all, chances are you only need to work around >> the power-up issue in Dell HDD firmware. >> >> Here''s what I had to do to get the drives going in my R515: >> /kernel/drv/sd.conf >> >> sd-config-list = "SEAGATE ST3300657SS", "power-condition:false", >> "SEAGATE ST2000NM0001", "power-condition:false"; >> >> (that''s for Seagate 300GB 15k SAS and 2TB 7k2 SAS drives, depending on >> your drive model the strings might differ) > > How would that work when the drive type is unknown (to format)? I assumed if sd knows the type, so will format.I haven''t looked at the code recently, but if it is the same parser as used elsewhere, then a partial match should work. Can someone try it out and report back to the list? sd-config-list = "SEAGATE ST", "power-condition:false"; -- richard -- ZFS Performance and Training Richard.Elling at RichardElling.com +1-760-896-4422 -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20120528/9bf55c94/attachment.html>
On 05/29/12 08:42 AM, Richard Elling wrote:> On May 28, 2012, at 2:48 AM, Ian Collins wrote: >> On 05/28/12 08:55 PM, Sa?o Kiselkov wrote: >>> .. >>> If the drives show up at all, chances are you only need to work around >>> the power-up issue in Dell HDD firmware. >>> >>> Here''s what I had to do to get the drives going in my R515: >>> /kernel/drv/sd.conf >>> >>> sd-config-list = "SEAGATE ST3300657SS", "power-condition:false", >>> "SEAGATE ST2000NM0001", "power-condition:false"; >>> >>> (that''s for Seagate 300GB 15k SAS and 2TB 7k2 SAS drives, depending on >>> your drive model the strings might differ) >> >> How would that work when the drive type is unknown (to format)? I >> assumed if sd knows the type, so will format. > > I haven''t looked at the code recently, but if it is the same parser as > used elsewhere, > then a partial match should work. Can someone try it out and report > back to the list? > sd-config-list = "SEAGATE ST", "power-condition:false"; >Well I finally got back to testing this box... Yes, that shorthand fixes the power-up issue (tested from a cold start). -- Ian.