Hello, We are currently running XCP 1.0 on nine servers. Each server is installed with a Emulex LightPulse fibre 4GB card that is attached to our SAN. Initially everything booted quickly and worked fine, but when we enabled multipathing and activated the extra paths on our fibre switch the servers now get 30 minutes of I/O errors on boot. After the machines start multipath works great and XCP shows our four paths correctly. My question is: Should I install the emulex driver directly to our DOM 0 and will this fix the boot problem? One last clarification. The servers still boot, they just take 30 minutes to do so. While they are trying to boot tons of /dev/sd* errors scroll by on the screen. After the machine finishes booting the I/O errors appear to stop. Thanks for your time, -- Martin Smith _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
> One last clarification. The servers still boot, they just take 30 > minutes to do so. While they are trying to boot tons of /dev/sd* errors > scroll by on the screen. After the machine finishes booting the I/O > errors appear to stop.What model SAN is it? I''ve seen this before and the fix is to install the proper multipath driver (appropriate to your SAN) into your initrd. The i/o errors are coming from the inactive path on an active/passive array. For example, with our IBM DS-4800 array, we had to add the scsi_dh_rdac driver to the initrd so it was available to the multipath stuff that was happening at boot. John -- John Madden Sr UNIX Systems Engineer / Office of Technology Ivy Tech Community College of Indiana jmadden@ivytech.edu _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
You could also try to login the target only once to temporarily "disable" multipathing and see if its booting fine. Am 12.07.2011 um 22:22 schrieb "John Madden" <jmadden@ivytech.edu>:>> One last clarification. The servers still boot, they just take 30 >> minutes to do so. While they are trying to boot tons of /dev/sd* errors >> scroll by on the screen. After the machine finishes booting the I/O >> errors appear to stop. > > What model SAN is it? I''ve seen this before and the fix is to install the proper multipath driver (appropriate to your SAN) into your initrd. The i/o errors are coming from the inactive path on an active/passive array. For example, with our IBM DS-4800 array, we had to add the scsi_dh_rdac driver to the initrd so it was available to the multipath stuff that was happening at boot. > > John > > > > > -- > John Madden > Sr UNIX Systems Engineer / Office of Technology > Ivy Tech Community College of Indiana > jmadden@ivytech.edu > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-users_______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Thomas: Yes, if I disable the other three paths the servers boot quickly. John: Its a SUN FLX380 storage array. Would I be looking for the drivers for the fibre card I installed or for the SAN? On Tue, Jul 12, 2011 at 4:12 PM, Thomas Pöhler <tp@turtle-entertainment.de>wrote:> You could also try to login the target only once to temporarily "disable" > multipathing and see if its booting fine. > > Am 12.07.2011 um 22:22 schrieb "John Madden" <jmadden@ivytech.edu>: > > >> One last clarification. The servers still boot, they just take 30 > >> minutes to do so. While they are trying to boot tons of /dev/sd* errors > >> scroll by on the screen. After the machine finishes booting the I/O > >> errors appear to stop. > > > > What model SAN is it? I''ve seen this before and the fix is to install > the proper multipath driver (appropriate to your SAN) into your initrd. The > i/o errors are coming from the inactive path on an active/passive array. > For example, with our IBM DS-4800 array, we had to add the scsi_dh_rdac > driver to the initrd so it was available to the multipath stuff that was > happening at boot. > > > > John > > > > > > > > > > -- > > John Madden > > Sr UNIX Systems Engineer / Office of Technology > > Ivy Tech Community College of Indiana > > jmadden@ivytech.edu > > > > _______________________________________________ > > Xen-users mailing list > > Xen-users@lists.xensource.com > > http://lists.xensource.com/xen-users >-- Martin Smith Phone: 612-208-2313 _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
On 07/12/2011 09:13 PM, Martin Smith wrote:> Thomas: Yes, if I disable the other three paths the servers boot quickly. > > John: Its a SUN FLX380 storage array. Would I be looking for the drivers > for the fibre card I installed or for the SAN?The answer should be in your multipath.conf on dom0, though I don''t know what facilities XCP provides for SAN booting and such (I run CentOS 5 and it works fine there). According to this guy: http://www.bitingbytes.de/cms/?p=15 You should be set up as RDAC, which is pretty common on these OEM''d arrays. Get it all working properly prio-wise, no errors or trespasses from the array''s point of view, etc., in dom0 before worrying about the boot environment. Has anyone worked with XCP and a RDAC SAN before? What distro is XCP based on? -- John Madden Sr UNIX Systems Engineer / Office of Technology Ivy Tech Community College of Indiana jmadden@ivytech.edu _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users