Greetings Xen-Users!! I''m new to XEN and have been trying to get it to work on this server for 6 weeks now, somewhat unsuccessfully. I have a Dell PowerEdge 2850 server with the PERC 4 controller and drives configured as RAID-5. My Linux base is Red Hat Enterprise Server version 3. I''m compiling with kernel 2.4.x because I have read it is more stable. I have gotten around getting the server to boot using an initrd, and have had to compile custom kernels as the default XEN binaries do not boot at all. This machine represents the first time I have compiled a Linux Kernel so I''m still in the learning stages. I currently have the machine installed with Xen 2.0.7, using Linux Kernel 2.4.30. I have 3 virtual machines each with its own bridge and NIC interface. I can run my apps in the virtual machines, but I get the problem where the system will completely freeze with no explanation on the console, or in the error logs. I read posts where some users have run into this in the past with Dell servers, but found no solutions. On one of the suggestions I copied my Red Hat .config into my xen0 source directory and ran ''make ARCH=xen menuconfig''. I configured according to my hardware and tried to reboot. In dmesg I still don''t see the ACPI configurations loading. I don''t know how to patch the kernel. I tried copying .c files from the i386 sources into xen but I kept getting undeclared function errors. I noticed when I initially run ''make world'' the latest kernel gets downloaded and patched in, but I get lost in the Makefile and don''t know the procedure. Can someone help please??? How do I insert drivers into a kernel build and test to make sure they will work? Thanx in advance. Max Baro meb@factsservices.com <mailto:meb@factsservices.com> _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Max E Baro wrote:> > I currently have the machine installed with Xen 2.0.7, using Linux > Kernel 2.4.30. I have 3 virtual machines each with its own bridge and > NIC interface. I can run my apps in the virtual machines, but I get the > problem where the system will completely freeze with no explanation on > the console, or in the error logs. I read posts where some users have > run into this in the past with Dell servers, but found no solutions. >Disable USB in the bios and things will be stable. It is a known problem with a number of Dells, but as yet there is no official fix as far as I know. Once USB is disabled it''ll be solid as a rock. Hope this helps. -Barry Flanagan _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
> Disable USB in the bios and things will be stable. It is a known problem > with a number of Dells, but as yet there is no official fix as far as I > know. Once USB is disabled it''ll be solid as a rock.This is some weird Dell thing; Linux does a workaround to avoid the problem but it wasn''t (originally) available in Xen. I *thought* that recent releases would Just Work... Anyhow, disabling the USB in the BIOS fixes the problem, as does (in Xens with the fix) adding "noirqbalance" to the command line. Max: the 2.6 port of Linux is also stable, it''s just a matter of preference really. Which OS you run in dom0 shouldn''t matter for this problem under 2.0. Cheers, Mark _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
On Thu, Aug 25, 2005 at 07:43:14PM +0100, Mark Williamson wrote:> > Disable USB in the bios and things will be stable. It is a known problem > > with a number of Dells, but as yet there is no official fix as far as I > > know. Once USB is disabled it''ll be solid as a rock. > > This is some weird Dell thing; Linux does a workaround to avoid the problem > but it wasn''t (originally) available in Xen. I *thought* that recent > releases would Just Work...FWIW, I''m seeing the same symptoms on an HP DL320 G3 server. When USB is enabled, the machine locks up frequently on network I/O (even when no USB-device is connected). This still happens on xen 2.0.7. With USB disabled, the machine is indeed rock-solid. I''m perfectly happy with that as I don''t need to connect USB-devices, but if you need feedback regarding possible fixes, I''ll be glad to help. Ingo. _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
On Fri, Aug 26, 2005 at 08:23:26AM +0200, Ingo Paschke wrote:> > This is some weird Dell thing; Linux does a workaround to avoid the problem > > but it wasn''t (originally) available in Xen. I *thought* that recent > > releases would Just Work... > > FWIW, I''m seeing the same symptoms on an HP DL320 G3 server. When USB is > enabled, the machine locks up frequently on network I/O (even when no > USB-device is connected).Can this be the unfamous IRQ-problem? Please check /proc/interrupts to see if these devices share the same IRQ. I can disable eth0 by accessing USB on my nforce3 machine. And, even worse, wipe data from my SATA disk by putting about one minute of traffic on eth1... Stress-test your devices carefully before going into production! Cheerz, Arie Kraai _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Am 27.08.2005 um 12:30 schrieb Arie Kraai:> On Fri, Aug 26, 2005 at 08:23:26AM +0200, Ingo Paschke wrote: > >>> This is some weird Dell thing; Linux does a workaround to avoid >>> the problem >>> but it wasn''t (originally) available in Xen. I *thought* that >>> recent >>> releases would Just Work... >>> >> >> FWIW, I''m seeing the same symptoms on an HP DL320 G3 server. When >> USB is >> enabled, the machine locks up frequently on network I/O (even when no >> USB-device is connected). > > Can this be the unfamous IRQ-problem? Please check /proc/interrupts to > see if these devices share the same IRQ.Yes, this seems to be an IRQ-problem. The BIOS reports that the USB- Controller and eth1 share IRQ 5. Here''s my configuration after disabling USB: $ xm dmesg [...] (XEN) PCI: PCI BIOS revision 2.10 entry at 0xf0096, last bus=11 (XEN) PCI: Using configuration type 1 (XEN) PCI: Probing PCI hardware (XEN) PCI: Probing PCI hardware (bus 00) (XEN) PCI: Ignoring BAR0-3 of IDE controller 00:1f.1 (XEN) Transparent bridge - PCI device 8086:244e (XEN) PCI->APIC IRQ transform: (B0,I1,P0) -> 16 (XEN) PCI->APIC IRQ transform: (B0,I28,P0) -> 16 (XEN) PCI->APIC IRQ transform: (B0,I31,P0) -> 17 (XEN) PCI->APIC IRQ transform: (B0,I31,P1) -> 17 (XEN) PCI->APIC IRQ transform: (B6,I1,P0) -> 24 (XEN) PCI->APIC IRQ transform: (B6,I1,P1) -> 25 (XEN) PCI->APIC IRQ transform: (B1,I2,P0) -> 22 (XEN) PCI->APIC IRQ transform: (B1,I2,P1) -> 23 (XEN) PCI: Device 00:00 not found by BIOS [...] $ lspci 0000:00:00.0 Host bridge: Intel Corp. Server Memory Controller Hub (rev 05) 0000:00:01.0 PCI bridge: Intel Corp. Server Memory Controller Hub PCI Express Port (rev 05) 0000:00:1c.0 PCI bridge: Intel Corp. 82801FB/FBM/FR/FW/FRW (ICH6 Family) PCI Express Port 1 (rev 03) 0000:00:1e.0 PCI bridge: Intel Corp. 82801 PCI Bridge (rev d3) 0000:00:1f.0 ISA bridge: Intel Corp. 82801FB/FR (ICH6/ICH6R) LPC Interface Bridge (rev 03) 0000:00:1f.1 IDE interface: Intel Corp. 82801FB/FBM/FR/FW/FRW (ICH6 Family) IDE Controller (rev 03) 0000:00:1f.2 IDE interface: Intel Corp. 82801FR/FRW (ICH6R/ICH6RW) SATA Controller (rev 03) 0000:01:02.0 System peripheral: Compaq Computer Corporation Integrated Lights Out Controller (rev 01) 0000:01:02.2 System peripheral: Compaq Computer Corporation Integrated Lights Out Processor (rev 01) 0000:01:03.0 VGA compatible controller: ATI Technologies Inc Rage XL (rev 27) 0000:05:00.0 PCI bridge: Intel Corp. PCI Bridge Hub A (rev 09) 0000:05:00.2 PCI bridge: Intel Corp. PCI Bridge Hub B (rev 09) 0000:06:01.0 Ethernet controller: Broadcom Corporation NetXtreme BCM5704 Gigabit Ethernet (rev 10) 0000:06:01.1 Ethernet controller: Broadcom Corporation NetXtreme BCM5704 Gigabit Ethernet (rev 10) $ cat /proc/interrupts CPU0 1: 914 Phys-irq i8042 12: 253 Phys-irq i8042 14: 22 Phys-irq ide0 17: 12576245 Phys-irq libata 24: 3700195 Phys-irq eth0 25: 3751876 Phys-irq eth1 128: 1 Dynamic-irq misdirect 129: 12 Dynamic-irq ctrl-if 130: 10173353 Dynamic-irq timer 131: 0 Dynamic-irq console 132: 0 Dynamic-irq net-be-dbg 133: 418202 Dynamic-irq blkif-backend 134: 439369 Dynamic-irq vif1.0 NMI: 0 ERR: 0> I can disable eth0 by accessing USB on my nforce3 machine. And, even > worse, wipe data from my SATA disk by putting about one minute of > traffic on eth1... > > Stress-test your devices carefully before going into production!Thanks for your advice, I''m still testing this machine, but it seems very stable. I''ve certainly not seen any corruption on the SATA-disks so far. Greetings, Ingo. _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
>Max E Baro wrote: > >> I currently have the machine installed with Xen 2.0.7, using Linux >> Kernel 2.4.30. I have 3 virtual machines each with its own bridge and >> NIC interface. I can run my apps in the virtual machines, but I get the >> problem where the system will completely freeze with no explanation on >> the console, or in the error logs. I read posts where some users have >> run into this in the past with Dell servers, but found no solutions. > > > > Disable USB in the bios and things will be stable. It is a known problem > with a number of Dells, but as yet there is no official fix as far as I > know. Once USB is disabled it''ll be solid as a rock. > > Hope this helps. > > -Barry FlanaganMany thanks to Barry and all who have posted. I''ve disabled USB in the BIOS and recompiled the kernel removing USB drivers. I am in the process of pounding the server to see how long it lasts this time. I still don''t get ACPI loading on bootup. Is this something that is particular to the 2.6 iteration of XEN? Max Baro Technical Support Representative FACTS Services, Inc. (305) 284 - 7440 meb@factsservices.com _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
> I still don''t get ACPI loading on bootup. Is this something that is > particular to the 2.6 iteration of XEN?It''s particular to the 2.0 release of Xen. Xen 3.0 should have much better ACPI support. Cheers, Mark _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users