Marcin Krol
2009-Jun-01 12:52 UTC
[Xen-users] terrible problems with Xen on SLES 10.2 / 11
Hello everyone, I''m totally new to Xen and trying to run it on some platforms (x86, x64) using SLES (that is what I have to use for reasons other than technical). Several machines on which I tried using Xen simply fails to run normally using Xen kernel: either network communication is not functioning at all despite proper configuration (that works on non-Xen kernel), or the kernel can''t communicate with disks, issuing SCSI bus reset commands in loop (and failing to reset it). Hardware is mainly made by IBM (xSeries with older Xeon or Opteron CPUs). While booting Xen kernels on SLES they have following symptoms: - various FATAL errors while loading modules, like missing xen_vbd or missing xen_vnif - when booting non-xen kernel, messages in dmesg like: xen_vnif: Unknown symbol balloon_update_driver_allowance xen_vnif: Unknown symbol balloon_release_driver_page I have searched for xen_vbd and xen_vnif modules in /lib/modules and they''re simply not there! Are they ''internal'' modules loaded by another module file? Or are they regular modules and they should be normally located as .ko files in /lib/modules/? I can''t tell because I couldn''t get ANY xen kernel to function correctly. Kernel config is as follows: title Xen -- SUSE Linux Enterprise Server 11 - 2.6.27.19-5 root (hd0,0) kernel /boot/xen.gz acpi=off noapic module /boot/vmlinuz-2.6.27.19-5-xen root=/dev/disk/by-id/scsi-SIBM-ESXSST336753LC_F3HX25YV80000743 8FXG9-part1 console=tty0 resume=/dev/sda2 splash=silent showopts module /boot/initrd-2.6.27.19-5-xen I have following xen packages installed (on SLES 11 x64): xen-3.3.1_18546_12-3.1 enic-kmp-xen-0.0.1_2.6.27.19_5-10.6 oracleasm-kmp-xen-2.0.5_2.6.27.19_5-7.6 xen-doc-pdf-3.3.1_18546_12-3.1 iscsitarget-kmp-xen-0.4.15_2.6.27.19_5-94.6 ext4dev-kmp-xen-0_2.6.27.19_5-7.6 xen-doc-html-3.3.1_18546_12-3.1 xen-libs-3.3.1_18546_12-3.1 xen-kmp-default-3.3.1_18546_12_2.6.27.19_5-3.1 brocade-bfa-kmp-xen-1.1.0.2_2.6.27.19_5-6.6 xen-tools-3.3.1_18546_12-3.1 kernel-xen-2.6.27.19-5.1 kernel-xen-base-2.6.27.19-5.1 fnic-kmp-xen-1.0.0_2.6.27.19_5-9.11 xen-tools-domU-3.3.1_18546_12-3.1 Please help, I''m at dead end with this. Regards, mk _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Fajar A. Nugraha
2009-Jun-01 13:08 UTC
Re: [Xen-users] terrible problems with Xen on SLES 10.2 / 11
On Mon, Jun 1, 2009 at 7:52 PM, Marcin Krol <mrkafk@gmail.com> wrote:> Hello everyone, > > I''m totally new to Xen and trying to run it on some platforms (x86, x64) > using SLES (that is what I have to use for reasons other than technical).Not the best reason :P If you''re using it as domU then you should be able to use any distro that you''re familiar with as dom0. My favorite is RHEL5.> > Several machines on which I tried using Xen simply fails to run normally > using Xen kernel: either network communication is not functioning at all > despite proper configuration (that works on non-Xen kernel), or the kernel > can''t communicate with disks, issuing SCSI bus reset commands in loop (and > failing to reset it).What is your xen setup like? Which part is experiencing problems: dom0, PV domU? HVM domU?> > Hardware is mainly made by IBM (xSeries with older Xeon or Opteron CPUs). > > While booting Xen kernels on SLES they have following symptoms: > > - various FATAL errors while loading modules, like missing xen_vbd or > missing xen_vnif > > - when booting non-xen kernel, messages in dmesg like: > > xen_vnif: Unknown symbol balloon_update_driver_allowance > xen_vnif: Unknown symbol balloon_release_driver_pageAgain, what is your setup like? xen-vnif and xen-vbd are PV drivers for Linux HVM domU. You do NOT need them for dom0 or PV domU. Besides, AFAIK they only work for kernel 2.6.18.x, not for newer kernels. Is it perhaps a HVM domU converted to physical machine? Or is it a machine upgraded from older suse version? -- Fajar _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Marcin Krol
2009-Jun-01 13:25 UTC
Re: [Xen-users] terrible problems with Xen on SLES 10.2 / 11
Hello Fajar, Thanks for answer! Fajar A. Nugraha wrote:>> I''m totally new to Xen and trying to run it on some platforms (x86, x64) >> using SLES (that is what I have to use for reasons other than technical). > > Not the best reason :PI know :-( :-P> If you''re using it as domU then you should be able to use any distro > that you''re familiar with as dom0. My favorite is RHEL5.Trouble is, I tested with RH5 (.1, .2, .3) just to make sure there is nothing else wrong and I couldn''t get it working either! That is, either network in the dom0 (that is, main/host domain IIRC?) doesn''t work at all or kernel can''t communicate with the disk and throws up lots of SCSI errors.>> Several machines on which I tried using Xen simply fails to run normally >> using Xen kernel: either network communication is not functioning at all >> despite proper configuration (that works on non-Xen kernel), or the kernel >> can''t communicate with disks, issuing SCSI bus reset commands in loop (and >> failing to reset it).> What is your xen setup like? Which part is experiencing problems: > dom0, PV domU? HVM domU?I simply chose "Install hypervisor and tools" in YAST, changed kernel in /boot/grub/menu.lst to Xen-enabled and reboot. Regardless of what machine I try this on, it doesn''t come back.>> Hardware is mainly made by IBM (xSeries with older Xeon or Opteron CPUs). >> >> While booting Xen kernels on SLES they have following symptoms: >> >> - various FATAL errors while loading modules, like missing xen_vbd or >> missing xen_vnif >> >> - when booting non-xen kernel, messages in dmesg like: >> >> xen_vnif: Unknown symbol balloon_update_driver_allowance >> xen_vnif: Unknown symbol balloon_release_driver_page> Again, what is your setup like?Clean install of SLES 10.2 or 11, on physical machine, failing to get dom0 working.> xen-vnif and xen-vbd are PV drivers for Linux HVM domU. You do NOT > need them for dom0 or PV domU.Good to know. I can''t fathom what is going wrong then. I''m currently trying to get dmesg output saved, but I have to wait some 30 minutes to get it, bc kernel throws various SCSI errors and tries to reset and it takes a long time for it to fall back into single user. When I get dmesg output, I''ll post it here.> Besides, AFAIK they only work for > kernel 2.6.18.x, not for newer kernels.> Is it perhaps a HVM domU converted to physical machine?No. It is plain SLES installed on physical machine, which I then try to enable to run Xen kernel.>Or is it a > machine upgraded from older suse version?It is not upgraded either, it is clean install every time (and I tried it on several machines, from IBM Netvista with P4 through Thinkcentre with P4 through xSeries with Xeon and xSeries with Opteron). Regards, mk _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Boris Derzhavets
2009-Jun-01 14:11 UTC
Re: [Xen-users] terrible problems with Xen on SLES 10.2 / 11
>It is not upgraded either, it is clean install every time (and I triedit on several machines, >from IBM Netvista with P4 through Thinkcentre with P4 through xSeries with Xeon and> xSeries with Opteron).During a clean SLES 11 install select Xen Host package to install (not via Yast) Load into into usual SLES. Make sure SLES itself is fine. Look at /boot/grub/menu.lst. It already has an entry for loading Xen 3.3.1 Try to reboot host via Xen entry. Xen-3.3.1.gz goes first , theh Suse''s xenified kernel, xend is supposed to start when Dom0 is loaded. Is it possible to capture screen output. Boris. _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Fajar A. Nugraha
2009-Jun-01 14:25 UTC
Re: [Xen-users] terrible problems with Xen on SLES 10.2 / 11
On Mon, Jun 1, 2009 at 8:25 PM, Marcin Krol <mrkafk@gmail.com> wrote:> Trouble is, I tested with RH5 (.1, .2, .3) just to make sure there is > nothing else wrong and I couldn''t get it working either! That is, either > network in the dom0 (that is, main/host domain IIRC?) doesn''t work at all or > kernel can''t communicate with the disk and throws up lots of SCSI errors. >> I can''t fathom what is going wrong then. I''m currently trying to get dmesg > output saved, but I have to wait some 30 minutes to get it, bc kernel throws > various SCSI errors and tries to reset and it takes a long time for it to > fall back into single user. When I get dmesg output, I''ll post it here.Here''s a question. Does the scsi controller work correctly on normal kernel? I''m beginning to think you have a hardware problem (bad disk or controller, etc.) Does lsmod have aacraid listed? What does lspci say about RAID controller? Mine has this 04:00.0 RAID bus controller: Adaptec AAC-RAID (Rocket) (rev 02) I have several IBM x series with Xeons, and they all work correctly with xen from RHEL5.x. -- Fajar _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Marcin Krol
2009-Jun-01 14:55 UTC
Re: [Xen-users] terrible problems with Xen on SLES 10.2 / 11
Fajar A. Nugraha wrote:> Here''s a question. Does the scsi controller work correctly on normal > kernel? I''m beginning to think you have a hardware problem (bad disk > or controller, etc.)It works correctly as far as I can tell, esp. that I have tried in on several machines (5 machines in fact, from desktop Netvista to rack-mounted eServer 326). It''s near impossible that they all have broken hd controllers.> Does lsmod have aacraid listed? What does lspci say about RAID > controller? Mine has this > 04:00.0 RAID bus controller: Adaptec AAC-RAID (Rocket) (rev 02)As far as I can tell, there''s no problem with that, that''s drive controller on one of the SLES 11 x86 machines: 00:1f.1 IDE interface: Intel Corporation 82801EB/ER (ICH5/ICH5R) IDE Controller (rev 02)> I have several IBM x series with Xeons, and they all work correctly > with xen from RHEL5.x.How did you install them then? I mean, installation procedure? Did you install RPMs by hand? What are the versions? I can try installing RH with xen to try to pinpoint the problem, I only need to know how. Regards, mk _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Fajar A. Nugraha
2009-Jun-01 15:25 UTC
Re: [Xen-users] terrible problems with Xen on SLES 10.2 / 11
On Mon, Jun 1, 2009 at 9:55 PM, Marcin Krol <mrkafk@gmail.com> wrote:>> Does lsmod have aacraid listed? What does lspci say about RAID >> controller? Mine has this >> 04:00.0 RAID bus controller: Adaptec AAC-RAID (Rocket) (rev 02) > > > As far as I can tell, there''s no problem with that, that''s drive controller > on one of the SLES 11 x86 machines: > > 00:1f.1 IDE interface: Intel Corporation 82801EB/ER (ICH5/ICH5R) IDE > Controller (rev 02)My machine has two controllers actually. One IDE controller 00:1f.2 IDE interface: Intel Corporation 631xESB/632xESB/3100 Chipset SATA IDE Controller (rev 09) And one HW RAID (the one I pasted earlier). The active one on my system is the AAC one.> >> I have several IBM x series with Xeons, and they all work correctly >> with xen from RHEL5.x. > > How did you install them then? I mean, installation procedure? Did you > install RPMs by hand? What are the versions? > > I can try installing RH with xen to try to pinpoint the problem, I only need > to know how.I started with standard installation, do a "yum groupinstall Virtualization", then adjust grub default entry. These are the relevant versions # rpm -qa | grep xen xen-libs-3.0.3-64.el5_2.3 kernel-xen-devel-2.6.18-92.1.10.el5 xen-3.0.3-64.el5_2.3 kernel-xen-2.6.18-92.1.10.el5 I chose this method since it allows me to verify first that the OS works correctly without Xen. Once I''m sure of it, I installed Xen. The somewhat old version is because I haven''t reboot this system in almost a year :) You could also choose to install virtualization during installation, which gives you xen kernel right away. -- Fajar _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Ciro Iriarte
2009-Jun-01 21:19 UTC
Re: [Xen-users] terrible problems with Xen on SLES 10.2 / 11
2009/6/1 Marcin Krol <mrkafk@gmail.com>:> Fajar A. Nugraha wrote: >> >> Here''s a question. Does the scsi controller work correctly on normal >> kernel? I''m beginning to think you have a hardware problem (bad disk >> or controller, etc.) > > It works correctly as far as I can tell, esp. that I have tried in on > several machines (5 machines in fact, from desktop Netvista to rack-mounted > eServer 326). It''s near impossible that they all have broken hd controllers. > >> Does lsmod have aacraid listed? What does lspci say about RAID >> controller? Mine has this >> 04:00.0 RAID bus controller: Adaptec AAC-RAID (Rocket) (rev 02) > > > As far as I can tell, there''s no problem with that, that''s drive controller > on one of the SLES 11 x86 machines: > > 00:1f.1 IDE interface: Intel Corporation 82801EB/ER (ICH5/ICH5R) IDE > Controller (rev 02) > >> I have several IBM x series with Xeons, and they all work correctly >> with xen from RHEL5.x. > > How did you install them then? I mean, installation procedure? Did you > install RPMs by hand? What are the versions? > > I can try installing RH with xen to try to pinpoint the problem, I only need > to know how. > > Regards, > mk > > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-users >I''m using SLES10 SP2 in production on HP Proliant and SUN Sunfire servers without issues. Are you using stock modules for the RAID card?. If you need to install third party modules, you must compile them booting with the Xen kernel. Is a good idea to update firmware/bios on the servers and SLES patches are a must. Regards, -- Ciro Iriarte http://cyruspy.wordpress.com -- _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Maybe Matching Threads
- unresolved symbols in PV driver for HVM
- redhat4.6-32bit DomU with pv driver can''t be saved
- redhat4.6-32bit DomU with pv driver can''t be saved
- autostarting storage pool
- CentOS DomU 2.6.18-128.1.6.el5 crashing on boot when xenpv_hvm drivers are loaded / snv_111 Xen 3.1 Dom0