terii wang
2008-Oct-08 21:43 UTC
[Xen-users] Windows assigned 4GB RAM BSOD with GPLPV (0.9.10)
I''m about to deploying a Xen server running three Windows Sever 2003 standard edition domUs into production. While working with my Windows team I discovered couple a problems. 1) domUs would freeze on reboot/shutdown when assigned 4 CPUs. dom0 have 8 physical CPUs. Adjusting it to 2 seems to remedy this problem. 2) BSOD during booting with 4GB RAM allocated. dom0 have 16GB. Adjusting it to 2GB seems to remedy this problem. I can live without #1. But I would need 4GB RAM for one of the domU. Due to fact it is a Citrix presentation server. Anyone experienced similar problems? When I boot with non-GPLPV drivers, those two problems seems to go away. Due to deadlines I probably push those into production without using GPLPV, for now. I have snapshotted the problematic LVMs if anyone is interested in debugging with me. If so, give me some instructions to do so. I guess this should help out solidify GPLPV drivers. :) Terii Wang _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
James Harper
2008-Oct-08 22:11 UTC
[Xen-users] RE: Windows assigned 4GB RAM BSOD with GPLPV (0.9.10)
> -----Original Message----- > From: terii wang [mailto:terii@linuxmonkey.net] > Sent: Thursday, 9 October 2008 08:43 > To: xen-users@lists.xensource.com > Cc: James Harper > Subject: Windows assigned 4GB RAM BSOD with GPLPV (0.9.10) > > I''m about to deploying a Xen server running three Windows Sever 2003 > standard edition domUs into production. > > While working with my Windows team I discovered couple a problems. > > 1) domUs would freeze on reboot/shutdown when assigned 4 CPUs. dom0 > have 8 physical CPUs. Adjusting it to 2 seems to remedy this problem. > > 2) BSOD during booting with 4GB RAM allocated. dom0 have 16GB. > Adjusting it to 2GB seems to remedy this problem. > > I can live without #1. But I would need 4GB RAM for one of the domU. > Due to fact it is a Citrix presentation server. > > Anyone experienced similar problems? > > > > When I boot with non-GPLPV drivers, those two problems seems to go > away. Due to deadlines I probably push those into production without > using GPLPV, for now.Can you please test a later version of the GPLPV drivers? 0.9.11-pre18 is the latest. I know I fixed a 4G problem at some point, but I thought that was earlier than 0.9.10. Also, can you give me the BSoD numbers? I have tested with 4CPU''s and have not noticed a problem before.> I have snapshotted the problematic LVMs if anyone is interested in > debugging with me. If so, give me some instructions to do so. I guess > this should help out solidify GPLPV drivers. :)James _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Thiago Camargo Martins Cordeiro
2008-Oct-08 22:26 UTC
Re: [Xen-users] Windows assigned 4GB RAM BSOD with GPLPV (0.9.10)
What version of Xen are you using? 2008/10/8 terii wang <terii@linuxmonkey.net>> I''m about to deploying a Xen server running three Windows Sever 2003 > standard edition domUs into production. > > While working with my Windows team I discovered couple a problems. > > 1) domUs would freeze on reboot/shutdown when assigned 4 CPUs. dom0 > have 8 physical CPUs. Adjusting it to 2 seems to remedy this problem. > > 2) BSOD during booting with 4GB RAM allocated. dom0 have 16GB. > Adjusting it to 2GB seems to remedy this problem. > > I can live without #1. But I would need 4GB RAM for one of the domU. > Due to fact it is a Citrix presentation server. > > Anyone experienced similar problems? > > > > When I boot with non-GPLPV drivers, those two problems seems to go > away. Due to deadlines I probably push those into production without > using GPLPV, for now. > > I have snapshotted the problematic LVMs if anyone is interested in > debugging with me. If so, give me some instructions to do so. I guess > this should help out solidify GPLPV drivers. :) > > > > Terii Wang > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-users >_______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
terii wang
2008-Oct-09 18:38 UTC
Re: [Xen-users] Windows assigned 4GB RAM BSOD with GPLPV (0.9.10)
On Wed, 8 Oct 2008 19:26:19 -0300 "Thiago Camargo Martins Cordeiro" <thiagocmartinsc@gmail.com> wrote:> What version of Xen are you using? >Ubuntu Hardy Xen 3.2.1 root@lonvm01: /etc/xen # uname -a Linux lonvm01 2.6.24-19-xen #1 SMP Wed Aug 20 21:08:51 UTC 2008 x86_64 GNU/Linux root@lonvm01: /etc/xen # xm info host : lonvm01 release : 2.6.24-19-xen version : #1 SMP Wed Aug 20 21:08:51 UTC 2008 machine : x86_64 nr_cpus : 8 nr_nodes : 1 cores_per_socket : 4 threads_per_core : 1 cpu_mhz : 2992 hw_caps : bfebfbff:20100800:00000000:00000140:000ce3bd:00000000:00000001 total_memory : 16378 free_memory : 4144 max_free_memory : 7569 max_para_memory : 7565 max_hvm_memory : 7539 node_to_cpu : node0:0-7 xen_major : 3 xen_minor : 2 xen_extra : .1-rc1-pre xen_caps : xen-3.0-x86_64 xen-3.0-x86_32p hvm-3.0-x86_32 hvm-3.0-x86_32p hvm-3.0-x86_64 xen_scheduler : credit xen_pagesize : 4096 platform_params : virt_start=0xffff800000000000 xen_changeset : unavailable cc_compiler : gcc version 4.2.3 (Ubuntu 4.2.3-2ubuntu7) cc_compile_by : buildd cc_compile_domain : buildd cc_compile_date : Fri Apr 11 01:13:51 UTC 2008 xend_config_format : 4 _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Thiago Camargo Martins Cordeiro
2008-Oct-09 19:11 UTC
Re: [Xen-users] Windows assigned 4GB RAM BSOD with GPLPV (0.9.10)
Terii, Try do add this lines to your /etc/apt/sources.list: deb http://us.archive.ubuntu.com/ubuntu/ hardy-proposed main restricted universe multiverse #deb-src http://us.archive.ubuntu.com/ubuntu/ hardy-proposed main restricted universe multiverse] And, "aptitude update;aptitude dist-upgrade", you will got linux-2.6.24-21-xen and see if your problems go away. However, Ubuntu Xen Kernel is not officially supported by Xen.org, if you really want a stable Xen system, you must use a linux-2.6.18.8-xen from xen.org, until dom0 support merges to vanilla Linux at kernel.org. ;-) To compile new xen-3.3.0 on your Ubuntu, you need: aptitude install --without-recommends bcc bin86 build-essential comerr-dev debhelper defoma diffstat dpkg-dev fontconfig fontconfig-config g++ g++-4.2 gawk gettext ghostscript graphviz gs-common gsfonts html2text intltool-debian libc6-dev-i386 libc6-i386 libcairo2 libcupsimage2 libcupsys2 libcurl4-openssl-dev libdatrie0 libdrm2 libfontconfig1 libfreetype6 libgd2-noxpm libgl1-mesa-dev libgl1-mesa-glx libglib2.0-0 libglu1-mesa libglu1-mesa-dev libglu1-xorg-dev libgraphviz4 libgs8 libice6 libidn11-dev libjpeg62 libjpeg62-dev libkadm55 libkpathsea4 libkrb5-dev libldap2-dev libltdl3 libncurses5-dev libpango1.0-0 libpango1.0-common libpaper1 libpcre3 libpixman-1-0 libpng12-0 libpoppler2 libpthread-stubs0 libpthread-stubs0-dev libsdl1.2-dev libsm6 libssl-dev libstdc++6-4.2-dev libthai-data libthai0 libtiff4 libtimedate-perl libvncserver-dev libvncserver0 libx11-6 libx11-data libx11-dev libxau-dev libxau6 libxaw7 libxcb-xlib0 libxcb-xlib0-dev libxcb1 libxcb1-dev libxdamage1 libxdmcp-dev libxdmcp6 libxext6 libxfixes3 libxft2 libxml2-dev libxmu6 libxpm4 libxrender1 libxt6 libxxf86vm1 make mesa-common-dev mercurial patch pciutils-dev pkg-config po-debconf python-all python-all-dev python2.4 python2.4-dev python2.4-minimal quilt tex-common texinfo texlive-base texlive-base-bin texlive-common texlive-doc-base texlive-fonts-recommended texlive-latex-base texlive-latex-recommended transfig ttf-dejavu ttf-dejavu-core ttf-dejavu-extra x11-common x11proto-core-dev x11proto-input-dev x11proto-kb-dev xtrans-dev zlib1g-dev Now to run your compiled Xen-3.3, you need: aptitude install --without-recommends binutils binutils-static bridge-utils debootstrap gcc gcc-4.2 libasound2 libbeecrypt6 libc6-dev libconfig-inifiles-perl libcurl3 libdirectfb-1.0-0 libexpect-perl libgomp1 libio-pty-perl libio-stty-perl libneon27 librpm4.4 libsdl1.2debian libsdl1.2debian-alsa libterm-readline-gnu-perl libterm-size-perl libtext-template-perl libxml2 linux-libc-dev linux-restricted-modules-common nvidia-kernel-common perl-doc python-dev python2.5-dev rinse rpm screen sgml-base vnstat xen-shell xen-tools xfsprogs xml-core To finalize, tun this commands: depmod -a 2.6.18.8-xen update-initramfs -k 2.6.18.8-xen -c -u vi /boot/grub/menu.lst # and configure your Xen options, like "nosmp" and "dom0_mem=512M", for example... update-grub update-rc.d xend defaults 20 21 update-rc.d xendomains defaults 21 20 reboot *NOTE*: If you use LVM, Ubuntu refuses to boot, dropping you to a (initramfs) promtp, all you need to do is: lvm vgchange -ay exit ...and your system will bootup normally. I don''t know why Ubuntu has this BUG with self compiled kernels from Xen but, if anyone knows how to configure initramdisk to avoid this in each reboot, I will apreciate any info! :-P Good Luck! Thiago 2008/10/9 terii wang <terii@linuxmonkey.net>> On Wed, 8 Oct 2008 19:26:19 -0300 > "Thiago Camargo Martins Cordeiro" <thiagocmartinsc@gmail.com> wrote: > > > What version of Xen are you using? > > > > Ubuntu Hardy > Xen 3.2.1 > > > root@lonvm01: /etc/xen > # uname -a > Linux lonvm01 2.6.24-19-xen #1 SMP Wed Aug 20 21:08:51 UTC 2008 x86_64 > GNU/Linux > > root@lonvm01: /etc/xen > # xm info > host : lonvm01 > release : 2.6.24-19-xen > version : #1 SMP Wed Aug 20 21:08:51 UTC 2008 > machine : x86_64 > nr_cpus : 8 > nr_nodes : 1 > cores_per_socket : 4 > threads_per_core : 1 > cpu_mhz : 2992 > hw_caps : > bfebfbff:20100800:00000000:00000140:000ce3bd:00000000:00000001 > total_memory : 16378 free_memory : 4144 > max_free_memory : 7569 > max_para_memory : 7565 > max_hvm_memory : 7539 > node_to_cpu : node0:0-7 > xen_major : 3 > xen_minor : 2 > xen_extra : .1-rc1-pre > xen_caps : xen-3.0-x86_64 xen-3.0-x86_32p hvm-3.0-x86_32 > hvm-3.0-x86_32p hvm-3.0-x86_64 xen_scheduler : credit > xen_pagesize : 4096 > platform_params : virt_start=0xffff800000000000 > xen_changeset : unavailable > cc_compiler : gcc version 4.2.3 (Ubuntu 4.2.3-2ubuntu7) > cc_compile_by : buildd > cc_compile_domain : buildd > cc_compile_date : Fri Apr 11 01:13:51 UTC 2008 > xend_config_format : 4 >_______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
terii wang
2008-Oct-09 19:28 UTC
Re: [Xen-users] RE: Windows assigned 4GB RAM BSOD with GPLPV (0.9.10)
On Thu, 9 Oct 2008 09:11:58 +1100 "James Harper" <james.harper@bendigoit.com.au> wrote:> Can you please test a later version of the GPLPV drivers? 0.9.11-pre18 > is the latest. I know I fixed a 4G problem at some point, but I > thought that was earlier than 0.9.10. Also, can you give me the BSoD > numbers? >0.9.11-pre18 seems to work great! STOP: 0x0000007B (0xF789EA94,Oxc0000034,0x00000000,0x00000000) Screenshot here: http://terii.kbcowboy.net/images/misc/xen_4gb-gplpv-bsod.jpg> I have tested with 4CPU''s and have not noticed a problem before. >To be more specific... 4CPUs+4GB RAM causing reboot/shutdown to freeze. This happens even with non-GPLPV enabled guests. So this is not GPLPV related. Unfortunately I don''t have enough time to coordinate with Windows team to test out stability of "pre" GPLPV drivers. I have to push out those guests as it is for now. I will continue to test out GPL PV drivers as new ones is released on my dev servers. Thanks again. _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
James Harper
2008-Oct-09 23:26 UTC
RE: [Xen-users] RE: Windows assigned 4GB RAM BSOD with GPLPV (0.9.10)
> On Thu, 9 Oct 2008 09:11:58 +1100 > "James Harper" <james.harper@bendigoit.com.au> wrote: > > > > Can you please test a later version of the GPLPV drivers?0.9.11-pre18> > is the latest. I know I fixed a 4G problem at some point, but I > > thought that was earlier than 0.9.10. Also, can you give me the BSoD > > numbers? > > > > 0.9.11-pre18 seems to work great! > > STOP: 0x0000007B (0xF789EA94,Oxc0000034,0x00000000,0x00000000) > > Screenshot here: > http://terii.kbcowboy.net/images/misc/xen_4gb-gplpv-bsod.jpg >Yes, this appears to be the problem I was seeing. At some point (>3.5G?) windows switches on PAE to get the available memory over 4G, and so even though it is a 32bit system it behaves like a 64bit system in terms of some of the addressing requirements, and the vbd driver wasn''t reporting to windows correctly that it supported this, so the vbd driver didn''t load and windows was left without a boot device (0x0000007B is inaccessible boot device).> > I have tested with 4CPU''s and have not noticed a problem before. > > > > To be more specific... 4CPUs+4GB RAM causing reboot/shutdown tofreeze.> This happens even with non-GPLPV enabled guests. So this is not GPLPV > related. > > Unfortunately I don''t have enough time to coordinate with Windows team > to test out stability of "pre" GPLPV drivers. I have to push out those > guests as it is for now. I will continue to test out GPL PV drivers as > new ones is released on my dev servers. Thanks again.Don''t read too much into the fact that the version of the drivers is tagged -preXX. They are much more stable than the 0.9.10 version, the only reason I was holding off on a 0.9.11 proper is that I had reports of a few problems that I wanted to have fixed before 0.9.11. Unfortunately I have never been able to reproduce these problems and I think the reporting parties and I have run out of steam in terms of trying to come up with a solution and/or a way to reproduce the problem. I will roll the driver version over to 0.9.11 today if I get time, but it will be the same as 0.9.11-pre18. James _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users