Roman Konz
2007-Aug-02 10:01 UTC
[Xen-users] Xen-Kernel detects just 3.2GB Ram on a 64Bit Debian
Hi all, i have installed a fresh Debian Etch on a Supermicro Opteron Server System with 8GB RAM. Everything works fine, until I installed XEN (i have tried installing from the Debian-Repository, from the XEN binary package and by compiling the whole XEN distribution by hand). If I boot the XEN Kernel, Linux shows me just 3,2GB RAM, but if I reboot into the Debian standard Kernel, the memory is detected correctly. I don''t know what to try next, so I hope you can help me :-) Thanks a lot! Roman Konz _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Peter Peltonen
2007-Aug-02 13:38 UTC
Re: [Xen-users] Xen-Kernel detects just 3.2GB Ram on a 64Bit Debian
Hi, On 8/2/07, Roman Konz <drummermonkey@gmail.com> wrote:> If I boot the XEN Kernel, Linux shows me just 3,2GB RAM, but if I > reboot into the Debian standard Kernel, the memory is detected > correctly. > > I don''t know what to try next, so I hope you can help me :-)I have similiar problem on 32bit CentOS5 and 6gb of RAM: with kernel-PAE all memory is indeed recognized, but with kernel-xen not (which has PAE support also). But AFAIK 64bit OS should "just" work and see all your memory. Which debian version / xen packages do you have installed? I will try next installing the 64bit version of CentOS5 and see if that makes a difference in my own case. Cheers, Peter _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Roman Konz
2007-Aug-02 14:18 UTC
Re: [Xen-users] Xen-Kernel detects just 3.2GB Ram on a 64Bit Debian
Hi Peter, i have tried XEN 3.0.4 which is shipped with debian itself. Then i''ve tried to install the official binary package of XEN 3.1, and it gave the same error. Compiling XEN 3.1&its shipped Kernel also don''t work. I''m not sure, but I think it must be an error in the XEN Kernel. The same version (2.6.18) compiled without XEN support works fine with 8G of memory. Now i have tried the evaluation of XEN Enterprise - same error. A Hardware-Failure is not possible because i have tried it on 2 (same Hardare) Computers. Is it possible, that the XEN-Patch does not support our Hardware? Thanks a lot Greets, Roman Konz 2007/8/2, Peter Peltonen <peter.peltonen@gmail.com>:> Hi, > > On 8/2/07, Roman Konz <drummermonkey@gmail.com> wrote: > > If I boot the XEN Kernel, Linux shows me just 3,2GB RAM, but if I > > reboot into the Debian standard Kernel, the memory is detected > > correctly. > > > > I don''t know what to try next, so I hope you can help me :-) > > I have similiar problem on 32bit CentOS5 and 6gb of RAM: with > kernel-PAE all memory is indeed recognized, but with kernel-xen not > (which has PAE support also). > > But AFAIK 64bit OS should "just" work and see all your memory. Which > debian version / xen packages do you have installed? > > I will try next installing the 64bit version of CentOS5 and see if > that makes a difference in my own case. > > Cheers, > Peter >_______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Stephan Seitz
2007-Aug-02 16:24 UTC
Re: [Xen-users] Xen-Kernel detects just 3.2GB Ram on a 64Bit Debian
Hi Roman, We had similar problems with recent Supermicro Boards after installing huge amounts of RAM. The problems disappeared on all machines after we made BIOS updates. Only issue was to find the right BIOS image, since Supermicro offered a bunch of images labelled with the same version but with different release dates. Greetings Stephan Roman Konz schrieb:> Hi Peter, > > i have tried XEN 3.0.4 which is shipped with debian itself. > Then i''ve tried to install the official binary package of XEN 3.1, > and it gave the same error. > Compiling XEN 3.1&its shipped Kernel also don''t work. > > I''m not sure, but I think it must be an error in the XEN Kernel. > The same version (2.6.18) compiled without XEN support works fine with > 8G of memory. > > Now i have tried the evaluation of XEN Enterprise - same error. > A Hardware-Failure is not possible because i have tried it on 2 (same > Hardare) Computers. > Is it possible, that the XEN-Patch does not support our Hardware? > > Thanks a lot > > Greets, > Roman Konz > > > 2007/8/2, Peter Peltonen <peter.peltonen@gmail.com>: >> Hi, >> >> On 8/2/07, Roman Konz <drummermonkey@gmail.com> wrote: >>> If I boot the XEN Kernel, Linux shows me just 3,2GB RAM, but if I >>> reboot into the Debian standard Kernel, the memory is detected >>> correctly. >>> >>> I don''t know what to try next, so I hope you can help me :-) >> I have similiar problem on 32bit CentOS5 and 6gb of RAM: with >> kernel-PAE all memory is indeed recognized, but with kernel-xen not >> (which has PAE support also). >> >> But AFAIK 64bit OS should "just" work and see all your memory. Which >> debian version / xen packages do you have installed? >> >> I will try next installing the 64bit version of CentOS5 and see if >> that makes a difference in my own case. >> >> Cheers, >> Peter >> > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-users-- Stephan Seitz Senior System Administrator *netz-haut* e.K. multimediale kommunikation zweierweg 22 97074 würzburg fon: +49 931 2876247 fax: +49 931 2876248 web: www.netz-haut.de <http://www.netz-haut.de/> registriergericht: amtsgericht würzburg, hra 5054 _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Peter Peltonen
2007-Aug-02 17:16 UTC
Re: [Xen-users] Xen-Kernel detects just 3.2GB Ram on a 64Bit Debian
Hi Stephen, On 8/2/07, Stephan Seitz <s.seitz@netz-haut.de> wrote:> We had similar problems with recent Supermicro Boards after installing > huge amounts of RAM. > The problems disappeared on all machines after we made BIOS updates. > Only issue was to find the right BIOS image, since Supermicro offered > a bunch of images labelled with the same version but with different > release dates.We have the reason here as I also have a Supermicro board. My motherboard is Supermicro H8SMA-2 A64/Opteron with MD Athlon 64 X2 5200+ processor with 2 x 1GB ECC DDR-II SDRAM and 2x 2GB ECC DDR-II SDRAM. I just installed 64bit CentOS and it did not make any change: the system still sees only 3.2GB of RAM when booting with xen enabled kernel (with normal kernel all 6GB is recognized). Supermicro offers just one BIOS update to download for this board: Revision: R 1.0a. I find this a bit odd, as when I enter the BIOS I see: AMIBIOS Version 08.00.14 ID 1SMI2010 I wonder if I should try the update or not? Peter _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Robert A. Klahn
2007-Aug-02 17:18 UTC
[Xen-users] Re: Xen-Kernel detects just 3.2GB Ram on a 64Bit Debian
I ran into a similar problem in Fedora 7, x86_64, 16GB RAM, only 3GB+abit detected by Xen 3.1. Ultimately, I tracked it down to a problem in Grub. I reported it on the Fedora Bugzilla at https://bugzilla.redhat.com/bugzilla/show_bug.cgi?id=250299 But the shorter version is this patch to Grub: --- grub-0.97/stage2/common.c.e820 2007-07-30 11:36:19.000000000 -0800 +++ grub-0.97/stage2/common.c 2007-07-30 11:36:55.000000000 -0800 @@ -142,6 +142,7 @@ init_bios_info (void) { #ifndef STAGE1_5 - unsigned long cont, memtmp, addr; + unsigned long memtmp, addr; + volatile unsigned long cont; int drive; #endif> Message: 1 > Date: Thu, 2 Aug 2007 16:18:18 +0200 > From: "Roman Konz" <drummermonkey@gmail.com> > Subject: Re: [Xen-users] Xen-Kernel detects just 3.2GB Ram on a 64Bit > Debian > To: "Peter Peltonen" <peter.peltonen@gmail.com> > Cc: xen-users@lists.xensource.com > Message-ID: > <313072780708020718k68386da4k851b2f20fe87fcd2@mail.gmail.com> > Content-Type: text/plain; charset=ISO-8859-1 > > Hi Peter, > > i have tried XEN 3.0.4 which is shipped with debian itself. > Then i''ve tried to install the official binary package of XEN 3.1, > and it gave the same error. > Compiling XEN 3.1&its shipped Kernel also don''t work. > > I''m not sure, but I think it must be an error in the XEN Kernel. > The same version (2.6.18) compiled without XEN support works fine with > 8G of memory. > > Now i have tried the evaluation of XEN Enterprise - same error. > A Hardware-Failure is not possible because i have tried it on 2 (same > Hardare) Computers. > Is it possible, that the XEN-Patch does not support our Hardware? > > Thanks a lot > > Greets, > Roman Konz > > > 2007/8/2, Peter Peltonen <peter.peltonen@gmail.com>: > > Hi, > > > > On 8/2/07, Roman Konz <drummermonkey@gmail.com> wrote: > > > If I boot the XEN Kernel, Linux shows me just 3,2GB RAM, but if I > > > reboot into the Debian standard Kernel, the memory is detected > > > correctly. > > > > > > I don''t know what to try next, so I hope you can help me :-) > > > > I have similiar problem on 32bit CentOS5 and 6gb of RAM: with > > kernel-PAE all memory is indeed recognized, but with kernel-xen not > > (which has PAE support also). > > > > But AFAIK 64bit OS should "just" work and see all your memory. Which > > debian version / xen packages do you have installed? > > > > I will try next installing the 64bit version of CentOS5 and see if > > that makes a difference in my own case. > > > > Cheers, > > Peter > >----------------------------------------------------------- Robert A. Klahn robert@kint.org AIM: rklahn "Hope has two beautiful daughters: Anger and Courage. Anger at the way things are, and Courage to struggle to create things as they should be." -- St. Augustine _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Roman Konz
2007-Aug-02 20:31 UTC
Re: [Xen-users] Xen-Kernel detects just 3.2GB Ram on a 64Bit Debian
Hi> What processor/motherboard do you have?I don''t remember exactly (i''m not at work at the moment, so I can''t access the Server) but it is a nvidia chipset with 2 Dual Core Opterons> We had similar problems with recent Supermicro Boards after installing > huge amounts of RAM. > The problems disappeared on all machines after we made BIOS updates. > Only issue was to find the right BIOS image, since Supermicro offered > a bunch of images labelled with the same version but with different > release dates.This is the first thing i will try tomorrow! Thanks a lot so far, i hope i can report success tomorrow Roman _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Stephan Seitz
2007-Aug-02 21:39 UTC
Re: [Xen-users] Xen-Kernel detects just 3.2GB Ram on a 64Bit Debian
Hi Peter,> My motherboard is Supermicro H8SMA-2 A64/Opteron with MD Athlon 64 X2 > 5200+ processor with 2 x 1GB ECC DDR-II SDRAM and 2x 2GB ECC DDR-II SDRAM.The latest updates we made were done on PDSME+ and PDSMI Boards with Intel chipset and Dualcore Xeon 3060. I currently don''t remember the Opteron driven Boards. Nevertheless, I would give it a try, since my experiences with Supermicro in general are that 8 out of 10 needs an update right out of the box, regardless if in AMD or Intel layout. Worth to say that you should doublecheck the revision ;) Greetings Stephan _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Robert Lacroix
2007-Aug-03 23:28 UTC
[Xen-users] RE: Xen-Kernel detects just 3.2GB Ram on a 64Bit Debian
I''ve tried Robert''s patch for grub but it didn''t solve our problem. We are using 8GB of ram in an MSI Q965MDO-FI. Applying the latest BIOS (v3.6) didn''t solve the problem either. Same behavior: Debian kernel linux-image-2.6.18-4-amd64: 8GB, using Xen Hypervisor 3.1.0 with linux-image-2.6.18-4-xen-amd64: 3.2GB. Any other ideas left? /robert ---------------------------------------------------------------------------- --------------------------------------- by Robert A. Klahn Aug 02, 2007; 07:18pm I ran into a similar problem in Fedora 7, x86_64, 16GB RAM, only 3GB+abit detected by Xen 3.1. Ultimately, I tracked it down to a problem in Grub. I reported it on the Fedora Bugzilla at https://bugzilla.redhat.com/bugzilla/show_bug.cgi?id=250299 But the shorter version is this patch to Grub: --- grub-0.97/stage2/common.c.e820 2007-07-30 11:36:19.000000000 -0800 +++ grub-0.97/stage2/common.c 2007-07-30 11:36:55.000000000 -0800 @@ -142,6 +142,7 @@ init_bios_info (void) { #ifndef STAGE1_5 - unsigned long cont, memtmp, addr; + unsigned long memtmp, addr; + volatile unsigned long cont; int drive; #endif> Message: 1> Date: Thu, 2 Aug 2007 16:18:18 +0200> From: "Roman Konz" <drummermonkey@...>> Subject: Re: [Xen-users] Xen-Kernel detects just 3.2GB Ram on a 64Bit> Debian> To: "Peter Peltonen" <peter.peltonen@...>> Cc: xen-users@...> Message-ID:> <313072780708020718k68386da4k851b2f20fe87fcd2@...>> Content-Type: text/plain; charset=ISO-8859-1>> Hi Peter,>> i have tried XEN 3.0.4 which is shipped with debian itself.> Then i''ve tried to install the official binary package of XEN 3.1,> and it gave the same error.> Compiling XEN 3.1&its shipped Kernel also don''t work.>> I''m not sure, but I think it must be an error in the XEN Kernel.> The same version (2.6.18) compiled without XEN support works fine with> 8G of memory.>> Now i have tried the evaluation of XEN Enterprise - same error.> A Hardware-Failure is not possible because i have tried it on 2 (same> Hardare) Computers.> Is it possible, that the XEN-Patch does not support our Hardware?>> Thanks a lot>> Greets,> Roman Konz>>> 2007/8/2, Peter Peltonen <peter.peltonen@...>:> > Hi,> >> > On 8/2/07, Roman Konz <drummermonkey@...> wrote:> > > If I boot the XEN Kernel, Linux shows me just 3,2GB RAM, but if I> > > reboot into the Debian standard Kernel, the memory is detected> > > correctly.> > >> > > I don''t know what to try next, so I hope you can help me :-)> >> > I have similiar problem on 32bit CentOS5 and 6gb of RAM: with> > kernel-PAE all memory is indeed recognized, but with kernel-xen not> > (which has PAE support also).> >> > But AFAIK 64bit OS should "just" work and see all your memory. Which> > debian version / xen packages do you have installed?> >> > I will try next installing the 64bit version of CentOS5 and see if> > that makes a difference in my own case.> >> > Cheers,> > Peter> >----------------------------------------------------------- Robert A. Klahn robert@... AIM: rklahn "Hope has two beautiful daughters: Anger and Courage. Anger at the way things are, and Courage to struggle to create things as they should be." -- St. Augustine _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Robert Lacroix
2007-Aug-04 08:16 UTC
[Xen-users] RE: RE: Xen-Kernel detects just 3.2GB Ram on a 64Bit Debian
I''ve tried Robert''s patch for grub but it didn''t solve our problem. We are using 8GB of ram in an MSI Q965MDO-FI. Applying the latest BIOS (v3.6) didn''t solve the problem either. Same behavior: Debian kernel linux-image-2.6.18-4-amd64: 8GB, using Xen Hypervisor 3.1.0 with linux-image-2.6.18-4-xen-amd64: 3.2GB. Any other ideas left? /robert From: Robert A. Klahn Sent: Donnerstag, 2. August 2007 19:18 To: ''xen-users@lists.xensource.com'' Subject: RE: Xen-Kernel detects just 3.2GB Ram on a 64Bit Debian I ran into a similar problem in Fedora 7, x86_64, 16GB RAM, only 3GB+abit detected by Xen 3.1. Ultimately, I tracked it down to a problem in Grub. I reported it on the Fedora Bugzilla at https://bugzilla.redhat.com/bugzilla/show_bug.cgi?id=250299 But the shorter version is this patch to Grub: --- grub-0.97/stage2/common.c.e820 2007-07-30 11:36:19.000000000 -0800 +++ grub-0.97/stage2/common.c 2007-07-30 11:36:55.000000000 -0800 @@ -142,6 +142,7 @@ init_bios_info (void) { #ifndef STAGE1_5 - unsigned long cont, memtmp, addr; + unsigned long memtmp, addr; + volatile unsigned long cont; int drive; #endif> Message: 1> Date: Thu, 2 Aug 2007 16:18:18 +0200> From: "Roman Konz" <drummermonkey@...>> Subject: Re: [Xen-users] Xen-Kernel detects just 3.2GB Ram on a 64Bit> Debian> To: "Peter Peltonen" <peter.peltonen@...>> Cc: xen-users@...> Message-ID:> <313072780708020718k68386da4k851b2f20fe87fcd2@...>> Content-Type: text/plain; charset=ISO-8859-1>> Hi Peter,>> i have tried XEN 3.0.4 which is shipped with debian itself.> Then i''ve tried to install the official binary package of XEN 3.1,> and it gave the same error.> Compiling XEN 3.1&its shipped Kernel also don''t work.>> I''m not sure, but I think it must be an error in the XEN Kernel.> The same version (2.6.18) compiled without XEN support works fine with> 8G of memory.>> Now i have tried the evaluation of XEN Enterprise - same error.> A Hardware-Failure is not possible because i have tried it on 2 (same> Hardare) Computers.> Is it possible, that the XEN-Patch does not support our Hardware?>> Thanks a lot>> Greets,> Roman Konz>>> 2007/8/2, Peter Peltonen <peter.peltonen@...>:> > Hi,> >> > On 8/2/07, Roman Konz <drummermonkey@...> wrote:> > > If I boot the XEN Kernel, Linux shows me just 3,2GB RAM, but if I> > > reboot into the Debian standard Kernel, the memory is detected> > > correctly.> > >> > > I don''t know what to try next, so I hope you can help me :-)> >> > I have similiar problem on 32bit CentOS5 and 6gb of RAM: with> > kernel-PAE all memory is indeed recognized, but with kernel-xen not> > (which has PAE support also).> >> > But AFAIK 64bit OS should "just" work and see all your memory. Which> > debian version / xen packages do you have installed?> >> > I will try next installing the 64bit version of CentOS5 and see if> > that makes a difference in my own case.> >> > Cheers,> > Peter> >----------------------------------------------------------- Robert A. Klahn robert@... AIM: rklahn "Hope has two beautiful daughters: Anger and Courage. Anger at the way things are, and Courage to struggle to create things as they should be." -- St. Augustine _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Peter Peltonen
2007-Aug-06 21:19 UTC
Re: [Xen-users] RE: Xen-Kernel detects just 3.2GB Ram on a 64Bit Debian
I have (almost) now solved my issues with Xen not resolving all RAM of Supermicro server. As grub patching seemed a bit too much work, I went straight ahead to flashing the BIOS. Everything else went just fine except one strange thing: Before the upgrade BIOS reported 5904M of RAM. After the upgrade it reported only 5360M. After BIOS upgrade I booted to 64bit CentOS5. To my disappointment the system still saw only 3,2G of RAM. But I did not give up :) I thought that if the problem was with grub, maybe some older version would work. So I installed 64bit CentOS 4.5 and installed Xen 3.10 to it from the binaries Xensource provides. And this is what I can now see on my server''s screen after issuing `xm dmesg`: (XEN) System RAM: 5343MB (5471676kB) So the problem was with grub I think and I probably just hurt myself by flashing the BIOS as I lost a few hundres of megabytes of memory. But at least we made this much progress. Cheers, Peter _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Robert Lacroix
2007-Aug-06 23:13 UTC
RE: [Xen-users] Xen-Kernel detects just 3.2GB Ram on a 64Bit Debian
The grub patch works perfectly fine and I have the full 8191MB available now. The problem was just that I didn''t know that patching the debian grub package, installing it and running update-grub isn''t enough. After issuing grub-install /dev/sda and a following reboot everything worked. Sorry for the confusion and thanks to Shock for giving me the hint ;-) /Robert _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Peter Peltonen
2007-Aug-07 20:10 UTC
Re: [Xen-users] RE: Xen-Kernel detects just 3.2GB Ram on a 64Bit Debian
Replying to myself... On 8/7/07, Peter Peltonen <peter.peltonen@gmail.com> wrote:> Everything else went just fine except one strange thing: Before the > upgrade BIOS reported 5904M of RAM. After the upgrade it reported only > 5360M.After setting "Memory Hole Remapping -> Enabled" from BIOS I can now see all my RAM. Whee :) The problem now is that the CentOS4.5+Xen3.1 does not seem to be able to boot the domUs created with CentOS5+Xen3.0. After issuing xm create I just get a blank line and nothing else. I suppose I still will try one more time installing CentOS5 and patching grub, as Robert reported a success story as well. Peter _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users