Hi All
I am having 2 physical machine of exactly same configuration and same
hardware. Both are having 16GB of RAM. But when I check one machine
its shows only 6GB but other one shows complete physical memory(16GB).
Is there any settings that need to be changed. To make complete 16 gb
memory available.
Both are having RHEL 5.2 installed and having xen that come bundled with it.
But in BIOS both machine is showing 16GB.
Output of the machine where 16 memory is available.
[root@mumxen01 ~]# free
total used free shared buffers cached
Mem: 14429184 973244 13455940 0 56728 398408
-/+ buffers/cache: 518108 13911076
Swap: 10241428 0 10241428
[root@mumxen01 ~]# xm list
Name ID Mem(MiB) VCPUs State Time(s)
Domain-0 0 14091 8 r----- 175.8
server201 3 2064 1 -b---- 10.1
Output of the machine where 16GB memory is not available .
[root@mumxen002 ~]# free
total used free shared buffers cached
Mem: 6406144 6380060 26084 0 67128 5569972
-/+ buffers/cache: 742960 5663184
Swap: 5245212 148 5245064
[root@mumxen002 ~]# xm list
Name ID Mem(MiB) VCPUs State Time(s)
Domain-0 0 6256 8 r----- 180836.0
server101 1 2007 1 -b---- 28981.2
server102 2 519 1 -b---- 25015.7
server103 3 519 1 -b---- 28607.5
server104 4 1031 1 -b---- 84507.4
server105 5 519 1 -b---- 38746.8
server106 6 519 1 r----- 28538.8
server107 7 519 1 -b---- 27493.2
server108 8 519 1 -b---- 27084.5
server109 9 519 1 -b---- 25775.3
server110 10 519 1 -b---- 21892.7
server111 11 519 1 -b---- 19579.8
server112 12 519 1 -b---- 57347.3
server113 17 519 1 -b---- 34197.6
server114 16 519 1 -b---- 19571.7
server115 18 519 1 -b---- 19732.2
Thanks in Advance
_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users
On Fri, Oct 3, 2008 at 19:24, Arpan Jindal <jindalarpan@gmail.com> wrote:> Hi All > > I am having 2 physical machine of exactly same configuration and same > hardware. Both are having 16GB of RAM. But when I check one machine > its shows only 6GB but other one shows complete physical memory(16GB). > Is there any settings that need to be changed. To make complete 16 gb > memory available. > > Both are having RHEL 5.2 installed and having xen that come bundled with it. > > But in BIOS both machine is showing 16GB. > > Output of the machine where 16 memory is available. > > [root@mumxen01 ~]# free > > total used free shared buffers cached > Mem: 14429184 973244 13455940 0 56728 398408 > -/+ buffers/cache: 518108 13911076 > Swap: 10241428 0 10241428Shows roughly 14 GB available to dom0> [root@mumxen01 ~]# xm list > Name ID Mem(MiB) VCPUs State Time(s) > Domain-0 0 14091 8 r----- 175.8 > server201 3 2064 1 -b---- 10.1Total, between dom0 and domU about 16 GB> Output of the machine where 16GB memory is not available . > > [root@mumxen002 ~]# free > total used free shared buffers cached > Mem: 6406144 6380060 26084 0 67128 5569972 > -/+ buffers/cache: 742960 5663184 > Swap: 5245212 148 5245064Shows about 6 GB available to dom0> [root@mumxen002 ~]# xm list > Name ID Mem(MiB) VCPUs State Time(s) > Domain-0 0 6256 8 r----- 180836.0 > server101 1 2007 1 -b---- 28981.2 > server102 2 519 1 -b---- 25015.7 > server103 3 519 1 -b---- 28607.5 > server104 4 1031 1 -b---- 84507.4 > server105 5 519 1 -b---- 38746.8 > server106 6 519 1 r----- 28538.8 > server107 7 519 1 -b---- 27493.2 > server108 8 519 1 -b---- 27084.5 > server109 9 519 1 -b---- 25775.3 > server110 10 519 1 -b---- 21892.7 > server111 11 519 1 -b---- 19579.8 > server112 12 519 1 -b---- 57347.3 > server113 17 519 1 -b---- 34197.6 > server114 16 519 1 -b---- 19571.7 > server115 18 519 1 -b---- 19732.2Shows a total of about 16 GB, roughly 10 GB used by the domUs. Everything looks right to me. -- Please keep list traffic on the list. Rob MacGregor Whoever fights monsters should see to it that in the process he doesn''t become a monster. Friedrich Nietzsche _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
no mystery here: 14091 +2064 =16155 6256 +2007 +519 +519 +1031 +519 +519 +519 +519 +519 +519 +519 +519 +519 +519 +519 =16041 -- Javier _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
the unspoken answer here (which confused me for a while as well) is that guests "steal" memory from the dom0. _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
the unspoken answer is that the guests "steal" memory from the dom0. this confused me for a while as well. _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
if this was the case then i should be able to create new virtual machine inside it .. but i cant create it as i got message as no memory to allocate . 2008/10/4 Javier Guerra <javier@guerrag.com>:> no mystery here: > > 14091 > +2064 > =16155 > > 6256 > +2007 > +519 > +519 > +1031 > +519 > +519 > +519 > +519 > +519 > +519 > +519 > +519 > +519 > +519 > +519 > =16041 > > > > > -- > Javier >_______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
On Fri, Oct 3, 2008 at 2:02 PM, Arpan Jindal <jindalarpan@gmail.com> wrote:> if this was the case then i should be able to create new virtual > machine inside it .. but i cant create it as i got message as no > memory to allocate .check the minimum ram for Dom0... i don''t remember the parameter''s name, but i think it''s in the GRUB config -- Javier _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Hi i am pasting outputs again. according to the calculation of adding the domain RAM and guest machine memory total should be 16 gb. and according to this calculation i should have created more virtual machines but when i create any new virtual machine i am getting error message as out of memory. out put of servers as [root@mumxen01 ~]# xm info host : mumxen01 release : 2.6.18-8.el5xen version : #1 SMP Fri Jan 26 14:29:35 EST 2007 machine : x86_64 nr_cpus : 8 nr_nodes : 1 sockets_per_node : 2 cores_per_socket : 4 threads_per_core : 1 cpu_mhz : 2000 hw_caps : bfebfbff:20000800:00000000:00000040:000ce33d:00000000:00000001 total_memory : 16383 free_memory : 0 xen_major : 3 xen_minor : 0 xen_extra : .3-rc5-8.el5 xen_caps : xen-3.0-x86_64 hvm-3.0-x86_32 hvm-3.0-x86_32p hvm-3.0-x86_64 xen_pagesize : 4096 platform_params : virt_start=0xffff800000000000 xen_changeset : unavailable cc_compiler : gcc version 4.1.1 20070105 (Red Hat 4.1.1-52) cc_compile_by : brewbuilder cc_compile_domain : build.redhat.com cc_compile_date : Fri Jan 26 14:12:03 EST 2007 xend_config_format : 2 [root@mumxen01 ~]# xm list Name ID Mem(MiB) VCPUs State Time(s) Domain-0 0 9954 8 r----- 4126.1 server104 9 4117 1 r----- 124.6 server201 3 2064 1 -b---- 1379.9 [root@mumxen01 ~]# [root@mumxen002 ~]# xm info host : mumxen002 release : 2.6.18-53.el5xen version : #1 SMP Wed Oct 10 16:48:44 EDT 2007 machine : x86_64 nr_cpus : 8 nr_nodes : 1 sockets_per_node : 2 cores_per_socket : 4 threads_per_core : 1 cpu_mhz : 2000 hw_caps : bfebfbff:20000800:00000000:00000040:000ce33d:00000000:00000001 total_memory : 16383 free_memory : 1043 xen_major : 3 xen_minor : 1 xen_extra : .0-53.el5 xen_caps : xen-3.0-x86_64 xen-3.0-x86_32p hvm-3.0-x86_32 hvm-3.0-x86_32p hvm-3.0-x86_64 xen_pagesize : 4096 platform_params : virt_start=0xffff800000000000 xen_changeset : unavailable cc_compiler : gcc version 4.1.2 20070626 (Red Hat 4.1.2-14) cc_compile_by : brewbuilder cc_compile_domain : build.redhat.com cc_compile_date : Wed Oct 10 16:30:57 EDT 2007 xend_config_format : 2 [root@mumxen002 ~]# xm list Name ID Mem(MiB) VCPUs State Time(s) Domain-0 0 6256 8 r----- 203351.6 server101 1 2007 1 -b---- 40379.6 server102 2 519 1 -b---- 34517.6 server103 3 519 1 -b---- 39044.9 server104 4 1039 1 -b---- 39124.1 server105 5 519 1 -b---- 49120.2 server106 6 519 1 -b---- 39234.6 server107 7 519 1 -b---- 37777.7 server108 8 519 1 -b---- 37907.9 server109 9 519 1 -b---- 36942.6 server110 10 519 1 -b---- 30085.9 server111 11 519 1 -b---- 26556.0 server112 12 519 1 -b---- 76582.5 server113 17 519 1 -b---- 42216.1 server114 16 519 1 -b---- 26396.7 server115 18 519 1 -b---- 26633.9 [root@mumxen002 ~]# kindly let me know what could be issue . or where it could be solved. Thanks On Fri, Oct 3, 2008 at 11:59 PM, Rob MacGregor <rob.macgregor@gmail.com> wrote:> On Fri, Oct 3, 2008 at 19:24, Arpan Jindal <jindalarpan@gmail.com> wrote: >> Hi All >> >> I am having 2 physical machine of exactly same configuration and same >> hardware. Both are having 16GB of RAM. But when I check one machine >> its shows only 6GB but other one shows complete physical memory(16GB). >> Is there any settings that need to be changed. To make complete 16 gb >> memory available. >> >> Both are having RHEL 5.2 installed and having xen that come bundled with it. >> >> But in BIOS both machine is showing 16GB. >> >> Output of the machine where 16 memory is available. >> >> [root@mumxen01 ~]# free >> >> total used free shared buffers cached >> Mem: 14429184 973244 13455940 0 56728 398408 >> -/+ buffers/cache: 518108 13911076 >> Swap: 10241428 0 10241428 > > Shows roughly 14 GB available to dom0 > >> [root@mumxen01 ~]# xm list >> Name ID Mem(MiB) VCPUs State Time(s) >> Domain-0 0 14091 8 r----- 175.8 >> server201 3 2064 1 -b---- 10.1 > > Total, between dom0 and domU about 16 GB > >> Output of the machine where 16GB memory is not available . >> >> [root@mumxen002 ~]# free >> total used free shared buffers cached >> Mem: 6406144 6380060 26084 0 67128 5569972 >> -/+ buffers/cache: 742960 5663184 >> Swap: 5245212 148 5245064 > > Shows about 6 GB available to dom0 > >> [root@mumxen002 ~]# xm list >> Name ID Mem(MiB) VCPUs State Time(s) >> Domain-0 0 6256 8 r----- 180836.0 >> server101 1 2007 1 -b---- 28981.2 >> server102 2 519 1 -b---- 25015.7 >> server103 3 519 1 -b---- 28607.5 >> server104 4 1031 1 -b---- 84507.4 >> server105 5 519 1 -b---- 38746.8 >> server106 6 519 1 r----- 28538.8 >> server107 7 519 1 -b---- 27493.2 >> server108 8 519 1 -b---- 27084.5 >> server109 9 519 1 -b---- 25775.3 >> server110 10 519 1 -b---- 21892.7 >> server111 11 519 1 -b---- 19579.8 >> server112 12 519 1 -b---- 57347.3 >> server113 17 519 1 -b---- 34197.6 >> server114 16 519 1 -b---- 19571.7 >> server115 18 519 1 -b---- 19732.2 > > Shows a total of about 16 GB, roughly 10 GB used by the domUs. > > Everything looks right to me. > > -- > Please keep list traffic on the list. > > Rob MacGregor > Whoever fights monsters should see to it that in the process he > doesn''t become a monster. Friedrich Nietzsche > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-users >_______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
resending Hi i am pasting outputs again. according to the calculation of adding the domain RAM and guest machine memory total should be 16 gb. and according to this calculation i should have created more virtual machines but when i create any new virtual machine i am getting error message as out of memory. out put of servers as [root@mumxen01 ~]# xm info host : mumxen01 release : 2.6.18-8.el5xen version : #1 SMP Fri Jan 26 14:29:35 EST 2007 machine : x86_64 nr_cpus : 8 nr_nodes : 1 sockets_per_node : 2 cores_per_socket : 4 threads_per_core : 1 cpu_mhz : 2000 hw_caps : bfebfbff:20000800:00000000:00000040:000ce33d:00000000:00000001 total_memory : 16383 free_memory : 0 xen_major : 3 xen_minor : 0 xen_extra : .3-rc5-8.el5 xen_caps : xen-3.0-x86_64 hvm-3.0-x86_32 hvm-3.0-x86_32p hvm-3.0-x86_64 xen_pagesize : 4096 platform_params : virt_start=0xffff800000000000 xen_changeset : unavailable cc_compiler : gcc version 4.1.1 20070105 (Red Hat 4.1.1-52) cc_compile_by : brewbuilder cc_compile_domain : build.redhat.com cc_compile_date : Fri Jan 26 14:12:03 EST 2007 xend_config_format : 2 [root@mumxen01 ~]# xm list Name ID Mem(MiB) VCPUs State Time(s) Domain-0 0 9954 8 r----- 4126.1 server104 9 4117 1 r----- 124.6 server201 3 2064 1 -b---- 1379.9 [root@mumxen01 ~]# [root@mumxen002 ~]# xm info host : mumxen002 release : 2.6.18-53.el5xen version : #1 SMP Wed Oct 10 16:48:44 EDT 2007 machine : x86_64 nr_cpus : 8 nr_nodes : 1 sockets_per_node : 2 cores_per_socket : 4 threads_per_core : 1 cpu_mhz : 2000 hw_caps : bfebfbff:20000800:00000000:00000040:000ce33d:00000000:00000001 total_memory : 16383 free_memory : 1043 xen_major : 3 xen_minor : 1 xen_extra : .0-53.el5 xen_caps : xen-3.0-x86_64 xen-3.0-x86_32p hvm-3.0-x86_32 hvm-3.0-x86_32p hvm-3.0-x86_64 xen_pagesize : 4096 platform_params : virt_start=0xffff800000000000 xen_changeset : unavailable cc_compiler : gcc version 4.1.2 20070626 (Red Hat 4.1.2-14) cc_compile_by : brewbuilder cc_compile_domain : build.redhat.com cc_compile_date : Wed Oct 10 16:30:57 EDT 2007 xend_config_format : 2 [root@mumxen002 ~]# xm list Name ID Mem(MiB) VCPUs State Time(s) Domain-0 0 6256 8 r----- 203351.6 server101 1 2007 1 -b---- 40379.6 server102 2 519 1 -b---- 34517.6 server103 3 519 1 -b---- 39044.9 server104 4 1039 1 -b---- 39124.1 server105 5 519 1 -b---- 49120.2 server106 6 519 1 -b---- 39234.6 server107 7 519 1 -b---- 37777.7 server108 8 519 1 -b---- 37907.9 server109 9 519 1 -b---- 36942.6 server110 10 519 1 -b---- 30085.9 server111 11 519 1 -b---- 26556.0 server112 12 519 1 -b---- 76582.5 server113 17 519 1 -b---- 42216.1 server114 16 519 1 -b---- 26396.7 server115 18 519 1 -b---- 26633.9 [root@mumxen002 ~]# kindly let me know what could be issue . or where it could be solved. Thanks On Fri, Oct 3, 2008 at 11:59 PM, Rob MacGregor <rob.macgregor@gmail.com> wrote:> On Fri, Oct 3, 2008 at 19:24, Arpan Jindal <jindalarpan@gmail.com> wrote: >> Hi All >> >> I am having 2 physical machine of exactly same configuration and same >> hardware. Both are having 16GB of RAM. But when I check one machine >> its shows only 6GB but other one shows complete physical memory(16GB). >> Is there any settings that need to be changed. To make complete 16 gb >> memory available. >> >> Both are having RHEL 5.2 installed and having xen that come bundled with it. >> >> But in BIOS both machine is showing 16GB. >> >> Output of the machine where 16 memory is available. >> >> [root@mumxen01 ~]# free >> >> total used free shared buffers cached >> Mem: 14429184 973244 13455940 0 56728 398408 >> -/+ buffers/cache: 518108 13911076 >> Swap: 10241428 0 10241428 > > Shows roughly 14 GB available to dom0 > >> [root@mumxen01 ~]# xm list >> Name ID Mem(MiB) VCPUs State Time(s) >> Domain-0 0 14091 8 r----- 175.8 >> server201 3 2064 1 -b---- 10.1 > > Total, between dom0 and domU about 16 GB > >> Output of the machine where 16GB memory is not available . >> >> [root@mumxen002 ~]# free >> total used free shared buffers cached >> Mem: 6406144 6380060 26084 0 67128 5569972 >> -/+ buffers/cache: 742960 5663184 >> Swap: 5245212 148 5245064 > > Shows about 6 GB available to dom0 > >> [root@mumxen002 ~]# xm list >> Name ID Mem(MiB) VCPUs State Time(s) >> Domain-0 0 6256 8 r----- 180836.0 >> server101 1 2007 1 -b---- 28981.2 >> server102 2 519 1 -b---- 25015.7 >> server103 3 519 1 -b---- 28607.5 >> server104 4 1031 1 -b---- 84507.4 >> server105 5 519 1 -b---- 38746.8 >> server106 6 519 1 r----- 28538.8 >> server107 7 519 1 -b---- 27493.2 >> server108 8 519 1 -b---- 27084.5 >> server109 9 519 1 -b---- 25775.3 >> server110 10 519 1 -b---- 21892.7 >> server111 11 519 1 -b---- 19579.8 >> server112 12 519 1 -b---- 57347.3 >> server113 17 519 1 -b---- 34197.6 >> server114 16 519 1 -b---- 19571.7 >> server115 18 519 1 -b---- 19732.2 > > Shows a total of about 16 GB, roughly 10 GB used by the domUs. > > Everything looks right to me. > > -- > Please keep list traffic on the list. > > Rob MacGregor > Whoever fights monsters should see to it that in the process he > doesn''t become a monster. Friedrich Nietzsche > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-users >_______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Quoting Arpan Jindal <jindalarpan@gmail.com>:> resending > > > > Hi > i am pasting outputs again. according to the calculation of adding the > domain RAM and guest machine memory total should be 16 gb. and > according to this calculation i should have created more virtual > machines but when i create any new virtual machine i am getting error > message as out of memory. > > total_memory : 16383 > free_memory : 0> [root@mumxen01 ~]# xm list > Name ID Mem(MiB) VCPUs State Time(s) > Domain-0 0 9954 8 r----- 4126.1 > server104 9 4117 1 r----- 124.6 > server201 3 2064 1 -b---- 1379.9 > [root@mumxen01 ~]# > >Hello Arpan, Maybe I am missing something but it looks like you have used all of your memeory for the two VMs and the dom0 already. 9954+4117+2064=16135MB or 16GB Do you really need 9GB of ram for dom0? Jon _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
no i dont need it at all.. what is the minimum survive with i need to run 20 vm under it .... and how i can decrease it On Mon, Oct 6, 2008 at 11:45 PM, <jonr@destar.net> wrote:> Quoting Arpan Jindal <jindalarpan@gmail.com>: > >> resending >> >> >> >> Hi >> i am pasting outputs again. according to the calculation of adding the >> domain RAM and guest machine memory total should be 16 gb. and >> according to this calculation i should have created more virtual >> machines but when i create any new virtual machine i am getting error >> message as out of memory. >> >> total_memory : 16383 >> free_memory : 0 > >> [root@mumxen01 ~]# xm list >> Name ID Mem(MiB) VCPUs State >> Time(s) >> Domain-0 0 9954 8 r----- >> 4126.1 >> server104 9 4117 1 r----- 124.6 >> server201 3 2064 1 -b---- 1379.9 >> [root@mumxen01 ~]# >> >> > Hello Arpan, > > Maybe I am missing something but it looks like you have used all of your > memeory for the two VMs and the dom0 already. > > 9954+4117+2064=16135MB or 16GB > > Do you really need 9GB of ram for dom0? > > Jon > > > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-users >_______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Quoting Arpan Jindal <jindalarpan@gmail.com>:> no i dont need it at all.. > what is the minimum survive with i need to run 20 vm under it .... > and how i can decrease it >In your /boot/grub/menu.lst file of your dom0, you will see a line similar to the one below, notice how I have told dom0 it is only going to get 512M of RAM. I am not sure if you could just say 512M after the ''='' sign, this is how I have always done it. To get this number you would multiply whatever RAM value by 1024. I am not sure what a good value for dom0 would be. I use 512MB because I have installed a minimal OS using just what I need for a base system and just what I need for Xen. I am not sure how fat distros like CentOS or Fedora or the debian type systems are. Do they install a desktop environment for dom0? I don''t know. e.g. 256MB 256*1024=262144 512MB 512*1024=524288 9GB 9216*1024=9437184 ;) kernel /boot/xen-3.2gz dom0_mem=524288 Jon _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
On Oct 6, 2008, at 20:32 , jonr@destar.net wrote:> 256MB 256*1024=262144 > 512MB 512*1024=524288 > 9GB 9216*1024=9437184 ;) > > kernel /boot/xen-3.2gz dom0_mem=524288dom0_mem=512M works just fine. Pi _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
On Mon, Oct 06, 2008 at 08:57:54PM +0200, Pim van Riezen wrote:> > On Oct 6, 2008, at 20:32 , jonr@destar.net wrote: >> 256MB 256*1024=262144 >> 512MB 512*1024=524288 >> 9GB 9216*1024=9437184 ;) >> >> kernel /boot/xen-3.2gz dom0_mem=524288 > > dom0_mem=512M works just fine.All this dom0 memory is usually used for cache. Do a free(1) to see how much is currently cached:> # free -m > total used free shared buffers cached > 512 468 43 0 2 117Read the proc(5) man page, search for "drop_caches" and you might be able to free up some memory:> # sync > # echo 1 > /proc/sys/vm/drop_caches > # free -m > total used free shared buffers cached > 512 370 141 0 0 21I know, not much difference here, but before I set dom0_mem to 512M I used this particular trick to free a few gigs of kernel cache for new domUs. -- Fridh _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users