Hi everybody, I hope I''ll find any one can help me in this big prblem. I have 10 XCP hosts, some of them has more than 2 Virtal machines (max 4 VMs) each host has: Intel Quad Core i7 2.8Gig 2*1T HDD 1*1G NIC for internal use 1*100 Mbps connected to public network 12 GB RAM for example for one of them (XCP 0.5) Host: I installed 2 Centos VMs each with 3GB RAM, and 4VCPUs and 910 GB VHDD and 2 VNICs, I followed the documentation to install them. and I increased the Dom0 memory by editing /boot/extlinux.conf "dom0_mem=2940M" because I faced too many problems with default values and I thought it will be better if I increased the mem. BUT NOW every 2 weeks " may be less" all my XCP hosts hanging and when I tried to check RAM using xentop I got: xentop - 10:15:06 Xen 3.4.2 3 domains: 1 running, 2 blocked, 0 paused, 0 crashed, 0 dying, 0 shutdown Mem: 12573752k total, 8600008k used, 3973744k free CPUs: 8 @ 2809MHz NAME STATE CPU(sec) CPU(%) MEM(k) MEM(%) MAXMEM(k) MAXMEM(%) VCPUS NETS NETTX(k) NETRX(k) VBDS VBD_OO VBD_RD VBD_WR SSID Domain-0 -----r 537556 13.1 2095872 16.7 2095872 16.7 8 0 0 0 0 0 0 0 0 Download B --b--- 16500 2.0 3145728 25.0 3145728 25.0 4 2 59102 4239032 1 0 43473 2535945 0 User Profi --b--- 16873 0.8 3145728 25.0 3145728 25.0 4 2 50837 339454 1 0 46217 2708478 0 and O/P from "free -m " free -m total used free shared buffers cached Mem: 2047 1768 278 0 121 534 -/+ buffers/cache: 1112 934 Swap: 511 0 511 and from "top" only: top - 10:17:25 up 24 days, 2:09, 1 user, load average: 0.18, 0.24, 0.56 Tasks: 83 total, 2 running, 81 sleeping, 0 stopped, 0 zombie Cpu(s): 6.0%us, 0.3%sy, 0.0%ni, 92.7%id, 1.0%wa, 0.0%hi, 0.0%si, 0.0%st Mem: 2096132k total, 1810692k used, 285440k free, 123932k buffers Swap: 524280k total, 200k used, 524080k free, 547272k cached PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 5517 root 10 -10 930m 925m 948 S 8.7 45.2 8204:39 ovs-vswitchd 1163 root 15 -5 0 0 0 S 1.3 0.0 428:06.76 netback and after restarting, every thing working fine again and after some time hanging again and when I am trying to ping my VMs some times I am getting timeout, and some times I am loosing data packets. I want to know why my XCP hosts hanging and not responding after sometime. Any help will be appriciated,Please Inas _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Kind Regards,
Christopher James Petrolino
On Jun 26, 2011, at 4:33 AM, inas mohamed <inas_2003@yahoo.com> wrote:
Hi everybody,
I hope I''ll find any one can help me in this big prblem.
I have 10 XCP hosts, some of them has more than 2 Virtal machines (max 4
VMs)
each host has:
Intel Quad Core i7 2.8Gig
2*1T HDD
1*1G NIC for internal use
1*100 Mbps connected to public network
12 GB RAM
for example for one of them (XCP 0.5) Host:
To clarify, you are using XCP 0.5? If so I would definitely
suggest upgrading to 1.0
I installed 2 Centos VMs each with 3GB RAM, and 4VCPUs and 910 GB VHDD and 2
VNICs, I followed the documentation to install them. and I increased the
Dom0 memory by editing /boot/extlinux.conf "dom0_mem=2940M" because I
faced
too many problems with default values and I thought it will be better if I
increased the mem.
BUT NOW every 2 weeks " may be less" all my XCP hosts hanging and when
I
tried to check RAM using xentop I got:
xentop - 10:15:06 Xen 3.4.2
3 domains: 1 running, 2 blocked, 0 paused, 0 crashed, 0 dying, 0 shutdown
Mem: 12573752k total, 8600008k used, 3973744k free CPUs: 8 @ 2809MHz
NAME STATE CPU(sec) CPU(%) MEM(k) MEM(%) MAXMEM(k) MAXMEM(%)
VCPUS NETS NETTX(k) NETRX(k) VBDS VBD_OO VBD_RD VBD_WR SSID
Domain-0 -----r 537556 13.1 2095872 16.7 2095872
16.7 8 0 0 0 0 0 0 0 0
Download B --b--- 16500 2.0 3145728 25.0 3145728
25.0 4 2 59102 4239032 1 0 43473 2535945 0
User Profi --b--- 16873 0.8 3145728 25.0 3145728
25.0 4 2 50837 339454 1 0 46217 2708478 0
and O/P from "free -m "
free -m
total used free shared buffers cached
Mem: 2047 1768 278 0 121 534
-/+ buffers/cache: 1112 934
Swap: 511 0 511
and from "top" only:
top - 10:17:25 up 24 days, 2:09, 1 user, load average: 0.18, 0.24, 0.56
Tasks: 83 total, 2 running, 81 sleeping, 0 stopped, 0 zombie
Cpu(s): 6.0%us, 0.3%sy, 0.0%ni, 92.7%id, 1.0%wa, 0.0%hi, 0.0%si,
0.0%st
Mem: 2096132k total, 1810692k used, 285440k free, 123932k buffers
Swap: 524280k total, 200k used, 524080k free, 547272k cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+
COMMAND
5517 root 10 -10 930m 925m 948 S 8.7 45.2 8204:39
ovs-vswitchd
1163 root 15 -5 0 0 0 S 1.3 0.0 428:06.76 netback
and after restarting, every thing working fine again and after some time
hanging again and when I am trying to ping my VMs some times I am getting
timeout, and some times I am loosing data packets.
I want to know why my XCP hosts hanging and not responding after sometime.
Any help will be appriciated,Please
Inas
_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users
_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users
Hi, Thanks so much for replying, and yes I am using XCP 0.5 . Is this a problem in XCP 0.5 and I observed that ovs-vswitchd is using too much memory (more than 50% from top command) and it makes the CPU usage reached to 100%. I don''t know what is this daemon? and is it the problem if yes how to solve this problem. Thanks again for your help Inas --- On Sun, 6/26/11, Chris Petrolino <cpetrolino@gmail.com> wrote: From: Chris Petrolino <cpetrolino@gmail.com> Subject: Re: [Xen-users] Xen Cloud Platform Problem To: "inas mohamed" <inas_2003@yahoo.com> Cc: "xen-users@lists.xensource.com" <xen-users@lists.xensource.com> Date: Sunday, June 26, 2011, 8:23 PM Kind Regards, Christopher James Petrolino On Jun 26, 2011, at 4:33 AM, inas mohamed <inas_2003@yahoo.com> wrote: Hi everybody, I hope I''ll find any one can help me in this big prblem. I have 10 XCP hosts, some of them has more than 2 Virtal machines (max 4 VMs) each host has: Intel Quad Core i7 2.8Gig 2*1T HDD 1*1G NIC for internal use 1*100 Mbps connected to public network 12 GB RAM for example for one of them (XCP 0.5) Host: To clarify, you are using XCP 0.5? If so I would definitely suggest upgrading to 1.0 I installed 2 Centos VMs each with 3GB RAM, and 4VCPUs and 910 GB VHDD and 2 VNICs, I followed the documentation to install them. and I increased the Dom0 memory by editing /boot/extlinux.conf "dom0_mem=2940M" because I faced too many problems with default values and I thought it will be better if I increased the mem. BUT NOW every 2 weeks " may be less" all my XCP hosts hanging and when I tried to check RAM using xentop I got: xentop - 10:15:06 Xen 3.4.2 3 domains: 1 running, 2 blocked, 0 paused, 0 crashed, 0 dying, 0 shutdown Mem: 12573752k total, 8600008k used, 3973744k free CPUs: 8 @ 2809MHz NAME STATE CPU(sec) CPU(%) MEM(k) MEM(%) MAXMEM(k) MAXMEM(%) VCPUS NETS NETTX(k) NETRX(k) VBDS VBD_OO VBD_RD VBD_WR SSID Domain-0 -----r 537556 13.1 2095872 16.7 2095872 16.7 8 0 0 0 0 0 0 0 0 Download B --b--- 16500 2.0 3145728 25.0 3145728 25.0 4 2 59102 4239032 1 0 43473 2535945 0 User Profi --b--- 16873 0.8 3145728 25.0 3145728 25.0 4 2 50837 339454 1 0 46217 2708478 0 and O/P from "free -m " free -m total used free shared buffers cached Mem: 2047 1768 278 0 121 534 -/+ buffers/cache: 1112 934 Swap: 511 0 511 and from "top" only: top - 10:17:25 up 24 days, 2:09, 1 user, load average: 0.18, 0.24, 0.56 Tasks: 83 total, 2 running, 81 sleeping, 0 stopped, 0 zombie Cpu(s): 6.0%us, 0.3%sy, 0.0%ni, 92.7%id, 1.0%wa, 0.0%hi, 0.0%si, 0.0%st Mem: 2096132k total, 1810692k used, 285440k free, 123932k buffers Swap: 524280k total, 200k used, 524080k free, 547272k cached PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 5517 root 10 -10 930m 925m 948 S 8.7 45.2 8204:39 ovs-vswitchd 1163 root 15 -5 0 0 0 S 1.3 0.0 428:06.76 netback and after restarting, every thing working fine again and after some time hanging again and when I am trying to ping my VMs some times I am getting timeout, and some times I am loosing data packets. I want to know why my XCP hosts hanging and not responding after sometime. Any help will be appriciated,Please Inas _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users -----Inline Attachment Follows----- _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
On Mon, Jun 27, 2011 at 1:15 AM, inas mohamed <inas_2003@yahoo.com> wrote:> > Hi, > > Thanks so much for replying, and yes I am using XCP 0.5 . Is this a problem in XCP 0.5 and I observed that ovs-vswitchd is using too much memory (more than 50% from top command) and it makes the CPU usage reached to 100%. I don''t know what is this daemon? and is it the problem if yes how to solve this problem. >ovs-vswitchd is the Open vSwitch daemon. This handles the networking on the XCP system. To diagnose your general problem, you going to want to look through the logs and use monitoring tools to figure out what is going on. For example /var/log/xensource.log, /var/log/messages. Use the built in monitoring in XCP if you have the XenTools installed and can use OpenXenManager or XenCenter to view the graphs. You can also use top within the VMs that you expect potential problems. You may want to setup a monitoring tool that watches at the network level such as nagios, cacti, etc. Hope that helps. You may want to consider setting up a text box with XCP 1.0 or higher to see if you can reproduce the condition there as well. -- Todd Deshane http://www.linkedin.com/in/deshantm http://www.xen.org/products/cloudxen.html http://runningxen.com/ _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users