Md Mooktakim Ahmed
2006-Aug-24 09:51 UTC
[Xen-users] domU keeps crashing with repeating error message
I don''t know what happened. I have other domU''s running and they seem to be fine. Also i have on_crash="destroy" which should shutdown the domU if there is a crash. But for some reason the domain crashes and keep repeating the following message: printk: 755 messages suppressed. oom-killer: gfp_mask=0xd0, order=0 [<c0146acf>] out_of_memory+0xbf/0xe0 [<c0147e39>] __alloc_pages+0x279/0x310 [<c01609e7>] kmem_getpages+0x37/0xa0 [<c0161747>] alloc_slabmgmt+0x57/0x70 [<c0161967>] cache_grow+0xd7/0x1d0 [<c0161bcb>] cache_alloc_refill+0x16b/0x210 [<c0161e95>] kmem_cache_alloc+0x85/0x90 [<c011c729>] dup_task_struct+0x29/0xa0 [<c011d446>] copy_process+0x86/0xdf0 [<c011e2a9>] do_fork+0x69/0x190 [<c0103058>] kernel_thread+0x98/0xb0 [<c01354d0>] kthread+0x0/0xc0 [<c0102fb0>] kernel_thread_helper+0x0/0x10 [<c01355b8>] keventd_create_kthread+0x28/0x60 [<c01354d0>] kthread+0x0/0xc0 [<c0131379>] run_workqueue+0x79/0xf0 [<c012da30>] do_sigaction+0x1c0/0x2b0 [<c0135590>] keventd_create_kthread+0x0/0x60 [<c013153c>] worker_thread+0x14c/0x170 [<c01190d0>] default_wake_function+0x0/0x20 [<c01190d0>] default_wake_function+0x0/0x20 [<c01313f0>] worker_thread+0x0/0x170 [<c013558a>] kthread+0xba/0xc0 [<c01354d0>] kthread+0x0/0xc0 [<c0102fb5>] kernel_thread_helper+0x5/0x10 DMA per-cpu: cpu 0 hot: high 186, batch 31 used:28 cpu 0 cold: high 62, batch 15 used:48 DMA32 per-cpu: empty Normal per-cpu: empty HighMem per-cpu: empty Free pages: 2056kB (0kB HighMem) Active:80524 inactive:40996 dirty:0 writeback:0 unstable:0 free:514 slab:3658 mapped:121482 pagetables:1694 DMA free:2056kB min:2916kB low:3644kB high:4372kB active:322096kB inactive:163984kB present:532480kB pages_scanned:1093031976 all_unreclaimable? yes lowmem_reserve[]: 0 0 0 0 DMA32 free:0kB min:0kB low:0kB high:0kB active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 0 0 0 Normal free:0kB min:0kB low:0kB high:0kB active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 0 0 0 HighMem free:0kB min:128kB low:128kB high:128kB active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 0 0 0 DMA: 0*4kB 1*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 1*2048kB 0*4096kB = 2056kB DMA32: empty Normal: empty HighMem: empty Swap cache: add 2800388, delete 2800142, find 1381304/1936805, race 2+20 Free swap = 0kB Total swap = 1048568kB It repeats that over and over. Here xm info on my machine: cyclops ## Dom 0 ## ~ $ xm info host : cyclops.xensolutions.co.uk release : 2.6.16-xen version : #1 SMP Thu Apr 13 18:46:07 BST 2006 machine : i686 nr_cpus : 1 nr_nodes : 1 sockets_per_node : 1 cores_per_socket : 1 threads_per_core : 1 cpu_mhz : 2404 hw_caps : bfebfbff:00000000:00000000:00000080:00004400 total_memory : 1016 free_memory : 163 xen_major : 3 xen_minor : 0 xen_extra : .2-2 xen_caps : xen-3.0-x86_32 platform_params : virt_start=0xfc000000 xen_changeset : Thu Apr 13 15:18:37 2006 +0100 9617:5802713c159b cc_compiler : gcc version 3.3.3 20040412 (Red Hat Linux 3.3.3-7) cc_compile_by : xenod cc_compile_domain : cl.cam.ac.uk cc_compile_date : Thu Apr 13 17:34:06 BST 2006 Any help will be appreciated. -- Website: http://www.mooktakim.com email: mma@mooktakim.com _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Marcin Owsiany
2006-Aug-24 12:34 UTC
Re: [Xen-users] domU keeps crashing with repeating error message
On Thu, Aug 24, 2006 at 10:51:59AM +0100, Md Mooktakim Ahmed wrote:> I don''t know what happened.[...]> oom-killer: gfp_mask=0xd0, order=0[...]> Free pages: 2056kB (0kB HighMem)[...]> Free swap = 0kB > Total swap = 1048568kBLooks like it ran out of memory, as it reports only 2MB free memory, and your 1GB swap is full as well. Marcin -- Marcin Owsiany <marcin@owsiany.pl> http://marcin.owsiany.pl/ GnuPG: 1024D/60F41216 FE67 DA2D 0ACA FC5E 3F75 D6F6 3A0D 8AA0 60F4 1216 "Every program in development at MIT expands until it can read mail." -- Unknown _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Md Mooktakim Ahmed
2006-Aug-24 13:10 UTC
Re: [Xen-users] domU keeps crashing with repeating error message
So the domU ran out of memory? and not the dom 0? if its a domU out of memory problem. Whats the best way to proceed? Should i increase swap? or RAM? or both? On Thu, August 24, 2006 1:34 pm, Marcin Owsiany wrote:> On Thu, Aug 24, 2006 at 10:51:59AM +0100, Md Mooktakim Ahmed wrote: > >> I don''t know what happened. >> > [...] > >> oom-killer: gfp_mask=0xd0, order=0 >> > [...] > >> Free pages: 2056kB (0kB HighMem) >> > [...] > >> Free swap = 0kB >> Total swap = 1048568kB >> > > Looks like it ran out of memory, as it reports only 2MB free memory, and > your 1GB swap is full as well. > > Marcin > -- > Marcin Owsiany <marcin@owsiany.pl> http://marcin.owsiany.pl/ > GnuPG: 1024D/60F41216 FE67 DA2D 0ACA FC5E 3F75 D6F6 3A0D 8AA0 60F4 1216 > > > "Every program in development at MIT expands until it can read mail." > -- Unknown > > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-users > > >-- Website: http://www.mooktakim.com email: mma@mooktakim.com _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Petersson, Mats
2006-Aug-24 13:19 UTC
RE: [Xen-users] domU keeps crashing with repeating error message
> -----Original Message----- > From: xen-users-bounces@lists.xensource.com > [mailto:xen-users-bounces@lists.xensource.com] On Behalf Of > Md Mooktakim Ahmed > Sent: 24 August 2006 14:10 > To: xen-users@lists.xensource.com > Subject: Re: [Xen-users] domU keeps crashing with repeating > error message > > So the domU ran out of memory? > and not the dom 0? > > if its a domU out of memory problem. Whats the best way to proceed? > Should i increase swap? or RAM? or both?Depends on what you expect your DomU to use memory for... More swap will allow it to have a bigger working set, but at the cost of having to do more disk accesses. Giving it more memory will allow it to have more memory without storing data on disk. Obviously, giving it more memory will also reduce the number of DomU you can ultimately run on the system. You can check with applications such as "top" to see how much memory each task uses. If you find that a lot of your tasks are running with a lot of memory, and they are "active" (i.e. at least sometimes get some percentage of CPU time), then you probably want more memory. If you find that the ACTIVE tasks aren''t using much memory, but the system overall needs a fair bit of memory, then swap-space is what you need [because the systme doesn''t actively use that huge amounts of memoyr]. Press "M" in top, and it will list processes in memory usage order rather than the normal "processor usage" order. Using various stat''s software to look at "swapping" would be another hint to tell you which way to go. -- Mats> > On Thu, August 24, 2006 1:34 pm, Marcin Owsiany wrote: > > On Thu, Aug 24, 2006 at 10:51:59AM +0100, Md Mooktakim Ahmed wrote: > > > >> I don''t know what happened. > >> > > [...] > > > >> oom-killer: gfp_mask=0xd0, order=0 > >> > > [...] > > > >> Free pages: 2056kB (0kB HighMem) > >> > > [...] > > > >> Free swap = 0kB > >> Total swap = 1048568kB > >> > > > > Looks like it ran out of memory, as it reports only 2MB > free memory, and > > your 1GB swap is full as well. > > > > Marcin > > -- > > Marcin Owsiany <marcin@owsiany.pl> > http://marcin.owsiany.pl/ > > GnuPG: 1024D/60F41216 FE67 DA2D 0ACA FC5E 3F75 D6F6 3A0D > 8AA0 60F4 1216 > > > > > > "Every program in development at MIT expands until it can > read mail." > > -- Unknown > > > > > > _______________________________________________ > > Xen-users mailing list > > Xen-users@lists.xensource.com > > http://lists.xensource.com/xen-users > > > > > > > > > -- > Website: http://www.mooktakim.com > email: mma@mooktakim.com > > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-users > > >_______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Marcin Owsiany
2006-Aug-24 13:34 UTC
Re: [Xen-users] domU keeps crashing with repeating error message
On Thu, Aug 24, 2006 at 02:10:12PM +0100, Md Mooktakim Ahmed wrote:> So the domU ran out of memory? > and not the dom 0?Well, depends on from which domain the messages you posted were. Marcin -- Marcin Owsiany <marcin@owsiany.pl> http://marcin.owsiany.pl/ GnuPG: 1024D/60F41216 FE67 DA2D 0ACA FC5E 3F75 D6F6 3A0D 8AA0 60F4 1216 "Every program in development at MIT expands until it can read mail." -- Unknown _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Md Mooktakim Ahmed
2006-Aug-24 15:27 UTC
Re: [Xen-users] domU keeps crashing with repeating error message
It can''t just be a memory problem. I''m running most of the same services as i did on a 128Mb UML virtual machine. I have half a gig meory and all of it are being used. Half of my swap is being used (1Gb in total). Only thing i can think of is that i''m using cyrus-imap instead of courier-imap. On Thu, August 24, 2006 2:34 pm, Marcin Owsiany wrote:> On Thu, Aug 24, 2006 at 02:10:12PM +0100, Md Mooktakim Ahmed wrote: > >> So the domU ran out of memory? >> and not the dom 0? > > Well, depends on from which domain the messages you posted were. > > > Marcin > -- > Marcin Owsiany <marcin@owsiany.pl> http://marcin.owsiany.pl/ > GnuPG: 1024D/60F41216 FE67 DA2D 0ACA FC5E 3F75 D6F6 3A0D 8AA0 60F4 1216 > > > "Every program in development at MIT expands until it can read mail." > -- Unknown > > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-users > > >-- Website: http://www.mooktakim.com email: mma@mooktakim.com _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Md Mooktakim Ahmed
2006-Aug-25 10:08 UTC
Re: [Xen-users] domU keeps crashing with repeating error message
Why does my domU crash like this just because it ran out of memory? I really don''t understand. Even if it crashes, its supposed to shutdown and not print out repeating error messages, becuase i have set on_crash="destroy" On Thu, August 24, 2006 2:34 pm, Marcin Owsiany wrote:> On Thu, Aug 24, 2006 at 02:10:12PM +0100, Md Mooktakim Ahmed wrote: > >> So the domU ran out of memory? >> and not the dom 0? > > Well, depends on from which domain the messages you posted were. > > > Marcin > -- > Marcin Owsiany <marcin@owsiany.pl> http://marcin.owsiany.pl/ > GnuPG: 1024D/60F41216 FE67 DA2D 0ACA FC5E 3F75 D6F6 3A0D 8AA0 60F4 1216 > > > "Every program in development at MIT expands until it can read mail." > -- Unknown > > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-users > > >-- Website: http://www.mooktakim.com email: mma@mooktakim.com _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users