Just gave 3.0 a spin. Had been running 2.0.7 for the past 3 months or so without problems (aside from intermittent failure during live migration). Anyway, 3.0 seems to have an issue with my machine. It starts up the 4 domains that I''ve got defined (was running 6 user domains with 2.0.7, but two of those were running 2.4 kernels which I can''t seem to build with Xen 3.0 yet, and I see from the readme file it isn''t yet supported so I''m not complaining :-) Once the 4 user domains starts the machine will suddenly reboot. I added a sleep inbetween individual domain startups in xendomains and was able to get it to start up without rebooting, but then after about 5 or so minutes the machine rebooted again. I turned hyperthreading off on the machine and it seems to be able to boot with all 4 user domains just fine without the need for sleeps inbetween (very consistently dies if HT is enabled and I don''t sleep a little while between domain starts). So I''m leaving HT off for now to see if it remains stable with HT disabled. I was going to report this on bugzilla, but bugzilla.xensource.com is giving me a server error right now. -- Ray _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
> I turned hyperthreading off on the machine and it seems to be > able to boot with all 4 user domains just fine without the > need for sleeps inbetween (very consistently dies if HT is > enabled and I don''t sleep a little while between domain > starts). So I''m leaving HT off for now to see if it remains > stable with HT disabled.There certainly shouldn''t be an issue with HT. If you leave it in text mode do you see an oops message? Please can you file this on bugzilla, including details about your system.> I was going to report this on bugzilla, but > bugzilla.xensource.com is giving me a server error right now.bugzilla should be back up -- we decided to move it onto another hosting site in preparation for some heavy traffic on the downloads servers. Thanks, Ian _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Done. Filed bug #432. Here is the information I entered into it for reference. Using pull from hg as of this morning (12/5/2005). If I enable hyperthreading on my machine then Xen gets into trouble within minutes of starting up user domains. With hyperthreading disabled it ran for several hours with no problem. Machine is a Dell Optplex GX280 with 2G of memory. I get the following on the screen when it hangs: [<c040acc0>] fn_hash_lookup+0xb0/0xc0 [<c03dba3b>] ip_route_input_slow+0x7cb/0x7e0 [<c0418f08>] br_nf_forward_finish+0xb8/0x140 [<c0413760>] br_forward_finish+0x0/0x70 [<c04192bc>] br_nf_forward_arp+0x17c/0x1c0 [<c013eed6>] buffered_rmqueue+0x106/0x250 [<c03cfb65>] neigh_update+0x235/0x350 [<c03c4214>] kfree_skbmem+0x24/0x30 [<c0400c11>] arp_process+0x61/0x510 [<c0414420>] br_handle_frame_finish+0x0/0x130 [<c04011b7>] arp_rcv+0xf7/0x170 [<c0410fa1>] packet_rcv_spkt+0x151/0x260 [<c03ca9a1>] netif_receive_skb+0x1e1/0x250 [<c012184e>] tasklet_action+0x4a/0xd0 [<c0121555>] __do_softirq+0x95/0xb0 [<c01215bd>] do_softirq+0x4b/0x50 [<c01215bd>] do_IRQ+0x22/0x30 [<c01048b0>] evtchn_do_upcall+0x70/0xa0 [<c0108c68>] hypervisor_callback+0x2c/0x34 [<c01068a2>] xen_idle+0x42/0x90 [<c0106933>] cpu_idle+0x43/0x50 [<c055e85d>] start_kernel+0x18d/0x1d0 [<c055e390>] unknown_bootoption+0x0/0x210 Kernel panic - not synching: BUG! -----Original Message----- From: Ian Pratt [mailto:m+Ian.Pratt@cl.cam.ac.uk] Sent: Monday, December 05, 2005 12:33 PM To: Cole, Ray; xen-users@lists.xensource.com Cc: ian.pratt@cl.cam.ac.uk Subject: RE: [Xen-users] Xen 3.0 and Hyperthreading an issue?> I turned hyperthreading off on the machine and it seems to be > able to boot with all 4 user domains just fine without the > need for sleeps inbetween (very consistently dies if HT is > enabled and I don''t sleep a little while between domain > starts). So I''m leaving HT off for now to see if it remains > stable with HT disabled.There certainly shouldn''t be an issue with HT. If you leave it in text mode do you see an oops message? Please can you file this on bugzilla, including details about your system.> I was going to report this on bugzilla, but > bugzilla.xensource.com is giving me a server error right now.bugzilla should be back up -- we decided to move it onto another hosting site in preparation for some heavy traffic on the downloads servers. Thanks, Ian _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Cole, Ray wrote:> I get the following on the screen when it hangs: > > [<c040acc0>] fn_hash_lookup+0xb0/0xc0 > [<c03dba3b>] ip_route_input_slow+0x7cb/0x7e0 > [<c0418f08>] br_nf_forward_finish+0xb8/0x140 > [<c0413760>] br_forward_finish+0x0/0x70 > [<c04192bc>] br_nf_forward_arp+0x17c/0x1c0 > [<c013eed6>] buffered_rmqueue+0x106/0x250 > [<c03cfb65>] neigh_update+0x235/0x350 > [<c03c4214>] kfree_skbmem+0x24/0x30 > [<c0400c11>] arp_process+0x61/0x510 > [<c0414420>] br_handle_frame_finish+0x0/0x130 > [<c04011b7>] arp_rcv+0xf7/0x170 > [<c0410fa1>] packet_rcv_spkt+0x151/0x260 > [<c03ca9a1>] netif_receive_skb+0x1e1/0x250 > [<c012184e>] tasklet_action+0x4a/0xd0 > [<c0121555>] __do_softirq+0x95/0xb0 > [<c01215bd>] do_softirq+0x4b/0x50 > [<c01215bd>] do_IRQ+0x22/0x30 > [<c01048b0>] evtchn_do_upcall+0x70/0xa0 > [<c0108c68>] hypervisor_callback+0x2c/0x34 > [<c01068a2>] xen_idle+0x42/0x90 > [<c0106933>] cpu_idle+0x43/0x50 > [<c055e85d>] start_kernel+0x18d/0x1d0 > [<c055e390>] unknown_bootoption+0x0/0x210 > Kernel panic - not synching: BUG!Presumably there''s more than that that''s falling off the screen. Can you get the screen into a text mode with more lines, or log to a serial console, or otherwise try to capture the rest? _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
I don''t have an appropriate cable for a serial console, but wouldn''t mind setting my console to 50 lines or something. But...how do I do that? I saw some references to adding ''vga=ext'' on the kernel command line to set it, but this doesn''t seem to actually do anything different when I boot. _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
I rebuilt the domain 0 kernel with the proper console support, and I now have a full dump. Will add this to the bug as well soon: kernel BUG at drivers/xen/netback/netback.c:297 (net_rx_action)! [<c02ebb1a>] net_rx_action+0x3fa/0x500 [<c03d9ae5>] dev_queue_xmit+0x225/0x310 [<c041a440>] fn_hash_lookup+0xb0/0xc0 [<c03eb1bb>] ip_route_input_slow+0x7cb/0x7e0 [<c011950a>] __wake_up+0x3a/0x70 [<c0247e3b>] add_timer_randomness+0x16b/0x170 [<c03df2e5>] neigh_update+0x235/0x350 [<c03d3994>] kfree_skbmem+0x24/0x30 [<c0410391>] arp_process+0x61/0x510 [<c0423b00>] br_pass_frame_up_finish+0x0/0x20 [<c0423c4c>] br_handle_frame_finish+0xac/0x130 [<c0410937>] arp_rcv+0xf7/0x170 [<c0420721>] packet_rcv_spkt+0x151/0x260 [<c03da121>] netif_receive_skb+0x1e1/0x250 [<c012184e>] tasklet_action+0x4e/0xd0 [<c0121555>] __do_softirq+0x95/0xb0 [<c01215bd>] do_softirq+0x4d/0x50 [<c010d082>] do_IRQ+0x22/0x30 [<c01048b0>] evtchn_do_upcall+0x70/0xa0 [<c0108c68>] hypervisor_callback+0x2c/0x34 [<c01068a2>] xen_idle+0x42/0x90 [<c0106933>] cpu_idle+0x43/0x50 [<c057685d>] start_kernel+0x18d/0x1d0 [<c0576390>] unknown_bootoption+0x0/0x210 Kernel panic - not syncing: BUG! -----Original Message----- From: Cole, Ray Sent: Tuesday, December 06, 2005 9:39 AM To: ''Charles Duffy''; xen-users@lists.xensource.com Subject: RE: [Xen-users] Re: Xen 3.0 and Hyperthreading an issue? I don''t have an appropriate cable for a serial console, but wouldn''t mind setting my console to 50 lines or something. But...how do I do that? I saw some references to adding ''vga=ext'' on the kernel command line to set it, but this doesn''t seem to actually do anything different when I boot. _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
> I rebuilt the domain 0 kernel with the proper console > support, and I now have a full dump. Will add this to the > bug as well soon:What do you get if you boot with HT/SMP enabled, but then do "xm vcpus-set 0 1" in domain 0 (or edit your xend-config.sxp such that dom0-num-cpus = 1. Is it stable? Most people generally run with 1 cpu in dom0 as it generally leads to better performance. Thanks, Ian> kernel BUG at drivers/xen/netback/netback.c:297 (net_rx_action)! > [<c02ebb1a>] net_rx_action+0x3fa/0x500 > [<c03d9ae5>] dev_queue_xmit+0x225/0x310 > [<c041a440>] fn_hash_lookup+0xb0/0xc0 > [<c03eb1bb>] ip_route_input_slow+0x7cb/0x7e0 > [<c011950a>] __wake_up+0x3a/0x70 > [<c0247e3b>] add_timer_randomness+0x16b/0x170 > [<c03df2e5>] neigh_update+0x235/0x350 > [<c03d3994>] kfree_skbmem+0x24/0x30 > [<c0410391>] arp_process+0x61/0x510 > [<c0423b00>] br_pass_frame_up_finish+0x0/0x20 > [<c0423c4c>] br_handle_frame_finish+0xac/0x130 > [<c0410937>] arp_rcv+0xf7/0x170 > [<c0420721>] packet_rcv_spkt+0x151/0x260 > [<c03da121>] netif_receive_skb+0x1e1/0x250 > [<c012184e>] tasklet_action+0x4e/0xd0 > [<c0121555>] __do_softirq+0x95/0xb0 > [<c01215bd>] do_softirq+0x4d/0x50 > [<c010d082>] do_IRQ+0x22/0x30 > [<c01048b0>] evtchn_do_upcall+0x70/0xa0 > [<c0108c68>] hypervisor_callback+0x2c/0x34 > [<c01068a2>] xen_idle+0x42/0x90 > [<c0106933>] cpu_idle+0x43/0x50 > [<c057685d>] start_kernel+0x18d/0x1d0 > [<c0576390>] unknown_bootoption+0x0/0x210 > Kernel panic - not syncing: BUG! > > -----Original Message----- > From: Cole, Ray > Sent: Tuesday, December 06, 2005 9:39 AM > To: ''Charles Duffy''; xen-users@lists.xensource.com > Subject: RE: [Xen-users] Re: Xen 3.0 and Hyperthreading an issue? > > > I don''t have an appropriate cable for a serial console, but > wouldn''t mind setting my console to 50 lines or something. > But...how do I do that? I saw some references to adding > ''vga=ext'' on the kernel command line to set it, but this > doesn''t seem to actually do anything different when I boot. > > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-users >_______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
I gave that a shot, but it remains unstable. -- Ray -----Original Message----- From: Ian Pratt [mailto:m+Ian.Pratt@cl.cam.ac.uk] Sent: Tuesday, December 06, 2005 12:00 PM To: Cole, Ray; Charles Duffy; xen-users@lists.xensource.com Cc: ian.pratt@cl.cam.ac.uk Subject: RE: [Xen-users] Re: Xen 3.0 and Hyperthreading an issue?> I rebuilt the domain 0 kernel with the proper console > support, and I now have a full dump. Will add this to the > bug as well soon:What do you get if you boot with HT/SMP enabled, but then do "xm vcpus-set 0 1" in domain 0 (or edit your xend-config.sxp such that dom0-num-cpus = 1. Is it stable? Most people generally run with 1 cpu in dom0 as it generally leads to better performance. Thanks, Ian> kernel BUG at drivers/xen/netback/netback.c:297 (net_rx_action)! > [<c02ebb1a>] net_rx_action+0x3fa/0x500 > [<c03d9ae5>] dev_queue_xmit+0x225/0x310 > [<c041a440>] fn_hash_lookup+0xb0/0xc0 > [<c03eb1bb>] ip_route_input_slow+0x7cb/0x7e0 > [<c011950a>] __wake_up+0x3a/0x70 > [<c0247e3b>] add_timer_randomness+0x16b/0x170 > [<c03df2e5>] neigh_update+0x235/0x350 > [<c03d3994>] kfree_skbmem+0x24/0x30 > [<c0410391>] arp_process+0x61/0x510 > [<c0423b00>] br_pass_frame_up_finish+0x0/0x20 > [<c0423c4c>] br_handle_frame_finish+0xac/0x130 > [<c0410937>] arp_rcv+0xf7/0x170 > [<c0420721>] packet_rcv_spkt+0x151/0x260 > [<c03da121>] netif_receive_skb+0x1e1/0x250 > [<c012184e>] tasklet_action+0x4e/0xd0 > [<c0121555>] __do_softirq+0x95/0xb0 > [<c01215bd>] do_softirq+0x4d/0x50 > [<c010d082>] do_IRQ+0x22/0x30 > [<c01048b0>] evtchn_do_upcall+0x70/0xa0 > [<c0108c68>] hypervisor_callback+0x2c/0x34 > [<c01068a2>] xen_idle+0x42/0x90 > [<c0106933>] cpu_idle+0x43/0x50 > [<c057685d>] start_kernel+0x18d/0x1d0 > [<c0576390>] unknown_bootoption+0x0/0x210 > Kernel panic - not syncing: BUG! > > -----Original Message----- > From: Cole, Ray > Sent: Tuesday, December 06, 2005 9:39 AM > To: ''Charles Duffy''; xen-users@lists.xensource.com > Subject: RE: [Xen-users] Re: Xen 3.0 and Hyperthreading an issue? > > > I don''t have an appropriate cable for a serial console, but > wouldn''t mind setting my console to 50 lines or something. > But...how do I do that? I saw some references to adding > ''vga=ext'' on the kernel command line to set it, but this > doesn''t seem to actually do anything different when I boot. > > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-users >_______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Please see http://bits.xensource.com/Xen/docs/xen3_rpm_install_notes.html try with maxcpus=1 and see if works title Xen (2.6.12.6-xen3_2.1) root (hd0,0) kernel /xen-3.gz com1=115200,8n1 module /vmlinuz-2.6.12.6-xen3_2.1 root=/dev/VolGroup00/LogVol00 ro maxcpus=1 console=tty1 console=ttyS0,115200n8 module /initrd-2.6.12.6-xen3_2.1.img Itamar Reis Peixoto +55 (34) 3238 3845 e-mail : itamar@ispbrasil.com.br _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Still fails :-( -----Original Message----- From: xen-users-bounces@lists.xensource.com [mailto:xen-users-bounces@lists.xensource.com]On Behalf Of itamar Sent: Tuesday, December 06, 2005 1:05 PM To: Cole, Ray Cc: xen-users@lists.xensource.com Subject: [Xen-users] Re: Xen 3.0 and Hyperthreading an issue? Please see http://bits.xensource.com/Xen/docs/xen3_rpm_install_notes.html try with maxcpus=1 and see if works title Xen (2.6.12.6-xen3_2.1) root (hd0,0) kernel /xen-3.gz com1=115200,8n1 module /vmlinuz-2.6.12.6-xen3_2.1 root=/dev/VolGroup00/LogVol00 ro maxcpus=1 console=tty1 console=ttyS0,115200n8 module /initrd-2.6.12.6-xen3_2.1.img Itamar Reis Peixoto +55 (34) 3238 3845 e-mail : itamar@ispbrasil.com.br _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
I am using fedora 4 + xen3 rpm with a P4 3.2 HT with 4 GB of ram and seems to be working fine. Itamar Reis Peixoto +55 (34) 3238 3845 e-mail : itamar@ispbrasil.com.br _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
I''m using RH Enterprise 4.0, xen3 built from xen-3.0-testing.hg (sync''d as of Monday morning CST shortly after seeing the announcement that 3.0 was released). 2 GB of memory. Rest of the info has been attached to bug #432. I''d run 2.0.7 for several months without a problem with HT, so I''m certain the hardware is behaving reasonably well. -- Ray -----Original Message----- From: itamar [mailto:itamar@ispbrasil.com.br] Sent: Tuesday, December 06, 2005 1:19 PM To: Cole, Ray Cc: xen-users@lists.xensource.com Subject: Re: [Xen-users] Re: Xen 3.0 and Hyperthreading an issue? I am using fedora 4 + xen3 rpm with a P4 3.2 HT with 4 GB of ram and seems to be working fine. Itamar Reis Peixoto +55 (34) 3238 3845 e-mail : itamar@ispbrasil.com.br _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users