Hello, I''m having some trouble trying to run Centos4 hvm domU domains on a Centos 5 server running kernel-2.6.18-8.1.15.el5.centos.plusxen, using xen 3.0.3-25.0.4.el5 on x86_64 architecture. On three out of four of the servers I''ve tried, I will get a total system (dom0) crash when trying to start a fully virtualized domU. I will run `xm create xen_test`, it will start, then return to the command line, but invariably within five to ten seconds the entire system will freeze. I get no error messages to any of the logs, or anything output to the console. Absolutely nothing responds. I can''t find any record of the error after power cycling the machine. The interesting thing is that on one server of the same type out of the four I''ve tried, it works absolutely fine every time. I''ve tried moving the hvm image and config to the other servers but those fail as well. There might be some differences in the hardware components used but the servers have the same board and same CPUs, with the same version of Centos and Xen. I did read that some people were having problems with hvm crashing the dom0 a while back on the list when using AMD 64 cpus. I don''t know if that would apply to this version of xen or if it might be somehow related, but I thought it was a good chance. Porting xen 3.1 to the kernel-xen RPM is an option, but one I''d really like to avoid if possible. Thanks, Brendan Wood _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Hi Brendan, CentOS 5.1 is available now, bundling a Xen derived from 3.1. Are you able to try this and see if it solves your problem? The HVM support in 3.1 is much improved from 3.0.3 (as evidenced by Redhat now talking about Windows guests, IIRC). Cheers, Mark On Friday 16 November 2007, Brendan Wood wrote:> Hello, > > I''m having some trouble trying to run Centos4 hvm domU domains on a Centos > 5 server running kernel-2.6.18-8.1.15.el5.centos.plusxen, using xen > 3.0.3-25.0.4.el5 on x86_64 architecture. On three out of four of the > servers I''ve tried, I will get a total system (dom0) crash when trying to > start a fully virtualized domU. I will run `xm create xen_test`, it will > start, then return to the command line, but invariably within five to ten > seconds the entire system will freeze. I get no error messages to any of > the logs, or anything output to the console. Absolutely nothing responds. I > can''t find any record of the error after power cycling the machine. > > The interesting thing is that on one server of the same type out of the > four I''ve tried, it works absolutely fine every time. I''ve tried moving the > hvm image and config to the other servers but those fail as well. There > might be some differences in the hardware components used but the servers > have the same board and same CPUs, with the same version of Centos and Xen. > > I did read that some people were having problems with hvm crashing the dom0 > a while back on the list when using AMD 64 cpus. I don''t know if that would > apply to this version of xen or if it might be somehow related, but I > thought it was a good chance. Porting xen 3.1 to the kernel-xen RPM is an > option, but one I''d really like to avoid if possible. > > Thanks, > > Brendan Wood > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-users-- Dave: Just a question. What use is a unicyle with no seat? And no pedals! Mark: To answer a question with a question: What use is a skateboard? Dave: Skateboards have wheels. Mark: My wheel has a wheel! _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Did centos 5.1 do something different than the Red Hat on which they were based? the Red Hat 5 /update 1 is still claiming to have xen 3.0.3 and 32-bit guests on 64bit dom0 as a "technology preview", i.e. it doesn''t work yet,. If anyone does have that feature working on either redhat or centos, let me know. Steve ------------------------------------------------------------------ Steven C. Timm, Ph.D (630) 840-8525 timm@fnal.gov http://home.fnal.gov/~timm/ Fermilab Computing Division, Scientific Computing Facilities, Grid Facilities Department, FermiGrid Services Group, Assistant Group Leader. On Tue, 4 Dec 2007, Mark Williamson wrote:> Hi Brendan, > > CentOS 5.1 is available now, bundling a Xen derived from 3.1. Are you able to > try this and see if it solves your problem? The HVM support in 3.1 is much > improved from 3.0.3 (as evidenced by Redhat now talking about Windows guests, > IIRC). > > Cheers, > Mark > > On Friday 16 November 2007, Brendan Wood wrote: >> Hello, >> >> I''m having some trouble trying to run Centos4 hvm domU domains on a Centos >> 5 server running kernel-2.6.18-8.1.15.el5.centos.plusxen, using xen >> 3.0.3-25.0.4.el5 on x86_64 architecture. On three out of four of the >> servers I''ve tried, I will get a total system (dom0) crash when trying to >> start a fully virtualized domU. I will run `xm create xen_test`, it will >> start, then return to the command line, but invariably within five to ten >> seconds the entire system will freeze. I get no error messages to any of >> the logs, or anything output to the console. Absolutely nothing responds. I >> can''t find any record of the error after power cycling the machine. >> >> The interesting thing is that on one server of the same type out of the >> four I''ve tried, it works absolutely fine every time. I''ve tried moving the >> hvm image and config to the other servers but those fail as well. There >> might be some differences in the hardware components used but the servers >> have the same board and same CPUs, with the same version of Centos and Xen. >> >> I did read that some people were having problems with hvm crashing the dom0 >> a while back on the list when using AMD 64 cpus. I don''t know if that would >> apply to this version of xen or if it might be somehow related, but I >> thought it was a good chance. Porting xen 3.1 to the kernel-xen RPM is an >> option, but one I''d really like to avoid if possible. >> >> Thanks, >> >> Brendan Wood >> >> _______________________________________________ >> Xen-users mailing list >> Xen-users@lists.xensource.com >> http://lists.xensource.com/xen-users > > > > -- > Dave: Just a question. What use is a unicyle with no seat? And no pedals! > Mark: To answer a question with a question: What use is a skateboard? > Dave: Skateboards have wheels. > Mark: My wheel has a wheel! > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-users >_______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
> Did centos 5.1 do something different than the Red Hat on which > they were based? the Red Hat 5 /update 1 is still claiming to > have xen 3.0.3 and 32-bit guests on 64bit dom0 as a "technology preview", > i.e. it doesn''t work yet,.From what I''ve heard, Redhat haven''t changed the package version number but it''s actually now based on 3.1 under RHEL 5.1... I know how crazy that sounds, but there was definitely supposed to be a Xen update in this release and at least two people on the mailing list have said that it *is* 3.1 even though it claims not to be! I''m not sure what''s going on there; my CentOS 5 box isn''t at 5.1 yet but in any case I''m currently running a custom Xen on there.> If anyone does have that feature working > on either redhat or centos, let me know.As for 64-bit status I don''t know what RedHat''s policy is on that, even since the 5.1 release. Cheers, Mark> Steve > > > ------------------------------------------------------------------ > Steven C. Timm, Ph.D (630) 840-8525 > timm@fnal.gov http://home.fnal.gov/~timm/ > Fermilab Computing Division, Scientific Computing Facilities, > Grid Facilities Department, FermiGrid Services Group, Assistant Group > Leader. > > On Tue, 4 Dec 2007, Mark Williamson wrote: > > Hi Brendan, > > > > CentOS 5.1 is available now, bundling a Xen derived from 3.1. Are you > > able to try this and see if it solves your problem? The HVM support in > > 3.1 is much improved from 3.0.3 (as evidenced by Redhat now talking about > > Windows guests, IIRC). > > > > Cheers, > > Mark > > > > On Friday 16 November 2007, Brendan Wood wrote: > >> Hello, > >> > >> I''m having some trouble trying to run Centos4 hvm domU domains on a > >> Centos 5 server running kernel-2.6.18-8.1.15.el5.centos.plusxen, using > >> xen 3.0.3-25.0.4.el5 on x86_64 architecture. On three out of four of the > >> servers I''ve tried, I will get a total system (dom0) crash when trying > >> to start a fully virtualized domU. I will run `xm create xen_test`, it > >> will start, then return to the command line, but invariably within five > >> to ten seconds the entire system will freeze. I get no error messages to > >> any of the logs, or anything output to the console. Absolutely nothing > >> responds. I can''t find any record of the error after power cycling the > >> machine. > >> > >> The interesting thing is that on one server of the same type out of the > >> four I''ve tried, it works absolutely fine every time. I''ve tried moving > >> the hvm image and config to the other servers but those fail as well. > >> There might be some differences in the hardware components used but the > >> servers have the same board and same CPUs, with the same version of > >> Centos and Xen. > >> > >> I did read that some people were having problems with hvm crashing the > >> dom0 a while back on the list when using AMD 64 cpus. I don''t know if > >> that would apply to this version of xen or if it might be somehow > >> related, but I thought it was a good chance. Porting xen 3.1 to the > >> kernel-xen RPM is an option, but one I''d really like to avoid if > >> possible. > >> > >> Thanks, > >> > >> Brendan Wood > >> > >> _______________________________________________ > >> Xen-users mailing list > >> Xen-users@lists.xensource.com > >> http://lists.xensource.com/xen-users > > > > -- > > Dave: Just a question. What use is a unicyle with no seat? And no > > pedals! Mark: To answer a question with a question: What use is a > > skateboard? Dave: Skateboards have wheels. > > Mark: My wheel has a wheel! > > > > _______________________________________________ > > Xen-users mailing list > > Xen-users@lists.xensource.com > > http://lists.xensource.com/xen-users-- Dave: Just a question. What use is a unicyle with no seat? And no pedals! Mark: To answer a question with a question: What use is a skateboard? Dave: Skateboards have wheels. Mark: My wheel has a wheel! _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Hello Mark, Thank you for responding. I actually just got it working after a BIOS update to our servers and the 3.1 xen build from source. I just now put together an rpm to deploy to fix it on all the machines. It seemed to be a BIOS problem that was causing the complete freezing, though Xen was still performing unreliably until we upgraded to 3.1. I''m glad to hear that Centos 5.1 is out now, though, as it will be a lot easier to upgrade than to support our own xen rpms for now. I''ll check it out. It would actually be interesting to see if the new version works with the original BIOS as well. Thanks, Brendan On Mon, Dec 03, 2007 at 08:02:15PM -0800, Mark Williamson wrote:> Hi Brendan, > > CentOS 5.1 is available now, bundling a Xen derived from 3.1. Are you able to > try this and see if it solves your problem? The HVM support in 3.1 is much > improved from 3.0.3 (as evidenced by Redhat now talking about Windows guests, > IIRC). > > Cheers, > Mark > > On Friday 16 November 2007, Brendan Wood wrote: > > Hello, > > > > I''m having some trouble trying to run Centos4 hvm domU domains on a Centos > > 5 server running kernel-2.6.18-8.1.15.el5.centos.plusxen, using xen > > 3.0.3-25.0.4.el5 on x86_64 architecture. On three out of four of the > > servers I''ve tried, I will get a total system (dom0) crash when trying to > > start a fully virtualized domU. I will run `xm create xen_test`, it will > > start, then return to the command line, but invariably within five to ten > > seconds the entire system will freeze. I get no error messages to any of > > the logs, or anything output to the console. Absolutely nothing responds. I > > can''t find any record of the error after power cycling the machine. > > > > The interesting thing is that on one server of the same type out of the > > four I''ve tried, it works absolutely fine every time. I''ve tried moving the > > hvm image and config to the other servers but those fail as well. There > > might be some differences in the hardware components used but the servers > > have the same board and same CPUs, with the same version of Centos and Xen. > > > > I did read that some people were having problems with hvm crashing the dom0 > > a while back on the list when using AMD 64 cpus. I don''t know if that would > > apply to this version of xen or if it might be somehow related, but I > > thought it was a good chance. Porting xen 3.1 to the kernel-xen RPM is an > > option, but one I''d really like to avoid if possible. > > > > Thanks, > > > > Brendan Wood > > > > _______________________________________________ > > Xen-users mailing list > > Xen-users@lists.xensource.com > > http://lists.xensource.com/xen-users > > > > -- > Dave: Just a question. What use is a unicyle with no seat? And no pedals! > Mark: To answer a question with a question: What use is a skateboard? > Dave: Skateboards have wheels. > Mark: My wheel has a wheel!_______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
hello brendan, I just installed CentOS 5.1 for dom0 and tried to install 32bit centos 5.1on my 64bit dom0. but this is still doesn''t work, i think my machine is dell pe1950 which is support both vmx and pae. here is what i do exactly, first, install centos 5.1 to brand new machine for dom0. [root@vmp-1 ~]# uname -a Linux vmp-1.domain.com 2.6.18-53.el5xen #1 SMP Mon Nov 12 02:46:57 EST 2007 x86_64 x86_64 x86_64 GNU/Linux and i create xen pv guest using i386 boot kernel for centos 5.1 (/centos/5/i386/images/xen/vmlinuz) now, it seems ok, everything going well but while installing package, it prints out kernel panic message and give me dom0''s shell prompt. my BIOS is newest, so i don''t think it is BIOS problum for me. any idea for this? thanks. Hyunsung On 12/4/07, Brendan Wood <bwood@responsys.com> wrote:> > > Hello Mark, > > Thank you for responding. I actually just got it working after a BIOS > update to our servers and the 3.1 xen build from source. I just now put > together an rpm to deploy to fix it on all the machines. It seemed to be > a BIOS problem that was causing the complete freezing, though Xen was > still performing unreliably until we upgraded to 3.1. > > I''m glad to hear that Centos 5.1 is out now, though, as it will be a lot > easier to upgrade than to support our own xen rpms for now. I''ll check > it out. It would actually be interesting to see if the new version works > with the original BIOS as well. > > Thanks, > > Brendan > > On Mon, Dec 03, 2007 at 08:02:15PM -0800, Mark Williamson wrote: > > Hi Brendan, > > > > CentOS 5.1 is available now, bundling a Xen derived from 3.1. Are you > able to > > try this and see if it solves your problem? The HVM support in 3.1 is > much > > improved from 3.0.3 (as evidenced by Redhat now talking about Windows > guests, > > IIRC). > > > > Cheers, > > Mark > > > > On Friday 16 November 2007, Brendan Wood wrote: > > > Hello, > > > > > > I''m having some trouble trying to run Centos4 hvm domU domains on a > Centos > > > 5 server running kernel-2.6.18-8.1.15.el5.centos.plusxen, using xen > > > 3.0.3-25.0.4.el5 on x86_64 architecture. On three out of four of the > > > servers I''ve tried, I will get a total system (dom0) crash when trying > to > > > start a fully virtualized domU. I will run `xm create xen_test`, it > will > > > start, then return to the command line, but invariably within five to > ten > > > seconds the entire system will freeze. I get no error messages to any > of > > > the logs, or anything output to the console. Absolutely nothing > responds. I > > > can''t find any record of the error after power cycling the machine. > > > > > > The interesting thing is that on one server of the same type out of > the > > > four I''ve tried, it works absolutely fine every time. I''ve tried > moving the > > > hvm image and config to the other servers but those fail as well. > There > > > might be some differences in the hardware components used but the > servers > > > have the same board and same CPUs, with the same version of Centos and > Xen. > > > > > > I did read that some people were having problems with hvm crashing the > dom0 > > > a while back on the list when using AMD 64 cpus. I don''t know if that > would > > > apply to this version of xen or if it might be somehow related, but I > > > thought it was a good chance. Porting xen 3.1 to the kernel-xen RPM is > an > > > option, but one I''d really like to avoid if possible. > > > > > > Thanks, > > > > > > Brendan Wood > > > > > > _______________________________________________ > > > Xen-users mailing list > > > Xen-users@lists.xensource.com > > > http://lists.xensource.com/xen-users > > > > > > > > -- > > Dave: Just a question. What use is a unicyle with no seat? And no > pedals! > > Mark: To answer a question with a question: What use is a skateboard? > > Dave: Skateboards have wheels. > > Mark: My wheel has a wheel! > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-users >_______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
That sounds like a different issue than the one I was experiencing. In my case, it only happened with fully virtualized domU instances, and it froze the entire machine, rather than returning back to dom0. Maybe someone else on the list can help you with this. You might want to start a new thread for it. Brendan On Wed, Dec 05, 2007 at 08:18:28PM -0800, HyunSung Jang wrote:> hello brendan, > I just installed CentOS 5.1 for dom0 and tried to install 32bit centos 5.1 on my 64bit dom0. > but this is still doesn''t work, i think > > my machine is dell pe1950 which is support both vmx and pae. > > here is what i do exactly, > first, install centos 5.1 to brand new machine for dom0. > > [root@vmp-1 ~]# uname -a > Linux vmp-1.domain.com 2.6.18-53.el5xen #1 SMP Mon Nov 12 02:46:57 EST 2007 x86_64 x86_64 x86_64 GNU/Linux > > and i create xen pv guest using i386 boot kernel for centos 5.1 > (/centos/5/i386/images/xen/vmlinuz) > > now, it seems ok, everything going well > but while installing package, it prints out kernel panic message and give me dom0''s shell prompt. > > my BIOS is newest, so i don''t think it is BIOS problum for me. > any idea for this? > > thanks. > > Hyunsung > > On 12/4/07, Brendan Wood <bwood@responsys.com> wrote: > > > Hello Mark, > > Thank you for responding. I actually just got it working after a BIOS > update to our servers and the 3.1 xen build from source. I just now put > together an rpm to deploy to fix it on all the machines. It seemed to be > a BIOS problem that was causing the complete freezing, though Xen was > still performing unreliably until we upgraded to 3.1. > > I''m glad to hear that Centos 5.1 is out now, though, as it will be a lot > easier to upgrade than to support our own xen rpms for now. I''ll check > it out. It would actually be interesting to see if the new version works > with the original BIOS as well. > > Thanks, > > Brendan > > On Mon, Dec 03, 2007 at 08:02:15PM -0800, Mark Williamson wrote: > > Hi Brendan, > > > > CentOS 5.1 is available now, bundling a Xen derived from 3.1. Are you able to > > try this and see if it solves your problem? The HVM support in 3.1 is much > > improved from 3.0.3 (as evidenced by Redhat now talking about Windows guests, > > IIRC). > > > > Cheers, > > Mark > > > > On Friday 16 November 2007, Brendan Wood wrote: > > > Hello, > > > > > > I''m having some trouble trying to run Centos4 hvm domU domains on a Centos > > > 5 server running kernel-2.6.18-8.1.15.el5.centos.plusxen, using xen > > > 3.0.3-25.0.4.el5 on x86_64 architecture. On three out of four of the > > > servers I''ve tried, I will get a total system (dom0) crash when trying to > > > start a fully virtualized domU. I will run `xm create xen_test`, it will > > > start, then return to the command line, but invariably within five to ten > > > seconds the entire system will freeze. I get no error messages to any of > > > the logs, or anything output to the console. Absolutely nothing responds. I > > > can''t find any record of the error after power cycling the machine. > > > > > > The interesting thing is that on one server of the same type out of the > > > four I''ve tried, it works absolutely fine every time. I''ve tried moving the > > > hvm image and config to the other servers but those fail as well. There > > > might be some differences in the hardware components used but the servers > > > have the same board and same CPUs, with the same version of Centos and Xen. > > > > > > I did read that some people were having problems with hvm crashing the dom0 > > > a while back on the list when using AMD 64 cpus. I don''t know if that would > > > apply to this version of xen or if it might be somehow related, but I > > > thought it was a good chance. Porting xen 3.1 to the kernel-xen RPM is an > > > option, but one I''d really like to avoid if possible. > > > > > > Thanks, > > > > > > Brendan Wood > > > > > > _______________________________________________ > > > Xen-users mailing list > > > Xen-users@lists.xensource.com <mailto:Xen-users@lists.xensource.com> > > > http://lists.xensource.com/xen-users > > > > > > > > -- > > Dave: Just a question. What use is a unicyle with no seat? And no pedals! > > Mark: To answer a question with a question: What use is a skateboard? > > Dave: Skateboards have wheels. > > Mark: My wheel has a wheel! > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-users > > >_______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Mark Williamson <mark.williamson@cl.cam.ac.uk> wrote:> > Hi Brendan, > > CentOS 5.1 is available now, bundling a Xen derived from 3.1. Are you able to > try this and see if it solves your problem? The HVM support in 3.1 is much > improved from 3.0.3 (as evidenced by Redhat now talking about Windows guests, > IIRC). > > Cheers, > MarkI tested the version of Xen released with CentOS, and it doesn''t seem to fix all the issues. While the original freezing problem seems to have been solved with a new BIOS provided by our server manufacturer, the xen-3.0.3-41 package (which is apparently supposed to be Xen 3.1, while xen-3.0.3-25 was still Xen 3.0. Good old Redhat) didn''t fix other issues I''d noticed. Particularly, I noticed that it was still only seeing 3535M of RAM, when the servers had 4G or 8G altogether. Apparently it''s more of a bug in grub than in Xen itself, but the Xen 3.1.2 release I used to build my RPM seems to have solved that. I did notice that while Xen 3.1.2 did solve an issue we were having with the hvm hardware clock running fast, to the point where it was two weeks ahead at least, the clocks are still a couple of seconds out of sync with each other on different domU instances. This can be corrected with ntpd to the point that it doesn''t cause an issue, at least. I wasn''t able to test whether the Redhat release solved this issue as the one test server to which I was able to apply the CentOS 5.1 updates inexplicably didn''t know any time problems to begin with, despite being the same configuration and BIOS version as other servers that exhibited the problem. Go figure. Anyway, I just wanted to post my experiences so far. Xen 3.1 is absolutely required for 64-bit HVM from what I''ve seen, and Xen 3.1.2 seems to run a lot better than the prepackaged versions. Thanks for the help, Brendan Wood _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users