Hi folks, I have several servers running the Xen packages from Debian Lenny - the cpu architectures are ranging from dual pentium III, dual xeons from 4 years ago and current quad core xeons. All share a problem: they frequently crash. The physical machine then reboots, and in the logs there is absolutely nothing. The intervals between crashes range from just a day to around 30 days in the max, but mostly it happens roughly every few days. The only pattern I found so far is: the more virtual machines on the host, the infrequent the crashes (that alone is weird). To avoid these crashes I tried - setting dom0_min_mem to 1 GB in the Xen config and similar in the Xen kernel config in grubs menu.lst, - binding each domU to a certain cpu or cpu core while dedicating one cpu or core to dom0, - dedicate at least 512 MB of RAM to each domU (whether needed or not). Nothing really helps and I am stuck. Googleing does not lead to anything helpful. Is it a problem of Debians Xen implementation (I had the same issues with Ubuntu 8.04)? Is it a general problem of Xen 3.2 (Xen 3.03 on my RedHat/CentOS servers runs very, very, very stable and smooth)? Is there anything I can do or check? Any hint or help is appreciated. Dirk _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Dirk H. Schulz wrote:> Hi folks, > > I have several servers running the Xen packages from Debian Lenny - > the cpu architectures are ranging from dual pentium III, dual xeons > from 4 years ago and current quad core xeons. All share a problem: > they frequently crash. > > The physical machine then reboots, and in the logs there is absolutely > nothing. The intervals between crashes range from just a day to around > 30 days in the max, but mostly it happens roughly every few days. The > only pattern I found so far is: the more virtual machines on the host, > the infrequent the crashes (that alone is weird).Wow... I just (a week or so back) migrated a server from Debian Lenny on bare iron to Lenny on Xen. I''m seeing a similar problem - about once a day the physical machine crashes and reboots, with nothing in the log to give any indication why. I''m in the process of identifying and installing tools for capturing pre-crash activity - any suggestions would be welcome. Miles Fidelman -- In theory, there is no difference between theory and practice. In<fnord> practice, there is. .... Yogi Berra _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
On Thu, Jun 10, 2010 at 09:22:01PM +0200, Dirk H. Schulz wrote:> I have several servers running the Xen packages from Debian Lenny - > the cpu architectures are ranging from dual pentium III, dual xeons > from 4 years ago and current quad core xeons. All share a problem: > they frequently crash.Funny, that. I have a bunch of those machines too - all 64 bit installs, running on Opteron hardware, and no crashes. Been running those for a few years now. I''m guessing it''s something specific you do :) Thanks, Ward. -- Pong.be -( "I love the way Microsoft follows standards. In much )- Virtual hosting -( the same manner that fish follow migrating caribou." )- http://pong.be -( -- Paul Tomblin )- GnuPG public key: http://pgp.mit.edu _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Well, the Debian Lenny Xen implementation (with that particular Xen Dom0 kernel) is known to be "not that stable" - depending on the setup, load, etc. So in case of these problems, switching to something more proven like Redhat/CentOS shouldn''t hurt. Or build the Xen solution on top of Lenny with Xen and kernel from source (more work, but for many it''s worth the effort). Or just use XCP, XenServer.... :) Regards Matej Zary ________________________________________ From: xen-users-bounces@lists.xensource.com [xen-users-bounces@lists.xensource.com] On Behalf Of Ward Vandewege [ward@pong.be] Sent: 10 June 2010 21:49 To: Dirk H. Schulz Cc: xen-users@lists.xensource.com Subject: Re: [Xen-users] Xen on Debian Lenny quite unstable On Thu, Jun 10, 2010 at 09:22:01PM +0200, Dirk H. Schulz wrote:> I have several servers running the Xen packages from Debian Lenny - > the cpu architectures are ranging from dual pentium III, dual xeons > from 4 years ago and current quad core xeons. All share a problem: > they frequently crash.Funny, that. I have a bunch of those machines too - all 64 bit installs, running on Opteron hardware, and no crashes. Been running those for a few years now. I''m guessing it''s something specific you do :) Thanks, Ward. -- Pong.be -( "I love the way Microsoft follows standards. In much )- Virtual hosting -( the same manner that fish follow migrating caribou." )- http://pong.be -( -- Paul Tomblin )- GnuPG public key: http://pgp.mit.edu _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Valtteri Kiviniemi
2010-Jun-11 00:17 UTC
Re: [Xen-users] Xen on Debian Lenny quite unstable
Hi, Debian Lenny has quite shitty Xen package, and I have also found it to be very unreliable. I moved from package Xen to source Xen, so I only have minimal Debian Lenny installation with the packages needed to compile Xen. I would recommend that you download the latest Xen from xen.org and compile it manually, or then use some better distribution which has a working Xen (like redhat or centos). Downside using distributions package Xen is that they are usually rather old versions. - Valtteri Kiviniemi Matej Zary kirjoitti:> Well, the Debian Lenny Xen implementation (with that particular Xen Dom0 kernel) is known to be "not that stable" - depending on the setup, load, etc. So in case of these problems, switching to something more proven like Redhat/CentOS shouldn''t hurt. Or build the Xen solution on top of Lenny with Xen and kernel from source (more work, but for many it''s worth the effort). Or just use XCP, XenServer.... :) > > Regards > > Matej Zary > > > > ________________________________________ > From: xen-users-bounces@lists.xensource.com [xen-users-bounces@lists.xensource.com] On Behalf Of Ward Vandewege [ward@pong.be] > Sent: 10 June 2010 21:49 > To: Dirk H. Schulz > Cc: xen-users@lists.xensource.com > Subject: Re: [Xen-users] Xen on Debian Lenny quite unstable > > On Thu, Jun 10, 2010 at 09:22:01PM +0200, Dirk H. Schulz wrote: >> I have several servers running the Xen packages from Debian Lenny - >> the cpu architectures are ranging from dual pentium III, dual xeons >> from 4 years ago and current quad core xeons. All share a problem: >> they frequently crash. > > Funny, that. I have a bunch of those machines too - all 64 bit installs, > running on Opteron hardware, and no crashes. Been running those for a few > years now. > > I''m guessing it''s something specific you do :) > > Thanks, > Ward. > > -- > Pong.be -( "I love the way Microsoft follows standards. In much )- > Virtual hosting -( the same manner that fish follow migrating caribou." )- > http://pong.be -( -- Paul Tomblin )- > GnuPG public key: http://pgp.mit.edu > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-users > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-users_______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
On Thu, 2010-06-10 at 15:49 -0400, Ward Vandewege wrote:> On Thu, Jun 10, 2010 at 09:22:01PM +0200, Dirk H. Schulz wrote: > > I have several servers running the Xen packages from Debian Lenny - > > the cpu architectures are ranging from dual pentium III, dual xeons > > from 4 years ago and current quad core xeons. All share a problem: > > they frequently crash. > > Funny, that. I have a bunch of those machines too - all 64 bit installs, > running on Opteron hardware, and no crashes. Been running those for a few > years now. > > I''m guessing it''s something specific you do :) > > Thanks, > Ward. >I have to agree with Ward. I am running out-of-the-box Debian Lenny with Xen (Xen 3.2-1, kernel 2.6.26-2-xen-amd64) on a pair of production boxes (Dual hex-core Opteron). Each is running five different DomUs performing various functions. Among those are a DomU DNS server (Bind). Those DNS servers are precessing over 20 million look up requests per day with no crashes. I do limit Dom0 memory and pin the CPUs. None of the DomUs use CPU0. The Dom0 has access to all CPUs. I also cap the DomU CPUs to 80%. Initially, I had network problems which were related to a NIC (Gigaswift) driver problem. A new (Intel) NIC solved that problem. Please let me know if you would like more details on my configuration, Steve. _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
On Fri, Jun 11, 2010 at 03:17:20AM +0300, Valtteri Kiviniemi wrote:> Debian Lenny has quite shitty Xen package, and I have also found it > to be very unreliable.I don''t know what it is that makes you say this, but Lenny''s stock Xen packages (64 bit) have been very reliable for me. I have more than 10 machines running that setup. Some have only 8G of ram; I have a few 32GB machines and one 64GB machine. They run anything from 10 to close to 40 domUs. And they are rock solid. Like I said, they are all Opteron machines - most dual core, some quad core. Perhaps the problems you are seeing are caused by Intel-specific codepaths? Thanks, Ward. -- Pong.be -( "In my opinion M$ is a lot better at making money than )- Virtual hosting -( it is at making good operating systems." -- Linus )- http://pong.be -( Torvalds )- GnuPG public key: http://pgp.mit.edu _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
I have quite a few machines running both intel and amd cpus with the debian packages for 3.2 from 4gb ram up to 64gb and no problems. I also pin cpus and don''t share dom0''s cpu with any domU''s. My guess is hes doing something strange to trigger it? I know there are some known bugs in that version but i have upwards of 10 machines running it with very high uptimes. - chris On Thu, Jun 10, 2010 at 10:40 PM, Ward Vandewege <ward@pong.be> wrote:> On Fri, Jun 11, 2010 at 03:17:20AM +0300, Valtteri Kiviniemi wrote: >> Debian Lenny has quite shitty Xen package, and I have also found it >> to be very unreliable. > > I don''t know what it is that makes you say this, but Lenny''s stock Xen > packages (64 bit) have been very reliable for me. > > I have more than 10 machines running that setup. Some have only 8G of ram; I > have a few 32GB machines and one 64GB machine. They run anything from 10 to > close to 40 domUs. > > And they are rock solid. > > Like I said, they are all Opteron machines - most dual core, some quad core. > > Perhaps the problems you are seeing are caused by Intel-specific codepaths? > > Thanks, > Ward. > > -- > Pong.be -( "In my opinion M$ is a lot better at making money than )- > Virtual hosting -( it is at making good operating systems." -- Linus )- > http://pong.be -( Torvalds )- > GnuPG public key: http://pgp.mit.edu > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-users >_______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Miles Fidelman
2010-Jun-11 04:41 UTC
[Xen-users] kexec/kdump in xen-linux-system-2.6.26-2-xen-686?
Anybody know if the stock Debian Lenny Xen system (xen-linux-system-2.6.26-2-xen-686) is built to support kexec/kdump - for Dom0? Thanks, Miles Fidelman -- In theory, there is no difference between theory and practice. In<fnord> practice, there is. .... Yogi Berra _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Folks, thanks a lot for all the feedback. First let me make clear: I am doing nothing special. They are standard installs with just one difference: the bridged network interface is a bond in some cases (but by far not all cases). The configuration I did is as described: - pin cpus - pin no domU do dom0''s cpu - dedicate a minimum amount of RAM (mostly 1 GB) to dom0 - dedicate at least 512 MB to each domU, not ballooning (start amount and max amount are the same). So, what I observe from your answers, is that people having no problems with Lenny''s Xen implementation are running 64Bit on AMD architectures. Is there anybody out there running several intel machines with 32Bit Lenny Xen and NOT having any problems with regular crashes? I will take a look at compiling myself again (had done so all throught the 2.x years), but that would mean giving up. :-) So let''s make a poll out of it: Anyone here having frequent crashes with 64Bit Lenny''s Xen? Anyone here NOT having frequent crashes with 32Bit Lenny''s Xen? Each answer please also name the processor architecture. Thanks a lot, Dirk Am 11.06.10 06:03, schrieb chris:> I have quite a few machines running both intel and amd cpus with the > debian packages for 3.2 from 4gb ram up to 64gb and no problems. I > also pin cpus and don''t share dom0''s cpu with any domU''s. My guess is > hes doing something strange to trigger it? I know there are some known > bugs in that version but i have upwards of 10 machines running it with > very high uptimes. > > - chris > > On Thu, Jun 10, 2010 at 10:40 PM, Ward Vandewege<ward@pong.be> wrote: > >> On Fri, Jun 11, 2010 at 03:17:20AM +0300, Valtteri Kiviniemi wrote: >> >>> Debian Lenny has quite shitty Xen package, and I have also found it >>> to be very unreliable. >>> >> I don''t know what it is that makes you say this, but Lenny''s stock Xen >> packages (64 bit) have been very reliable for me. >> >> I have more than 10 machines running that setup. Some have only 8G of ram; I >> have a few 32GB machines and one 64GB machine. They run anything from 10 to >> close to 40 domUs. >> >> And they are rock solid. >> >> Like I said, they are all Opteron machines - most dual core, some quad core. >> >> Perhaps the problems you are seeing are caused by Intel-specific codepaths? >> >> Thanks, >> Ward. >> >> -- >> Pong.be -( "In my opinion M$ is a lot better at making money than )- >> Virtual hosting -( it is at making good operating systems." -- Linus )- >> http://pong.be -( Torvalds )- >> GnuPG public key: http://pgp.mit.edu >> >> _______________________________________________ >> Xen-users mailing list >> Xen-users@lists.xensource.com >> http://lists.xensource.com/xen-users >> >> > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-users >_______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Jonathan Tripathy
2010-Jun-11 09:05 UTC
RE: [Xen-users] Xen on Debian Lenny quite unstable
Hi Dirk, I don''t have any experience yet, however in the next few days I am going to test my Ubuntu 10.04 64-bit Dom0 with about 40 64-bit DomUs on my Intel Xeon Quad Core. Would the result of this help you? Thanks ________________________________ From: xen-users-bounces@lists.xensource.com on behalf of Dirk H. Schulz Sent: Fri 11/06/2010 09:58 To: xen-users@lists.xensource.com Subject: Re: [Xen-users] Xen on Debian Lenny quite unstable Folks, thanks a lot for all the feedback. First let me make clear: I am doing nothing special. They are standard installs with just one difference: the bridged network interface is a bond in some cases (but by far not all cases). The configuration I did is as described: - pin cpus - pin no domU do dom0''s cpu - dedicate a minimum amount of RAM (mostly 1 GB) to dom0 - dedicate at least 512 MB to each domU, not ballooning (start amount and max amount are the same). So, what I observe from your answers, is that people having no problems with Lenny''s Xen implementation are running 64Bit on AMD architectures. Is there anybody out there running several intel machines with 32Bit Lenny Xen and NOT having any problems with regular crashes? I will take a look at compiling myself again (had done so all throught the 2.x years), but that would mean giving up. :-) So let''s make a poll out of it: Anyone here having frequent crashes with 64Bit Lenny''s Xen? Anyone here NOT having frequent crashes with 32Bit Lenny''s Xen? Each answer please also name the processor architecture. Thanks a lot, Dirk Am 11.06.10 06:03, schrieb chris:> I have quite a few machines running both intel and amd cpus with the > debian packages for 3.2 from 4gb ram up to 64gb and no problems. I > also pin cpus and don''t share dom0''s cpu with any domU''s. My guess is > hes doing something strange to trigger it? I know there are some known > bugs in that version but i have upwards of 10 machines running it with > very high uptimes. > > - chris > > On Thu, Jun 10, 2010 at 10:40 PM, Ward Vandewege<ward@pong.be> wrote: > >> On Fri, Jun 11, 2010 at 03:17:20AM +0300, Valtteri Kiviniemi wrote: >> >>> Debian Lenny has quite shitty Xen package, and I have also found it >>> to be very unreliable. >>> >> I don''t know what it is that makes you say this, but Lenny''s stock Xen >> packages (64 bit) have been very reliable for me. >> >> I have more than 10 machines running that setup. Some have only 8G of ram; I >> have a few 32GB machines and one 64GB machine. They run anything from 10 to >> close to 40 domUs. >> >> And they are rock solid. >> >> Like I said, they are all Opteron machines - most dual core, some quad core. >> >> Perhaps the problems you are seeing are caused by Intel-specific codepaths? >> >> Thanks, >> Ward. >> >> -- >> Pong.be -( "In my opinion M$ is a lot better at making money than )- >> Virtual hosting -( it is at making good operating systems." -- Linus )- >> http://pong.be -( Torvalds )- >> GnuPG public key: http://pgp.mit.edu >> >> _______________________________________________ >> Xen-users mailing list >> Xen-users@lists.xensource.com >> http://lists.xensource.com/xen-users >> >> > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-users >_______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
just to confirm: using around 10 instances with lenny 64bits both on dom0 and domU and no issues so far. might something with bonding? I''ve read (I''m far from an expert) some issues with bonding and xen that might cause your arbitrary crashes? samuel On 11 June 2010 10:58, Dirk H. Schulz <dirk.schulz@kinzesberg.de> wrote:> Folks, > > thanks a lot for all the feedback. First let me make clear: I am doing > nothing special. They are standard installs with just one difference: the > bridged network interface is a bond in some cases (but by far not all > cases). > > The configuration I did is as described: > - pin cpus > - pin no domU do dom0''s cpu > - dedicate a minimum amount of RAM (mostly 1 GB) to dom0 > - dedicate at least 512 MB to each domU, not ballooning (start amount and > max amount are the same). > > So, what I observe from your answers, is that people having no problems > with Lenny''s Xen implementation are running 64Bit on AMD architectures. > > Is there anybody out there running several intel machines with 32Bit Lenny > Xen and NOT having any problems with regular crashes? > > I will take a look at compiling myself again (had done so all throught the > 2.x years), but that would mean giving up. :-) > > So let''s make a poll out of it: > Anyone here having frequent crashes with 64Bit Lenny''s Xen? > Anyone here NOT having frequent crashes with 32Bit Lenny''s Xen? > Each answer please also name the processor architecture. > > Thanks a lot, > > Dirk > > > Am 11.06.10 06:03, schrieb chris: > > I have quite a few machines running both intel and amd cpus with the >> debian packages for 3.2 from 4gb ram up to 64gb and no problems. I >> also pin cpus and don''t share dom0''s cpu with any domU''s. My guess is >> hes doing something strange to trigger it? I know there are some known >> bugs in that version but i have upwards of 10 machines running it with >> very high uptimes. >> >> - chris >> >> On Thu, Jun 10, 2010 at 10:40 PM, Ward Vandewege<ward@pong.be> wrote: >> >> >>> On Fri, Jun 11, 2010 at 03:17:20AM +0300, Valtteri Kiviniemi wrote: >>> >>> >>>> Debian Lenny has quite shitty Xen package, and I have also found it >>>> to be very unreliable. >>>> >>>> >>> I don''t know what it is that makes you say this, but Lenny''s stock Xen >>> packages (64 bit) have been very reliable for me. >>> >>> I have more than 10 machines running that setup. Some have only 8G of >>> ram; I >>> have a few 32GB machines and one 64GB machine. They run anything from 10 >>> to >>> close to 40 domUs. >>> >>> And they are rock solid. >>> >>> Like I said, they are all Opteron machines - most dual core, some quad >>> core. >>> >>> Perhaps the problems you are seeing are caused by Intel-specific >>> codepaths? >>> >>> Thanks, >>> Ward. >>> >>> -- >>> Pong.be -( "In my opinion M$ is a lot better at making money than >>> )- >>> Virtual hosting -( it is at making good operating systems." -- Linus >>> )- >>> http://pong.be -( Torvalds >>> )- >>> GnuPG public key: http://pgp.mit.edu >>> >>> _______________________________________________ >>> Xen-users mailing list >>> Xen-users@lists.xensource.com >>> http://lists.xensource.com/xen-users >>> >>> >>> >> _______________________________________________ >> Xen-users mailing list >> Xen-users@lists.xensource.com >> http://lists.xensource.com/xen-users >> >> > > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-users >_______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Hi Jonathan, Am 11.06.10 11:05, schrieb Jonathan Tripathy:> Hi Dirk, > I don''t have any experience yet, however in the next few days I am > going to test my Ubuntu 10.04 64-bit Dom0 with about 40 64-bit DomUs > on my Intel Xeon Quad Core. > Would the result of this help you?Oh yes, if it is no problem for you, that would be very nice. Thanks, Dirk> Thanks > > ------------------------------------------------------------------------ > *From:* xen-users-bounces@lists.xensource.com on behalf of Dirk H. Schulz > *Sent:* Fri 11/06/2010 09:58 > *To:* xen-users@lists.xensource.com > *Subject:* Re: [Xen-users] Xen on Debian Lenny quite unstable > > Folks, > > thanks a lot for all the feedback. First let me make clear: I am doing > nothing special. They are standard installs with just one difference: > the bridged network interface is a bond in some cases (but by far not > all cases). > > The configuration I did is as described: > - pin cpus > - pin no domU do dom0''s cpu > - dedicate a minimum amount of RAM (mostly 1 GB) to dom0 > - dedicate at least 512 MB to each domU, not ballooning (start amount > and max amount are the same). > > So, what I observe from your answers, is that people having no problems > with Lenny''s Xen implementation are running 64Bit on AMD architectures. > > Is there anybody out there running several intel machines with 32Bit > Lenny Xen and NOT having any problems with regular crashes? > > I will take a look at compiling myself again (had done so all throught > the 2.x years), but that would mean giving up. :-) > > So let''s make a poll out of it: > Anyone here having frequent crashes with 64Bit Lenny''s Xen? > Anyone here NOT having frequent crashes with 32Bit Lenny''s Xen? > Each answer please also name the processor architecture. > > Thanks a lot, > > Dirk > > > Am 11.06.10 06:03, schrieb chris: > > I have quite a few machines running both intel and amd cpus with the > > debian packages for 3.2 from 4gb ram up to 64gb and no problems. I > > also pin cpus and don''t share dom0''s cpu with any domU''s. My guess is > > hes doing something strange to trigger it? I know there are some known > > bugs in that version but i have upwards of 10 machines running it with > > very high uptimes. > > > > - chris > > > > On Thu, Jun 10, 2010 at 10:40 PM, Ward Vandewege<ward@pong.be> wrote: > > > >> On Fri, Jun 11, 2010 at 03:17:20AM +0300, Valtteri Kiviniemi wrote: > >> > >>> Debian Lenny has quite shitty Xen package, and I have also found it > >>> to be very unreliable. > >>> > >> I don''t know what it is that makes you say this, but Lenny''s stock Xen > >> packages (64 bit) have been very reliable for me. > >> > >> I have more than 10 machines running that setup. Some have only 8G > of ram; I > >> have a few 32GB machines and one 64GB machine. They run anything > from 10 to > >> close to 40 domUs. > >> > >> And they are rock solid. > >> > >> Like I said, they are all Opteron machines - most dual core, some > quad core. > >> > >> Perhaps the problems you are seeing are caused by Intel-specific > codepaths? > >> > >> Thanks, > >> Ward. > >> > >> -- > >> Pong.be -( "In my opinion M$ is a lot better at making > money than )- > >> Virtual hosting -( it is at making good operating systems." -- > Linus )- > >> http://pong.be -( > Torvalds )- > >> GnuPG public key: http://pgp.mit.edu > >> > >> _______________________________________________ > >> Xen-users mailing list > >> Xen-users@lists.xensource.com > >> http://lists.xensource.com/xen-users > >> > >> > > _______________________________________________ > > Xen-users mailing list > > Xen-users@lists.xensource.com > > http://lists.xensource.com/xen-users > > > > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-users > > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-users_______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Am 11.06.10 11:07, schrieb samuel:> just to confirm: using around 10 instances with lenny 64bits both on > dom0 and domU and no issues so far. > > might something with bonding? I''ve read (I''m far from an expert) some > issues with bonding and xen that might cause your arbitrary crashes?There are issues with bonding and bridging used together, but AFAIK far from causing crashes. By the way, the machines not using bonding crash similarly. Dirk> > samuel > > On 11 June 2010 10:58, Dirk H. Schulz <dirk.schulz@kinzesberg.de > <mailto:dirk.schulz@kinzesberg.de>> wrote: > > Folks, > > thanks a lot for all the feedback. First let me make clear: I am > doing nothing special. They are standard installs with just one > difference: the bridged network interface is a bond in some cases > (but by far not all cases). > > The configuration I did is as described: > - pin cpus > - pin no domU do dom0''s cpu > - dedicate a minimum amount of RAM (mostly 1 GB) to dom0 > - dedicate at least 512 MB to each domU, not ballooning (start > amount and max amount are the same). > > So, what I observe from your answers, is that people having no > problems with Lenny''s Xen implementation are running 64Bit on AMD > architectures. > > Is there anybody out there running several intel machines with > 32Bit Lenny Xen and NOT having any problems with regular crashes? > > I will take a look at compiling myself again (had done so all > throught the 2.x years), but that would mean giving up. :-) > > So let''s make a poll out of it: > Anyone here having frequent crashes with 64Bit Lenny''s Xen? > Anyone here NOT having frequent crashes with 32Bit Lenny''s Xen? > Each answer please also name the processor architecture. > > Thanks a lot, > > Dirk > > > Am 11.06.10 06:03, schrieb chris: > > I have quite a few machines running both intel and amd cpus > with the > debian packages for 3.2 from 4gb ram up to 64gb and no problems. I > also pin cpus and don''t share dom0''s cpu with any domU''s. My > guess is > hes doing something strange to trigger it? I know there are > some known > bugs in that version but i have upwards of 10 machines running > it with > very high uptimes. > > - chris > > On Thu, Jun 10, 2010 at 10:40 PM, Ward Vandewege<ward@pong.be > <mailto:ward@pong.be>> wrote: > > On Fri, Jun 11, 2010 at 03:17:20AM +0300, Valtteri > Kiviniemi wrote: > > Debian Lenny has quite shitty Xen package, and I have > also found it > to be very unreliable. > > I don''t know what it is that makes you say this, but > Lenny''s stock Xen > packages (64 bit) have been very reliable for me. > > I have more than 10 machines running that setup. Some have > only 8G of ram; I > have a few 32GB machines and one 64GB machine. They run > anything from 10 to > close to 40 domUs. > > And they are rock solid. > > Like I said, they are all Opteron machines - most dual > core, some quad core. > > Perhaps the problems you are seeing are caused by > Intel-specific codepaths? > > Thanks, > Ward. > > -- > Pong.be -( "In my opinion M$ is a lot better at > making money than )- > Virtual hosting -( it is at making good operating > systems." -- Linus )- > http://pong.be -( Torvalds > )- > GnuPG public key: http://pgp.mit.edu > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > <mailto:Xen-users@lists.xensource.com> > http://lists.xensource.com/xen-users > > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > <mailto:Xen-users@lists.xensource.com> > http://lists.xensource.com/xen-users > > > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com <mailto:Xen-users@lists.xensource.com> > http://lists.xensource.com/xen-users > > > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-users_______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
On Fri, Jun 11, 2010 at 3:58 PM, Dirk H. Schulz <dirk.schulz@kinzesberg.de> wrote:> Is there anybody out there running several intel machines with 32Bit Lenny > Xen and NOT having any problems with regular crashes? > > I will take a look at compiling myself again (had done so all throught the > 2.x years), but that would mean giving up. :-)Just wondering, why are you using 32bit Xen and dom0? Is your current system 64bit capable? -- Fajar _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Dirk H. Schulz wrote:>So, what I observe from your answers, is that people having no >problems with Lenny''s Xen implementation are running 64Bit on AMD >architectures. > >Is there anybody out there running several intel machines with 32Bit >Lenny Xen and NOT having any problems with regular crashes?Yes, I have two servers running Lenny on i386 - but they are running a 2.6.18-6-xen-686 kernel as that was the latest pre-build kernel supporting Dom0 at the time I built them. They aren''t perfect (console daemon hangs up from time to time) but they seem fairly stable. When (or rather if) I get some new ''hand me down'' hardware, I''ll probably look at building something a bit more up to date. -- Simon Hobson Visit http://www.magpiesnestpublishing.co.uk/ for books by acclaimed author Gladys Hobson. Novels - poetry - short stories - ideal as Christmas stocking fillers. Some available as e-books. _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Valtteri Kiviniemi
2010-Jun-11 12:14 UTC
Re: [Xen-users] Xen on Debian Lenny quite unstable
Hi, Btw. One more thing; last time I checked (~1 year ago), the Debian 2.6.26 kernel did not have a working xm save / xm restore, so can someone who is running it report if its working or not? - Valtteri Kiviniemi Simon Hobson kirjoitti:> Dirk H. Schulz wrote: > >> So, what I observe from your answers, is that people having no >> problems with Lenny''s Xen implementation are running 64Bit on AMD >> architectures. >> >> Is there anybody out there running several intel machines with 32Bit >> Lenny Xen and NOT having any problems with regular crashes? > > Yes, I have two servers running Lenny on i386 - but they are running a > 2.6.18-6-xen-686 kernel as that was the latest pre-build kernel > supporting Dom0 at the time I built them. They aren''t perfect (console > daemon hangs up from time to time) but they seem fairly stable. > > When (or rather if) I get some new ''hand me down'' hardware, I''ll > probably look at building something a bit more up to date. >_______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Am 11.06.10 14:05, schrieb Fajar A. Nugraha:> On Fri, Jun 11, 2010 at 3:58 PM, Dirk H. Schulz > <dirk.schulz@kinzesberg.de> wrote: > > Just wondering, why are you using 32bit Xen and dom0? Is your current > system 64bit capable? > >Well, that depends. The Dual Pentium III systems are not, the Core i7 is, and the Xeons should be 64Bit capable also, according to Intels listings. Dirk _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
"Dirk H. Schulz" <dirk.schulz@kinzesberg.de> writes:> Is there anybody out there running several intel machines with 32Bit > Lenny Xen and NOT having any problems with regular crashes?The 32-bit Lenny dom0 kernel is unstable, as you and others observed. Don''t use that. The 64-bit version is stable, though. I''m running the 32-bit Etch dom0 kernel on my Lenny dom0-s, that''s stable, too, aside from sporadic (and curable) xenconsoled hangups. -- Regards, Feri. _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Dirk H. Schulz
2010-Jun-11 13:08 UTC
Re: [Xen-users] Re: Xen on Debian Lenny quite unstable
Am 11.06.10 14:58, schrieb Ferenc Wagner:> "Dirk H. Schulz"<dirk.schulz@kinzesberg.de> writes: > > >> Is there anybody out there running several intel machines with 32Bit >> Lenny Xen and NOT having any problems with regular crashes? >> > The 32-bit Lenny dom0 kernel is unstable, as you and others observed. > Don''t use that. The 64-bit version is stable, though. I''m running the > 32-bit Etch dom0 kernel on my Lenny dom0-s, that''s stable, too, aside > from sporadic (and curable) xenconsoled hangups. >Well, I hope this does not sound too newbie-like, but 1. How do you get the 32bit Etch dom0 kernel? Manual package download or some tweeking of the apt sources? 2. Is it sufficient to exchange the kernel or did you exchange other packages/binaries as well? Thanks for you help! Dirk _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Dirk H. Schulz
2010-Jun-11 13:19 UTC
32Bit on 64Bit - Was: Re: [Xen-users] Xen on Debian Lenny quite unstable
Okay, next question on the way to a solution: Anyone out there running 32Bit domUs successfully on a 64Bit dom0 with Lenny? Dirk Am 10.06.10 21:34, schrieb Miles Fidelman:> Dirk H. Schulz wrote: >> Hi folks, >> >> I have several servers running the Xen packages from Debian Lenny - >> the cpu architectures are ranging from dual pentium III, dual xeons >> from 4 years ago and current quad core xeons. All share a problem: >> they frequently crash. >> >> The physical machine then reboots, and in the logs there is >> absolutely nothing. The intervals between crashes range from just a >> day to around 30 days in the max, but mostly it happens roughly every >> few days. The only pattern I found so far is: the more virtual >> machines on the host, the infrequent the crashes (that alone is weird). > Wow... I just (a week or so back) migrated a server from Debian Lenny > on bare iron to Lenny on Xen. I''m seeing a similar problem - about > once a day the physical machine crashes and reboots, with nothing in > the log to give any indication why. > > I''m in the process of identifying and installing tools for capturing > pre-crash activity - any suggestions would be welcome. > > Miles Fidelman >_______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
James Harper
2010-Jun-11 13:45 UTC
RE: 32Bit on 64Bit - Was: Re: [Xen-users] Xen on Debian Lenny quiteunstable
> > Okay, next question on the way to a solution: > > Anyone out there running 32Bit domUs successfully on a 64Bit dom0 with > Lenny? >Depending on the dom0 kernel that might not work. The data structure that is used for communication between domains for PV block devices has different alignment under 32 and 64 bits so needs thunking between them which didn''t come in until post-lenny I think. If you make all your DomU''s the same then you should be fine. James _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
"Dirk H. Schulz" <dirk.schulz@kinzesberg.de> writes:> Am 11.06.10 14:58, schrieb Ferenc Wagner: > >> "Dirk H. Schulz"<dirk.schulz@kinzesberg.de> writes: >> >>> Is there anybody out there running several intel machines with 32Bit >>> Lenny Xen and NOT having any problems with regular crashes? >> >> The 32-bit Lenny dom0 kernel is unstable, as you and others observed. >> Don''t use that. The 64-bit version is stable, though. I''m running the >> 32-bit Etch dom0 kernel on my Lenny dom0-s, that''s stable, too, aside >> from sporadic (and curable) xenconsoled hangups. > > Well, I hope this does not sound too newbie-like, but > 1. How do you get the 32bit Etch dom0 kernel? Manual package download > or some tweeking of the apt sources?Add something like the following to /etc/apt/sources.list: deb http://ftp.de.debian.org/debian etch main deb http://security.debian.org/ etch/updates main> 2. Is it sufficient to exchange the kernel or did you exchange other > packages/binaries as well?The Etch dom0 kernel (linux-image-2.6.18-6-xen-686) works fine with xen-linux-system-2.6.26-2-xen-686 from Lenny and the supporting binaries. Just don''t boot the 2.6.26-2-xen-686 kernel, there''s no need to change other binaries or anything. -- Feri. _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users