Ian Pratt
2005-May-24 12:54 UTC
RE: [Xen-users] mysql & xen - is anyone using this combinationsuccessfully?
> I''m beginning to wonder whether it''s safe to use mysql on xen > in a live environment.We''ve tended to do our testing with PostgreSQL, but we obviously want mysql to work perfectly too. Are you just running with the glibc tls disabled? If so, its possible that its an incompatibility with the old thread library that it falls back to. The best soloution is to install a ''xen friendly'' glibc for your installation. What distro are you running? The othe ralternative is to not disable tls by mv''ing the directory out the way, but to leave it active. You''ll get some loss of performance, but it should be executed correctly. Another interesting datapoint would be to try the unstable.bk tree. It''s still a bit ''raw'', but providing you''re just using the features present in 2.x its actually pretty stable. If anyone has a simple recipe for deterministically provoking this issue it would be good to know. Best, Ian _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Paul Laws
2005-May-25 09:43 UTC
Re: [Xen-users] mysql & xen - is anyone using this combinationsuccessfully?
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Ian Pratt wrote, On 24/05/05 13:54:> > >>I''m beginning to wonder whether it''s safe to use mysql on xen >>in a live environment. > > > We''ve tended to do our testing with PostgreSQL, but we obviously want > mysql to work perfectly too. > > Are you just running with the glibc tls disabled? If so, its possible > that its an incompatibility with the old thread library that it falls > back to.I''m using gentoo, and have specifically excluded the "nptl" USE flag to prevent the new thread handling. I have no tls directory under /lib, so I guess this is working (?)> > The best soloution is to install a ''xen friendly'' glibc for your > installation. What distro are you running? > > The othe ralternative is to not disable tls by mv''ing the directory out > the way, but to leave it active. You''ll get some loss of performance, > but it should be executed correctly. > > Another interesting datapoint would be to try the unstable.bk tree. It''s > still a bit ''raw'', but providing you''re just using the features present > in 2.x its actually pretty stable. > > If anyone has a simple recipe for deterministically provoking this issue > it would be good to know.FWIW, my setup here has involved several machines a couple of "live" ones basically used to hold transient data in a queue, a development box and a reporting server containing large volumes of log records - mostly used for queries. It''s the reporting server which had the data corruption, and the two queue handlers which have experienced the segvs. The queue handlers are running on identical boxes (IBM e325s over scsi), and the reporting server on a generic system over SATA, if this helps. The queue handlers have both had the segv, but at different times. They''re in a round-robin carrying much the same traffic. I guess this means the problem is going to be difficult to reproduce :-(> > Best, > Ian > >Hope this helps, Paul. - -- Paul Laws Analyst / Programmer -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.1 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org iD8DBQFClEjJYmQ8biuDK88RAiKzAJ46ALzxjd+jqMmsve4XMJi/PpEAhgCfWs9Q f9qKuhOJh4MKPXuX2lBdBSA=TMDL -----END PGP SIGNATURE----- _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Mark Williamson
2005-May-25 09:54 UTC
Re: [Xen-users] mysql & xen - is anyone using this combinationsuccessfully?
> I''m using gentoo, and have specifically excluded the "nptl" USE flag to > prevent the new thread handling. I have no tls directory under /lib, so I > guess this is working (?)There''s also a gcc flag for emitting direct TLS references directly in the code (the TLS library does this, which is why we disable it). The gcc flag is "-mno-tls-direct-seg-refs". Could this be your problem? Does recompiling, with no-tls-direct-seg-refs help? Cheers, Mark> > The best soloution is to install a ''xen friendly'' glibc for your > > installation. What distro are you running? > > > > The othe ralternative is to not disable tls by mv''ing the directory out > > the way, but to leave it active. You''ll get some loss of performance, > > but it should be executed correctly. > > > > Another interesting datapoint would be to try the unstable.bk tree. It''s > > still a bit ''raw'', but providing you''re just using the features present > > in 2.x its actually pretty stable. > > > > If anyone has a simple recipe for deterministically provoking this issue > > it would be good to know. > > FWIW, my setup here has involved several machines a couple of "live" ones > basically used to hold transient data in a queue, a development box and a > reporting server containing large volumes of log records - mostly used for > queries. > > It''s the reporting server which had the data corruption, and the two queue > handlers which have experienced the segvs. > > The queue handlers are running on identical boxes (IBM e325s over scsi), > and the reporting server on a generic system over SATA, if this helps. > > The queue handlers have both had the segv, but at different times. They''re > in a round-robin carrying much the same traffic. I guess this means the > problem is going to be difficult to reproduce :-( > > > Best, > > Ian > > Hope this helps, > Paul._______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Mark Williamson
2005-May-25 10:03 UTC
Re: [Xen-users] mysql & xen - is anyone using this combinationsuccessfully?
> Would I have to use this when compiling gcc or when compiling mysql? (FWIW > I get the segv with both with a native mysql compilation under gentoo, and > with the precompiled (statically linked) binaries from mysql)In this case, when compiling MySQL (although, in general, when compiling everything - there are a few other packages (OOo, for instance) which break otherwise). Another thing you could do is compile Xen itself with more debugging information and see if it''s complaining about any errors when MySQL crashes: cd $(XENROOT)/xen/ make debug=y verbose=y cp xen.gz /boot/xen-2.0.gz # or whatever you called it I think we''ve had this problem on Gentoo before - can anyone confirm / deny? Cheers, Mark _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Paul Laws
2005-May-25 10:49 UTC
Re: [Xen-users] mysql & xen - is anyone using this combinationsuccessfully?
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Mark Williamson wrote, On 25/05/05 10:54:>>I''m using gentoo, and have specifically excluded the "nptl" USE flag to >>prevent the new thread handling. I have no tls directory under /lib, so I >>guess this is working (?) > > > There''s also a gcc flag for emitting direct TLS references directly in the > code (the TLS library does this, which is why we disable it). The gcc flag > is "-mno-tls-direct-seg-refs". Could this be your problem? Does > recompiling, with no-tls-direct-seg-refs help? > > Cheers, > Mark >Would I have to use this when compiling gcc or when compiling mysql? (FWIW I get the segv with both with a native mysql compilation under gentoo, and with the precompiled (statically linked) binaries from mysql) [snip] - -- Paul Laws Analyst / Programmer -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.1 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org iD8DBQFClFgyYmQ8biuDK88RAj7LAJ4sj7PCNaTui3F8tDOULqhgwX25FwCg3/vm RvX6kjG9sYuWWE71YII/Tkw=MnfZ -----END PGP SIGNATURE----- _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Paul Laws
2005-May-26 08:17 UTC
Re: [Xen-users] mysql & xen - is anyone using this combinationsuccessfully?
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Mark Williamson wrote, On 25/05/05 11:03:>>Would I have to use this when compiling gcc or when compiling mysql? (FWIW >>I get the segv with both with a native mysql compilation under gentoo, and >>with the precompiled (statically linked) binaries from mysql) > > > In this case, when compiling MySQL (although, in general, when compiling > everything - there are a few other packages (OOo, for instance) which break > otherwise).I''ll give this a compile when I can - hopefully soon.> > Another thing you could do is compile Xen itself with more debugging > information and see if it''s complaining about any errors when MySQL crashes: > cd $(XENROOT)/xen/ > make debug=y verbose=y > cp xen.gz /boot/xen-2.0.gz # or whatever you called it > > I think we''ve had this problem on Gentoo before - can anyone confirm / deny? > > Cheers, > Mark > >- -- Paul Laws Analyst / Programmer -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.1 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org iD8DBQFClYYqYmQ8biuDK88RAu89AJ9eVvBAEE09hYLPdjfnva6yd7L5NQCggwsG llRz+QhF7tQSBPip0g5CbEs=f6xV -----END PGP SIGNATURE----- _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Paul Laws
2005-May-26 08:23 UTC
Most stable distribution for running Xen [Was Re: [Xen-users] mysql & xen - is anyone using this combinationsuccessfully?]
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Mark Williamson wrote, On 25/05/05 11:03:>>Would I have to use this when compiling gcc or when compiling mysql? (FWIW >>I get the segv with both with a native mysql compilation under gentoo, and >>with the precompiled (statically linked) binaries from mysql) >[snip]> I think we''ve had this problem on Gentoo before - can anyone confirm / deny?[snip] Having had segv problems with mysql over Xen over gentoo, has anyone got recommendations for a distro which might do a better job? Paul. - -- Paul Laws Analyst / Programmer -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.1 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org iD8DBQFClYdsYmQ8biuDK88RApx1AJ98cYZu75uJwYCC8lVYl0xmKsOi6wCgiolw yLIjJXzL0rSCiooIDlNETcY=AsD6 -----END PGP SIGNATURE----- _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Paul Laws
2005-May-26 08:28 UTC
Re: [Xen-users] mysql & xen - is anyone using this combinationsuccessfully?
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Paul Laws wrote, On 25/05/05 11:49:> Mark Williamson wrote, On 25/05/05 10:54: > >>>>I''m using gentoo, and have specifically excluded the "nptl" USE flag to >>>>prevent the new thread handling. I have no tls directory under /lib, so I >>>>guess this is working (?) >>> >>> >>>There''s also a gcc flag for emitting direct TLS references directly in the >>>code (the TLS library does this, which is why we disable it). The gcc flag >>>is "-mno-tls-direct-seg-refs". Could this be your problem? Does >>>recompiling, with no-tls-direct-seg-refs help?I get this error from configure when trying this flag: configure:2693: i686-pc-linux-gnu-gcc -mno-tls-direct-seg-refs - -DHAVE_ERRNO_AS_DEFINE=1 -DUSE_OLD_FUNCTIONS conftest.c >&5 cc1: error: invalid option `no-tls-direct-seg-refs'' I''ve checked the gcc info, and the nearest I can find is this: `-ftls-model=MODEL'' Alter the thread-local storage model to be used (*note Thread-Local::). The MODEL argument should be one of `global-dynamic'', `local-dynamic'', `initial-exec'' or `local-exec''. The default without `-fpic'' is `initial-exec''; with `-fpic'' the default is `global-dynamic''. I''m not using pic. # gcc --version gcc (GCC) 3.3.5-20050130 (Gentoo Linux 3.3.5.20050130-r1, ssp-3.3.5.20050130-1, pie-8.7.7.1) Copyright (C) 2003 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. Any other ideas?>>> >>>Cheers, >>>Mark >>> > > > Would I have to use this when compiling gcc or when compiling mysql? (FWIW I > get the segv with both with a native mysql compilation under gentoo, and with > the precompiled (statically linked) binaries from mysql) > > [snip] > > -- > Paul Laws > Analyst / Programmer_______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users - -- Paul Laws Analyst / Programmer -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.1 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org iD8DBQFClYi5YmQ8biuDK88RAoZhAJ9xrL86iGLmIxDcB2qvCFl/M8Gx6wCfZVXX fccQy4FMMXg7jQ0zn2mrGR8=PYl5 -----END PGP SIGNATURE----- _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Michael Warner
2005-May-26 09:09 UTC
Re: Most stable distribution for running Xen [Was Re: [Xen-users] mysql & xen - is anyone using this combinationsuccessfully?]
Hi, Try using a distro thats tested more then gentoo, with gentoo there no telling what combination of software is causing a problem. CentOS is great (based off of RHE), very stable, otherwise debian is also a great choice. I''ve used xen on both without issues. -Mike Paul Laws wrote:>-----BEGIN PGP SIGNED MESSAGE----- >Hash: SHA1 > >Mark Williamson wrote, On 25/05/05 11:03: > > >>>Would I have to use this when compiling gcc or when compiling mysql? (FWIW >>>I get the segv with both with a native mysql compilation under gentoo, and >>>with the precompiled (statically linked) binaries from mysql) >>> >>> >[snip] > > > >>I think we''ve had this problem on Gentoo before - can anyone confirm / deny? >> >> > >[snip] > >Having had segv problems with mysql over Xen over gentoo, has anyone got >recommendations for a distro which might do a better job? > >Paul. > >- -- >Paul Laws >Analyst / Programmer >-----BEGIN PGP SIGNATURE----- >Version: GnuPG v1.4.1 (GNU/Linux) >Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org > >iD8DBQFClYdsYmQ8biuDK88RApx1AJ98cYZu75uJwYCC8lVYl0xmKsOi6wCgiolw >yLIjJXzL0rSCiooIDlNETcY>=AsD6 >-----END PGP SIGNATURE----- > >_______________________________________________ >Xen-users mailing list >Xen-users@lists.xensource.com >http://lists.xensource.com/xen-users > >_______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Paul Laws
2005-May-26 10:00 UTC
Re: Most stable distribution for running Xen [Was Re: [Xen-users] mysql & xen - is anyone using this combinationsuccessfully?]
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Would you recommend this for dom0 or domU or both? I have to say we''ve been using gentoo here for a couple of years on a dozen live servers without any problems. Portage is great for tracking either bugfixes or security fixes. Michael Warner wrote, On 26/05/05 10:09:> Hi, > > Try using a distro thats tested more then gentoo, with gentoo there no > telling what combination of software is causing a problem. CentOS is > great (based off of RHE), very stable, otherwise debian is also a great > choice. I''ve used xen on both without issues. > > -Mike > > Paul Laws wrote: > > Mark Williamson wrote, On 25/05/05 11:03: > > >>>>> Would I have to use this when compiling gcc or when compiling mysql? >>>>> (FWIW >>>>> I get the segv with both with a native mysql compilation under >>>>> gentoo, and >>>>> with the precompiled (statically linked) binaries from mysql) >>>>> > > [snip] > > > >>>> I think we''ve had this problem on Gentoo before - can anyone confirm >>>> / deny? >>>> > > > [snip] > > Having had segv problems with mysql over Xen over gentoo, has anyone got > recommendations for a distro which might do a better job? > > Paul. > > -- > Paul Laws > Analyst / Programmer >>_______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users>>- -- Paul Laws Analyst / Programmer -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.1 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org iD8DBQFClZ5IYmQ8biuDK88RAqTjAJ9jJIaAOsD7bjnVszSmURGyL1XksQCg1dAK WqgEiQ6ArAKbMxQwD/Z5ywQ=DTCt -----END PGP SIGNATURE----- _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Eric S. Johansson
2005-May-26 11:38 UTC
Re: Most stable distribution for running Xen [Was Re: [Xen-users] mysql & xen - is anyone using this combinationsuccessfully?]
Paul Laws wrote:> -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > Would you recommend this for dom0 or domU or both? > > I have to say we''ve been using gentoo here for a couple of years on a dozen > live servers without any problems. Portage is great for tracking either > bugfixes or security fixes.it seems to me that if you stay away from ~x86 ebuilds gentoo is as reliable as other distributions. personally, I typically find roughly the same set of bugs exist across multiple distributions. ---eric -- http://www.wired.com/wired/archive/13.03/view.html?pg=5 The result of the duopoly that currently defines "competition" is that prices and service suck. We''re the world''s leader in Internet technology - except that we''re not. _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Paul Laws
2005-May-26 11:41 UTC
Re: Most stable distribution for running Xen [Was Re: [Xen-users] mysql & xen - is anyone using this combinationsuccessfully?]
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Eric S. Johansson wrote, On 26/05/05 12:38: [snip]> it seems to me that if you stay away from ~x86 ebuilds gentoo is as > reliable as other distributions. personally, I typically find roughly > the same set of bugs exist across multiple distributions. > > ---ericI think you''re right :-D - -- Paul Laws Analyst / Programmer -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.1 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org iD8DBQFClbXZYmQ8biuDK88RAnneAJ41tmkJ5QRT9UjdfPd8uopmYeFM9wCggPsk ffQi+1XsVh0aSNs+0vVFRxI=ZvIP -----END PGP SIGNATURE----- _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users