Hi all, I know people have used Puppet with passenger[1], but has anyone tried it with Ruby Enterprise Edition[2]? The producers of REE claim that the two in combination can cut Rails memory usage by 33%, and I''m quite curious if it has a similar impact on puppetmasterd. Anyone who''s having high memory issues willing to give it a try? 1 - http://reductivelabs.com/trac/puppet/wiki/UsingPassenger 2 - http://www.rubyenterpriseedition.com/ -- If you would be a real seeker after truth, it is necessary that at least once in your life you doubt, as far as possible, all things. -- Rene Descartes --------------------------------------------------------------------- Luke Kanies | http://reductivelabs.com | http://madstop.com --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "Puppet Users" group. To post to this group, send email to puppet-users@googlegroups.com To unsubscribe from this group, send email to puppet-users+unsubscribe@googlegroups.com For more options, visit this group at http://groups.google.com/group/puppet-users?hl=en -~----------~----~----~----~------~----~------~--~---
Nigel Kersten
2009-Jan-13 00:19 UTC
[Puppet Users] Re: puppetmasterd with passenger and REE?
This is actually on my to-do list for this quarter, investigating Passenger/REE... On Mon, Jan 12, 2009 at 1:31 PM, Luke Kanies <luke@madstop.com> wrote:> > Hi all, > > I know people have used Puppet with passenger[1], but has anyone tried > it with Ruby Enterprise Edition[2]? > > The producers of REE claim that the two in combination can cut Rails > memory usage by 33%, and I''m quite curious if it has a similar impact > on puppetmasterd. Anyone who''s having high memory issues willing to > give it a try? > > 1 - http://reductivelabs.com/trac/puppet/wiki/UsingPassenger > 2 - http://www.rubyenterpriseedition.com/ > > -- > If you would be a real seeker after truth, it is necessary that at > least once in your life you doubt, as far as possible, all things. > -- Rene Descartes > --------------------------------------------------------------------- > Luke Kanies | http://reductivelabs.com | http://madstop.com > > > > >-- Nigel Kersten Systems Administrator Tech Lead - MacOps --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "Puppet Users" group. To post to this group, send email to puppet-users@googlegroups.com To unsubscribe from this group, send email to puppet-users+unsubscribe@googlegroups.com For more options, visit this group at http://groups.google.com/group/puppet-users?hl=en -~----------~----~----~----~------~----~------~--~---
On Mon, Jan 12, 2009 at 16:31, Luke Kanies <luke@madstop.com> wrote:> > Hi all, > > I know people have used Puppet with passenger[1], but has anyone tried > it with Ruby Enterprise Edition[2]? > > The producers of REE claim that the two in combination can cut Rails > memory usage by 33%, and I''m quite curious if it has a similar impact > on puppetmasterd. Anyone who''s having high memory issues willing to > give it a try?Passenger has actually had a fairly non-trivial impact on memory usage and responsiveness compared to mongrel. 4GB box (stored configs with mysql) serving around 300 puppet clients was regularly running out of memory entirely under mongrel. The cost/benefit ratio to deploying REE right now isn''t to the point where it''s worth investigating in our case, and given that it''s actually slower than standard ruby on amd64 right now that''ll be the case for a while right now i think. Cheers, -Thom --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "Puppet Users" group. To post to this group, send email to puppet-users@googlegroups.com To unsubscribe from this group, send email to puppet-users+unsubscribe@googlegroups.com For more options, visit this group at http://groups.google.com/group/puppet-users?hl=en -~----------~----~----~----~------~----~------~--~---
Hi, I think that there are two points here, One is passenger with standard ruby, and the other with REE. As far as Passenger goes, I would recommend it to people who start fresh (e.g. migrating from webrick). for REE - memory usage, I thought that passenger REE(GC) optimizations are not relevant to rack applications, however, I spend the last 30 minutes looking for that article I had in my mind, so maybe I''m wrong about it. Currently, when I have a mongrel process which abuse memory, monit restart it, which causes some clients to think the server has gone away (not sure why apache doesn''t move it to another process) - but that happens so rarely, that its not a huge motivation to migrate. All in all, passenger simplifies a lot when it comes to managing puppetmaster processes, and its also dynamic (e.g. it wont load a lot of processes if there is no need) - so maybe it would save memory usage anyway. How do people benchmark? anyone has a good way to simulate load? Ohad On Tue, Jan 13, 2009 at 8:43 AM, Thom May <thom@joost.com> wrote:> > On Mon, Jan 12, 2009 at 16:31, Luke Kanies <luke@madstop.com> wrote: > > > > Hi all, > > > > I know people have used Puppet with passenger[1], but has anyone tried > > it with Ruby Enterprise Edition[2]? > > > > The producers of REE claim that the two in combination can cut Rails > > memory usage by 33%, and I''m quite curious if it has a similar impact > > on puppetmasterd. Anyone who''s having high memory issues willing to > > give it a try? > > Passenger has actually had a fairly non-trivial impact on memory usage and > responsiveness compared to mongrel. 4GB box (stored configs with mysql) > serving > around 300 puppet clients was regularly running out of memory entirely > under mongrel. > > The cost/benefit ratio to deploying REE right now isn''t to the point > where it''s worth > investigating in our case, and given that it''s actually slower than > standard ruby on > amd64 right now that''ll be the case for a while right now i think. > Cheers, > -Thom > > > >--~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "Puppet Users" group. To post to this group, send email to puppet-users@googlegroups.com To unsubscribe from this group, send email to puppet-users+unsubscribe@googlegroups.com For more options, visit this group at http://groups.google.com/group/puppet-users?hl=en -~----------~----~----~----~------~----~------~--~---
found it: (from http://www.modrails.com/documentation/Usersguide.html#reducing_memory_usage) Is it possible to reduce memory consumption of your Rails applications by 33% on average, by using Ruby Enterprise Edition<http://www.rubyenterpriseedition.com/>. Please visit the website for details. Note that this feature does not apply to Rack applications. :( Cheers, Ohad On Tue, Jan 13, 2009 at 9:39 AM, Ohad Levy <ohadlevy@gmail.com> wrote:> Hi, > > I think that there are two points here, > > One is passenger with standard ruby, and the other with REE. > > As far as Passenger goes, I would recommend it to people who start fresh > (e.g. migrating from webrick). > > for REE - memory usage, I thought that passenger REE(GC) optimizations are > not relevant to rack applications, however, I spend the last 30 minutes > looking for that article I had in my mind, so maybe I''m wrong about it. > > Currently, when I have a mongrel process which abuse memory, monit restart > it, which causes some clients to think the server has gone away (not sure > why apache doesn''t move it to another process) - but that happens so rarely, > that its not a huge motivation to migrate. > > All in all, passenger simplifies a lot when it comes to managing > puppetmaster processes, and its also dynamic (e.g. it wont load a lot of > processes if there is no need) - so maybe it would save memory usage anyway. > > How do people benchmark? anyone has a good way to simulate load? > > Ohad > > > On Tue, Jan 13, 2009 at 8:43 AM, Thom May <thom@joost.com> wrote: > >> >> On Mon, Jan 12, 2009 at 16:31, Luke Kanies <luke@madstop.com> wrote: >> > >> > Hi all, >> > >> > I know people have used Puppet with passenger[1], but has anyone tried >> > it with Ruby Enterprise Edition[2]? >> > >> > The producers of REE claim that the two in combination can cut Rails >> > memory usage by 33%, and I''m quite curious if it has a similar impact >> > on puppetmasterd. Anyone who''s having high memory issues willing to >> > give it a try? >> >> Passenger has actually had a fairly non-trivial impact on memory usage and >> responsiveness compared to mongrel. 4GB box (stored configs with mysql) >> serving >> around 300 puppet clients was regularly running out of memory entirely >> under mongrel. >> >> The cost/benefit ratio to deploying REE right now isn''t to the point >> where it''s worth >> investigating in our case, and given that it''s actually slower than >> standard ruby on >> amd64 right now that''ll be the case for a while right now i think. >> Cheers, >> -Thom >> >> >> >> >--~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "Puppet Users" group. To post to this group, send email to puppet-users@googlegroups.com To unsubscribe from this group, send email to puppet-users+unsubscribe@googlegroups.com For more options, visit this group at http://groups.google.com/group/puppet-users?hl=en -~----------~----~----~----~------~----~------~--~---
James Bellenger
2009-Jan-13 20:45 UTC
[Puppet Users] Re: puppetmasterd with passenger and REE?
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Ohad Levy wrote:> How do people benchmark? anyone has a good way to simulate load?I''ve written up some notes on setting up a load-testing/benchmarking environment for puppet using JMeter. I''ve found that it''s been pretty handy in simulating puppet load and seeing how a puppetmaster behaves. http://www.forwardcamegrendel.org/benchmarking-puppet-jmeter James Bellenger. -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.7 (GNU/Linux) iD8DBQFJbP1d8TYLVDRcCYURAnLdAJ0Uzvha5o1x41oH/zWiWpCEK+2EMACePB3C A1o6mIsvZV4zni8QSzde57c=1Inb -----END PGP SIGNATURE----- --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "Puppet Users" group. To post to this group, send email to puppet-users@googlegroups.com To unsubscribe from this group, send email to puppet-users+unsubscribe@googlegroups.com For more options, visit this group at http://groups.google.com/group/puppet-users?hl=en -~----------~----~----~----~------~----~------~--~---
Luke Kanies
2009-Jan-13 22:31 UTC
[Puppet Users] Re: puppetmasterd with passenger and REE?
On Jan 13, 2009, at 2:45 PM, James Bellenger wrote:> > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > Ohad Levy wrote: >> How do people benchmark? anyone has a good way to simulate load? > > I''ve written up some notes on setting up a load-testing/benchmarking > environment for puppet using JMeter. I''ve found that it''s been pretty > handy in simulating puppet load and seeing how a puppetmaster behaves. > > http://www.forwardcamegrendel.org/benchmarking-puppet-jmeterAny observations you''d care to share? I''ve had real trouble finding environments that exhibit problems people have in a way I can diagnose and, hopefully, solve them. Having a clean way to do performance analysis would be great. I''ve provided a battery of load-generators with ''puppet-test'', but I''ve never been able to find many problems with it, which makes me think the problems are generally from services working in combination. -- To get back my youth I would do anything in the world, except take exercise, get up early, or be respectable. -- Oscar Wilde --------------------------------------------------------------------- Luke Kanies | http://reductivelabs.com | http://madstop.com --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "Puppet Users" group. To post to this group, send email to puppet-users@googlegroups.com To unsubscribe from this group, send email to puppet-users+unsubscribe@googlegroups.com For more options, visit this group at http://groups.google.com/group/puppet-users?hl=en -~----------~----~----~----~------~----~------~--~---