Puppet users - Jul 2013 - Puppetmaster performance optimization/best practices?

I''ve recently started to have a problem with my puppetmaster using
more and more memory over a few days, and eventually hitting swap.
Restarting the puppetmaster services puts things back to normal for a
bit. (see: http://i.imgur.com/E8xPYqn.png)

I''m running 2.7.11 on distro-standard ruby 1.8.7, with 4 mongrel
puppetmaster processes, on a pretty standard Ubuntu 12.04 VM,
puppetmasters are behind nginx. Nginx handles the files (ala:
http://www.masterzen.fr/2010/03/21/more-puppet-offloading/). Running
foreman on the same machine, though it''s not used for much. Puppet is
setup to use a remote MySQL db.

We have ~200 servers in a single environment running against this
puppetmaster, which doesn''t seem like it should be a seriously taxing
load, so having to restart the service occasionally seems like an
indication I''m doing something wrong.

What am I missing? Should I be using Unicorn? Should I be using a
different Ruby? What should I be tuning or optimizing? Is there a good
resource for puppetmaster setup best practices?

Thanks!

-Jeff

-- 
You received this message because you are subscribed to the Google Groups
"Puppet Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to puppet-users+unsubscribe@googlegroups.com.
To post to this group, send email to puppet-users@googlegroups.com.
Visit this group at http://groups.google.com/group/puppet-users.
For more options, visit https://groups.google.com/groups/opt_out.

Start by setting up passenger. I am always amazed why people even start
with mongrel for anything but debugging.

The packages from puppetlabs are there and are stable. They will setup
the whole thing for you - you just apt-get install or yum install them.

Also I am not sure if you will get better memory usage from puppetdb
but it will be much faster for exported resources. 

Migration to puppet3 might also help although I will start with the
others first.

-- 
Nikola

On Tue, Jul 02, 2013 at 10:09:42PM -0400, Jeff Zellner
wrote:
> I''ve recently started to have a problem with my puppetmaster using
> more and more memory over a few days, and eventually hitting swap.
> Restarting the puppetmaster services puts things back to normal for a
> bit. (see: http://i.imgur.com/E8xPYqn.png)
> 
> I''m running 2.7.11 on distro-standard ruby 1.8.7, with 4 mongrel
> puppetmaster processes, on a pretty standard Ubuntu 12.04 VM,
> puppetmasters are behind nginx. Nginx handles the files (ala:
> http://www.masterzen.fr/2010/03/21/more-puppet-offloading/). Running
> foreman on the same machine, though it''s not used for much. Puppet
is
> setup to use a remote MySQL db.
> 
> We have ~200 servers in a single environment running against this
> puppetmaster, which doesn''t seem like it should be a seriously
taxing
> load, so having to restart the service occasionally seems like an
> indication I''m doing something wrong.
> 
> What am I missing? Should I be using Unicorn? Should I be using a
> different Ruby? What should I be tuning or optimizing? Is there a good
> resource for puppetmaster setup best practices?
> 
> Thanks!
> 
> -Jeff
> 
> -- 
> You received this message because you are subscribed to the Google Groups
"Puppet Users" group.
> To unsubscribe from this group and stop receiving emails from it, send an
email to puppet-users+unsubscribe@googlegroups.com.
> To post to this group, send email to puppet-users@googlegroups.com.
> Visit this group at http://groups.google.com/group/puppet-users.
> For more options, visit https://groups.google.com/groups/opt_out.
> 
> 
-- 
You received this message because you are subscribed to the Google Groups
"Puppet Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to puppet-users+unsubscribe@googlegroups.com.
To post to this group, send email to puppet-users@googlegroups.com.
Visit this group at http://groups.google.com/group/puppet-users.
For more options, visit https://groups.google.com/groups/opt_out.