Sukh Khehra
2009-Oct-24 16:59 UTC
[Puppet Users] intermittent fileserver module not found issues.
I just upgraded our puppetmaster servers from 0.24.4 to 0.25.1rc2 and configured them to use Passenger. Here''s what I am running now: ruby-irb-1.8.5-5.el5_1.1 httpd-2.2.3-11.el5_1.centos.3 ruby-devel-1.8.5-5.el5_1.1 ruby-augeas-0.3.0-1.el5 httpd-devel-2.2.3-11.el5_1.centos.3 ruby-1.8.5-5.el5_1.1 ruby-libs-1.8.5-5.el5_1.1 puppet-0.25.1rc2-1 ruby-shadow-1.4.1-6 rubygems-0.9.4-1.el5 httpd-devel-2.2.3-11.el5_1.centos.3 augeas-libs-0.5.3-1 puppet-server-0.25.1rc2-1 I am using ruby-enterprise-1.8.7-20090928 with passenger apache module version 2.2.2 (2.2.5 did not work for me). Things seem to work ok for the most part. Intermittently, however, I am seeing these errors log on the master. The same clients don''t cause this at other times. Anyone ever seen this? I''d appreciate the help. My apache puppetmaster.conf, config.ru, and a puppet manifest snippet that I think is triggering this is pasted below. ############ start log entries ############ 2009-10-24T16:41:19+00:00 <mypuppetserver> puppetmasterd[2874]: Using cached node for <mypuppetclient> 2009-10-24T16:41:19+00:00 <mypuppetserver> puppetmasterd[2874]: Fileserver module ''hyperic'' not mounted 2009-10-24T16:41:19+00:00 <mypuppetserver> puppetmasterd[30546]: Allowing authenticated client <mypuppetclient>(192.168.16.46) access to fileserver.describe 2009-10-24T16:41:19+00:00 <mypuppetserver> puppetmasterd[30546]: Using cached node for <mypuppetclient> 2009-10-24T16:41:19+00:00 <mypuppetserver> puppetmasterd[30546]: (mount[hyperic]) Describing /hyperic/plugins/mysql_stats-plugin.jar for <mypuppetclient> -- 2009-10-24T16:41:19+00:00 <mypuppetserver> puppetmasterd[2874]: Using cached node for <mypuppetclient> 2009-10-24T16:41:19+00:00 <mypuppetserver> puppetmasterd[2874]: Fileserver module ''hyperic'' not mounted 2009-10-24T16:41:19+00:00 <mypuppetserver> puppetmasterd[2874]: Handling request: POST /RPC2 2009-10-24T16:41:19+00:00 <mypuppetserver> puppetmasterd[2259]: (//puppet/Service[puppet]/ensure) ensure changed ''stopped'' to ''running'' 2009-10-24T16:41:19+00:00 <mypuppetserver> puppetmasterd[2259]: Handling request: POST /RPC2 -- 2009-10-24T16:41:19+00:00 <mypuppetserver> puppetmasterd[2874]: Using cached node for <mypuppetclient> 2009-10-24T16:41:19+00:00 <mypuppetserver> puppetmasterd[2874]: Fileserver module ''hyperic'' not mounted 2009-10-24T16:41:19+00:00 <mypuppetserver> puppetmasterd[2259]: Allowing authenticated client <mypuppetclient>(192.168.16.46) access to fileserver.describe 2009-10-24T16:41:19+00:00 <mypuppetserver> puppetmasterd[2259]: Using cached node for <mypuppetclient> 2009-10-24T16:41:19+00:00 <mypuppetserver> puppetmasterd[2259]: (mount[hyperic]) Describing /hyperic/plugins/pps-filterstatus-plugin.xml for <mypuppetclient> -- 2009-10-24T16:41:19+00:00 <mypuppetserver> puppetmasterd[2874]: Using cached node for <mypuppetclient> 2009-10-24T16:41:19+00:00 <mypuppetserver> puppetmasterd[2874]: Fileserver module ''ssh'' not mounted 2009-10-24T16:41:19+00:00 <mypuppetserver> puppetmasterd[2874]: Handling request: POST /RPC2 2009-10-24T16:41:19+00:00 <mypuppetserver> puppetmasterd[2874]: Allowing authenticated client <mypuppetclient>(192.168.16.46) access to puppetreports.report 2009-10-24T16:41:19+00:00 <mypuppetserver> puppetmasterd[2874]: Processing reports store, rrdgraph, log for <mypuppetclient> ############ end log entries ############ ############ puppetmaster.conf ############ LoadModule passenger_module /opt/ruby-enterprise-1.8.7-20090928/lib/ruby/gems/1.8/gems/passenger-2.2 .2/ext/apache2/mod_passenger.so PassengerRoot /opt/ruby-enterprise-1.8.7-20090928/lib/ruby/gems/1.8/gems/passenger-2.2 .2 PassengerRuby /opt/ruby-enterprise-1.8.7-20090928/bin/ruby ## you probably want to tune these settings PassengerHighPerformance on PassengerMaxPoolSize 15 PassengerPoolIdleTime 600 ## PassengerMaxRequests 1000 PassengerStatThrottleRate 120 RackAutoDetect Off RailsAutoDetect Off Listen 8140 <VirtualHost *:8140> SSLEngine on SSLProtocol -ALL +SSLv3 +TLSv1 SSLCipherSuite ALL:!ADH:RC4+RSA:+HIGH:+MEDIUM:-LOW:-SSLv2:-EXP SSLCertificateFile /var/lib/puppet/ssl/certs/<mypuppetserver>.pem SSLCertificateKeyFile /var/lib/puppet/ssl/private_keys/<mypuppetserver>.pem SSLCertificateChainFile /var/lib/puppet/ssl/ca/ca_crt.pem SSLCACertificateFile /var/lib/puppet/ssl/ca/ca_crt.pem # If Apache complains about invalid signatures on the CRL, you can try disabling # CRL checking by commenting the next line, but this is not recommended. # SSLCARevocationFile /var/lib/puppet/ssl/ca/ca_crl.pem SSLVerifyClient optional SSLVerifyDepth 1 SSLOptions +StdEnvVars DocumentRoot /usr/share/puppet/rack/puppetmasterd/public/ RackBaseURI / <Directory /usr/share/puppet/rack/puppetmasterd/> Options None AllowOverride None Order allow,deny allow from all </Directory> </VirtualHost> ############ end puppetmaster.conf ################ ############ start config.ru ############ # a config.ru, for use with every rack-compatible webserver. # SSL needs to be handled outside this, though. # if puppet is not in your RUBYLIB: $:.unshift(''/usr/lib/ruby/site_ruby/1.8'') $0 = "puppetmasterd" require ''puppet'' # if you want debugging: ARGV << "--debug" ARGV << "--rack" require ''puppet/application/puppetmasterd'' # we''re usually running inside a Rack::Builder.new {} block, # therefore we need to call run *here*. run Puppet::Application[:puppetmasterd].run ############## end config.ru ###################### ############## start puppet manifest snippet ################### class hyperic::server { file { # alert email templates "hq-html_email.gsp": path => "/opt/hyperic/server-current/hq-engine/server/default/deploy/hq.ear/aler tTemplates/html_email.gsp", ensure => present, owner => "hqserver", group => "hqserver", mode => 0664, source => "puppet://$servername/hyperic/alertTemplates/html_email.gsp"; } } ############## end puppet manifest snippet ##################### --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "Puppet Users" group. To post to this group, send email to puppet-users@googlegroups.com To unsubscribe from this group, send email to puppet-users+unsubscribe@googlegroups.com For more options, visit this group at http://groups.google.com/group/puppet-users?hl=en -~----------~----~----~----~------~----~------~--~---
Luke Kanies
2009-Oct-26 05:11 UTC
[Puppet Users] Re: intermittent fileserver module not found issues.
On Oct 24, 2009, at 9:59 AM, Sukh Khehra wrote: [...]> Things seem to work ok for the most part. Intermittently, however, I > am > seeing these errors log on the master. The same clients don''t cause > this > at other times. Anyone ever seen this? I''d appreciate the help. > > My apache puppetmaster.conf, config.ru, and a puppet manifest snippet > that I think is triggering this is pasted below.While I appreciate the thoroughness, can you be a bit more succinct in what exactly is broken? Am I right in reading that the hyperic fileserver module is sometimes not found? Is it only for some clients, only at certain times, etc? -- Take the utmost trouble to find the right thing to say, and then say it with the utmost levity. -- George Bernard Shaw --------------------------------------------------------------------- Luke Kanies | http://reductivelabs.com | http://madstop.com --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "Puppet Users" group. To post to this group, send email to puppet-users@googlegroups.com To unsubscribe from this group, send email to puppet-users+unsubscribe@googlegroups.com For more options, visit this group at http://groups.google.com/group/puppet-users?hl=en -~----------~----~----~----~------~----~------~--~---
Sukh Khehra
2009-Oct-26 05:57 UTC
[Puppet Users] Re: intermittent fileserver module not found issues.
Basically, what''s broken is that on some runs, puppet client fails to process our file type resource declarations correctly. When this happens, puppetmaster logs the errors I provided earlier. Puppet clients log this:(Using my sendmail module as an example on this one.) 2009-10-25T12:02:53+00:00 <mypuppetclient> puppetd[27478]: (//sendmail::relay/File[sysconfig-sendmail]/source) Could not describe /sendmail/<mypuppetclient>/sysconfig-sendmail: Fileserver module ''sendmail'' not mounted 2009-10-25T12:02:53+00:00 <mypuppetclient> puppetd[27478]: (//sendmail::relay/File[sysconfig-sendmail]/source) Could not describe /sendmail/sysconfig-sendmail: Fileserver module ''sendmail'' not mounted 2009-10-25T12:02:53+00:00 <mypuppetclient> puppetd[27478]: (//sendmail::relay/File[sysconfig-sendmail]/ensure) No specified sources exist 2009-10-25T12:02:53+00:00 <mypuppetclient> puppetd[27478]: (//sendmail::relay/File[sysconfig-sendmail]/ensure) No specified sources exist 2009-10-25T12:02:53+00:00 <mypuppetclient> puppetd[27478]: (//sendmail::relay/File[sysconfig-sendmail]/source) No specified sources exist Again, this only happens intermittently. On other puppet runs this error is not logged. I failed to mention earlier that all our puppet clients are still on 0.24.4. I just updated a couple of clients to 0.25.1rc2 as well to see if it helps. I haven''t seen the issue on those since but need to watch the logs some more to be sure. If it does, guess we can rush through our client upgrades sooner than we had planned unless someone has any ideas on what to look at on the master/passenger side. Also, I''m not sure if its relevant but we''re not using an auth.conf file in our setup yet. -----Original Message----- From: puppet-users@googlegroups.com [mailto:puppet-users@googlegroups.com] On Behalf Of Luke Kanies Sent: Sunday, October 25, 2009 10:11 PM To: puppet-users@googlegroups.com Subject: [Puppet Users] Re: intermittent fileserver module not found issues. On Oct 24, 2009, at 9:59 AM, Sukh Khehra wrote: [...]> Things seem to work ok for the most part. Intermittently, however, I > am > seeing these errors log on the master. The same clients don''t cause > this > at other times. Anyone ever seen this? I''d appreciate the help. > > My apache puppetmaster.conf, config.ru, and a puppet manifest snippet > that I think is triggering this is pasted below.While I appreciate the thoroughness, can you be a bit more succinct in what exactly is broken? Am I right in reading that the hyperic fileserver module is sometimes not found? Is it only for some clients, only at certain times, etc? -- Take the utmost trouble to find the right thing to say, and then say it with the utmost levity. -- George Bernard Shaw --------------------------------------------------------------------- Luke Kanies | http://reductivelabs.com | http://madstop.com --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "Puppet Users" group. To post to this group, send email to puppet-users@googlegroups.com To unsubscribe from this group, send email to puppet-users+unsubscribe@googlegroups.com For more options, visit this group at http://groups.google.com/group/puppet-users?hl=en -~----------~----~----~----~------~----~------~--~---