Seeing ''SSL_read'' errors being logged by puppetmaster. Anyone know what causes these or how to correct? They''re sporadic, not happening all the time or on all puppet runs. /var/log/puppet/masterhttp.log [2011-07-25 10:00:10] ERROR OpenSSL::SSL::SSLError: SSL_read:: internal error /var/log/messages Jul 25 10:00:10 cmd-box puppet-master[22572]: SSL_read:: internal error Thanks -- You received this message because you are subscribed to the Google Groups "Puppet Users" group. To post to this group, send email to puppet-users@googlegroups.com. To unsubscribe from this group, send email to puppet-users+unsubscribe@googlegroups.com. For more options, visit this group at http://groups.google.com/group/puppet-users?hl=en.
I did find that this error is being generated/caused by 1 host, on that host it appears to be related to the report generation, puppet agent log from host that''s generating the error- puppet-agent[12044]: Could not send report: Error 400 on SERVER: SSL_read:: internal error Still looking for what could be causing this. Thanks On Jul 25, 9:27 am, "c.clifton" <juice...@gmail.com> wrote:> Seeing ''SSL_read'' errors being logged by puppetmaster. Anyone know > what causes these or how to correct? They''re sporadic, not happening > all the time or on all puppet runs. > > /var/log/puppet/masterhttp.log > [2011-07-25 10:00:10] ERROR OpenSSL::SSL::SSLError: SSL_read:: > internal error > > /var/log/messages > Jul 25 10:00:10 cmd-box puppet-master[22572]: SSL_read:: internal > error > > Thanks-- You received this message because you are subscribed to the Google Groups "Puppet Users" group. To post to this group, send email to puppet-users@googlegroups.com. To unsubscribe from this group, send email to puppet-users+unsubscribe@googlegroups.com. For more options, visit this group at http://groups.google.com/group/puppet-users?hl=en.
On Mon, Jul 25, 2011 at 8:44 AM, c.clifton <juice.qr@gmail.com> wrote:> I did find that this error is being generated/caused by 1 host, on > that host it appears to be related to the report generation, > > puppet agent log from host that''s generating the error- > puppet-agent[12044]: Could not send report: Error 400 on SERVER: > SSL_read:: internal error > > Still looking for what could be causing this. >I''m pretty sure I''ve seen this error with corrupt certificates/keys. Can you clean this one and regenerate it to see if that''s the problem?> > Thanks > > > On Jul 25, 9:27 am, "c.clifton" <juice...@gmail.com> wrote: > > Seeing ''SSL_read'' errors being logged by puppetmaster. Anyone know > > what causes these or how to correct? They''re sporadic, not happening > > all the time or on all puppet runs. > > > > /var/log/puppet/masterhttp.log > > [2011-07-25 10:00:10] ERROR OpenSSL::SSL::SSLError: SSL_read:: > > internal error > > > > /var/log/messages > > Jul 25 10:00:10 cmd-box puppet-master[22572]: SSL_read:: internal > > error > > > > Thanks > > -- > You received this message because you are subscribed to the Google Groups > "Puppet Users" group. > To post to this group, send email to puppet-users@googlegroups.com. > To unsubscribe from this group, send email to > puppet-users+unsubscribe@googlegroups.com. > For more options, visit this group at > http://groups.google.com/group/puppet-users?hl=en. > >-- Nigel Kersten Product Manager, Puppet Labs *Join us for **PuppetConf * <http://www.bit.ly/puppetconfsig> Sept 22/23 Portland, Oregon, USA. * * -- You received this message because you are subscribed to the Google Groups "Puppet Users" group. To post to this group, send email to puppet-users@googlegroups.com. To unsubscribe from this group, send email to puppet-users+unsubscribe@googlegroups.com. For more options, visit this group at http://groups.google.com/group/puppet-users?hl=en.
rm -rf''d the ''/var/lib/puppet/ssl'' dir on the client, regenerated/ signed the client cert. Still seeing the SSL_Read error with a a couple of these clients. Thanks On Jul 25, 12:57 pm, Nigel Kersten <ni...@puppetlabs.com> wrote:> On Mon, Jul 25, 2011 at 8:44 AM, c.clifton <juice...@gmail.com> wrote: > > I did find that this error is being generated/caused by 1 host, on > > that host it appears to be related to the report generation, > > > puppet agent log from host that''s generating the error- > > puppet-agent[12044]: Could not send report: Error 400 on SERVER: > > SSL_read:: internal error > > > Still looking for what could be causing this. > > I''m pretty sure I''ve seen this error with corrupt certificates/keys. > > Can you clean this one and regenerate it to see if that''s the problem? > > > > > > > > > > > > > Thanks > > > On Jul 25, 9:27 am, "c.clifton" <juice...@gmail.com> wrote: > > > Seeing ''SSL_read'' errors being logged by puppetmaster. Anyone know > > > what causes these or how to correct? They''re sporadic, not happening > > > all the time or on all puppet runs. > > > > /var/log/puppet/masterhttp.log > > > [2011-07-25 10:00:10] ERROR OpenSSL::SSL::SSLError: SSL_read:: > > > internal error > > > > /var/log/messages > > > Jul 25 10:00:10 cmd-box puppet-master[22572]: SSL_read:: internal > > > error > > > > Thanks > > > -- > > You received this message because you are subscribed to the Google Groups > > "Puppet Users" group. > > To post to this group, send email to puppet-users@googlegroups.com. > > To unsubscribe from this group, send email to > > puppet-users+unsubscribe@googlegroups.com. > > For more options, visit this group at > >http://groups.google.com/group/puppet-users?hl=en. > > -- > Nigel Kersten > Product Manager, Puppet Labs > > *Join us for **PuppetConf * > <http://www.bit.ly/puppetconfsig> > Sept 22/23 Portland, Oregon, USA. > * > *-- You received this message because you are subscribed to the Google Groups "Puppet Users" group. To post to this group, send email to puppet-users@googlegroups.com. To unsubscribe from this group, send email to puppet-users+unsubscribe@googlegroups.com. For more options, visit this group at http://groups.google.com/group/puppet-users?hl=en.
On Tue, Jul 26, 2011 at 2:26 PM, c.clifton <juice.qr@gmail.com> wrote:> rm -rf''d the ''/var/lib/puppet/ssl'' dir on the client, regenerated/ > signed the client cert. Still seeing the SSL_Read error with a a > couple of these clients.Hrm. No particular pattern to the clients that are having errors? Is it always the same ones?> > Thanks > > On Jul 25, 12:57 pm, Nigel Kersten <ni...@puppetlabs.com> wrote: >> On Mon, Jul 25, 2011 at 8:44 AM, c.clifton <juice...@gmail.com> wrote: >> > I did find that this error is being generated/caused by 1 host, on >> > that host it appears to be related to the report generation, >> >> > puppet agent log from host that''s generating the error- >> > puppet-agent[12044]: Could not send report: Error 400 on SERVER: >> > SSL_read:: internal error >> >> > Still looking for what could be causing this. >> >> I''m pretty sure I''ve seen this error with corrupt certificates/keys. >> >> Can you clean this one and regenerate it to see if that''s the problem? >> >> >> >> >> >> >> >> >> >> >> >> > Thanks >> >> > On Jul 25, 9:27 am, "c.clifton" <juice...@gmail.com> wrote: >> > > Seeing ''SSL_read'' errors being logged by puppetmaster. Anyone know >> > > what causes these or how to correct? They''re sporadic, not happening >> > > all the time or on all puppet runs. >> >> > > /var/log/puppet/masterhttp.log >> > > [2011-07-25 10:00:10] ERROR OpenSSL::SSL::SSLError: SSL_read:: >> > > internal error >> >> > > /var/log/messages >> > > Jul 25 10:00:10 cmd-box puppet-master[22572]: SSL_read:: internal >> > > error >> >> > > Thanks >> >> > -- >> > You received this message because you are subscribed to the Google Groups >> > "Puppet Users" group. >> > To post to this group, send email to puppet-users@googlegroups.com. >> > To unsubscribe from this group, send email to >> > puppet-users+unsubscribe@googlegroups.com. >> > For more options, visit this group at >> >http://groups.google.com/group/puppet-users?hl=en. >> >> -- >> Nigel Kersten >> Product Manager, Puppet Labs >> >> *Join us for **PuppetConf * >> <http://www.bit.ly/puppetconfsig> >> Sept 22/23 Portland, Oregon, USA. >> * >> * > > -- > You received this message because you are subscribed to the Google Groups "Puppet Users" group. > To post to this group, send email to puppet-users@googlegroups.com. > To unsubscribe from this group, send email to puppet-users+unsubscribe@googlegroups.com. > For more options, visit this group at http://groups.google.com/group/puppet-users?hl=en. > >-- Nigel Kersten Product Manager, Puppet Labs Join us for PuppetConf <http://www.bit.ly/puppetconfsig> Sept 22/23 Portland, Oregon, USA. -- You received this message because you are subscribed to the Google Groups "Puppet Users" group. To post to this group, send email to puppet-users@googlegroups.com. To unsubscribe from this group, send email to puppet-users+unsubscribe@googlegroups.com. For more options, visit this group at http://groups.google.com/group/puppet-users?hl=en.
One thing I''m seeing is differing versions of openssl. On the clients that are generating these ssl errors, openssl-0.9.8e-12.el5_5.7 On the clients that don''t seem to have the ssl errors, openssl-0.9.8e-12.el5_4.6 The puppet master server has openssl-0.9.8e-12.el5_5.7, which doesn''t seem to make sense, I would expect the boxes that have the different version of openssl to have errors, but they don''t. The ssl error seems to be related to the reporting somehow. We have the puppet dashboard set up, and the clients report to that. (puppet dashboard is run by webrick, and is same box as puppet master) On Jul 27, 10:20 pm, Nigel Kersten <ni...@puppetlabs.com> wrote:> On Tue, Jul 26, 2011 at 2:26 PM, c.clifton <juice...@gmail.com> wrote: > > rm -rf''d the ''/var/lib/puppet/ssl'' dir on the client, regenerated/ > > signed the client cert. Still seeing the SSL_Read error with a a > > couple of these clients. > > Hrm. No particular pattern to the clients that are having errors? Is > it always the same ones? > > > > > > > > > > > > > Thanks > > > On Jul 25, 12:57 pm, Nigel Kersten <ni...@puppetlabs.com> wrote: > >> On Mon, Jul 25, 2011 at 8:44 AM, c.clifton <juice...@gmail.com> wrote: > >> > I did find that this error is being generated/caused by 1 host, on > >> > that host it appears to be related to the report generation, > > >> > puppet agent log from host that''s generating the error- > >> > puppet-agent[12044]: Could not send report: Error 400 on SERVER: > >> > SSL_read:: internal error > > >> > Still looking for what could be causing this. > > >> I''m pretty sure I''ve seen this error with corrupt certificates/keys. > > >> Can you clean this one and regenerate it to see if that''s the problem? > > >> > Thanks > > >> > On Jul 25, 9:27 am, "c.clifton" <juice...@gmail.com> wrote: > >> > > Seeing ''SSL_read'' errors being logged by puppetmaster. Anyone know > >> > > what causes these or how to correct? They''re sporadic, not happening > >> > > all the time or on all puppet runs. > > >> > > /var/log/puppet/masterhttp.log > >> > > [2011-07-25 10:00:10] ERROR OpenSSL::SSL::SSLError: SSL_read:: > >> > > internal error > > >> > > /var/log/messages > >> > > Jul 25 10:00:10 cmd-box puppet-master[22572]: SSL_read:: internal > >> > > error > > >> > > Thanks > > >> > -- > >> > You received this message because you are subscribed to the Google Groups > >> > "Puppet Users" group. > >> > To post to this group, send email to puppet-users@googlegroups.com. > >> > To unsubscribe from this group, send email to > >> > puppet-users+unsubscribe@googlegroups.com. > >> > For more options, visit this group at > >> >http://groups.google.com/group/puppet-users?hl=en. > > >> -- > >> Nigel Kersten > >> Product Manager, Puppet Labs > > >> *Join us for **PuppetConf * > >> <http://www.bit.ly/puppetconfsig> > >> Sept 22/23 Portland, Oregon, USA. > >> * > >> * > > > -- > > You received this message because you are subscribed to the Google Groups "Puppet Users" group. > > To post to this group, send email to puppet-users@googlegroups.com. > > To unsubscribe from this group, send email to puppet-users+unsubscribe@googlegroups.com. > > For more options, visit this group athttp://groups.google.com/group/puppet-users?hl=en. > > -- > Nigel Kersten > Product Manager, Puppet Labs > > Join us for PuppetConf > <http://www.bit.ly/puppetconfsig> > Sept 22/23 Portland, Oregon, USA.-- You received this message because you are subscribed to the Google Groups "Puppet Users" group. To post to this group, send email to puppet-users@googlegroups.com. To unsubscribe from this group, send email to puppet-users+unsubscribe@googlegroups.com. For more options, visit this group at http://groups.google.com/group/puppet-users?hl=en.
Another minor oddity, our puppet clients are configured to sync every 30 mins, however the ''puppet-agent[32709]: Could not send report: Error 400 on SERVER: SSL_read:: internal error'' only occurs at the top of the hour, never at half past. Jul 26 19:00:07 host2 puppet-agent[3634]: Could not send report: Error 400 on SERVER: SSL_read:: internal error Jul 26 21:00:07 host2 puppet-agent[5458]: Could not send report: Error 400 on SERVER: SSL_read:: internal error Jul 26 22:00:07 host2 puppet-agent[6310]: Could not send report: Error 400 on SERVER: SSL_read:: internal error Jul 27 03:00:07 host2 puppet-agent[11913]: Could not send report: Error 400 on SERVER: SSL_read:: internal error Jul 27 15:00:07 host2 puppet-agent[22100]: Could not send report: Error 400 on SERVER: SSL_read:: internal error Jul 27 18:00:07 host2 puppet-agent[24740]: Could not send report: Error 400 on SERVER: SSL_read:: internal error Jul 28 11:00:07 host2 puppet-agent[7365]: Could not send report: Error 400 on SERVER: SSL_read:: internal error Jul 28 13:00:07 host2 puppet-agent[32709]: Could not send report: Error 400 on SERVER: SSL_read:: internal error On Jul 28, 12:05 pm, "c.clifton" <juice...@gmail.com> wrote:> One thing I''m seeing is differing versions of openssl. > > On the clients that are generating these ssl errors, > > openssl-0.9.8e-12.el5_5.7 > > On the clients that don''t seem to have the ssl errors, > > openssl-0.9.8e-12.el5_4.6 > > The puppet master server has openssl-0.9.8e-12.el5_5.7, which doesn''t > seem to make sense, I would expect the boxes that have the different > version of openssl to have errors, but they don''t. > > The ssl error seems to be related to the reporting somehow. We have > the puppet dashboard set up, and the clients report to that. (puppet > dashboard is run by webrick, and is same box as puppet master) > > On Jul 27, 10:20 pm, Nigel Kersten <ni...@puppetlabs.com> wrote: > > > > > > > > > On Tue, Jul 26, 2011 at 2:26 PM, c.clifton <juice...@gmail.com> wrote: > > > rm -rf''d the ''/var/lib/puppet/ssl'' dir on the client, regenerated/ > > > signed the client cert. Still seeing the SSL_Read error with a a > > > couple of these clients. > > > Hrm. No particular pattern to the clients that are having errors? Is > > it always the same ones? > > > > Thanks > > > > On Jul 25, 12:57 pm, Nigel Kersten <ni...@puppetlabs.com> wrote: > > >> On Mon, Jul 25, 2011 at 8:44 AM, c.clifton <juice...@gmail.com> wrote: > > >> > I did find that this error is being generated/caused by 1 host, on > > >> > that host it appears to be related to the report generation, > > > >> > puppet agent log from host that''s generating the error- > > >> > puppet-agent[12044]: Could not send report: Error 400 on SERVER: > > >> > SSL_read:: internal error > > > >> > Still looking for what could be causing this. > > > >> I''m pretty sure I''ve seen this error with corrupt certificates/keys. > > > >> Can you clean this one and regenerate it to see if that''s the problem? > > > >> > Thanks > > > >> > On Jul 25, 9:27 am, "c.clifton" <juice...@gmail.com> wrote: > > >> > > Seeing ''SSL_read'' errors being logged by puppetmaster. Anyone know > > >> > > what causes these or how to correct? They''re sporadic, not happening > > >> > > all the time or on all puppet runs. > > > >> > > /var/log/puppet/masterhttp.log > > >> > > [2011-07-25 10:00:10] ERROR OpenSSL::SSL::SSLError: SSL_read:: > > >> > > internal error > > > >> > > /var/log/messages > > >> > > Jul 25 10:00:10 cmd-box puppet-master[22572]: SSL_read:: internal > > >> > > error > > > >> > > Thanks > > > >> > -- > > >> > You received this message because you are subscribed to the Google Groups > > >> > "Puppet Users" group. > > >> > To post to this group, send email to puppet-users@googlegroups.com. > > >> > To unsubscribe from this group, send email to > > >> > puppet-users+unsubscribe@googlegroups.com. > > >> > For more options, visit this group at > > >> >http://groups.google.com/group/puppet-users?hl=en. > > > >> -- > > >> Nigel Kersten > > >> Product Manager, Puppet Labs > > > >> *Join us for **PuppetConf * > > >> <http://www.bit.ly/puppetconfsig> > > >> Sept 22/23 Portland, Oregon, USA. > > >> * > > >> * > > > > -- > > > You received this message because you are subscribed to the Google Groups "Puppet Users" group. > > > To post to this group, send email to puppet-users@googlegroups.com. > > > To unsubscribe from this group, send email to puppet-users+unsubscribe@googlegroups.com. > > > For more options, visit this group athttp://groups.google.com/group/puppet-users?hl=en. > > > -- > > Nigel Kersten > > Product Manager, Puppet Labs > > > Join us for PuppetConf > > <http://www.bit.ly/puppetconfsig> > > Sept 22/23 Portland, Oregon, USA.-- You received this message because you are subscribed to the Google Groups "Puppet Users" group. To post to this group, send email to puppet-users@googlegroups.com. To unsubscribe from this group, send email to puppet-users+unsubscribe@googlegroups.com. For more options, visit this group at http://groups.google.com/group/puppet-users?hl=en.