Hi all, I''m in the procedure of migrating my old puppet server (puppet-2.6.14-1.el5) with mongrel to a new one (puppet-2.7.14-1.el6.noarch) with passenger. I''m facing a really strange behaviour with the catalog compilation time. I''ve 3 servers: 1.-) Centos 5.8 puppet-2.6.14-1.el5 + rubygem-mongrel-1.0.1-6.el5 Client: Compiled catalog for td055.pic.es in environment production in 4.25 seconds Server: time puppet master --verbose --compile td055.pic.es [...] real 0m14.891s user 0m11.263s sys 0m1.793s puppet master --verbose --compile td055.pic.es|wc -l 22930 2.-) SL 6.1 puppet-2.7.11-2.el6.noarch + passenger-3.0.11 Client: Compiled catalog for td055.pic.es in environment production in 76.99 seconds Server: time puppet master --verbose --compile td055.pic.es [...] real 1m10.661s user 1m5.739s sys 0m4.903s puppet master --verbose --compile td055.pic.es|wc -l 22933 3.-) SL 6.1 puppet-2.7.14-1.el6.noarch + passenger-3.0.12 Client: err: Could not retrieve catalog from remote server: execution expired Server: real 2m13.377s user 2m7.615s sys 0m5.728s puppet master --verbose --compile td055.pic.es|wc -l 23008 * Obviously I''m trying to compile the same code in all cases ** I''ve only 8 warnings about dyanmic lookup. As you can see, in last version it gets a timeout because it takes too long to compile. So, at this point, I''m wondering what could be causing this behaviour. Why my code is being compiled fast in 2.6 but not in 2.7? What language programing considerations do I have to take into account when migrating? TIA, Arnau -- You received this message because you are subscribed to the Google Groups "Puppet Users" group. To post to this group, send email to puppet-users@googlegroups.com. To unsubscribe from this group, send email to puppet-users+unsubscribe@googlegroups.com. For more options, visit this group at http://groups.google.com/group/puppet-users?hl=en.
On Tue, 8 May 2012 13:07:04 +0200 Arnau Bria wrote: I should add more info on servers and "manifests":> 1.-) Centos 5.8 puppet-2.6.14-1.el5 + rubygem-mongrel-1.0.1-6.el5 > > Client: > Compiled catalog for td055.pic.es in environment production in 4.25 > seconds Server: > time puppet master --verbose --compile td055.pic.es > [...] > real 0m14.891s > user 0m11.263s > sys 0m1.793s > > puppet master --verbose --compile td055.pic.es|wc -l > 229304 x Intel(R) Xeon(R) CPU 5160 @ 3.00GHz & 8GB of RAM> 2.-) SL 6.1 puppet-2.7.11-2.el6.noarch + passenger-3.0.11 > > Client: > Compiled catalog for td055.pic.es in environment production in 76.99 > seconds Server: > time puppet master --verbose --compile td055.pic.es > [...] > real 1m10.661s > user 1m5.739s > sys 0m4.903s > puppet master --verbose --compile td055.pic.es|wc -l > 229334 x Intel(R) Xeon(R) CPU 5160 @ 3.00GHz & 8GB of RAM> 3.-) SL 6.1 puppet-2.7.14-1.el6.noarch + passenger-3.0.12 > > Client: > err: Could not retrieve catalog from remote server: execution expired > Server: > real 2m13.377s > user 2m7.615s > sys 0m5.728s > > puppet master --verbose --compile td055.pic.es|wc -l > 230088 x Quad-Core AMD Opteron(tm) Processor 2356 & 16 GB of RAM My code has about 40 classes. I do use Stages (not a lot, for few repos) and I have many interclass dependecy (Service require file which require package). Puppet is installed via yum using puppetlabs repo. First server is shared by ~600 hosts, second one shared by ~200 nodes and last one is only used by this test node. I don''t know If I could more info... I''m quiete lost. Cheers, Arnau -- You received this message because you are subscribed to the Google Groups "Puppet Users" group. To post to this group, send email to puppet-users@googlegroups.com. To unsubscribe from this group, send email to puppet-users+unsubscribe@googlegroups.com. For more options, visit this group at http://groups.google.com/group/puppet-users?hl=en.
Derek J. Balling
2012-May-08 18:15 UTC
Re: [Puppet Users] Compile catalog time: 2.6 vs 2.7.X
FWIW, we are experiencing exactly the same thing in 2.7 that you are. We used to average 6-9 seconds for compilation time and now it''s anywhere from 15 to 250 to "timed out". D On May 8, 2012, at 7:07 AM, Arnau Bria wrote:> Compiled catalog for td055.pic.es in environment production in 4.25 seconds > Compiled catalog for td055.pic.es in environment production in 76.99 seconds > err: Could not retrieve catalog from remote server: execution expired> Why my code is being compiled fast in 2.6 but not in 2.7? What language > programing considerations do I have to take into account when migrating?-- You received this message because you are subscribed to the Google Groups "Puppet Users" group. To post to this group, send email to puppet-users@googlegroups.com. To unsubscribe from this group, send email to puppet-users+unsubscribe@googlegroups.com. For more options, visit this group at http://groups.google.com/group/puppet-users?hl=en.
Arnau, is it possible for you to send me a copy of your manifests? A colleague and I were recently trying to find out where the slowness in 2.7 really was. We weren''t able to pinpoint it as we had to move on to something else, but we were not able to generate a catalog that had compile time differences of this magnitude. Seeing a catalog causing this degree of slowness would greatly help us pin point what''s going on. I understand if this isn''t possible, and if so it would help if you could give us a high level overview of your manifests such as number of classes, resources per class, use of conditionals, and use of functions. -- Carl Caum Puppet Labs On Tuesday, May 8, 2012 at 11:15 AM, Derek J. Balling wrote:> FWIW, we are experiencing exactly the same thing in 2.7 that you are. We used to average 6-9 seconds for compilation time and now it''s anywhere from 15 to 250 to "timed out". > > D > > > On May 8, 2012, at 7:07 AM, Arnau Bria wrote: > > Compiled catalog for td055.pic.es (http://td055.pic.es) in environment production in 4.25 seconds > > Compiled catalog for td055.pic.es (http://td055.pic.es) in environment production in 76.99 seconds > > err: Could not retrieve catalog from remote server: execution expired > > > > > > Why my code is being compiled fast in 2.6 but not in 2.7? What language > > programing considerations do I have to take into account when migrating? > > > > > -- > You received this message because you are subscribed to the Google Groups "Puppet Users" group. > To post to this group, send email to puppet-users@googlegroups.com (mailto:puppet-users@googlegroups.com). > To unsubscribe from this group, send email to puppet-users+unsubscribe@googlegroups.com (mailto:puppet-users+unsubscribe@googlegroups.com). > For more options, visit this group at http://groups.google.com/group/puppet-users?hl=en. > >-- You received this message because you are subscribed to the Google Groups "Puppet Users" group. To post to this group, send email to puppet-users@googlegroups.com. To unsubscribe from this group, send email to puppet-users+unsubscribe@googlegroups.com. For more options, visit this group at http://groups.google.com/group/puppet-users?hl=en.
Further, it would help to know how many different environments you''re using On May 8, 3:24 pm, Carl Caum <c...@puppetlabs.com> wrote:> Arnau, is it possible for you to send me a copy of your manifests? A colleague and I were recently trying to find out where the slowness in 2.7 really was. We weren''t able to pinpoint it as we had to move on to something else, but we were not able to generate a catalog that had compile time differences of this magnitude. Seeing a catalog causing this degree of slowness would greatly help us pin point what''s going on. > > I understand if this isn''t possible, and if so it would help if you could give us a high level overview of your manifests such as number of classes, resources per class, use of conditionals, and use of functions. > > -- Carl Caum > Puppet Labs > > > > > > > > On Tuesday, May 8, 2012 at 11:15 AM, Derek J. Balling wrote: > > FWIW, we are experiencing exactly the same thing in 2.7 that you are. We used to average 6-9 seconds for compilation time and now it''s anywhere from 15 to 250 to "timed out". > > > D > > > On May 8, 2012, at 7:07 AM, Arnau Bria wrote: > > > Compiled catalog for td055.pic.es (http://td055.pic.es) in environment production in 4.25 seconds > > > Compiled catalog for td055.pic.es (http://td055.pic.es) in environment production in 76.99 seconds > > > err: Could not retrieve catalog from remote server: execution expired > > > > Why my code is being compiled fast in 2.6 but not in 2.7? What language > > > programing considerations do I have to take into account when migrating? > > > -- > > You received this message because you are subscribed to the Google Groups "Puppet Users" group. > > To post to this group, send email to puppet-users@googlegroups.com (mailto:puppet-users@googlegroups.com). > > To unsubscribe from this group, send email to puppet-users+unsubscribe@googlegroups.com (mailto:puppet-users+unsubscribe@googlegroups.com). > > For more options, visit this group athttp://groups.google.com/group/puppet-users?hl=en.-- You received this message because you are subscribed to the Google Groups "Puppet Users" group. To post to this group, send email to puppet-users@googlegroups.com. To unsubscribe from this group, send email to puppet-users+unsubscribe@googlegroups.com. For more options, visit this group at http://groups.google.com/group/puppet-users?hl=en.