Hi guys, Which puppet operations should i try to avoid? I know that probably the most time consuming operations are file copies, but, is there something from the code point of view that I should try to avoid? I''ve seen for example, that on Solaris, puppet will execute pkginfo quite alot of times - sometimes with a package name, some other times without (pkginfo -l), thats extremely time consuming (cpu jumps to 100%)... Currently it looks like that the Linux client behavior is much faster than a Solaris one (even on a "fast" Solaris machines). Thanks! Ohad _______________________________________________ Puppet-users mailing list Puppet-users@madstop.com https://mail.madstop.com/mailman/listinfo/puppet-users
On Sep 8, 2007, at 1:28 AM, Ohad Levy wrote:> Hi guys, > > Which puppet operations should i try to avoid? > I know that probably the most time consuming operations are file > copies, but, is there something from the code point of view that I > should try to avoid?Yum is painfully slow, but then, yum is slow with or without Puppet. Package management when using ''latest'' does not yet use prefetching, which means a command gets run for every package.> I''ve seen for example, that on Solaris, puppet will execute pkginfo > quite alot of times - sometimes with a package name, some other > times without (pkginfo -l), thats extremely time consuming (cpu > jumps to 100%)...This should be much better in 0.23 releases, since prefetch has been enabled for all package types (I think). If pkginfo is still being called for every package, that would be a bug, and should be pretty darn easy to fix, too.> Currently it looks like that the Linux client behavior is much > faster than a Solaris one (even on a "fast" Solaris machines).Interesting. -- There is nothing worse than aggressive stupidity. -- Johann Wolfgang von Goethe --------------------------------------------------------------------- Luke Kanies | http://reductivelabs.com | http://madstop.com
> > > > > I''ve seen for example, that on Solaris, puppet will execute pkginfo > > quite alot of times - sometimes with a package name, some other > > times without (pkginfo -l), thats extremely time consuming (cpu > > jumps to 100%)... > > This should be much better in 0.23 releases, since prefetch has been > enabled for all package types (I think). If pkginfo is still being > called for every package, that would be a bug, and should be pretty > darn easy to fix, too.I''ve just upgrade from 22.x to 23 and it actully much worse! first of all, I get a new error message: warning: Found multiple default providers for service: init, base; using init notice: Starting configuration run debug: Prefetching sun resources for package debug: package provider sun: Executing ''/usr/bin/pkginfo -l'' Broken Pipe err: Could not prefetch package provider ''sun'': Could not find VSTOCK debug: Prefetching blastwave resources for package debug: package provider blastwave: Executing ''/opt/csw/bin/pkg-get -c'' as you can see, both pkginfo and pkg-get are being executed without a package name - damn slow... :( just by moving to 23 i''ve increased my runtime from 67 seconds to 107 :( Thanks, Ohad> Currently it looks like that the Linux client behavior is much > > faster than a Solaris one (even on a "fast" Solaris machines). > > Interesting. > > -- > There is nothing worse than aggressive stupidity. > -- Johann Wolfgang von Goethe > --------------------------------------------------------------------- > Luke Kanies | http://reductivelabs.com | http://madstop.com > > > _______________________________________________ > Puppet-users mailing list > Puppet-users@madstop.com > https://mail.madstop.com/mailman/listinfo/puppet-users >_______________________________________________ Puppet-users mailing list Puppet-users@madstop.com https://mail.madstop.com/mailman/listinfo/puppet-users
On Sep 10, 2007, at 4:29 AM, Ohad Levy wrote:> I''ve just upgrade from 22.x to 23 and it actully much worse! > > first of all, I get a new error message: > warning: Found multiple default providers for service: init, base; > using init > notice: Starting configuration run > debug: Prefetching sun resources for package > debug: package provider sun: Executing ''/usr/bin/pkginfo -l'' > Broken Pipe > err: Could not prefetch package provider ''sun'': Could not find VSTOCK > debug: Prefetching blastwave resources for package > debug: package provider blastwave: Executing ''/opt/csw/bin/pkg-get -c'' > > as you can see, both pkginfo and pkg-get are being executed without > a package name - damn slow... :(Well, you have to execute at least one of them, and by default it definitely shouldn''t execute both of them. However, if you have packages in your configuration with each provider, then Puppet will have to run pkg-info for both of them. Are you still getting per-package pkg-info runs? I''d think even two pkg-info commands would be faster than one for every package.> just by moving to 23 i''ve increased my runtime from 67 seconds to > 107 :(-- I don''t want any yes-men around me. I want everybody to tell me the truth even if it costs them their jobs. -- Samuel Goldwyn --------------------------------------------------------------------- Luke Kanies | http://reductivelabs.com | http://madstop.com