Puppet users - Jan 2013 - How to increase performance of managed directories?

I have several directories that are installed and managed with puppet.  I 
am finding the majority of the time of the puppet run is spent validating 
the directory.  Are there any tricks to improve the performance of managed 
directories? Or a better way than simple file resource with  ensure => 
directory and recurse => true?

  file {''/xyz/directory'' :
    ensure => directory,
    recurse => true,
    source => "puppet:///modules/mymod/directory",
  }

-- 
You received this message because you are subscribed to the Google Groups
"Puppet Users" group.
To view this discussion on the web visit
https://groups.google.com/d/msg/puppet-users/-/TuE-ygecAngJ.
To post to this group, send email to puppet-users@googlegroups.com.
To unsubscribe from this group, send email to
puppet-users+unsubscribe@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/puppet-users?hl=en.

Smaller directories? :)

But seriously Puppet sucks at distributing large directories (you should see
posts to the list going back years on this topic). If you look at the file type
resource docs (http://docs.puppetlabs.com/references/stable/type.html#file)you
can see you can change the checksum used, ignore files (unsure of speed
improvements there), recurselimit to limit the depth of recursion and possibly
the mtime attribute.

Alternatively, if running *nix you could try rsync in an exec. 

Your mileage may vary,

Den

On 10/01/2013, at 12:01, Schofield <dbschofield@gmail.com> wrote:
> I have several directories that are installed and managed with puppet.  I
am finding the majority of the time of the puppet run is spent validating the
directory.  Are there any tricks to improve the performance of managed
directories? Or a better way than simple file resource with  ensure =>
directory and recurse => true?
> 
>   file {''/xyz/directory'' :
>     ensure => directory,
>     recurse => true,
>     source => "puppet:///modules/mymod/directory",
>   }
> -- 
> You received this message because you are subscribed to the Google Groups
"Puppet Users" group.
> To view this discussion on the web visit
https://groups.google.com/d/msg/puppet-users/-/TuE-ygecAngJ.
> To post to this group, send email to puppet-users@googlegroups.com.
> To unsubscribe from this group, send email to
puppet-users+unsubscribe@googlegroups.com.
> For more options, visit this group at
http://groups.google.com/group/puppet-users?hl=en.
-- 
You received this message because you are subscribed to the Google Groups
"Puppet Users" group.
To post to this group, send email to puppet-users@googlegroups.com.
To unsubscribe from this group, send email to
puppet-users+unsubscribe@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/puppet-users?hl=en.

I used to manage a few directories recursively and it was very slow and
cumbersome.
I just manage the directories themselves if i need to and the files
individually.
It makes it a bit more complex initially but you get fine grained control
over things and it''s so much faster.

If you really need to manage a directory recursively and there is no other
way I recommend using your preferred version control system.
If you want to do that easily with puppet then puppetlabs/vcsrepo on the
forge looks like the nicest way of doing it.



On 10 January 2013 16:39, Denmat <tu2bgone@gmail.com> wrote:
> Smaller directories? :)
>
> But seriously Puppet sucks at distributing large directories (you should
> see posts to the list going back years on this topic). If you look at the
> file type resource docs (
> http://docs.puppetlabs.com/references/stable/type.html#file)you can see
> you can change the checksum used, ignore files (unsure of speed
> improvements there), recurselimit to limit the depth of recursion and
> possibly the mtime attribute.
>
> Alternatively, if running *nix you could try rsync in an exec.
>
> Your mileage may vary,
>
> Den
>
> On 10/01/2013, at 12:01, Schofield <dbschofield@gmail.com> wrote:
>
> I have several directories that are installed and managed with puppet.  I
> am finding the majority of the time of the puppet run is spent validating
> the directory.  Are there any tricks to improve the performance of managed
> directories? Or a better way than simple file resource with  ensure =>
> directory and recurse => true?
>
>   file {''/xyz/directory'' :
>     ensure => directory,
>     recurse => true,
>     source => "puppet:///modules/mymod/directory",
>   }
>
> --
> You received this message because you are subscribed to the Google Groups
> "Puppet Users" group.
> To view this discussion on the web visit
> https://groups.google.com/d/msg/puppet-users/-/TuE-ygecAngJ.
> To post to this group, send email to puppet-users@googlegroups.com.
> To unsubscribe from this group, send email to
> puppet-users+unsubscribe@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/puppet-users?hl=en.
>
>  --
> You received this message because you are subscribed to the Google Groups
> "Puppet Users" group.
> To post to this group, send email to puppet-users@googlegroups.com.
> To unsubscribe from this group, send email to
> puppet-users+unsubscribe@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/puppet-users?hl=en.
>
-- 
You received this message because you are subscribed to the Google Groups
"Puppet Users" group.
To post to this group, send email to puppet-users@googlegroups.com.
To unsubscribe from this group, send email to
puppet-users+unsubscribe@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/puppet-users?hl=en.

On Thursday, January 10, 2013 1:57:34 AM UTC-5, Pete
wrote:
>
> I used to manage a few directories recursively and it was very slow and 
> cumbersome.
> I just manage the directories themselves if i need to and the files 
> individually.
> It makes it a bit more complex initially but you get fine grained control 
> over things and it''s so much faster.
>
> If you really need to manage a directory recursively and there is no other 
> way I recommend using your preferred version control system.
> If you want to do that easily with puppet then puppetlabs/vcsrepo on the 
> forge looks like the nicest way of doing it.
>
Is there a simple way to recursively pull directories down from the puppet 
master if they don''t exist, but if the root directory does exist
don''t
bother recursively checking them?

-- 
You received this message because you are subscribed to the Google Groups
"Puppet Users" group.
To post to this group, send email to puppet-users@googlegroups.com.
To unsubscribe from this group, send email to
puppet-users+unsubscribe@googlegroups.com.
Visit this group at http://groups.google.com/group/puppet-users?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.