Puppet users - Nov 2013 - Thousands of "FileBucket got a duplicate file" messages

On developer servers we create a sandbox directory for each user and set 
the permissions on the directory so that apache and other developers can 
access it if necessary.  Here''s what we use:

                "${home_dir}/${name}/sandboxes":
                        owner   => "$name",
                        group   => "$name",
                        mode    => "0751",
                        ensure  => $ensure ? { absent => absent, default
=>
$_sandbox_dir };

As a result, a puppet run takes forever as it throws out the message 
"FileBucket got a duplicate file" for every single duplicate file from
our
codebase, and that''s a lot of files.  A puppet run can take well over
an
hour. We didn''t specify "recurse" for the directory, yet it
seems to be
recursing through the directory structure anyway.  The more sandboxes our 
developers create, the longer the process takes.  I''ve tried
suppressing
the recursion by adding "recurse => false", but that made no
difference (as
expected since that''s the default).

How can I get puppet to ignore the files in sandboxes directory so our 
puppet runs don''t take quite so long?

We''re still running puppet 2.6.13 and can''t immediately
upgrade until we
are certain we won''t break anything in our manifests.

-- 
You received this message because you are subscribed to the Google Groups
"Puppet Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to puppet-users+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/puppet-users/6c385ec3-0f10-4415-bded-facd118d10d3%40googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

On Wed, Nov 13, 2013 at 11:13 AM, GeekBiker
<wentworth.ross@gmail.com>wrote:
> On developer servers we create a sandbox directory for each user and set
> the permissions on the directory so that apache and other developers can
> access it if necessary.  Here''s what we use:
>
>                 "${home_dir}/${name}/sandboxes":
>                         owner   => "$name",
>                         group   => "$name",
>                         mode    => "0751",
>                         ensure  => $ensure ? { absent => absent,
default
> => $_sandbox_dir };
>
> As a result, a puppet run takes forever as it throws out the message
> "FileBucket got a duplicate file" for every single duplicate file
from our
> codebase, and that''s a lot of files.  A puppet run can take well
over an
> hour. We didn''t specify "recurse" for the directory, yet
it seems to be
> recursing through the directory structure anyway.  The more sandboxes our
> developers create, the longer the process takes.  I''ve tried
suppressing
> the recursion by adding "recurse => false", but that made no
difference (as
> expected since that''s the default).
>
> How can I get puppet to ignore the files in sandboxes directory so our
> puppet runs don''t take quite so long?
>
> We''re still running puppet 2.6.13 and can''t immediately
upgrade until we
> are certain we won''t break anything in our manifests.
>
>  --
> You received this message because you are subscribed to the Google Groups
> "Puppet Users" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to puppet-users+unsubscribe@googlegroups.com.
> To view this discussion on the web visit
>
https://groups.google.com/d/msgid/puppet-users/6c385ec3-0f10-4415-bded-facd118d10d3%40googlegroups.com
> .
> For more options, visit https://groups.google.com/groups/opt_out.
>
The "FileBucket got a duplicate file" is because puppet is backing up
files
that it is overwriting/deleting. You may want to add a file resource
default to prevent backups[1].

If you want backups, then know that they are slow and buggy in older
versions. For example, pre-3.3.x, backed up files were PSON encoded, which
in the best case consumed cpu usage trying to do regexp''s on file
content,
and in the worst case, corrupted the files in transit. The master would
also echo the backed up file back to the agent. These issues are fixed in
[2], and make sure to use the latest 3.3.x version.

Josh

[1]
http://docs.puppetlabs.com/references/latest/type.html#file-attribute-backup
[2] http://projects.puppetlabs.com/issues/22375

-- 
Josh Cooper
Developer, Puppet Labs

-- 
You received this message because you are subscribed to the Google Groups
"Puppet Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to puppet-users+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/puppet-users/CA%2Bu97u%3DnzS267xCCDZaarSchqVS2u2P-P_7P10yGtoUfTaBjTg%40mail.gmail.com.
For more options, visit https://groups.google.com/groups/opt_out.

Ah, ha.  Thanks.  i added "backup => false" to the file resource
and it
stopped the noise.  I''m making sure there are no negative side effects 
before rolling the change out.

-- 
You received this message because you are subscribed to the Google Groups
"Puppet Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to puppet-users+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/puppet-users/98431363-07f2-4736-ad67-657e50227fa8%40googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.