Puppet users - Oct 2009 - How to determine if there is a room for a copied file in puppet before copying?

Good afternoon all,

How  one  can  predict  a  problem  with copying before puppet actualy
starts  it? Copying is expensive, because I''m talking about many GB of
data. I suspect that it should be easy to know how much free space and
how many free nodes are available on the target device. I realize that
it  is  not  so  easy  to  accurately  predict  the space requirements
beforehand, but from the other hand, since I don''t use compressed file
systems, there are obvious checks one can make to predict a failure in
many  cases.  One cannot fit directory of 1GB files when there is only
500MB free space on target...

--
Thank you for your reply,
 Adam Ryczkowski


--~--~---------~--~----~------------~-------~--~----~
You received this message because you are subscribed to the Google Groups
"Puppet Users" group.
To post to this group, send email to puppet-users@googlegroups.com
To unsubscribe from this group, send email to
puppet-users+unsubscribe@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/puppet-users?hl=en
-~----------~----~----~----~------~----~------~--~---

On Oct 18, 2009, at 2:15 AM, Adam Ryczkowski wrote:
>
> Good afternoon all,
>
> How  one  can  predict  a  problem  with copying before puppet actualy
> starts  it? Copying is expensive, because I''m talking about many
GB of
> data. I suspect that it should be easy to know how much free space and
> how many free nodes are available on the target device. I realize that
> it  is  not  so  easy  to  accurately  predict  the space requirements
> beforehand, but from the other hand, since I don''t use compressed
file
> systems, there are obvious checks one can make to predict a failure in
> many  cases.  One cannot fit directory of 1GB files when there is only
> 500MB free space on target...
This would be possible once we move the Exec checks into metaparams.   
Someone''s working on that right now and we''re shepherding it
in, but
it''s probably not going to make it until the next major release at the
end of the year.

Really, though, you probably don''t want to use Puppet to copy a 1gb  
file - it still copies the files into memory.  Use an exec, for now,  
and have it conditional on there being space.

Or, of course, use NFS. :)

-- 
You don''t learn anything the second time you''re kicked by a
mule.
     -- Anonymous Texan
---------------------------------------------------------------------
Luke Kanies | http://reductivelabs.com | http://madstop.com


--~--~---------~--~----~------------~-------~--~----~
You received this message because you are subscribed to the Google Groups
"Puppet Users" group.
To post to this group, send email to puppet-users@googlegroups.com
To unsubscribe from this group, send email to
puppet-users+unsubscribe@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/puppet-users?hl=en
-~----------~----~----~----~------~----~------~--~---

> Really, though, you probably don''t want to use Puppet to copy a
1gb
> file - it still copies the files into memory.
Is  this true also for local copies (i.e. copies which doesn''t involve
file server, and where source and destination are on the same system)?


--~--~---------~--~----~------------~-------~--~----~
You received this message because you are subscribed to the Google Groups
"Puppet Users" group.
To post to this group, send email to puppet-users@googlegroups.com
To unsubscribe from this group, send email to
puppet-users+unsubscribe@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/puppet-users?hl=en
-~----------~----~----~----~------~----~------~--~---

On Oct 19, 2009, at 5:29 AM, Adam Ryczkowski wrote:
>
>
>> Really, though, you probably don''t want to use Puppet to copy
a 1gb
>> file - it still copies the files into memory.
> Is  this true also for local copies (i.e. copies which doesn''t
involve
> file server, and where source and destination are on the same system)?
You know, I''ve never really thought about them differently, but yeah,  
it is true, and that could probably easily be optimized out.  It just  
comes up so rarely that I haven''t considered it.  Maybe open that as a
bug?

-- 
I have lost friends, some by death... others through sheer inability
to cross the street. -- Virginia Woolf
---------------------------------------------------------------------
Luke Kanies | http://reductivelabs.com | http://madstop.com


--~--~---------~--~----~------------~-------~--~----~
You received this message because you are subscribed to the Google Groups
"Puppet Users" group.
To post to this group, send email to puppet-users@googlegroups.com
To unsubscribe from this group, send email to
puppet-users+unsubscribe@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/puppet-users?hl=en
-~----------~----~----~----~------~----~------~--~---

On 21 Paź, 06:54, Luke Kanies <l...@madstop.com>
wrote:
> On Oct 19, 2009, at 5:29 AM, Adam Ryczkowski wrote:
>
>
>
> >> Really, though, you probably don''t want to use Puppet to
copy a 1gb
> >> file - it still copies the files into memory.
> > Is  this true also for local copies (i.e. copies which
doesn''t involve
> > file server, and where source and destination are on the same system)?
>
> You know, I''ve never really thought about them differently, but
yeah,  
> it is true, and that could probably easily be optimized out.  It just  
> comes up so rarely that I haven''t considered it.  Maybe open that
as a  
> bug?
I just hope in one time I would know Ruby and Puppet enough to also
contribute to the project.


--~--~---------~--~----~------------~-------~--~----~
You received this message because you are subscribed to the Google Groups
"Puppet Users" group.
To post to this group, send email to puppet-users@googlegroups.com
To unsubscribe from this group, send email to
puppet-users+unsubscribe@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/puppet-users?hl=en
-~----------~----~----~----~------~----~------~--~---