Puppet users - Aug 2008 - file serving speed in REST

This is all ridiculously preliminary, but it''s late, I''m
tired, and I
think this kinda kicks ass.

I''ve just committed what I think is the (finally!) conversion of file  
serving to REST from xmlrpc.  I took the time to refactor how  
recursion works, and that probably has had a bigger effect on speed  
than the REST change, at least for larger directories and smaller files.

In doing some basic testing, I''ve got a single directory with 30 files
in it, and I''m copying them remotely.

Here are the numbers I''m seeing right now (keep in mind it''s
late and
I''m three Red Bulls to the wind).

xmlrpc:
Initial copy: 11.2s
Second run: 8.0s

REST:
Initial copy: 6.4s
Second run: 2.1s

These are all relatively small files (like, 8 characters each), and  
I''d expect the speedup to be greater with larger files.

Still, though, it looks really good.  Around 2x speedup on initial  
copies, and 4x speedup on later comparisons.

For those who are interested in trying this out, you can find it in  
the feature/master/1481 branch in my github repo.  It''d be great to  
hear if people are having issues with this code.

-- 
The easiest way to figure the cost of living is to take your income and
add ten percent.
---------------------------------------------------------------------
Luke Kanies | http://reductivelabs.com | http://madstop.com


--~--~---------~--~----~------------~-------~--~----~
You received this message because you are subscribed to the Google Groups
"Puppet Users" group.
To post to this group, send email to puppet-users@googlegroups.com
To unsubscribe from this group, send email to
puppet-users+unsubscribe@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/puppet-users?hl=en
-~----------~----~----~----~------~----~------~--~---

w00t!

I gotta test this out.

Great work dude!

On 29/08/2008, at 8:39 PM, Luke Kanies <luke@madstop.com> wrote:
>
> This is all ridiculously preliminary, but it''s late, I''m
tired, and I
> think this kinda kicks ass.
>
> I''ve just committed what I think is the (finally!) conversion of
file
> serving to REST from xmlrpc.  I took the time to refactor how
> recursion works, and that probably has had a bigger effect on speed
> than the REST change, at least for larger directories and smaller  
> files.
>
> In doing some basic testing, I''ve got a single directory with 30
files
> in it, and I''m copying them remotely.
>
> Here are the numbers I''m seeing right now (keep in mind
it''s late and
> I''m three Red Bulls to the wind).
>
> xmlrpc:
> Initial copy: 11.2s
> Second run: 8.0s
>
> REST:
> Initial copy: 6.4s
> Second run: 2.1s
>
> These are all relatively small files (like, 8 characters each), and
> I''d expect the speedup to be greater with larger files.
>
> Still, though, it looks really good.  Around 2x speedup on initial
> copies, and 4x speedup on later comparisons.
>
> For those who are interested in trying this out, you can find it in
> the feature/master/1481 branch in my github repo.  It''d be great
to
> hear if people are having issues with this code.
>
> -- 
> The easiest way to figure the cost of living is to take your income  
> and
> add ten percent.
> ---------------------------------------------------------------------
> Luke Kanies | http://reductivelabs.com | http://madstop.com
>
>
> >
--~--~---------~--~----~------------~-------~--~----~
You received this message because you are subscribed to the Google Groups
"Puppet Users" group.
To post to this group, send email to puppet-users@googlegroups.com
To unsubscribe from this group, send email to
puppet-users+unsubscribe@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/puppet-users?hl=en
-~----------~----~----~----~------~----~------~--~---