[Gluster-users] Problem: Gluster performance too high..

Harry Mangalam
Thu, 29 Mar 2012 19:30:17 -0000

I'm doing some perf tests on a small gluster filesystem - 5 bricks on
4 servers, all single-homed on the private net.

I've spawned up to 70 simultaneous jobs on our cluster nodes writing
files of various sizes from /dev/zero to the gluster fs to see what
the effect on the aggregate bandwith and the data is slightly
unbelievable in that it seems to exceed the theoretical max of the
network. (I used /dev/zero instead of /dev/urandom since /dev/urandom
couldn't generate data fast enough.

The 35,000 files of the right size do hit the filesystem (of course
they're all zero's) but the speed at which they transfer exceeds (by
quite a bit) the theoretical max of a 1 Gb network.

Does gluster (or anything else) do transparent compression?  What else
would explain this oddity?


--
Harry Mangalam - Research Computing, OIT, Rm 225 MSTB, UC Irvine
[ZOT 2225] / 92697  Google Voice Multiplexer: (949) 478-4487
415 South Circle View Dr, Irvine, CA, 92697 [shipping]
MSTB Lat/Long: (33.642025,-117.844414) (paste into Google Maps)
--
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://supercolony.gluster.org/pipermail/gluster-users/attachments/20120329/a029b8ad/attachment.html>