Hello, I imagine you get this kind of messages all the time, but just in case: I have setup with 2 storage servers with debian package of gluster - version 3.1.0 They are connected by dedicated 1 gigabit ethernet cards. I've set up simple replicated storage with 2 replicas and transport over TCP (just followed the how to on the wiki with obvious changes). Here goes my problem: If I try to copy small files (i.e. extract kernel source) I get a horrible results: praha-storage2:/mnt/test# time tar xf linux-2.6.26.8.tar.bz2 real 15m19.825s user 0m13.989s sys 0m5.152s likewise when rsyncing OpenVZ VPSes - I just can't get over 2MB/s in syncing. I've monitored all resources - CPU load, network, disk I/O - they are all used up to 0.00000nothing %. Network latency is about 0.11 ms all the time. Is this normal, or am I doing something wrong? Please help. I am frustrated :( -- S pozdravem / Best Regards Pavel ?najdr +420 720 107 791 http://vpsfree.cz
have you tried larger files? I have seen a note somewhere that refers to tons of itty bitty files, it even cites the kernel source as an example. I can't seem to find it. Could you try larger than 1k files? -luis On Nov 10, 2010, at 8:23 PM, Pavel Snajdr wrote:> Hello, > > I imagine you get this kind of messages all the time, but just in case: > > I have setup with 2 storage servers with debian package of gluster - version 3.1.0 > > They are connected by dedicated 1 gigabit ethernet cards. > > I've set up simple replicated storage with 2 replicas and transport over TCP (just followed the how to on the wiki with obvious changes). > > Here goes my problem: > > If I try to copy small files (i.e. extract kernel source) I get a horrible results: > > praha-storage2:/mnt/test# time tar xf linux-2.6.26.8.tar.bz2 > > > real 15m19.825s > user 0m13.989s > sys 0m5.152s > > likewise when rsyncing OpenVZ VPSes - I just can't get over 2MB/s in syncing. > > I've monitored all resources - CPU load, network, disk I/O - they are all used up to 0.00000nothing %. > > Network latency is about 0.11 ms all the time. > > Is this normal, or am I doing something wrong? > > Please help. I am frustrated :( > > -- > S pozdravem / Best Regards > > Pavel ?najdr > +420 720 107 791 > > http://vpsfree.cz > > _______________________________________________ > Gluster-users mailing list > Gluster-users at gluster.org > http://gluster.org/cgi-bin/mailman/listinfo/gluster-users >Luis E. Cerezo blog: http://www.luiscerezo.org fotofun: http://www.flickr.com/photos/luiscerezo/ twitter: http://twitter.com/luiscerezo/ Voice: +1 412 223 7396
Pavel -
I have other performance testing running in EC2 this weekend, I'll
add a kernel extract to the test suite, see what I get with various
instance types, EBS design, etc. I'll get the results out to the list on
Tuesday.
Thanks,
Craig
-->
Craig Carl
Senior Systems Engineer
Gluster
On 11/10/2010 06:23 PM, Pavel Snajdr wrote:> Hello,
>
> I imagine you get this kind of messages all the time, but just in case:
>
> I have setup with 2 storage servers with debian package of gluster -
> version 3.1.0
>
> They are connected by dedicated 1 gigabit ethernet cards.
>
> I've set up simple replicated storage with 2 replicas and transport
> over TCP (just followed the how to on the wiki with obvious changes).
>
> Here goes my problem:
>
> If I try to copy small files (i.e. extract kernel source) I get a
> horrible results:
>
> praha-storage2:/mnt/test# time tar xf linux-2.6.26.8.tar.bz2
>
>
> real 15m19.825s
> user 0m13.989s
> sys 0m5.152s
>
> likewise when rsyncing OpenVZ VPSes - I just can't get over 2MB/s in
> syncing.
>
> I've monitored all resources - CPU load, network, disk I/O - they are
> all used up to 0.00000nothing %.
>
> Network latency is about 0.11 ms all the time.
>
> Is this normal, or am I doing something wrong?
>
> Please help. I am frustrated :(
>