Gluster users - Jan 2010 - tuning glusterfs?

I ran a simple bonnie++ benchmark on 3.0.0.  The read performance
through FUSE is horrible.  Are there some parameters that can be tuned
to improve read performance?

GlusterFS:

Version  1.96       ------Sequential Output------ --Sequential Input- --Random-
Concurrency   1     -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine        Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  /sec %CP
localhost.loc 2000M     4  31 23901  30  1632  13     3  33  6289  11  68.9   8
Latency              7834ms     140ms     340ms    7767ms     543ms     757ms
Version  1.96       ------Sequential Create------ --------Random Create--------
localhost.localdoma -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
              files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP
                 16   148  14  1365  27   234  18   123  16   350  18   134  10
Latency               123ms   22783us     123ms     297ms   19895us     157ms


Locate ext3 filesystem:

Version  1.96       ------Sequential Output------ --Sequential Input- --Random-
Concurrency   1     -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine        Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  /sec %CP
localhost.loc 2000M    74  99 39432  12 27308  10   836  99 65104   9 351.5  11
Latency               179ms    1207ms     429ms     109ms     109ms     215ms
Version  1.96       ------Sequential Create------ --------Random Create--------
localhost.localdoma -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
              files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP
                 16 23991  81 +++++ +++ +++++ +++ 17007  57 +++++ +++ +++++ +++
Latency              1276us    1189us     787us    1183us     438us    2813us


-- 
Jiann-Ming Su
"I have to decide between two equally frightening options.
 If I wanted to do that, I'd vote." --Duckman
"The system's broke, Hank.  The election baby has peed in
the bath water.  You got to throw 'em both out."  --Dale Gribble
"Those who vote decide nothing.
Those who count the votes decide everything.?  --Joseph Stalin

Am 19.01.2010 18:30, schrieb Jiann-Ming Su:
> I ran a simple bonnie++ benchmark on 3.0.0.  The read performance
> through FUSE is horrible.  Are there some parameters that can be tuned
> to improve read performance?
Hi Jiann,

You didn't provide information for anyone to help you. You should at 
least post the exact bonnie++ command line you used and some information 
about your setup (config files, transport, etc.).

hth
  Paul

Hi,

Its not correct to compare performance of glusterfs with local file system,
since with glusterfs (as with FUSE based filesystems), the context switches
(b/w user and kernel spaces) can be costly. Better comparision would be to
compare glusterfs with NFS (at least for the configuration you've posted
here). Can you try comparing glusterfs performance with NFS? A more
realistic comparision would be with configuration involving network.

regards,
On Tue, Jan 19, 2010 at 9:30 PM, Jiann-Ming Su <sujiannming at
gmail.com>wrote:
> I ran a simple bonnie++ benchmark on 3.0.0.  The read performance
> through FUSE is horrible.  Are there some parameters that can be tuned
> to improve read performance?
>
> GlusterFS:
>
> Version  1.96       ------Sequential Output------ --Sequential Input-
> --Random-
> Concurrency   1     -Per Chr- --Block-- -Rewrite- -Per Chr- --Block--
> --Seeks--
> Machine        Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  /sec
> %CP
> localhost.loc 2000M     4  31 23901  30  1632  13     3  33  6289  11  68.9
>   8
> Latency              7834ms     140ms     340ms    7767ms     543ms
> 757ms
> Version  1.96       ------Sequential Create------ --------Random
> Create--------
> localhost.localdoma -Create-- --Read--- -Delete-- -Create-- --Read---
> -Delete--
>              files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec
> %CP
>                 16   148  14  1365  27   234  18   123  16   350  18   134
>  10
> Latency               123ms   22783us     123ms     297ms   19895us
> 157ms
>
>
> Locate ext3 filesystem:
>
> Version  1.96       ------Sequential Output------ --Sequential Input-
> --Random-
> Concurrency   1     -Per Chr- --Block-- -Rewrite- -Per Chr- --Block--
> --Seeks--
> Machine        Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  /sec
> %CP
> localhost.loc 2000M    74  99 39432  12 27308  10   836  99 65104   9 351.5
>  11
> Latency               179ms    1207ms     429ms     109ms     109ms
> 215ms
> Version  1.96       ------Sequential Create------ --------Random
> Create--------
> localhost.localdoma -Create-- --Read--- -Delete-- -Create-- --Read---
> -Delete--
>              files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec
> %CP
>                 16 23991  81 +++++ +++ +++++ +++ 17007  57 +++++ +++ +++++
> +++
> Latency              1276us    1189us     787us    1183us     438us
>  2813us
>
>
> --
> Jiann-Ming Su
> "I have to decide between two equally frightening options.
>  If I wanted to do that, I'd vote." --Duckman
> "The system's broke, Hank.  The election baby has peed in
> the bath water.  You got to throw 'em both out."  --Dale Gribble
> "Those who vote decide nothing.
> Those who count the votes decide everything.?  --Joseph Stalin
> _______________________________________________
> Gluster-users mailing list
> Gluster-users at gluster.org
> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
>


-- 
Raghavendra G