Gluster users - Oct 2011 - Need help with optimizing GlusterFS for Apache

Our webserver is configured as such:

The actual website files, php, html ,css and so on. Or on a dedicated
non-glusterfs ext4 partition.
However, the website access Videos and especially image files on a
gluster mounted directory.

The write performance for our backend gluster storage is not that
important. Since it only comes into play when someone uploads a video or
image.
However, the files are being read from constantly and randomly.
Especially all the small image files which get read everytime someone
loads our website.

It is quite a busy site, with somewhere along the line of 500 apache
accesses per second during our busy hours.

I've been taking a look at performance.cache-size and translators. But
I'm not quite sure what the ideal settings would be.

Can anyone help me out with some settings to try out, based on
experience they've had?

Thanks.

On 10/17/2011 05:16 PM, Robert Krig wrote:
>
> Our webserver is configured as such:
>
> The actual website files, php, html ,css and so on. Or on a dedicated
> non-glusterfs ext4 partition.
> However, the website access Videos and especially image files on a
> gluster mounted directory.
>
> The write performance for our backend gluster storage is not that
> important. Since it only comes into play when someone uploads a video or
> image.
> However, the files are being read from constantly and randomly.
> Especially all the small image files which get read everytime someone
> loads our website.
>
> It is quite a busy site, with somewhere along the line of 500 apache
> accesses per second during our busy hours.
>
> I've been taking a look at performance.cache-size and translators. But
> I'm not quite sure what the ideal settings would be.
>
> Can anyone help me out with some settings to try out, based on
> experience they've had?
>
> Thanks.
>
> _______________________________________________
> Gluster-users mailing list
> Gluster-users at gluster.org
> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
I think I'm going to have to abandon GlusterFS for our Image files. The
performance is abysmal. I've tried all sorts of settings, but at some
point the http process just keeps spawning more and more processess
because clients are waiting because the directory can't be read, since
glusterfs is busy.
We're not even reaching 500 apache requests per second and already
apache locks up.

I'm pretty sure it can't be the hardware, since we're talking about
a 12
Core Hyperthreading Xeon CPU, with 48GB of ram and 30TB of storage in a
hardware Raid.

I realise that GlusterFS is not ideal for many small files, but this is
beyond ridiculous. It certainly doesn't help that the documentation
doesn't even properly explain how to activate different translators, or
where exactly to edit them by hand in the config files.

If anyone has any suggestions, I'd be happy to hear them.