[ This didn't seem to come through the first time - sorry if you get two copies :) ] ----- Forwarded Message ----- From: "Darren Austin" <darren-lists at widgit.com> To: gluster-users-bounces at gluster.org Sent: Tuesday, 28 June, 2011 11:05:38 AM Subject: Performance + Translators Hi, I've been measuring the performance of a GlusterFS backed Apache instance and noticed some quite concerning performance issues. Should the GlusterFS client be hitting BOTH the replicated servers for every httpd request that comes in? For every request that is made, the client seems to be requesting the file from both the replicated servers in the cluster - is this a situation which is normal? Also, even though the requested file is exactly the same every time, Gluster seems to be re-requesting it from the server(s) for every httpd request. I've read that the quick-read translator is supposed to cache file access requests to increase performance, but it doesn't seem to have any effect here - but that may be due to a configuration error on my part. I'm not even sure if the quick-read translator is being enabled - and if it has to be enabled in some way on the client? I've attached logs from the point of setting up a new volume and mounting it from the client - even though the vol file being sent to the client contains references to the quick-read translator, I don't know if it's actually being used - is there some way to tell? Also, as a test, I used 'volume set XXX performance.quick-read off', and re-mounted from the client. The same performance tests didn't change - so either the quick-read translator is having no effect, or it's not being enabled on the client. I'm pretty new to GlusterFS, so can anyone offer some insight into how client side translators get enabled/disabled? My impression from the documentation is that you set their options using 'volume set' on the server, and the client picks them up - but that doesn't seem to be the case here. Thanks, Darren. -- Darren Austin - Systems Administrator, Widgit Software. Tel: +44 (0)1926 333680. Web: http://www.widgit.com/ 26 Queen Street, Cubbington, Warwickshire, CV32 7NA. -------------- next part -------------- A non-text attachment was scrubbed... Name: data-volume-fuse.vol Type: application/octet-stream Size: 1186 bytes Desc: not available URL: <http://supercolony.gluster.org/pipermail/gluster-users/attachments/20110628/9b4ea664/attachment.obj> -------------- next part -------------- A non-text attachment was scrubbed... Name: data-volume.10.49.14.115.data.vol Type: application/octet-stream Size: 979 bytes Desc: not available URL: <http://supercolony.gluster.org/pipermail/gluster-users/attachments/20110628/9b4ea664/attachment-0001.obj> -------------- next part -------------- A non-text attachment was scrubbed... Name: data-volume.10.234.158.226.data.vol Type: application/octet-stream Size: 979 bytes Desc: not available URL: <http://supercolony.gluster.org/pipermail/gluster-users/attachments/20110628/9b4ea664/attachment-0002.obj> -------------- next part -------------- A non-text attachment was scrubbed... Name: mnt.log Type: text/x-log Size: 3460 bytes Desc: not available URL: <http://supercolony.gluster.org/pipermail/gluster-users/attachments/20110628/9b4ea664/attachment.bin>
Can anyone give me some pointers on this please? :) I'm really needing to get a performance increase out of Gluster, and I can't figure out if things like quick-read are active or not (and if they are, why disabling them makes no difference to performance). Thanks! :) Darren. ----- Original Message -----> [ This didn't seem to come through the first time - sorry if you get > two copies :) ] > > ----- Forwarded Message ----- > From: "Darren Austin" <darren-lists at widgit.com> > To: gluster-users-bounces at gluster.org > Sent: Tuesday, 28 June, 2011 11:05:38 AM > Subject: Performance + Translators > > Hi, > I've been measuring the performance of a GlusterFS backed Apache > instance and noticed some quite concerning performance issues. > > Should the GlusterFS client be hitting BOTH the replicated servers for > every httpd request that comes in? > For every request that is made, the client seems to be requesting the > file from both the replicated servers in the cluster - is this a > situation which is normal? > > Also, even though the requested file is exactly the same every time, > Gluster seems to be re-requesting it from the server(s) for every > httpd request. > > I've read that the quick-read translator is supposed to cache file > access requests to increase performance, but it doesn't seem to have > any effect here - but that may be due to a configuration error on my > part. > > I'm not even sure if the quick-read translator is being enabled - and > if it has to be enabled in some way on the client? > I've attached logs from the point of setting up a new volume and > mounting it from the client - even though the vol file being sent to > the client contains references to the quick-read translator, I don't > know if > it's actually being used - is there some way to tell? > > Also, as a test, I used 'volume set XXX performance.quick-read off', > and re-mounted from the client. The same performance tests didn't > change - > so either the quick-read translator is having no effect, or it's not > being enabled on the client. > > I'm pretty new to GlusterFS, so can anyone offer some insight into how > client side translators get enabled/disabled? My impression from the > documentation is that you set their options using 'volume set' on the > server, and the client picks them up - but that doesn't seem to be the > case here. > > Thanks, > Darren. > > -- Darren Austin - Systems Administrator, Widgit Software. > Tel: +44 (0)1926 333680. Web: http://www.widgit.com/ > 26 Queen Street, Cubbington, Warwickshire, CV32 7NA. > > > _______________________________________________ Gluster-users mailing > list Gluster-users at gluster.org > http://gluster.org/cgi-bin/mailman/listinfo/gluster-users-- Darren Austin - Systems Administrator, Widgit Software. Tel: +44 (0)1926 333680. Web: http://www.widgit.com/ 26 Queen Street, Cubbington, Warwickshire, CV32 7NA.
Darren, Replicate performs a lookup to both servers to ensure the files are in sync. Once cached, it should only perform mtime checks with the servers. Can you check if you are not seeing performance gain even in a non replicated setup? Just as a step in debugging.. Avati On Tue, Jun 28, 2011 at 3:50 PM, Darren Austin <darren-lists at widgit.com>wrote:> [ This didn't seem to come through the first time - sorry if you get two > copies :) ] > > ----- Forwarded Message ----- > From: "Darren Austin" <darren-lists at widgit.com> > To: gluster-users-bounces at gluster.org > Sent: Tuesday, 28 June, 2011 11:05:38 AM > Subject: Performance + Translators > > Hi, > I've been measuring the performance of a GlusterFS backed Apache > instance and noticed some quite concerning performance issues. > > Should the GlusterFS client be hitting BOTH the replicated servers for > every httpd request that comes in? > For every request that is made, the client seems to be requesting the > file from both the replicated servers in the cluster - is this a > situation which is normal? > > Also, even though the requested file is exactly the same every time, > Gluster seems to be re-requesting it from the server(s) for every httpd > request. > > I've read that the quick-read translator is supposed to cache file > access requests to increase performance, but it doesn't seem to have any > effect here - but that may be due to a configuration error on my part. > > I'm not even sure if the quick-read translator is being enabled - and if > it has to be enabled in some way on the client? > I've attached logs from the point of setting up a new volume and > mounting it from the client - even though the vol file being sent to the > client contains references to the quick-read translator, I don't know if > it's actually being used - is there some way to tell? > > Also, as a test, I used 'volume set XXX performance.quick-read off', and > re-mounted from the client. The same performance tests didn't change - > so either the quick-read translator is having no effect, or it's not > being enabled on the client. > > I'm pretty new to GlusterFS, so can anyone offer some insight into how > client side translators get enabled/disabled? My impression from the > documentation is that you set their options using 'volume set' on the > server, and the client picks them up - but that doesn't seem to be the > case here. > > Thanks, > Darren. > > -- > Darren Austin - Systems Administrator, Widgit Software. > Tel: +44 (0)1926 333680. Web: http://www.widgit.com/ > 26 Queen Street, Cubbington, Warwickshire, CV32 7NA. > > > _______________________________________________ > Gluster-users mailing list > Gluster-users at gluster.org > http://gluster.org/cgi-bin/mailman/listinfo/gluster-users > >-------------- next part -------------- An HTML attachment was scrubbed... URL: <http://supercolony.gluster.org/pipermail/gluster-users/attachments/20110629/c1e06b7d/attachment.html>