of the GlusterFS servers and then increased the Proxy server count. If there are
any other GlusterFS servers then you can start Gluster Object Storage on those
machines and do some load balancing over all these machines by using Pound,
nginx etc. This will help reduce the cpu usage of the current machine and also
utilize the other server resources.
I read the documentation and there''s no mention about separating the
swift/object-storage servers in such way. I already have a working setup, I just
need to add more proxies.
I could, of course, setup two sets of independent servers and somehow do a messy
data sharding between the two servers, but it''s simpler and cheaper to
scale just the proxy servers as needed (this is almost standard procedure in
Swift) since, from our measurements, they are the bottleneck.
There is a difference here how the swift and Gluster Object Storage work.
Currently, all the servers (proxy, auth, object, etc) are all coupled to each
other and hence they cannot be seperated. This can be emulated by configuring
the setup as I mentioned above.
Hope this helps.
Thanks,
Junaid
--_000_232914239D8BEE4DB46C66AE74E75E550365A8E1mbx024e1nj10exc_
Content-Type: text/html; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable
<html dir=3D"ltr">
<head>
<meta http-equiv=3D"Content-Type" content=3D"text/html;
charset=3Diso-8859-1">
<style id=3D"owaParaStyle" type=3D"text/css">P
{margin-top:0;margin-bottom:0;}</style>
</head>
<body ocsi=3D"0" fpstyle=3D"1">
<div style=3D"direction: ltr;font-family: Tahoma;color:
#000000;font-size: 10pt;">Hi Daniel.<br>
If you want to to load balance the load on proxy server across multiple machines
then you have to use load balancer, Pound is the one we have tested with, it
will load balance across all the backend proxies. This is the only way for load
balancing on proxy.<br>
If you don''t want proxy and other storage (object/container/account)
working on the same node/machine, as you mentioned in the latest code there is
provision to setup remote object/container/account server. Let me know if you
are facing any issue with this.<br>
If your testing with HTTPS workload then CPU usage will be high due to SSL
processing, we observer very low CPU usage with HTTP.<br>
<br>
Regards,<br>
Gaurav<br>
<div style=3D"font-family: Times New Roman; color: rgb(0, 0, 0);
font-size: 16px;">
<hr tabindex=3D"-1">
<div style=3D"direction: ltr;"
id=3D"divRpF19051"><font color=3D"#000000"
face=3D"Tahoma" size=3D"2"><b>From:</b>
gluster-users-bounces at gluster.org [gluster-users-bounces at gluster.org] on
behalf of Mohammed Junaid [junaid at gluster.com]<br>
<b>Sent:</b> Friday, October 28, 2011 12:12 PM<br>
<b>To:</b> Daniel Pereira<br>
<b>Cc:</b> gluster-users at gluster.org<br>
<b>Subject:</b> Re: [Gluster-users] Gluster object-storage
additional proxy<br>
</font><br>
</div>
<div></div>
<div>Hi Daniel,<br>
<br>
<div>Please find the comments inline.</div>
<div><br>
</div>
<div>
<div class=3D"gmail_quote">
<blockquote class=3D"gmail_quote" style=3D"margin: 0pt 0pt 0pt
0.8ex; border-left: 1px solid rgb(204, 204, 204); padding-left: 1ex;">
Yes, I did that. However the CPU usage gets very high (100% for all cores) to
have all the Gluster and Swift daemons running on the same machine. We want to
separate the processes in the same manner it is already possible in
Swift.</blockquote>
<div><br>
</div>
<div>From what I understand, you have started the Gluster Object Storage
on one of the GlusterFS servers and then increased the Proxy server count. If
there are any other GlusterFS servers then you can start Gluster Object Storage
on those machines and do some
load balancing over all these machines by using Pound, nginx etc. This will
help reduce the cpu usage of the current machine and also utilize the other
server resources.</div>
<div><br>
</div>
<blockquote class=3D"gmail_quote" style=3D"margin: 0pt 0pt 0pt
0.8ex; border-left: 1px solid rgb(204, 204, 204); padding-left: 1ex;">
I read the documentation and there''s no mention about separating the
swift/object-storage servers in such way. I already have a working setup, I just
need to add more proxies.<br>
I could, of course, setup two sets of independent servers and somehow do a messy
data sharding between the two servers, but it''s simpler and cheaper to
scale just the proxy servers as needed (this is almost standard procedure in
Swift) since, from our measurements,
they are the bottleneck.<br>
</blockquote>
<div><br>
</div>
<div>There is a difference here how the swift and Gluster Object Storage
work. Currently, all the servers (proxy, auth, object, etc) are all coupled to
each other and hence they cannot be seperated. This can be emulated by
configuring the setup as I mentioned
above.</div>
<div><br>
</div>
<div>Hope this helps.</div>
<div><br>
</div>
<div>Thanks,</div>
<div>Junaid</div>
</div>
</div>
</div>
</div>
</div>
</body>
</html>
--_000_232914239D8BEE4DB46C66AE74E75E550365A8E1mbx024e1nj10exc_--