Xavier Normand
2012-Mar-12 14:26 UTC
[Gluster-users] Need advice for choosing proper glusterfs cluster hardware
Hi, I'm in a process to our NFS / DRDB setup to a more scalable glusterfs cluster. I would like to some advise on what would be the best hardware match to fit both speed and storage. Currently our actual setup fit's out need for speed, but adding storage in that kind of setup a pain! Current setup: 2 servers [ Active / Passive ] Quad Core 2.4 Raid 10 [ 8 * 600GB SAS 3 GB/s ] 2.2 TB usable space client protocol: NFS What i plan to use: 2 servers [ Distributed replicate ] i5 - Quad Core - 3,3Ghz Raid 10 [ 4 * 2TB SATA ] 3.72 TB usable space Client protocol: glusterfs The big question! Should i use more servers with less disk space to get the same speed. Or i will probably get the same speed as my actual NFS setup. We host a lot of small files that will be read by our fontend servers. Thank's Xavier Normand -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://supercolony.gluster.org/pipermail/gluster-users/attachments/20120312/f11c21df/attachment.html>
Bryan Whitehead
2012-Mar-13 17:02 UTC
[Gluster-users] Need advice for choosing proper glusterfs cluster hardware
No matter what you do, you will be limited by your network speed. Consider getting 10Gig network cards or Infiniband. All writes will need to hit both servers, so the max throughput you'll get is about 50MB/sec with a 1G card. You can get a full 100MB/sec by using the NFS/gluster connector to one of the servers (assuming your servers have 10G/Infiniband). On Mon, Mar 12, 2012 at 7:26 AM, Xavier Normand <xavier.normand at gmail.com>wrote:> Hi, > > I'm in a process to our NFS / DRDB setup to a more scalable glusterfs > cluster. I would like to some advise on what would be the best hardware > match to fit both speed and storage. Currently our actual setup fit's out > need for speed, but adding storage in that kind of setup a pain! > > Current setup: > 2 servers [ Active / Passive ] > Quad Core 2.4 > Raid 10 [ 8 * 600GB SAS 3 GB/s ] > 2.2 TB usable space > client protocol: NFS > > What i plan to use: > 2 servers [ Distributed replicate ] > i5 - Quad Core - 3,3Ghz > Raid 10 [ 4 * 2TB SATA ] > 3.72 TB usable space > Client protocol: glusterfs > > The big question! Should i use more servers with less disk space to get > the same speed. Or i will probably get the same speed as my actual NFS > setup. We host a lot of small files that will be read by our fontend > servers. > > Thank's > > *Xavier Normand* > > _______________________________________________ > Gluster-users mailing list > Gluster-users at gluster.org > http://gluster.org/cgi-bin/mailman/listinfo/gluster-users > >-------------- next part -------------- An HTML attachment was scrubbed... URL: <http://supercolony.gluster.org/pipermail/gluster-users/attachments/20120313/6c7b43f8/attachment.html>
Jeff Darcy
2012-Mar-13 18:21 UTC
[Gluster-users] Need advice for choosing proper glusterfs cluster hardware
On 03/13/2012 01:02 PM, Bryan Whitehead wrote:> No matter what you do, you will be limited by your network speed. Consider > getting 10Gig network cards or Infiniband. > > All writes will need to hit both servers, so the max throughput you''ll get is > about 50MB/sec with a 1G card. You can get a full 100MB/sec by using the > NFS/gluster connector to one of the servers (assuming your servers have > 10G/Infiniband).Agreed. If you''re reading a lot of small files you''ll probably want to go the NFS route instead of native protocol. Then you''ll want to have separate front-end and back-end networks. The back end should be 10GbE or IB, not so much because of bandwidth but because of latency. The front end can be whatever your web servers (or whatever) can handle. You''ll also need to be careful during setup to ensure that the GlusterFS servers actually use the back-end network while exporting NFS out of the front.> > On Mon, Mar 12, 2012 at 7:26 AM, Xavier Normand <xavier.normand at gmail.com > <mailto:xavier.normand at gmail.com>> wrote: > > Hi, > > I''m in a process to our NFS / DRDB setup to a more scalable glusterfs > cluster. I would like to some advise on what would be the best hardware > match to fit both speed and storage. Currently our actual setup fit''s out > need for speed, but adding storage in that kind of setup a pain! > > Current setup: > 2 servers [ Active / Passive ] > Quad Core 2.4 > Raid 10 [ 8 * 600GB SAS 3 GB/s ] > 2.2 TB usable space > client protocol: NFS > > What i plan to use: > 2 servers [ Distributed replicate ] > i5 - Quad Core - 3,3Ghz > Raid 10 [ 4 * 2TB SATA ] > 3.72 TB usable space > Client protocol: glusterfs > > The big question! Should i use more servers with less disk space to get the > same speed. Or i will probably get the same speed as my actual NFS setup. > We host a lot of small files that will be read by our fontend servers. > > Thank''s > > *Xavier Normand* > > _______________________________________________ > Gluster-users mailing list > Gluster-users at gluster.org <mailto:Gluster-users at gluster.org> > http://gluster.org/cgi-bin/mailman/listinfo/gluster-users > > > > > _______________________________________________ > Gluster-users mailing list > Gluster-users at gluster.org > http://gluster.org/cgi-bin/mailman/listinfo/gluster-users