More details on your setup[ would be useful: - Number of Nodes - CPU & RAM on Each Node - What else is running on the nodes - Number of bricks - output of "gluster volume info" & "gluster volume status" - ZFS config for each Node * number of disks and rai arrangement * log and cache SSD? * zpool status On 25 November 2015 at 03:24, Rao, Uthra R. (GSFC-672.0)[ADNET SYSTEMS INC] <uthra.r.rao at nasa.gov> wrote:> I have set-up zfsonlinux and glusterFS with replicated volumes. The > servers and the client is all on 10Gb network. I have installed > glusterfs-3.7.6-1.el7.x86_64. We are not using NFS to mount the GlusterFS > volume on the client. I would like to know what GlusterFS tuning will help > in our case? I would really appreciate it if you could share your > experience with GlusterFS Performance tuning. > > > > Thank you. > > Uthra > > _______________________________________________ > Gluster-users mailing list > Gluster-users at gluster.org > http://www.gluster.org/mailman/listinfo/gluster-users >-- Lindsay -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://www.gluster.org/pipermail/gluster-users/attachments/20151125/b9c6936f/attachment.html>
On 11/24/2015 12:09 PM, Lindsay Mathieson wrote:> More details on your setup[ would be useful: > - Number of Nodes > - CPU & RAM on Each Node > - What else is running on the nodes > - Number of bricks > - output of "gluster volume info" & "gluster volume status"- What you want to accomplish with this "tuning" - What expectations did you engineer for when you built this system - How does it not meet your engineering expectations> > - ZFS config for each Node > * number of disks and rai arrangement > * log and cache SSD? > * zpool status > > > On 25 November 2015 at 03:24, Rao, Uthra R. (GSFC-672.0)[ADNET SYSTEMS > INC] <uthra.r.rao at nasa.gov <mailto:uthra.r.rao at nasa.gov>> wrote: > > I have set-up zfsonlinux and glusterFS with replicated volumes. > The servers and the client is all on 10Gb network. I have > installed glusterfs-3.7.6-1.el7.x86_64. We are not using NFS to > mount the GlusterFS volume on the client. I would like to know > what GlusterFS tuning will help in our case? I would really > appreciate it if you could share your experience with GlusterFS > Performance tuning. > > Thank you. > > Uthra > > > _______________________________________________ > Gluster-users mailing list > Gluster-users at gluster.org <mailto:Gluster-users at gluster.org> > http://www.gluster.org/mailman/listinfo/gluster-users > > > > > -- > Lindsay > > > _______________________________________________ > Gluster-users mailing list > Gluster-users at gluster.org > http://www.gluster.org/mailman/listinfo/gluster-users-------------- next part -------------- An HTML attachment was scrubbed... URL: <http://www.gluster.org/pipermail/gluster-users/attachments/20151124/855f22bb/attachment.html>
Hi Lindsay Mathieson and all, Le 24/11/2015 21:09, Lindsay Mathieson a ?crit :> More details on your setup[ would be useful: > - Number of Nodes > - CPU & RAM on Each Node > - What else is running on the nodes > - Number of bricks > - output of "gluster volume info" & "gluster volume status" > > - ZFS config for each Node > * number of disks and rai arrangement > * log and cache SSD? > * zpool status >OK I have tested that kind of configuration, and the result depend of what you are waiting for : * zfsonlinux is now efficient, but you will not have access to the ACL ; * on a volume with seven disk we get the maximum of the PCI Express bandwidth ; * so you can mount a distributed gluster volume with your zfsonlinux nodes. The bandwidth will depend of the kind of glusterfs volume you want to build : distributed, stripped, replicated ; o replicated : bad, because of the synchronism write for the files replication ; o striped is the best because it allow you to get an average bandwidth on a file whatever the node you R/W the file ; * then the last, for me, is the Ethernet access between each nodes. If you have 1Gb, get back to your sand box, At the year you need 10Gbs and as the minimal Ethernet access is two port you need to bound them ; * have 10 Gbs Ethernet switch ; That the expressions of the needs for the now and future necessities. sincerely Pierre L?onard -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://www.gluster.org/pipermail/gluster-users/attachments/20151124/377ab9cc/attachment.html>