Ben Turner
2015-Mar-23 18:57 UTC
[Gluster-users] What should I do to improve performance ?
----- Original Message -----> From: "marianna cattani" <marianna.cattani at gmail.com> > To: gluster-users at gluster.org > Sent: Monday, March 23, 2015 6:09:41 AM > Subject: [Gluster-users] What should I do to improve performance ? > > Dear all, > I followed the tutorial I read at this link : > http://www.gluster.org/documentation/use_cases/Virt-store-usecase/ > > I have 4 nodes configured as a linked list , each node also performs virtual > machines with KVM and mounts on its ip address, like this: > > 172.16.155.12:/nova /var/lib/nova/instances glusterfs defaults,_netdev 0 0 > > Each node has two nic (ten giga) bonded in mode 4. > > What can I do to further improve the speed ?What kind of disks are back ending your 10G NICs? Are you using FUSE or libgfapi to connect to gluster from your hypervisor? What kind of speeds are you expecting vs seeing in your environment? We need to understand what your HW can do first then gather some data running on gluster and compare the two. As a rule of thumb with replica 2 you should see about: throughput = ( NIC line speed / 2 ) - 20% overhead As long as your disks can service it. If you are seeing about that on the gluster mounts then go inside one of the VMs and run the same test, the VM should get something similar. If you aren't seeing at least 400 MB / sec on sequential writes and 500-700 MB /sec on reads then there may be something off in your storage stack. -b> BR. > > M. > > _______________________________________________ > Gluster-users mailing list > Gluster-users at gluster.org > http://www.gluster.org/mailman/listinfo/gluster-users
marianna cattani
2015-Mar-24 11:59 UTC
[Gluster-users] What should I do to improve performance ?
Hello Ben , whole infrastucture runs on 4 servers with SAS drives 7,200 rpm and a raid controller LSI. Probably the network is oversized compared to the disks and controllers . To verify that libgfapi is operating, is enough that my vm's disks have named as / dev / vd * ? I'm not sure that I understand the test which you suggest , if this is my mount point /var/lib/nova/instances I could run: bonnie++ -d /var/lib/nova/instances -r 2048 then on the vm that use /var/lib/nova/instances i run the same thing ? Is it right ? BR M. 2015-03-23 19:57 GMT+01:00 Ben Turner <bturner at redhat.com>:> ----- Original Message ----- > > From: "marianna cattani" <marianna.cattani at gmail.com> > > To: gluster-users at gluster.org > > Sent: Monday, March 23, 2015 6:09:41 AM > > Subject: [Gluster-users] What should I do to improve performance ? > > > > Dear all, > > I followed the tutorial I read at this link : > > http://www.gluster.org/documentation/use_cases/Virt-store-usecase/ > > > > I have 4 nodes configured as a linked list , each node also performs > virtual > > machines with KVM and mounts on its ip address, like this: > > > > 172.16.155.12:/nova /var/lib/nova/instances glusterfs defaults,_netdev > 0 0 > > > > Each node has two nic (ten giga) bonded in mode 4. > > > > What can I do to further improve the speed ? > > What kind of disks are back ending your 10G NICs? Are you using FUSE or > libgfapi to connect to gluster from your hypervisor? What kind of speeds > are you expecting vs seeing in your environment? We need to understand > what your HW can do first then gather some data running on gluster and > compare the two. As a rule of thumb with replica 2 you should see about: > > throughput = ( NIC line speed / 2 ) - 20% overhead > > As long as your disks can service it. If you are seeing about that on the > gluster mounts then go inside one of the VMs and run the same test, the VM > should get something similar. If you aren't seeing at least 400 MB / sec > on sequential writes and 500-700 MB /sec on reads then there may be > something off in your storage stack. > > -b > > > BR. > > > > M. > > > > _______________________________________________ > > Gluster-users mailing list > > Gluster-users at gluster.org > > http://www.gluster.org/mailman/listinfo/gluster-users >-------------- next part -------------- An HTML attachment was scrubbed... URL: <http://www.gluster.org/pipermail/gluster-users/attachments/20150324/db13a296/attachment.html>