marianna cattani
2015-Mar-24 11:59 UTC
[Gluster-users] What should I do to improve performance ?
Hello Ben , whole infrastucture runs on 4 servers with SAS drives 7,200 rpm and a raid controller LSI. Probably the network is oversized compared to the disks and controllers . To verify that libgfapi is operating, is enough that my vm's disks have named as / dev / vd * ? I'm not sure that I understand the test which you suggest , if this is my mount point /var/lib/nova/instances I could run: bonnie++ -d /var/lib/nova/instances -r 2048 then on the vm that use /var/lib/nova/instances i run the same thing ? Is it right ? BR M. 2015-03-23 19:57 GMT+01:00 Ben Turner <bturner at redhat.com>:> ----- Original Message ----- > > From: "marianna cattani" <marianna.cattani at gmail.com> > > To: gluster-users at gluster.org > > Sent: Monday, March 23, 2015 6:09:41 AM > > Subject: [Gluster-users] What should I do to improve performance ? > > > > Dear all, > > I followed the tutorial I read at this link : > > http://www.gluster.org/documentation/use_cases/Virt-store-usecase/ > > > > I have 4 nodes configured as a linked list , each node also performs > virtual > > machines with KVM and mounts on its ip address, like this: > > > > 172.16.155.12:/nova /var/lib/nova/instances glusterfs defaults,_netdev > 0 0 > > > > Each node has two nic (ten giga) bonded in mode 4. > > > > What can I do to further improve the speed ? > > What kind of disks are back ending your 10G NICs? Are you using FUSE or > libgfapi to connect to gluster from your hypervisor? What kind of speeds > are you expecting vs seeing in your environment? We need to understand > what your HW can do first then gather some data running on gluster and > compare the two. As a rule of thumb with replica 2 you should see about: > > throughput = ( NIC line speed / 2 ) - 20% overhead > > As long as your disks can service it. If you are seeing about that on the > gluster mounts then go inside one of the VMs and run the same test, the VM > should get something similar. If you aren't seeing at least 400 MB / sec > on sequential writes and 500-700 MB /sec on reads then there may be > something off in your storage stack. > > -b > > > BR. > > > > M. > > > > _______________________________________________ > > Gluster-users mailing list > > Gluster-users at gluster.org > > http://www.gluster.org/mailman/listinfo/gluster-users >-------------- next part -------------- An HTML attachment was scrubbed... URL: <http://www.gluster.org/pipermail/gluster-users/attachments/20150324/db13a296/attachment.html>
On 24-3-2015 12:59, marianna cattani wrote:> Hello Ben , > whole infrastucture runs on 4 servers with SAS drives 7,200 rpm and a > raid controller LSI. > > Probably the network is oversized compared to the disks and controllers . > > To verify that libgfapi is operating, is enough that my vm's disks > have named as / dev / vd * ? > >do a 'virsh -r dumpxml yourvm' and have a look at the output should like like: <disk type='network' device='disk' snapshot='no'> <driver name='qemu' type='raw' cache='none' error_policy='stop' io='threads'/> <source protocol='gluster' name='GlusterSSD/e11866bf-1120-4c87-a992-9be32f110b8d/images/09ca5046-ab7a-11d8-9f2a-ffac3e89a6ad/042a9f7d-15be-443d-bcf7-a2ba8db43f72'> <host name='test.com' port='0'/> </source> <target dev='vda' bus='virtio'/> <serial>09ca5046-ab7a-4bd8-9f2a-ffac3e89a6ad</serial> <boot order='1'/> <alias name='virtio-disk0'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/> </disk> The first line is import type=network indicates that its using libgfapi. Joop