Hi.... I have setup a 4 node cluster on virtual servers on RHEL platform. Not able to get better performance statistics on glusterFS as compared to local file system. Kindly suggest a test run that can be checked to differentiate between them. Regards, Anish Kumar "Confidentiality Warning: This message and any attachments are intended only for the use of the intended recipient(s). are confidential and may be privileged. If you are not the intended recipient. you are hereby notified that any review. re-transmission. conversion to hard copy. copying. circulation or other use of this message and any attachments is strictly prohibited. If you are not the intended recipient. please notify the sender immediately by return email. and delete this message and any attachments from your system. Virus Warning: Although the company has taken reasonable precautions to ensure no viruses are present in this email. The company cannot accept responsibility for any loss or damage arising from the use of this email or attachment." -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://supercolony.gluster.org/pipermail/gluster-users/attachments/20110624/4faeafb2/attachment.html>
Can you run "dd if=/dev/zero of=/junk bs=128k count=10000 oflag=direct" on the local file system and then run "dd if=/dev/zero of=/client-mount/junk bs=128k count=10000 oflag=direct" on gluster mounted file system? compare them What's your disk configuration on RHEL in terms of RAID, # of disks etc. And are those 4 servers sharing the same local storage? On Thu, Jun 23, 2011 at 9:59 PM, <Anish.B.Kumar at ril.com> wrote:> Hi?. > > > > I have setup a 4 node cluster on virtual servers on RHEL platform. > > Not able to get better performance statistics on glusterFS as compared to > local file system. > > Kindly suggest a test run that can be checked to differentiate between them. > > > > Regards, > > Anish Kumar > > > > > > "Confidentiality Warning: This message and any attachments are intended only > for the use of the intended recipient(s). > are confidential and may be privileged. If you are not the intended > recipient. you are hereby notified that any > review. re-transmission. conversion to hard copy. copying. circulation or > other use of this message and any attachments is > strictly prohibited. If you are not the intended recipient. please notify > the sender immediately by return email. > and delete this message and any attachments from your system. > > Virus Warning: Although the company has taken reasonable precautions to > ensure no viruses are present in this email. > The company cannot accept responsibility for any loss or damage arising from > the use of this email or attachment." > _______________________________________________ > Gluster-users mailing list > Gluster-users at gluster.org > http://gluster.org/cgi-bin/mailman/listinfo/gluster-users > >
On Friday 24 June 2011 10:29 AM, Anish.B.Kumar at ril.com wrote:> Hi?. > > I have setup a 4 node cluster on virtual servers on RHEL platform. >It would help if you can post the output of "gluster volume info", to start with. Are you using some benchmark to compare GlusterFS performance with local filesystem performance? Pavan> Not able to get better performance statistics on glusterFS as compared > to local file system. > > Kindly suggest a test run that can be checked to differentiate between them. > > Regards, > > Anish Kumar > > "Confidentiality Warning: This message and any attachments are intended > only for the use of the intended recipient(s). > are confidential and may be privileged. If you are not the intended > recipient. you are hereby notified that any > review. re-transmission. conversion to hard copy. copying. circulation > or other use of this message and any attachments is > strictly prohibited. If you are not the intended recipient. please > notify the sender immediately by return email. > and delete this message and any attachments from your system. > > Virus Warning: Although the company has taken reasonable precautions to > ensure no viruses are present in this email. > The company cannot accept responsibility for any loss or damage arising > from the use of this email or attachment." > > > > _______________________________________________ > Gluster-users mailing list > Gluster-users at gluster.org > http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
On Saturday 25 June 2011 03:56 PM, Anish.B.Kumar at ril.com wrote:> Yes sure it's 74 MB . > I am using Gluster version 3.2.1.1 > > In my 4 node cluster setup, one of my node on which I am performing test run is physical sever of HP proliant DL 380 G5 having RHEL 5.5 OS ,is having 1000Mbps network. > Other three nodes are hosted on Windows 2008 R2 on virtual machine(VM ware Application) , host machine network is of 1GbpsWhat are you virtual machines? Linux, I suppose? A few aspects of your setup makes the comparison unfair - 1. Since you run untar on the local file system on a physical server, the is a possibility to see the effect of write caching. 2. Since glusterfs is working on VMs, the comparison of its performance with that on a physical server is not fair. 3. The VMs are hosted on a system with low network bandwidth. 4. The IO throughput inside a VM is limited by the throughput of the host file system, in this case - a Windows filesystem (NTFS) ? What is the amount of RAM on the Windows system hosting the VMs? Pavan PS: Adding gluster-users. The discussion might help others.> > Regards, > Anish Kumar >
My virtual machines are Linux (RHEL 5.3 64 bit ). The RAM is of 4 GB on host server running Virtual machines. Regards, Anish Kumar -----Original Message----- From: Pavan T C [mailto:tcp at gluster.com] Sent: 25 June, 2011 4:03 PM To: Anish Kumar Subject: Re: [Gluster-users] Performance on GlusterFS On Saturday 25 June 2011 03:56 PM, Anish.B.Kumar at ril.com wrote:> Yes sure it's 74 MB . > I am using Gluster version 3.2.1.1 > > In my 4 node cluster setup, one of my node on which I am performing test run is physical sever of HP proliant DL 380 G5 having RHEL 5.5 OS ,is having 1000Mbps network. > Other three nodes are hosted on Windows 2008 R2 on virtual machine(VM > ware Application) , host machine network is of 1GbpsWhat are you virtual machines? Linux, I suppose? A few aspects of your setup makes the comparison unfair - 1. Since you run untar on the local file system on a physical server, the is a possibility to see the effect of write caching. 2. Since glusterfs is working on VMs, the comparison of its performance with that on a physical server is not fair. 3. The VMs are hosted on a system with low network bandwidth. 4. The IO throughput inside a VM is limited by the throughput of the host file system, in this case - a Windows filesystem (NTFS) ? What is the amount of RAM on the Windows system hosting the VMs? Pavan> > Regards, > Anish Kumar >"Confidentiality Warning: This message and any attachments are intended only for the use of the intended recipient(s). are confidential and may be privileged. If you are not the intended recipient. you are hereby notified that any review. re-transmission. conversion to hard copy. copying. circulation or other use of this message and any attachments is strictly prohibited. If you are not the intended recipient. please notify the sender immediately by return email. and delete this message and any attachments from your system. Virus Warning: Although the company has taken reasonable precautions to ensure no viruses are present in this email. The company cannot accept responsibility for any loss or damage arising from the use of this email or attachment."