search for: glusterus

Hi Soumya, (1) In http://mseas.mit.edu/download/phaley/GlusterUsers/TestNFSmount/ I've placed the following 2 log files etc-glusterfs-glusterd.vol.log gdata.log The first has repeated messages about nfs disconnects. The second had the <fuse_mnt_direcotry>.log name (but not much information). (2) About the gluster-NFS native server: do you know w...

Hi Soumya, When I originally did the tests I ran tcpdump on the client. I have rerun the tests, doing tcpdump on the server tcpdump -i any -nnSs 0 host 172.16.1.121 -w /root/capture_nfsfail.pcap The results are in the same place http://mseas.mit.edu/download/phaley/GlusterUsers/TestNFSmount/ capture_nfsfail.pcap has the results from the failed touch experiment capture_nfssucceed.pcap has the results from the successful touch experiment The brick log files are there too. I believe we are using kernel-NFS exporting a fuse mounted gluster volume. I am having Stev...

...-ganesha & gluster. Is there a version of nfs-ganesha that is recommended for use with glusterfs 3.7.11 built on Apr 27 2016 14:09:22 CentOS release 6.8 (Final) Thanks Pat On 07/05/2017 11:36 AM, Pat Haley wrote: > > Hi Soumya, > > (1) In http://mseas.mit.edu/download/phaley/GlusterUsers/TestNFSmount/ > I've placed the following 2 log files > > etc-glusterfs-glusterd.vol.log > gdata.log > > The first has repeated messages about nfs disconnects. The second had > the <fuse_mnt_direcotry>.log name (but not much information). > > (2) About the...

...FS areas >> >> Latest tests >> >> I have had time to run the tests for one of the dd tests you requested to >> the underlying XFS FS. The median rate was 170 MB/s. The dd results and >> iostat record are in >> >> http://mseas.mit.edu/download/phaley/GlusterUsers/TestXFS/ >> >> I'll add tests for the other brick and to the NFS area later. >> >> Thanks >> >> Pat >> >> >> On 06/12/2017 06:06 PM, Ben Turner wrote: >> >> Ok you are correct, you have a pure distributed volume. IE no replic...

...> When I originally did the tests I ran tcpdump on the client. > > I have rerun the tests, doing tcpdump on the server > > tcpdump -i any -nnSs 0 host 172.16.1.121 -w /root/capture_nfsfail.pcap > > The results are in the same place > > http://mseas.mit.edu/download/phaley/GlusterUsers/TestNFSmount/ > > capture_nfsfail.pcap has the results from the failed touch experiment > capture_nfssucceed.pcap has the results from the successful touch > experiment > > The brick log files are there too. Thanks for sharing. Looks like the error is not generated @gluste...

...rsion can be used. I see the packages built in centos7 storage sig [1] but not for centos6. Request Niels to comment. > > Thanks > > Pat > > > On 07/05/2017 11:36 AM, Pat Haley wrote: >> >> Hi Soumya, >> >> (1) In http://mseas.mit.edu/download/phaley/GlusterUsers/TestNFSmount/ >> I've placed the following 2 log files >> >> etc-glusterfs-glusterd.vol.log >> gdata.log >> >> The first has repeated messages about nfs disconnects. The second had >> the <fuse_mnt_direcotry>.log name (but not much information...

...the NFS and the > GlusterFS areas > > Latest tests > > I have had time to run the tests for one of the dd tests you requested to > the underlying XFS FS. The median rate was 170 MB/s. The dd results and > iostat record are in > > http://mseas.mit.edu/download/phaley/GlusterUsers/TestXFS/ > > I'll add tests for the other brick and to the NFS area later. > > Thanks > > Pat > > > On 06/12/2017 06:06 PM, Ben Turner wrote: > > Ok you are correct, you have a pure distributed volume. IE no replication overhead. So normally for pure dist I...

...t tests >> >> I have had time to run the tests for one of the dd tests you >> requested to the underlying XFS FS. The median rate was 170 >> MB/s. The dd results and iostat record are in >> >> http://mseas.mit.edu/download/phaley/GlusterUsers/TestXFS/ >> <http://mseas.mit.edu/download/phaley/GlusterUsers/TestXFS/> >> >> I'll add tests for the other brick and to the NFS area later. >> >> Thanks >> >> Pat >> >> >> On 06/12/2017...

...torage sig [1] but not for > centos6. Request Niels to comment. > > >> >> Thanks >> >> Pat >> >> >> On 07/05/2017 11:36 AM, Pat Haley wrote: >>> >>> Hi Soumya, >>> >>> (1) In http://mseas.mit.edu/download/phaley/GlusterUsers/TestNFSmount/ >>> I've placed the following 2 log files >>> >>> etc-glusterfs-glusterd.vol.log >>> gdata.log >>> >>> The first has repeated messages about nfs disconnects. The second had >>> the <fuse_mnt_direcotry>.log na...

...e is one physical server that hosts both the NFS and the GlusterFS areas Latest tests I have had time to run the tests for one of the dd tests you requested to the underlying XFS FS. The median rate was 170 MB/s. The dd results and iostat record are in http://mseas.mit.edu/download/phaley/GlusterUsers/TestXFS/ I'll add tests for the other brick and to the NFS area later. Thanks Pat On 06/12/2017 06:06 PM, Ben Turner wrote: > Ok you are correct, you have a pure distributed volume. IE no replication overhead. So normally for pure dist I use: > > throughput = slowest of disks...

...; > drwxrwsr-x 2 phaley dri_fleat 4.0K May 1 15:16 test > > Under this directory (mounted via nfs) user phaley can write > > ibfdr-compute-0-4(test)% touch dum > ibfdr-compute-0-4(test)% > > I have put the packet captures in > > http://mseas.mit.edu/download/phaley/GlusterUsers/TestNFSmount/ > > capture_nfsfail.pcap has the results from the failed touch experiment > capture_nfssucceed.pcap has the results from the successful touch > experiment > > The command I used for these was > > tcpdump -i ib0 -nnSs 0 host 172.16.1.119 -w /root/capture_...

...e NFS and the > GlusterFS areas > > Latest tests > > I have had time to run the tests for one of the dd tests you requested > to the underlying XFS FS. The median rate was 170 MB/s. The dd > results and iostat record are in > > http://mseas.mit.edu/download/phaley/GlusterUsers/TestXFS/ > > I'll add tests for the other brick and to the NFS area later. > > Thanks > > Pat > > > On 06/12/2017 06:06 PM, Ben Turner wrote: >> Ok you are correct, you have a pure distributed volume. IE no replication overhead. So normally for pure dist I...

...t; Latest tests >>> >>> I have had time to run the tests for one of the dd tests you requested >>> to the underlying XFS FS. The median rate was 170 MB/s. The dd results >>> and iostat record are in >>> >>> http://mseas.mit.edu/download/phaley/GlusterUsers/TestXFS/ >>> >>> I'll add tests for the other brick and to the NFS area later. >>> >>> Thanks >>> >>> Pat >>> >>> >>> On 06/12/2017 06:06 PM, Ben Turner wrote: >>> >>> Ok you are correct, you h...

...eat 4.0K May 1 15:16 test >> >> Under this directory (mounted via nfs) user phaley can write >> >> ibfdr-compute-0-4(test)% touch dum >> ibfdr-compute-0-4(test)% >> >> I have put the packet captures in >> >> http://mseas.mit.edu/download/phaley/GlusterUsers/TestNFSmount/ >> >> capture_nfsfail.pcap has the results from the failed touch experiment >> capture_nfssucceed.pcap has the results from the successful touch >> experiment >> >> The command I used for these was >> >> tcpdump -i ib0 -nnSs 0 host...

...ri_fleat is "test" which phaley owns drwxrwsr-x 2 phaley dri_fleat 4.0K May 1 15:16 test Under this directory (mounted via nfs) user phaley can write ibfdr-compute-0-4(test)% touch dum ibfdr-compute-0-4(test)% I have put the packet captures in http://mseas.mit.edu/download/phaley/GlusterUsers/TestNFSmount/ capture_nfsfail.pcap has the results from the failed touch experiment capture_nfssucceed.pcap has the results from the successful touch experiment The command I used for these was tcpdump -i ib0 -nnSs 0 host 172.16.1.119 -w /root/capture_nfstest.pcap The brick log files are...

...t; > > Hi Pranith, > > The "dd" command was: > > dd if=/dev/zero count=4096 bs=1048576 of=zeros.txt conv=sync > > There were 2 instances where dd reported 22 seconds. The output from the > dd tests are in > > http://mseas.mit.edu/download/phaley/GlusterUsers/TestVol/dd_testvol_gluster.txt > > Pat > > On 05/30/2017 09:27 PM, Pranith Kumar Karampuri wrote: > > Pat, > > What is the command you used? As per the following output, it > > seems like at least one write operation took 16 seconds. Which is > > real...

...t; >> The "dd" command was: >> >> dd if=/dev/zero count=4096 bs=1048576 of=zeros.txt conv=sync >> >> There were 2 instances where dd reported 22 seconds. The output from the >> dd tests are in >> >> http://mseas.mit.edu/download/phaley/GlusterUsers/TestVol/dd_testvol_gluster.txt >> >> Pat >> >> On 05/30/2017 09:27 PM, Pranith Kumar Karampuri wrote: >>> Pat, >>> What is the command you used? As per the following output, it >>> seems like at least one write operation took 16 seconds....

On 06/27/2017 10:17 AM, Pranith Kumar Karampuri wrote: > The only problem with using gluster mounted via NFS is that it does not > respect the group write permissions which we need. > > We have an exercise coming up in the a couple of weeks. It seems to me > that in order to improve our write times before then, it would be good > to solve the group write permissions for gluster

We use qcow2 with libvirt based kvm on many small clusters and have found it to be exremely reliable though maybe not the fastest, though some of that is most of our storage is SATA SSDs in a software RAID1 config for each brick. What problems are you running into? You just mention 'problems' -wk On 6/1/23 8:42 AM, Christian Schoepplein wrote: > Hi, > > we'd like to use

On oVirt / Redhat Virtualization, the following Gluster volumes settings are recommended to be applied (preferably at the creation of the volume) These settings are important for data reliability, ( Note that Replica 3 or Replica 2+1 is expected ) performance.quick-read=off performance.read-ahead=off performance.io-cache=off performance.low-prio-threads=32 network.remote-dio=enable