Mark Selby
2016-Mar-05 01:42 UTC
[Gluster-users] NFS Client issues with Gluster Server 3.6.9
I am trying to use GlusterFS as a general purpose NFS file server. I have tried using the FUSE client but the performance fall off vs NFS is quite large Both the client and the server are Ubuntu 14.04. I am using Gluster 3.6.9 because of the FUSE performance issues that have been reported with 3.7.8 (see https://bugzilla.redhat.com/show_bug.cgi?id=1309462) I am having serious issues with a generic NFS client as shown by the issues below. Basically most FOPs are giving me a Remote I/O error. I would not think I was 1st person to see these issues - but my Google Fu is not working. Any and all help would be much appreciated BTW - These operation against a plain Linux NFS server work fine. root at dc1strg001x /var/log 448# gluster volume status Status of volume: backups Gluster process Port Online Pid ------------------------------------------------------------------------------ Brick dc1strg001x:/zfspool/glusterfs/backups/data 49152 Y 6462 Brick dc1strg002x:/zfspool/glusterfs/backups/data 49152 Y 6382 NFS Server on localhost 2049 Y 6619 Self-heal Daemon on localhost N/A Y 6626 NFS Server on dc1strg002x 2049 Y 6502 Self-heal Daemon on dc1strg002x N/A Y 6509 root at vc1test001 /root 735# mount -o vers=3 -t nfs dc1strg001x:/backups /mnt/backups_nfs root at vc1test001 /mnt/backups_nfs 737# dd if=/dev/zero of=testfile bs=16k count=16384 16384+0 records in 16384+0 records out 268435456 bytes (268 MB) copied, 2.46237 s, 109 MB/s root at vc1test001 /mnt/backups_nfs 738# rm testfile root at vc1test001 /mnt/backups_nfs 739# dd if=/dev/zero of=testfile bs=16k count=16384 dd: failed to open ~testfile~: Remote I/O error root at vc1test001 /var/tmp 743# rsync -av testfile /mnt/backups_nfs/ sending incremental file list testfile rsync: mkstemp "/mnt/backups_nfs/.testfile.bzg47C" failed: Remote I/O error (121) sent 1,074,004,056 bytes received 121 bytes 165,231,411.85 bytes/sec total size is 1,073,741,824 speedup is 1.00 rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1183) [sender=3.1.0]
Jiffin Tony Thottan
2016-Mar-07 05:13 UTC
[Gluster-users] NFS Client issues with Gluster Server 3.6.9
On 05/03/16 07:12, Mark Selby wrote:> I am trying to use GlusterFS as a general purpose NFS file server. I > have tried using the FUSE client but the performance fall off vs NFS > is quite large > > Both the client and the server are Ubuntu 14.04. > > I am using Gluster 3.6.9 because of the FUSE performance issues that > have been reported with 3.7.8 (see > https://bugzilla.redhat.com/show_bug.cgi?id=1309462) > > I am having serious issues with a generic NFS client as shown by the > issues below. Basically most FOPs are giving me a Remote I/O error. > > I would not think I was 1st person to see these issues - but my Google > Fu is not working. > > Any and all help would be much appreciated > > BTW - These operation against a plain Linux NFS server work fine. > > > root at dc1strg001x /var/log 448# gluster volume status > Status of volume: backups > Gluster process Port Online Pid > ------------------------------------------------------------------------------ > > Brick dc1strg001x:/zfspool/glusterfs/backups/data 49152 Y 6462 > Brick dc1strg002x:/zfspool/glusterfs/backups/data 49152 Y 6382 > NFS Server on localhost 2049 Y 6619 > Self-heal Daemon on localhost N/A Y 6626 > NFS Server on dc1strg002x 2049 Y 6502 > Self-heal Daemon on dc1strg002x N/A Y 6509 > > > root at vc1test001 /root 735# mount -o vers=3 -t nfs dc1strg001x:/backups > /mnt/backups_nfs > > root at vc1test001 /mnt/backups_nfs 737# dd if=/dev/zero of=testfile > bs=16k count=16384 > 16384+0 records in > 16384+0 records out > 268435456 bytes (268 MB) copied, 2.46237 s, 109 MB/s > > root at vc1test001 /mnt/backups_nfs 738# rm testfile > > root at vc1test001 /mnt/backups_nfs 739# dd if=/dev/zero of=testfile > bs=16k count=16384 > dd: failed to open ~testfile~: Remote I/O error > > root at vc1test001 /var/tmp 743# rsync -av testfile /mnt/backups_nfs/ > sending incremental file list > testfile > rsync: mkstemp "/mnt/backups_nfs/.testfile.bzg47C" failed: Remote I/O > error (121) > > sent 1,074,004,056 bytes received 121 bytes 165,231,411.85 bytes/sec > total size is 1,073,741,824 speedup is 1.00 > rsync error: some files/attrs were not transferred (see previous > errors) (code 23) at main.c(1183) [sender=3.1.0] >Can you please provide the volume configuration(gluster vol info ) and log file for nfs server which u mounted (/var/log/glusterfs) -- Jiffin> _______________________________________________ > Gluster-users mailing list > Gluster-users at gluster.org > http://www.gluster.org/mailman/listinfo/gluster-users