Peter Auyeung
2015-Feb-05 18:02 UTC
[Gluster-users] [Gluster-devel] Input/Output Error on Gluster NFS
Hi Soumya root at glusterprod001:~# gluster volume info | grep nfs.acl 02/05/15 10:00:05 [ /root ] Seems like we do not have ACL enabled. nfs client is a RHEL4 standard NFS client Thanks -Peter ________________________________________ From: Soumya Koduri [skoduri at redhat.com] Sent: Wednesday, February 04, 2015 11:28 PM To: Peter Auyeung; gluster-users at gluster.org; gluster-devel at gluster.org Subject: Re: [Gluster-devel] [Gluster-users] Input/Output Error on Gluster NFS Hi Peter, Have you disabled Gluster-NFS ACLs . Please check the option value - #gluster v info | grep nfs.acl nfs.acl: ON Also please provide the details of the nfs-client you are using. Typically, nfs-clients seem to issue getxattr before doing setxattr/removexattr operations and return 'ENOTSUPP' incase of ACLs disabled. But from the strace, looks like the client has issued 'removexattr' of 'system.posix_acl_default' which returned EIO. Anyways, 'removexattr' should also have returned EOPNOTSUPP instead of EIO. Thanks, Soumya On 02/05/2015 02:31 AM, Peter Auyeung wrote:> I was trying to copy a directory of files to Gluster via NFS and getting > permission denied with Input/Output error > > ---> root at bizratedbstandby.bo2.shopzilla.sea (0.00)# cp -pr db /mnt/ > cp: setting permissions for `/mnt/db/full/pr_bizrate_standby_SMLS.F02-01-22-35.d': Input/output error > cp: setting permissions for `/mnt/db/full/pr_bizrate_standby_logging.F02-02-18-10.b': Input/output error > cp: setting permissions for `/mnt/db/full/pr_bizrate_SMLS.F02-01-22-35.d': Input/output error > cp: setting permissions for `/mnt/db/full/pr_bizrate_standby_master.F02-02-22-00': Input/output error > cp: setting permissions for `/mnt/db/full': Input/output error > cp: setting permissions for `/mnt/db': Input/output error > > Checked gluster nfs.log and etc log and bricks looks clean. > The files ends up able to copy over with right permission. > > Stack trace the copy and seems like it failed on removexattr > > removexattr("/mnt/db", "system.posix_acl_default"...) = -1 EIO (Input/output error) > > http://pastie.org/9884810 > > Any Clue? > > Thanks > Peter > > > > > > > > _______________________________________________ > Gluster-devel mailing list > Gluster-devel at gluster.org > http://www.gluster.org/mailman/listinfo/gluster-devel >
Soumya Koduri
2015-Feb-06 07:02 UTC
[Gluster-users] [Gluster-devel] Input/Output Error on Gluster NFS
On 02/05/2015 11:32 PM, Peter Auyeung wrote:> Hi Soumya > > root at glusterprod001:~# gluster volume info | grep nfs.acl > 02/05/15 10:00:05 [ /root ] > > Seems like we do not have ACL enabled. > > nfs client is a RHEL4 standard NFS clientOh by default ACLs are enabled. It seem to be shown in 'gluster volume info' only if we explicitly modify its value to ON/OFF. Can you please verify if the filesystem where your Gluster bricks have been created has been mounted with ACLs enabled. Thanks, Soumya> > Thanks > -Peter > ________________________________________ > From: Soumya Koduri [skoduri at redhat.com] > Sent: Wednesday, February 04, 2015 11:28 PM > To: Peter Auyeung; gluster-users at gluster.org; gluster-devel at gluster.org > Subject: Re: [Gluster-devel] [Gluster-users] Input/Output Error on Gluster NFS > > Hi Peter, > > Have you disabled Gluster-NFS ACLs . > > Please check the option value - > #gluster v info | grep nfs.acl > nfs.acl: ON > > Also please provide the details of the nfs-client you are using. > Typically, nfs-clients seem to issue getxattr before doing > setxattr/removexattr operations and return 'ENOTSUPP' incase of ACLs > disabled. But from the strace, looks like the client has issued > 'removexattr' of 'system.posix_acl_default' which returned EIO. > > Anyways, 'removexattr' should also have returned EOPNOTSUPP instead of EIO. > > Thanks, > Soumya > > On 02/05/2015 02:31 AM, Peter Auyeung wrote: >> I was trying to copy a directory of files to Gluster via NFS and getting >> permission denied with Input/Output error >> >> ---> root at bizratedbstandby.bo2.shopzilla.sea (0.00)# cp -pr db /mnt/ >> cp: setting permissions for `/mnt/db/full/pr_bizrate_standby_SMLS.F02-01-22-35.d': Input/output error >> cp: setting permissions for `/mnt/db/full/pr_bizrate_standby_logging.F02-02-18-10.b': Input/output error >> cp: setting permissions for `/mnt/db/full/pr_bizrate_SMLS.F02-01-22-35.d': Input/output error >> cp: setting permissions for `/mnt/db/full/pr_bizrate_standby_master.F02-02-22-00': Input/output error >> cp: setting permissions for `/mnt/db/full': Input/output error >> cp: setting permissions for `/mnt/db': Input/output error >> >> Checked gluster nfs.log and etc log and bricks looks clean. >> The files ends up able to copy over with right permission. >> >> Stack trace the copy and seems like it failed on removexattr >> >> removexattr("/mnt/db", "system.posix_acl_default"...) = -1 EIO (Input/output error) >> >> http://pastie.org/9884810 >> >> Any Clue? >> >> Thanks >> Peter >> >> >> >> >> >> >> >> _______________________________________________ >> Gluster-devel mailing list >> Gluster-devel at gluster.org >> http://www.gluster.org/mailman/listinfo/gluster-devel >>