Raghavendra Talur
2017-May-31 15:19 UTC
[Gluster-users] URGENT: Update issues from 3.6.6 to 3.10.2 Accessing files via samba come up with permission denied
If possible please share the glusterfs-* log files from /var/log/samba. This might be because of cluster.lookup-optimize. Adding Poornima and Raghavendra Gowdappa to help with this. On Wed, May 31, 2017 at 1:03 AM, Diego Remolina <dijuremo at gmail.com> wrote:> This is a bit puzzling, not sure what difference it would make, but: > > 1. Try to open file that has a problem, ie. MyRevitFile.rvt > Revit opens and shows a window that says access denied. > > 2. Rename file, i.e from windows explorer right click, rename to > MyRevitFile2.rvt > > 3. Without opening the file, rename file back to the original, i.e > MyRevitFile.rvt > > 4. Double click on file and now it will open just fine without the > Access Denied error. > > Any explanation for this? Could the rename operation be forcing or > updating some attributes that then allow the file to open? > > Diego > > On Tue, May 30, 2017 at 10:57 AM, Diego Remolina <dijuremo at gmail.com> wrote: >> This is what I see in the logs set from smb.conf via line -> >> glusterfs:logfile = /var/log/samba/glusterfs-projects.log >> >> [2017-05-30 14:52:31.051524] E [MSGID: 123001] >> [io-cache.c:564:ioc_open_cbk] 0-export-io-cache: inode context is NULL >> (a97bc9bb-68cf-4a69-aef7-39766b323c14) [Invalid argument] >> [2017-05-30 14:52:31.241850] W [MSGID: 114031] >> [client-rpc-fops.c:1100:client3_3_getxattr_cbk] 0-export-client-0: >> remote operation failed. Path: >> /projects/INACTIVE/WESTCOAST/Automotive/Acura/AS-Acura of Richmond/02 >> DRAWINGS/02 ARCH/CrownAcura-SD02-ArchModel.rvt (a97bc9bb-68cf-4a69- >> aef7-39766b323c14). Key: glusterfs.get_real_filename:desktop.ini [Not >> a directory] >> [2017-05-30 14:52:31.242956] W [MSGID: 114031] >> [client-rpc-fops.c:1100:client3_3_getxattr_cbk] 0-export-client-1: >> remote operation failed. Path: >> /projects/INACTIVE/WESTCOAST/Automotive/Acura/AS-Acura of Richmond/02 >> DRAWINGS/02 ARCH/CrownAcura-SD02-ArchModel.rvt (a97bc9bb-68cf-4a69- >> aef7-39766b323c14). Key: glusterfs.get_real_filename:desktop.ini [Not >> a directory] >> >> >> On Tue, May 30, 2017 at 10:37 AM, Diego Remolina <dijuremo at gmail.com> wrote: >>> Hi, >>> >>> Over the weekend we updated a two server glusterfs 3.6.6 install to >>> 3.10.2 We also updated samba and samba-vfs to the latest in CentOS. I >>> enabled several of the newer caching features from gluster 3.9 for >>> small file performance and samba, and we now seem to have some issues >>> with accessing files from glusterfs. When users try to access some >>> files, they get a Permission denied message. This seems to be only via >>> samba as I am able to su - username and then do strings on the file. >>> >>> [root at ysmha02 gluster-backups]# rpm -qa | grep gluster >>> glusterfs-client-xlators-3.10.2-1.el7.x86_64 >>> glusterfs-server-3.10.2-1.el7.x86_64 >>> glusterfs-api-3.10.2-1.el7.x86_64 >>> glusterfs-3.10.2-1.el7.x86_64 >>> glusterfs-cli-3.10.2-1.el7.x86_64 >>> centos-release-gluster310-1.0-1.el7.centos.noarch >>> samba-vfs-glusterfs-4.4.4-14.el7_3.x86_64 >>> glusterfs-fuse-3.10.2-1.el7.x86_64 >>> glusterfs-libs-3.10.2-1.el7.x86_64 >>> glusterfs-rdma-3.10.2-1.el7.x86_64 >>> >>> [root at ysmha02 gluster-backups]# rpm -qa | grep samba >>> samba-common-libs-4.4.4-14.el7_3.x86_64 >>> samba-common-tools-4.4.4-14.el7_3.x86_64 >>> samba-libs-4.4.4-14.el7_3.x86_64 >>> samba-4.4.4-14.el7_3.x86_64 >>> samba-client-libs-4.4.4-14.el7_3.x86_64 >>> samba-vfs-glusterfs-4.4.4-14.el7_3.x86_64 >>> samba-common-4.4.4-14.el7_3.noarch >>> >>> On the samba logs for the machine I notice something weird, samba >>> seems to be trying to stat the file we are trying as a directory to >>> see if it contains desktop.ini: >>> >>> [2017/05/30 10:13:07.297026, 0] >>> ../source3/modules/vfs_glusterfs.c:870(vfs_gluster_stat) >>> glfs_stat(ACTIVE/Automotive/FORD/AN - Ford East/02 >>> DRAWINGS/CURRENT/AN-FORD EAST_04-05-17_CD_R17.rvt/desktop.ini) failed: >>> Not a directory >>> [2017/05/30 10:13:07.298155, 0] >>> ../source3/modules/vfs_glusterfs.c:870(vfs_gluster_stat) >>> glfs_stat(ACTIVE/Automotive/FORD/AN - Ford East/02 >>> DRAWINGS/CURRENT/AN-FORD EAST_04-05-17_CD_R17.rvt/desktop.ini) failed: >>> Not a directory >>> >>> This seems to be happening only with files with the .rvt extension. >>> Though these files are usually larger in size vs other smaller excel, >>> power point, etc files. >>> >>> Here are the complete options for the volume: >>> >>> https://pastebin.com/ZH2vMsMN >>> >>> I turned off performance.cache-samba-metadata again to see if that >>> would help, but seems it does not help. >>> >>> I really appreciate any help with this. >>> >>> DIego > _______________________________________________ > Gluster-users mailing list > Gluster-users at gluster.org > http://lists.gluster.org/mailman/listinfo/gluster-users
Diego Remolina
2017-May-31 15:34 UTC
[Gluster-users] URGENT: Update issues from 3.6.6 to 3.10.2 Accessing files via samba come up with permission denied
Please download the log file from this link: https://drive.google.com/open?id=0B8EAPWIe4oyKN0h0X1pZVkRWVEU Let me know if you need any other log files. Diego On Wed, May 31, 2017 at 11:19 AM, Raghavendra Talur <rtalur at redhat.com> wrote:> If possible please share the glusterfs-* log files from /var/log/samba. > > This might be because of cluster.lookup-optimize. Adding Poornima and > Raghavendra Gowdappa to help with this. > > > On Wed, May 31, 2017 at 1:03 AM, Diego Remolina <dijuremo at gmail.com> wrote: >> This is a bit puzzling, not sure what difference it would make, but: >> >> 1. Try to open file that has a problem, ie. MyRevitFile.rvt >> Revit opens and shows a window that says access denied. >> >> 2. Rename file, i.e from windows explorer right click, rename to >> MyRevitFile2.rvt >> >> 3. Without opening the file, rename file back to the original, i.e >> MyRevitFile.rvt >> >> 4. Double click on file and now it will open just fine without the >> Access Denied error. >> >> Any explanation for this? Could the rename operation be forcing or >> updating some attributes that then allow the file to open? >> >> Diego >> >> On Tue, May 30, 2017 at 10:57 AM, Diego Remolina <dijuremo at gmail.com> wrote: >>> This is what I see in the logs set from smb.conf via line -> >>> glusterfs:logfile = /var/log/samba/glusterfs-projects.log >>> >>> [2017-05-30 14:52:31.051524] E [MSGID: 123001] >>> [io-cache.c:564:ioc_open_cbk] 0-export-io-cache: inode context is NULL >>> (a97bc9bb-68cf-4a69-aef7-39766b323c14) [Invalid argument] >>> [2017-05-30 14:52:31.241850] W [MSGID: 114031] >>> [client-rpc-fops.c:1100:client3_3_getxattr_cbk] 0-export-client-0: >>> remote operation failed. Path: >>> /projects/INACTIVE/WESTCOAST/Automotive/Acura/AS-Acura of Richmond/02 >>> DRAWINGS/02 ARCH/CrownAcura-SD02-ArchModel.rvt (a97bc9bb-68cf-4a69- >>> aef7-39766b323c14). Key: glusterfs.get_real_filename:desktop.ini [Not >>> a directory] >>> [2017-05-30 14:52:31.242956] W [MSGID: 114031] >>> [client-rpc-fops.c:1100:client3_3_getxattr_cbk] 0-export-client-1: >>> remote operation failed. Path: >>> /projects/INACTIVE/WESTCOAST/Automotive/Acura/AS-Acura of Richmond/02 >>> DRAWINGS/02 ARCH/CrownAcura-SD02-ArchModel.rvt (a97bc9bb-68cf-4a69- >>> aef7-39766b323c14). Key: glusterfs.get_real_filename:desktop.ini [Not >>> a directory] >>> >>> >>> On Tue, May 30, 2017 at 10:37 AM, Diego Remolina <dijuremo at gmail.com> wrote: >>>> Hi, >>>> >>>> Over the weekend we updated a two server glusterfs 3.6.6 install to >>>> 3.10.2 We also updated samba and samba-vfs to the latest in CentOS. I >>>> enabled several of the newer caching features from gluster 3.9 for >>>> small file performance and samba, and we now seem to have some issues >>>> with accessing files from glusterfs. When users try to access some >>>> files, they get a Permission denied message. This seems to be only via >>>> samba as I am able to su - username and then do strings on the file. >>>> >>>> [root at ysmha02 gluster-backups]# rpm -qa | grep gluster >>>> glusterfs-client-xlators-3.10.2-1.el7.x86_64 >>>> glusterfs-server-3.10.2-1.el7.x86_64 >>>> glusterfs-api-3.10.2-1.el7.x86_64 >>>> glusterfs-3.10.2-1.el7.x86_64 >>>> glusterfs-cli-3.10.2-1.el7.x86_64 >>>> centos-release-gluster310-1.0-1.el7.centos.noarch >>>> samba-vfs-glusterfs-4.4.4-14.el7_3.x86_64 >>>> glusterfs-fuse-3.10.2-1.el7.x86_64 >>>> glusterfs-libs-3.10.2-1.el7.x86_64 >>>> glusterfs-rdma-3.10.2-1.el7.x86_64 >>>> >>>> [root at ysmha02 gluster-backups]# rpm -qa | grep samba >>>> samba-common-libs-4.4.4-14.el7_3.x86_64 >>>> samba-common-tools-4.4.4-14.el7_3.x86_64 >>>> samba-libs-4.4.4-14.el7_3.x86_64 >>>> samba-4.4.4-14.el7_3.x86_64 >>>> samba-client-libs-4.4.4-14.el7_3.x86_64 >>>> samba-vfs-glusterfs-4.4.4-14.el7_3.x86_64 >>>> samba-common-4.4.4-14.el7_3.noarch >>>> >>>> On the samba logs for the machine I notice something weird, samba >>>> seems to be trying to stat the file we are trying as a directory to >>>> see if it contains desktop.ini: >>>> >>>> [2017/05/30 10:13:07.297026, 0] >>>> ../source3/modules/vfs_glusterfs.c:870(vfs_gluster_stat) >>>> glfs_stat(ACTIVE/Automotive/FORD/AN - Ford East/02 >>>> DRAWINGS/CURRENT/AN-FORD EAST_04-05-17_CD_R17.rvt/desktop.ini) failed: >>>> Not a directory >>>> [2017/05/30 10:13:07.298155, 0] >>>> ../source3/modules/vfs_glusterfs.c:870(vfs_gluster_stat) >>>> glfs_stat(ACTIVE/Automotive/FORD/AN - Ford East/02 >>>> DRAWINGS/CURRENT/AN-FORD EAST_04-05-17_CD_R17.rvt/desktop.ini) failed: >>>> Not a directory >>>> >>>> This seems to be happening only with files with the .rvt extension. >>>> Though these files are usually larger in size vs other smaller excel, >>>> power point, etc files. >>>> >>>> Here are the complete options for the volume: >>>> >>>> https://pastebin.com/ZH2vMsMN >>>> >>>> I turned off performance.cache-samba-metadata again to see if that >>>> would help, but seems it does not help. >>>> >>>> I really appreciate any help with this. >>>> >>>> DIego >> _______________________________________________ >> Gluster-users mailing list >> Gluster-users at gluster.org >> http://lists.gluster.org/mailman/listinfo/gluster-users