Ralph Boehme
2022-May-11 07:30 UTC
[Samba] Truncated list of files/folders when using AWS EFS share
On 5/11/22 08:54, Pednekar, Shirish via samba wrote:> I have Samba Server Version 4.14.5 installed on RHEL8 > (REDHAT_SUPPORT_PRODUCT_VERSION="8.5") Installed on an EC2 instance > and the mount is an EFS. I can't list all the files/folders browsing > from the windows client.does EFS support xattrs? If not, you could try setting "store dos attributes = no", but I'm not sure if this is going to help. You may want to closely inspect a Samba log with level 10, comparing both cases to find out where things go south. The code of the directory enumeration loop is not that hard to follow, in the logs look out for lines containing "smbd_dirptr_get_entry". Hth! -slow -- Ralph Boehme, Samba Team https://samba.org/ SerNet Samba Team Lead https://sernet.de/en/team-samba -------------- next part -------------- A non-text attachment was scrubbed... Name: OpenPGP_signature Type: application/pgp-signature Size: 840 bytes Desc: OpenPGP digital signature URL: <http://lists.samba.org/pipermail/samba/attachments/20220511/073cf49c/OpenPGP_signature.sig>
Jeremy Allison
2022-May-11 16:17 UTC
[Samba] Truncated list of files/folders when using AWS EFS share
On Wed, May 11, 2022 at 09:30:26AM +0200, Ralph Boehme via samba wrote:>On 5/11/22 08:54, Pednekar, Shirish via samba wrote: >>I have Samba Server Version 4.14.5 installed on RHEL8 >>(REDHAT_SUPPORT_PRODUCT_VERSION="8.5") Installed on an EC2 instance >>and the mount is an EFS. I can't list all the files/folders browsing >>from the windows client. > >does EFS support xattrs? If not, you could try setting "store dos >attributes = no", but I'm not sure if this is going to help. > >You may want to closely inspect a Samba log with level 10, comparing >both cases to find out where things go south. The code of the >directory enumeration loop is not that hard to follow, in the logs >look out for lines containing "smbd_dirptr_get_entry".This "feels" (no more data than that I'm afraid :-) like the duplicate fileid problem that got fixed in 4.15.7. Is there a chance you can install 4.15.7 or later on this box to check ? Jeremy.
Pednekar, Shirish
2022-May-16 01:56 UTC
[Samba] Truncated list of files/folders when using AWS EFS share
Hello Ralph, Thank you for looking into the case. I couldn?t find definite but saw some vague references about AWS EFS doesn't support xattrs. Since it was an easy try, I added the but to no effect. I then tried to track the smbd_dirptr_get_entry.The grep smbd_dirptr_get_entry shows the below and not sure what exactly to look at in this, smbd_dirptr_get_entry mask=[*] found test_tmp/file_20201030_000000.log fname=file_20201030_000000.log (file_20201030_000000.log) [2022/05/13 01:57:25.444968, 6, pid=531032, effective(97606749, 97601207), real(97606749, 0)] ../../source3/smbd/dir.c:823(smbd_dirptr_get_entry) smbd_dirptr_get_entry: dirptr 0x5627b77b4050 now at offset -2840337293508226108 [2022/05/13 01:57:25.445085, 3, pid=531032, effective(97606749, 97601207), real(97606749, 0)] ../../source3/smbd/dir.c:1025(smbd_dirptr_get_entry) smbd_dirptr_get_entry mask=[*] found test_tmp/file_20191031_080000.csv fname=file_20191031_080000.csv (file_20191031_080000.csv) [2022/05/13 01:57:25.445152, 6, pid=531032, effective(97606749, 97601207), real(97606749, 0)] ../../source3/smbd/dir.c:823(smbd_dirptr_get_entry) smbd_dirptr_get_entry: dirptr 0x5627b77b4050 now at offset -2840337293504025804 [2022/05/13 01:57:25.445269, 3, pid=531032, effective(97606749, 97601207), real(97606749, 0)] ../../source3/smbd/dir.c:1025(smbd_dirptr_get_entry) smbd_dirptr_get_entry mask=[*] found test_tmp/file_20200331_080000.csv fname=file_20200331_080000.csv (file_20200331_080000.csv) [2022/05/13 01:57:25.445334, 6, pid=531032, effective(97606749, 97601207), real(97606749, 0)] ../../source3/smbd/dir.c:823(smbd_dirptr_get_entry) smbd_dirptr_get_entry: dirptr 0x5627b77b4050 now at offset -2840337293503724356 [2022/05/13 01:57:25.445452, 3, pid=531032, effective(97606749, 97601207), real(97606749, 0)] ../../source3/smbd/dir.c:1025(smbd_dirptr_get_entry) smbd_dirptr_get_entry mask=[*] found test_tmp/file_20190313_080000.csv fname=file_20190313_080000.csv (file_20190313_080000.csv) [2022/05/13 01:57:25.445517, 6, pid=531032, effective(97606749, 97601207), real(97606749, 0)] ../../source3/smbd/dir.c:823(smbd_dirptr_get_entry) smbd_dirptr_get_entry: dirptr 0x5627b77b4050 now at offset -2840337293506046836 [2022/05/13 01:57:25.445645, 3, pid=531032, effective(97606749, 97601207), real(97606749, 0)] ../../source3/smbd/dir.c:1025(smbd_dirptr_get_entry) smbd_dirptr_get_entry mask=[*] found test_tmp/file_20201229.csv fname=file_20201229.csv (file_20201229.csv) [2022/05/13 01:57:25.445711, 6, pid=531032, effective(97606749, 97601207), real(97606749, 0)] ../../source3/smbd/dir.c:823(smbd_dirptr_get_entry) smbd_dirptr_get_entry: dirptr 0x5627b77b4050 now at offset -2840337293483267404 [2022/05/13 01:57:25.445828, 3, pid=531032, effective(97606749, 97601207), real(97606749, 0)] ../../source3/smbd/dir.c:1025(smbd_dirptr_get_entry) smbd_dirptr_get_entry mask=[*] found test_tmp/file_20190221_080000.csv fname=file_20190221_080000.csv (file_20190221_080000.csv) [2022/05/13 01:57:25.570669, 6, pid=531032, effective(97606749, 97601207), real(97606749, 0)] ../../source3/smbd/dir.c:823(smbd_dirptr_get_entry) smbd_dirptr_get_entry: dirptr 0x5627b77b4050 now at offset -1 Towards the end of ?smbd_dirptr_get_entry? , the following lines appear [2022/05/13 01:57:25.570682, 3, pid=531032, effective(97606749, 97601207), real(97606749, 0), class=smb2] ../../source3/smbd/smb2_server.c:3874(smbd_smb2_request_error_ex) smbd_smb2_request_error_ex: smbd_smb2_request_error_ex: idx[1] status[STATUS_NO_MORE_FILES] || at ../../source3/smbd/smb2_query_directory.c:160 [2022/05/13 01:57:25.570693, 10, pid=531032, effective(97606749, 97601207), real(97606749, 0), class=smb2] ../../source3/smbd/smb2_server.c:3766(smbd_smb2_request_done_ex) smbd_smb2_request_done_ex: mid [166] idx[1] status[STATUS_NO_MORE_FILES] body[8] dyn[yes:1] at ../../source3/smbd/smb2_server.c:3922 [2022/05/13 01:57:25.570704, 10, pid=531032, effective(97606749, 97601207), real(97606749, 0), class=smb2_credits] ../../source3/smbd/smb2_server.c:981(smb2_set_operation_credit) smb2_set_operation_credit: smb2_set_operation_credit: requested 1, charge 1, granted 1, current possible/max 8070/8192, total granted/max/low/range 123/8192/167/123 [2022/05/13 01:57:25.570993, 10, pid=531032, effective(97606749, 97601207), real(97606749, 0), class=smb2] ../../source3/smbd/smb2_server.c:4901(smbd_smb2_io_handler) smbd_smb2_request idx[1] of 5 vectors Thanks, Shirish From: Ralph Boehme <slow at samba.org> Sent: Wednesday, May 11, 2022 3:30 PM To: Pednekar, Shirish <Shirish.Pednekar at qube-rt.com>; samba at lists.samba.org Subject: Re: [Samba] Truncated list of files/folders when using AWS EFS share On 5/11/22 08:54, Pednekar, Shirish via samba wrote:> I have Samba Server Version 4.14.5 installed on RHEL8 > (REDHAT_SUPPORT_PRODUCT_VERSION="8.5") Installed on an EC2 instance > and the mount is an EFS. I can't list all the files/folders browsing > from the windows client.does EFS support xattrs? If not, you could try setting "store dos attributes = no", but I'm not sure if this is going to help. You may want to closely inspect a Samba log with level 10, comparing both cases to find out where things go south. The code of the directory enumeration loop is not that hard to follow, in the logs look out for lines containing "smbd_dirptr_get_entry". Hth! -slow -- Ralph Boehme, Samba Team https://samba.org/<https://samba.org> SerNet Samba Team Lead https://sernet.de/en/team-samba<https://sernet.de/en/team-samba>