Marc-Henri Pamiseux
2020-Jul-04 16:21 UTC
[Samba] Migrate a share from Mac-OSX to NAS ASUSTOR samba 4.4
Hello everyone, I hope you are well. Take care of yourself. I have the same problem as describe here: https://lists.samba.org/archive/samba/2014-December/187545.html I migrate a file share from a MAC-OS environment. For its new storage system, the company purchased an ASUSTOR NAS. This NAS works with an operating system based on version 4.14 of the GNU / LINUX x86_64 kernel. This NAS operates a Samba service in version 4.4.3. On this NAS, Samba's configuration file is locate in /usr/builtin/etc/samba/smb.conf. So I edited this file, then added the following directives in the Global section: mangled names = no display charset = UTF-8 unix charset = UTF-8 vfs objects = catia fruit streams_xattr fruit: nfs_aces = no fruit: encoding = native I have made no change in the "Share" sections. I restarted the smbd, nmbd and winbindd services. Note that there is no testparm utility on this NAS. Now, when I try to access a file named historically on Mac-OS with one of the characters prohibited by Microsoft, the file manager tells me that the file (by indicating its name) cannot be found ... I would like that, these files stored on the NAS, even if they are misnamed, can be opened from a MAC-OSX station, but also from a Windows station. Do you have an idea on how to do this? Thank you in advance for all your ideas and your time spent. ******************************** French ******************************** Bonjour tout le monde, J'esp?re que vous vous portez bien. Prenez soin de vous. Je rencontre le m?me probl?me que le billet mentionn? ici : https://lists.samba.org/archive/samba/2014-December/187545.html Je migre un partage de fichier depuis un environnement MAC-OS. Pour son nouveau syst?me de stockage, l'entreprise a achet? un NAS ASUSTOR. Ce NAS fonctionne sur un syst?me d'exploitation GNU/LINUX x86_64 version 4.14 du noyau. Ce NAS fait fonctionner un service Samba en version 4.4.3. Sur ce NAS, le fichier de configuration du NAS est situ? dans /usr/builtin/etc/samba/smb.conf. J'ai donc ?dit? ce fichier, puis j'ai ajout? les directives suivantes dans la section Globale : mangled names = no display charset = UTF-8 unix charset = UTF-8 vfs objects = catia fruit streams_xattr fruit:nfs_aces = no fruit:encoding = native Je n'ai apport? aucune modification dans les sections d?finissant les partages. J'ai red?marr? les services smbd, nmbd et winbindd. A noter qu'il n'existe pas d'utilitaire testparm sur ce NAS. A pr?sent, lorsque je tente d'acc?der ? un fichier nomm? historiquement avec l'un des caract?res interdit par Microsoft, le gestionnaire de fichier m'indique que le fichier (en indiquant son nom) est introuvable... J'aimerai que ces fichiers stock?s sur le NAS, m?me s'ils sont mal nomm?s, puissent s'ouvrir depuis un poste MAC-OSX, mais aussi depuis un poste Windows. Avez vous une id?e sur la mani?re de proc?der ? Merci d'avance pour toutes vos id?es et votre temps pass?. -- Marc-Henri Pamiseux - SARL Libricks - www.libricks.fr 6 rue L?onard de Vinci - CS 20119, 53001 LAVAL Cedex Tel. : 02.30.96.15.24 / Mobile : 06.26.71.30.97
Jeremy Allison
2020-Jul-07 00:54 UTC
[Samba] Migrate a share from Mac-OSX to NAS ASUSTOR samba 4.4
On Sat, Jul 04, 2020 at 06:21:57PM +0200, Marc-Henri Pamiseux via samba wrote:> Hello everyone, > I hope you are well. Take care of yourself. > > I have the same problem as describe here: > https://lists.samba.org/archive/samba/2014-December/187545.html > > I migrate a file share from a MAC-OS environment. For its new storage > system, the company purchased an ASUSTOR NAS. This NAS works with an > operating system based on version 4.14 of the GNU / LINUX x86_64 kernel. > This NAS operates a Samba service in version 4.4.3. > > On this NAS, Samba's configuration file is locate in > /usr/builtin/etc/samba/smb.conf. So I edited this file, then added the > following directives in the Global section: > > mangled names = no > display charset = UTF-8 > unix charset = UTF-8 > vfs objects = catia fruit streams_xattr > fruit: nfs_aces = no > fruit: encoding = native > > I have made no change in the "Share" sections. I restarted the smbd, > nmbd and winbindd services. Note that there is no testparm utility on > this NAS. > > Now, when I try to access a file named historically on Mac-OS with one > of the characters prohibited by Microsoft, the file manager tells me > that the file (by indicating its name) cannot be found ... > > I would like that, these files stored on the NAS, even if they are > misnamed, can be opened from a MAC-OSX station, but also from a Windows > station. Do you have an idea on how to do this?Can you get a wireshark trace plus a debug level 10 from the NAS ?
Marc-Henri Pamiseux
2020-Jul-07 22:31 UTC
[Samba] Migrate a share from Mac-OSX to NAS ASUSTOR samba 4.4
Hi Jeremy, Thank you for your reply. I don't use a Mac for myself. I use Linux at work. The problem I described concerns a client. They work for a newspaper. They use Adobe InDesign documents. The documents are generated by a service running under Microsoft Windows. To share the generated data, I had the idea of ??using an ASUSTOR NAS. The server application continues to operate but the MACs fail to use SMB sharing effectively. The NAS uses Windows ACLs. Since the users will be here tomorrow, I will change the log level for the tests. I already have a log but at level 2. In addition, I do not have a tcpdump utility compiled for this NAS, so it will not be easy to capture. Best regards ********************************************* Salut Jeremy, Merci pour votre r?ponse. Je n'utilise pas de Mac pour moi-m?me. J'utilise Linux au travail. Le probl?me que j'ai d?crit concerne un client. Ils travaillent pour un journal. Ils utilisent des documents Adobe InDesign. Les documents sont g?n?r?s par un serveur fonctionnant sous Microsoft Windows. Pour partager les donn?es g?n?r?es, j'ai eu l'id?e d'utiliser un NAS ASUSTOR. L'application serveur continue de fonctionner mais les MAC ne parviennent pas ? utiliser efficacement le partage SMB. Le NAS utilise les ACL Windows. ?tant donn? que les utilisateurs seront l? demain, je modifierai le niveau de journalisation pour les tests. J'ai d?j? un journal mais au niveau 2. De plus, je n'ai pas d'utilitaire tcpdump compil? pour ce NAS, donc ce ne sera pas facile ? capturer. Respectueusement, -- Marc-Henri Pamiseux - SARL Libricks - www.libricks.fr 6 rue L?onard de Vinci - CS 20119, 53001 LAVAL Cedex Tel. : 02.30.96.15.24 / Mobile : 06.26.71.30.97 Le 07/07/2020 ? 02:54, Jeremy Allison a ?crit?:> Can you get a wireshark trace plus a debug level 10 from > the NAS ? >
Marc-Henri Pamiseux
2020-Jul-08 13:24 UTC
[Samba] Migrate a share from Mac-OSX to NAS ASUSTOR samba 4.4
Hello, This migration generates several side effects. I modified the "log level" directive as follows: log level = 3 smb: 10 vfs: 10 acls: 10 locking: 10 I asked a user to open a document. He used the document named Unlink_200710_AVA_025_01. The latter does not have a file extension. This is an Indesign file: # file /volume1/Gaia/Production/DOCUMENTS/ Unlink_200710_AVA_025_01 /volume1/Gaia/Production/DOCUMENTS/Unlink_200710_AVA_025_01: Adobe InDesign Document InDesign has a special feature regarding file locking. When the application opens a file, it creates a lock in the form of a file in the same folder but with the extension .idlk: ~unlink_200710_ava_~ccjye8.idlk When you quit the InDesign application and close the file, the application deletes this file with the .idlk extension by itself. It turns out that since the migration, I notice that the .idlk files are no longer deleted. -> Here is an extract of the traces concerning this process: ------------------------------------------------------ [2020/07/08 13:24:40.516349, 10, pid=4486, effective(10007, 10002), real(10007, 0), class=vfs] ../source3/smbd/vfs.c:1316(check_reduced_name) check_reduced_name: check_reduced_name [Production/DOCUMENTS/Unlink_200710_AVA_025_01] [/volume1/Gaia] [2020/07/08 13:24:40.516414, 10, pid=4486, effective(10007, 10002), real(10007, 0), class=vfs] ../source3/smbd/vfs.c:1376(check_reduced_name) check_reduced_name realpath [Production/DOCUMENTS/Unlink_200710_AVA_025_01] -> [/volume1/Gaia/Production/DOCUMENTS/Unlink_200710_AVA_025_01] [2020/07/08 13:24:40.516414, 10, pid=4486, effective(10007, 10002), real(10007, 0), class=vfs] ../source3/smbd/vfs.c:1376(check_reduced_name) check_reduced_name realpath [Production/DOCUMENTS/Unlink_200710_AVA_025_01] -> [/volume1/Gaia/Production/DOCUMENTS/Unlink_200710_AVA_025_01] [2020/07/08 13:24:40.516444, 5, pid=4486, effective(10007, 10002), real(10007, 0), class=vfs] ../source3/smbd/vfs.c:1463(check_reduced_name) check_reduced_name: Production/DOCUMENTS/Unlink_200710_AVA_025_01 reduced to /volume1/Gaia/Production/DOCUMENTS/Unlink_200710_AVA_025_01 [2020/07/08 13:24:40.516811, 3, pid=4486, effective(10007, 10002), real(10007, 0)] ../source3/smbd/dir.c:1188(smbd_dirptr_get_entry) smbd_dirptr_get_entry mask=[Unlink_200710_AVA_025_01] found Production/DOCUMENTS/Unlink_200710_AVA_025_01 fname=Unlink_200710_AVA_025_01 (Unlink_200710_AVA_025_01) [2020/07/08 13:24:40.516864, 2, pid=4486, effective(10007, 10002), real(10007, 0)] ../source3/modules/vfs_fruit.c:895(ad_header_read_rsrc) open AppleDouble: Production/DOCUMENTS/._Unlink_200710_AVA_025_01, No such file or directory [2020/07/08 13:24:40.517046, 10, pid=4486, effective(10007, 10002), real(10007, 0), class=locking] ../source3/locking/share_mode_lock.c:275(share_mode_memcache_fe fetched entry for file Production/DOCUMENTS seq 0x10792665304706506964 key 15:791901:0 [2020/07/08 13:24:40.517093, 10, pid=4486, effective(10007, 10002), real(10007, 0), class=locking] ../source3/locking/locking.c:1225(find_delete_on_close_token) find_delete_on_close_token: name_hash = 0x9879a1fe [2020/07/08 13:24:40.517124, 10, pid=4486, effective(10007, 10002), real(10007, 0), class=locking] ../source3/locking/share_mode_lock.c:147(share_mode_memcache_de deleting entry for file Production/DOCUMENTS seq 0x10792665304706506964 key 15:791901:0 [2020/07/08 13:24:40.517156, 10, pid=4486, effective(10007, 10002), real(10007, 0), class=locking] ../source3/locking/share_mode_lock.c:370(unparse_share_modes) No used share mode found [2020/07/08 13:24:40.515674, 10, pid=4486, effective(10007, 10002), real(10007, 0), class=vfs] ../source3/smbd/vfs.c:1316(check_reduced_name) check_reduced_name: check_reduced_name [Production/DOCUMENTS] [/volume1/Gaia] [2020/07/08 13:24:40.515750, 10, pid=4486, effective(10007, 10002), real(10007, 0), class=vfs] ../source3/smbd/vfs.c:1376(check_reduced_name) check_reduced_name realpath [Production/DOCUMENTS] -> [/volume1/Gaia/Production/DOCUMENTS] [2020/07/08 13:24:40.515780, 5, pid=4486, effective(10007, 10002), real(10007, 0), class=vfs] ../source3/smbd/vfs.c:1463(check_reduced_name) check_reduced_name: Production/DOCUMENTS reduced to /volume1/Gaia/Production/DOCUMENTS [2020/07/08 13:24:40.516012, 10, pid=4486, effective(10007, 10002), real(10007, 0), class=vfs] ../source3/modules/vfs_streams_xattr.c:406(streams_xattr_open) streams_xattr_open called for Production/DOCUMENTS with flags 0x10000 [2020/07/08 13:24:40.516062, 10, pid=4486, effective(10007, 10002), real(10007, 0), class=vfs] ../source3/modules/vfs_streams_xattr.c:238(streams_xattr_fstat) streams_xattr_fstat called for 25 [2020/07/08 13:24:40.516110, 10, pid=4486, effective(10007, 10002), real(10007, 0), class=locking] ../source3/locking/share_mode_lock.c:147(share_mode_memcache_delete) deleting entry for file Production/DOCUMENTS seq 0x10792665304706506963 key 15:791901:0 [2020/07/08 13:24:40.516172, 10, pid=4486, effective(10007, 10002), real(10007, 0), class=locking] ../source3/locking/share_mode_lock.c:161(share_mode_memcache_store) stored entry for file Production/DOCUMENTS seq 0x10792665304706506964 key 15:791901:0 [2020/07/08 13:24:40.516349, 10, pid=4486, effective(10007, 10002), real(10007, 0), class=vfs] ../source3/smbd/vfs.c:1316(check_reduced_name) check_reduced_name: check_reduced_name [Production/DOCUMENTS/Unlink_200710_AVA_025_01] [/volume1/Gaia] [2020/07/08 13:24:40.516414, 10, pid=4486, effective(10007, 10002), real(10007, 0), class=vfs] ../source3/smbd/vfs.c:1376(check_reduced_name) check_reduced_name realpath [Production/DOCUMENTS/Unlink_200710_AVA_025_01] -> [/volume1/Gaia/Production/DOCUMENTS/Unlink_200710_AVA_025_01] [2020/07/08 13:24:40.516444, 5, pid=4486, effective(10007, 10002), real(10007, 0), class=vfs] ../source3/smbd/vfs.c:1463(check_reduced_name) check_reduced_name: Production/DOCUMENTS/Unlink_200710_AVA_025_01 reduced to /volume1/Gaia/Production/DOCUMENTS/Unlink_200710_AVA_025_01 [2020/07/08 13:24:40.516485, 3, pid=4486, effective(10007, 10002), real(10007, 0)] ../source3/smbd/dir.c:629(dptr_create) creating new dirptr 0 for path Production/DOCUMENTS, expect_close = 0 [2020/07/08 13:24:40.516811, 3, pid=4486, effective(10007, 10002), real(10007, 0)] ../source3/smbd/dir.c:1188(smbd_dirptr_get_entry) smbd_dirptr_get_entry mask=[Unlink_200710_AVA_025_01] found Production/DOCUMENTS/Unlink_200710_AVA_025_01 fname=Unlink_200710_AVA_025_01 (Unlink_200710_AVA_025_01) [2020/07/08 13:24:40.516864, 2, pid=4486, effective(10007, 10002), real(10007, 0)] ../source3/modules/vfs_fruit.c:895(ad_header_read_rsrc) open AppleDouble: Production/DOCUMENTS/._Unlink_200710_AVA_025_01, No such file or directory [2020/07/08 13:24:40.517046, 10, pid=4486, effective(10007, 10002), real(10007, 0), class=locking] ../source3/locking/share_mode_lock.c:275(share_mode_memcache_fetch) fetched entry for file Production/DOCUMENTS seq 0x10792665304706506964 key 15:791901:0 [2020/07/08 13:24:40.517093, 10, pid=4486, effective(10007, 10002), real(10007, 0), class=locking] ../source3/locking/locking.c:1225(find_delete_on_close_token) find_delete_on_close_token: name_hash = 0x9879a1fe [2020/07/08 13:24:40.517124, 10, pid=4486, effective(10007, 10002), real(10007, 0), class=locking] ../source3/locking/share_mode_lock.c:147(share_mode_memcache_delete) deleting entry for file Production/DOCUMENTS seq 0x10792665304706506964 key 15:791901:0 [2020/07/08 13:24:40.517156, 10, pid=4486, effective(10007, 10002), real(10007, 0), class=locking] ../source3/locking/share_mode_lock.c:370(unparse_share_modes) No used share mode found ------------------------------------------------------ I do not understand. Thank you in advance for enlightening me. Yours. ******************************** French ******************************** Bonjour, Cette migration g?n?re plusieurs effets de bord. J'ai modifi? la directive de "log level" de la mani?re suivante : log level = 3 smb:10 vfs:10 acls:10 locking:10 J'ai demand? ? un utilisateur d'ouvrir un document. Il s'agit du document nomm? Unlink_200710_AVA_025_01. Ce dernier ne porte pas d'extension de fichier. Il s'agit d'un fichier Indesign : # file /volume1/Gaia/Production/DOCUMENTS/Unlink_200710_AVA_025_01 /volume1/Gaia/Production/DOCUMENTS/Unlink_200710_AVA_025_01: Adobe InDesign Document InDesign poss?de une particularit? concernant le verrouillage des fichiers. Lorsque l'application ouvre un fichier, elle cr?? un verrou sous forme d'un fichier dans le m?me dossier mais portant l'extension .idlk : ~unlink_200710_ava_~ccjye8.idlk Lorsque l'on quitte l'application InDesign et que l'on ferme le fichier, l'application supprime d'elle m?me ce fichier d'extension .idlk. Il s'av?re que depuis la migration, je constate que les fichier .idlk ne sont plus supprim?s. -> Voici un extrait des traces concernant ce proc?d? : ------------------------------------------------------ {... Voir pr?c?dement ...} ------------------------------------------------------ Je ne comprends pas. Merci par avance pour m'?clairer. Bien ? vous. -- Marc-Henri Pamiseux - SARL Libricks - www.libricks.fr 6 rue L?onard de Vinci - CS 20119, 53001 LAVAL Cedex Tel. : 02.30.96.15.24 / Mobile : 06.26.71.30.97