Neil Richardson
2018-Nov-25 15:39 UTC
[Gluster-users] Missing glusterfs.so (Gluster + Samba-VFS under Ubuntu)
Hi, guys. I'm new to all of this and need some help with a problem I've been banging my head against for a while. (Tried troubleshooting, checking logs, and lots of Googling for a few weeks now, but just keep hitting dead ends.) SYMPTOM: Missing file `/usr/lib/x86_64-linux-gnu/samba/vfs/glusterfs.so`, as evidenced by error messages like these: [2018/11/18 07:56:42.551587, 0] ../lib/util/modules.c:49(load_module) Error loading module '/usr/lib/x86_64-linux-gnu/samba/vfs/glusterfs.so': /usr/lib/x86_64-linux-gnu/samba/vfs/glusterfs.so: cannot open shared object file: No such file or directory [2018/11/18 07:56:42.551652, 0] ../source3/smbd/vfs.c:184(vfs_init_custom) error probing vfs module 'glusterfs': NT_STATUS_UNSUCCESSFUL [2018/11/18 07:56:42.551694, 0] ../source3/smbd/vfs.c:379(smbd_vfs_init) smbd_vfs_init: vfs_init_custom failed for glusterfs [2018/11/18 07:56:42.551729, 0] ../source3/smbd/service.c:623(make_connection_snum) vfs_init failed for service music PROBLEM: I was able to get a simple Gluster+Samba+CTDB cluster working enough so that my Windows machines could see a read-only share, and it seemed that if one Gluster node went offline the other would (eventually) pick up so that the share remained available. However I read that samba-vfs-glusterfs would allow a more seamless transition when a Gluster node goes down, and also allow Samba to talk directly to the Gluster storage without having to go through FUSE. However all of the documentation and tutorials I can find are either for non-Ubuntu systems or doesn't work (obsolete versions, PPA not found, etc). Basically I've done this (representative sample because my full changelog and automation scripts would be too lengthy): 1) Gluster/Samba/CTDB config, but without the ZFS RAID-1 configuration https://www.gluster.org/gluster-cifs-zfs-kind-of-part-2/ 2) Add and configure `samba-vfs-modules` https://www.samba.org/samba/docs/current/man-html/vfs_glusterfs.8.html 3) Try to add/pin Andr? Bauer's custom PPA to get any customized versions that might be needed https://lists.gluster.org/pipermail/gluster-users/2015-August/023339.html https://bugzilla.redhat.com/show_bug.cgi?id=1333264 I also tried a couple permutations of 'apt get' to see if the different packages were installing differently based on what other packages were installed, but I haven't found the magic sequence yet. It looks like glusterfs-common has a "libglusterfs.so" for Ubuntu 18 (https://ubuntu.pkgs.org/18.10/ubuntu-universe-i386/glusterfs-common_4.1.2-1_i386.deb.html) and Ubuntu 16, but that package is already installed and I'm still getting the error so there's something else I'm missing. ENVIRONMENT: Samba 4.7.6-UBUNTU glusterfs 4.1.2 I can't tell if this is a Gluster problem or a Samba problem, but I figure I can't be the only Gluster user trying to set up this configuration (and having this problem) so I'm starting here first. Can someone please give me a clue what direction I should be looking in? Thank you, -Neil -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 884 bytes Desc: OpenPGP digital signature URL: <http://lists.gluster.org/pipermail/gluster-users/attachments/20181125/2f365790/attachment.sig>
Anoop C S
2018-Nov-29 12:36 UTC
[Gluster-users] Missing glusterfs.so (Gluster + Samba-VFS under Ubuntu)
On Sun, 2018-11-25 at 07:39 -0800, Neil Richardson wrote:> Hi, guys. I'm new to all of this and need some help with a problem > I've been banging my head against for a while. (Tried > troubleshooting, checking logs, and lots of Googling for a few weeks > now, but just keep hitting dead ends.) > > > SYMPTOM: > Missing file `/usr/lib/x86_64-linux-gnu/samba/vfs/glusterfs.so`, as > evidenced by error messages like these: > > [2018/11/18 07:56:42.551587, 0] > ../lib/util/modules.c:49(load_module) > Error loading module > '/usr/lib/x86_64-linux-gnu/samba/vfs/glusterfs.so': > /usr/lib/x86_64-linux-gnu/samba/vfs/glusterfs.so: cannot open shared > object file: No such file or directory > [2018/11/18 07:56:42.551652, 0] > ../source3/smbd/vfs.c:184(vfs_init_custom) > error probing vfs module 'glusterfs': NT_STATUS_UNSUCCESSFUL > [2018/11/18 07:56:42.551694, 0] > ../source3/smbd/vfs.c:379(smbd_vfs_init) > smbd_vfs_init: vfs_init_custom failed for glusterfs > [2018/11/18 07:56:42.551729, 0] > ../source3/smbd/service.c:623(make_connection_snum) > vfs_init failed for service music > > > PROBLEM: > I was able to get a simple Gluster+Samba+CTDB cluster working enough > so that my Windows machines could see a read-only share, and it > seemed that if one Gluster node went offline the other would > (eventually) pick up so that the share remained available. However > I read that samba-vfs-glusterfs would allow a more seamless > transition when a Gluster node goes down, and also allow Samba to > talk directly to the Gluster storage without having to go through > FUSE. However all of the documentation and tutorials I can find are > either for non-Ubuntu systems or doesn't work (obsolete versions, > PPA not found, etc). > > Basically I've done this (representative sample because my full > changelog and automation scripts would be too lengthy): > 1) Gluster/Samba/CTDB config, but without the ZFS RAID-1 > configuration > https://www.gluster.org/gluster-cifs-zfs-kind-of-part-2/ > 2) Add and configure `samba-vfs-modules` > > https://www.samba.org/samba/docs/current/man-html/vfs_glusterfs.8.html > 3) Try to add/pin Andr? Bauer's custom PPA to get any customized > versions that might be needed > > https://lists.gluster.org/pipermail/gluster-users/2015-August/023339.html > https://bugzilla.redhat.com/show_bug.cgi?id=1333264 > > I also tried a couple permutations of 'apt get' to see if the > different packages were installing differently based on what other > packages were installed, but I haven't found the magic sequence yet. > > It looks like glusterfs-common has a "libglusterfs.so" for Ubuntu 18 > ( > https://ubuntu.pkgs.org/18.10/ubuntu-universe-i386/glusterfs-common_4.1.2-1_i386.deb.html > ) > and Ubuntu 16, but that package is already installed and I'm still > getting the error so there's something else I'm missing. > > > ENVIRONMENT: > Samba 4.7.6-UBUNTU > glusterfs 4.1.2 > > I can't tell if this is a Gluster problem or a Samba problem`/usr/lib/x86_64-linux-gnu/samba/vfs/glusterfs.so` has to come from Samba. By default vfs module for glusterfs should have been built unless it is explicitly disabled with '--disable-glusterfs' during build process. Let me see if I can find individual repositories which builds with vfs module for GlusterFS.> but I figure I can't be the only Gluster user trying to set up this > configuration (and having this problem) so I'm starting here first. > Can someone please give me a clue what direction I should be looking > in? > > > > Thank you, > -Neil > > > > _______________________________________________ > Gluster-users mailing list > Gluster-users at gluster.org > https://lists.gluster.org/mailman/listinfo/gluster-users
Neil Richardson
2018-Dec-06 18:55 UTC
[Gluster-users] Missing glusterfs.so (Gluster + Samba-VFS under Ubuntu)
"DEAR PEOPLE FROM THE FUTURE: Here's what we've figured out so far..."[1] I checked with Samba, they confirmed that it's missing in the Ubuntu packages. I filed a bug with Ubuntu[2], but as of Sept 2018 for various reasons[3][4] they won't fix it. So it looks like there are only two ways (that I know of, so far) to get it working under Ubuntu: patch it yourself, or use van Belle's pre-built packages (both methods described at [5]). [1] https://m.xkcd.com/979/ [2] https://bugs.launchpad.net/ubuntu/+source/samba/+bug/1807177 [3] https://bugs.launchpad.net/ubuntu/+source/samba/+bug/1807177/comments/2 [4] https://bugs.launchpad.net/ubuntu/+source/glusterfs/+bug/1274247 [5] https://lists.samba.org/archive/samba/2018-December/219821.html Thanks everyone for the help! -Neil -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 885 bytes Desc: OpenPGP digital signature URL: <http://lists.gluster.org/pipermail/gluster-users/attachments/20181206/d479422c/attachment.sig>