Hi,
On a debian 9 client,
=======root at kvm01:/var/lib/libvirt# dpkg -l glusterfs-client
8><---
ii glusterfs-client 3.8.8-1 amd64
clustered file-system (client package)
root at kvm01:/var/lib/libvirt#
======
I am trying to to do a mount to a Centos 7 gluster setup,
======[root at glustep1 libvirt]# rpm -q glusterfs
glusterfs-4.0.2-1.el7.x86_64
[root at glustep1 libvirt]#
======
mount -t glusterfs glusterp1.graywitch.co.nz:/gv0/kvm01/images
/var/lib/libvirt/images
the logs are telling me,
========root at kvm01:/var/lib/libvirt# >
/var/log/glusterfs/var-lib-libvirt-images.log
root at kvm01:/var/lib/libvirt# mount -t glusterfs
glusterp1.graywitch.co.nz:/gv0/kvm01/images/
/var/lib/libvirt/images
Mount failed. Please check the log file for more details.
root at kvm01:/var/lib/libvirt# more
/var/log/glusterfs/var-lib-libvirt-images.log
[2018-05-08 03:33:48.989219] I [MSGID: 100030] [glusterfsd.c:2454:main]
0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.8.8
(args: /usr
/sbin/glusterfs --volfile-server=glusterp1.graywitch.co.nz
--volfile-id=/gv0/kvm01/images/ /var/lib/libvirt/images)
[2018-05-08 03:33:48.996244] I [MSGID: 101190]
[event-epoll.c:628:event_dispatch_epoll_worker] 0-epoll: Started thread
with index 1
[2018-05-08 03:33:48.998694] E [glusterfsd-mgmt.c:1590:mgmt_getspec_cbk]
0-glusterfs: failed to get the 'volume file' from server
[2018-05-08 03:33:48.998721] E [glusterfsd-mgmt.c:1690:mgmt_getspec_cbk]
0-mgmt: failed to fetch volume file (key:/gv0/kvm01/images/)
[2018-05-08 03:33:48.998891] W [glusterfsd.c:1327:cleanup_and_exit]
(-->/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_handle_reply+0x90)
[0x7f25cd69ba20]
-->/usr/sbin/glusterfs(mgmt_getspec_cbk+0x494) [0x558e7de496f4]
-->/usr/sbin/glusterfs(cleanup_and_exit+0x54) [0x558e7de43444] ) 0-:
received signum (0), s
hutting down
[2018-05-08 03:33:48.998923] I [fuse-bridge.c:5794:fini] 0-fuse: Unmounting
'/var/lib/libvirt/images'.
[2018-05-08 03:33:49.019805] W [glusterfsd.c:1327:cleanup_and_exit]
(-->/lib/x86_64-linux-gnu/libpthread.so.0(+0x7494) [0x7f25cc72c494]
-->/usr/sbin/gluster
fs(glusterfs_sigwaiter+0xf5) [0x558e7de435e5]
-->/usr/sbin/glusterfs(cleanup_and_exit+0x54) [0x558e7de43444] ) 0-:
received signum (15), shutting down
root at kvm01:/var/lib/libvirt#
=========
though,
mount -t glusterfs glusterp1.graywitch.co.nz:/gv0 /isos
works fine.
==========root at kvm01:/var/lib/libvirt# df -h
Filesystem Size Used Avail Use% Mounted on
udev 7.8G 0 7.8G 0% /dev
tmpfs 1.6G 9.2M 1.6G 1% /run
/dev/mapper/kvm01--vg-root 23G 3.8G 18G 18% /
tmpfs 7.8G 0 7.8G 0% /dev/shm
tmpfs 5.0M 4.0K 5.0M 1% /run/lock
tmpfs 7.8G 0 7.8G 0% /sys/fs/cgroup
/dev/mapper/kvm01--vg-home 243G 61M 231G 1% /home
/dev/mapper/kvm01--vg-tmp 1.8G 5.6M 1.7G 1% /tmp
/dev/mapper/kvm01--vg-var 9.2G 302M 8.4G 4% /var
/dev/sda1 236M 63M 161M 28% /boot
tmpfs 1.6G 4.0K 1.6G 1% /run/user/115
tmpfs 1.6G 0 1.6G 0% /run/user/1000
glusterp1.graywitch.co.nz:/gv0 932G 247G 685G 27% /isos
also, I can mount the sub-directory fine on the gluster cluster itself,
======[root at glustep1 libvirt]# df -h
Filesystem Size Used Avail Use%
Mounted on
/dev/mapper/centos-root 20G 3.4G 17G 17% /
devtmpfs 3.8G 0 3.8G 0% /dev
tmpfs 3.8G 6.1M 3.8G 1%
/dev/shm
tmpfs 3.8G 9.0M 3.8G 1% /run
tmpfs 3.8G 0 3.8G 0%
/sys/fs/cgroup
/dev/sda1 969M 206M 713M 23% /boot
/dev/mapper/centos-tmp 3.9G 33M 3.9G 1% /tmp
/dev/mapper/centos-home 50G 4.3G 46G 9% /home
/dev/mapper/centos-var 20G 341M 20G 2% /var
/dev/mapper/centos-data1 120G 36M 120G 1% /data1
/dev/mapper/centos00-var_lib 9.4G 179M 9.2G 2%
/var/lib
/dev/mapper/vg--gluster--prod1-gluster--prod1 932G 233G 699G 25%
/bricks/brick1
tmpfs 771M 12K 771M 1%
/run/user/42
tmpfs 771M 32K 771M 1%
/run/user/1000
glusterp1:gv0/glusterp1/images 932G 247G 685G 27%
/var/lib/libvirt/images
glusterp1:gv0 932G 247G 685G 27% /isos
[root at glustep1 libvirt]#
=======
Is this a version mis-match thing? or what am I doing wrongly please?
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.gluster.org/pipermail/gluster-users/attachments/20180508/02027a8d/attachment.html>
Amar Tumballi
2018-May-09 08:20 UTC
[Gluster-users] mount failing client to gluster cluster.
On Tue, May 8, 2018 at 9:30 AM, Thing <thing.thing at gmail.com> wrote:> Hi, > > On a debian 9 client, > > =======> root at kvm01:/var/lib/libvirt# dpkg -l glusterfs-client > 8><--- > ii glusterfs-client 3.8.8-1 amd64 > clustered file-system (client package) > root at kvm01:/var/lib/libvirt# > ======> > I am trying to to do a mount to a Centos 7 gluster setup, > > ======> [root at glustep1 libvirt]# rpm -q glusterfs > glusterfs-4.0.2-1.el7.x86_64 > [root at glustep1 libvirt]# > ======> > mount -t glusterfs glusterp1.graywitch.co.nz:/gv0/kvm01/images > /var/lib/libvirt/images > >I see that you are trying 'subdir' mount. (as I see '/gv0' was able to mount fine). If that is the case, please make sure to add a proper 'auth.allow' entry for subdir. something like 'gluster volume set gv0 auth.allow "/(*),/kvm01/images(*)" But, while typing above, noticed that subdir mount is enabled by default for every directory if none of the options are given. So, looking deeper, I see below line in your client: [2018-05-08 03:33:48.989219] I [MSGID: 100030] [glusterfsd.c:2454:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs* version 3.8.8* (args: /usr /sbin/glusterfs --volfile-server=glusterp1.graywitch.co.nz --volfile-id=/gv0/kvm01/images/ /var/lib/libvirt/images) and for that version, we didn't had that particular feature. -Amar> the logs are telling me, > ========> root at kvm01:/var/lib/libvirt# > /var/log/glusterfs/var-lib- > libvirt-images.log > root at kvm01:/var/lib/libvirt# mount -t glusterfs glusterp1.graywitch.co.nz: > /gv0/kvm01/images/ /var/lib/libvirt/images > Mount failed. Please check the log file for more details. > root at kvm01:/var/lib/libvirt# more /var/log/glusterfs/var-lib- > libvirt-images.log > [2018-05-08 03:33:48.989219] I [MSGID: 100030] [glusterfsd.c:2454:main] > 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.8.8 > (args: /usr > /sbin/glusterfs --volfile-server=glusterp1.graywitch.co.nz > --volfile-id=/gv0/kvm01/images/ /var/lib/libvirt/images) > [2018-05-08 03:33:48.996244] I [MSGID: 101190] [event-epoll.c:628:event_dispatch_epoll_worker] > 0-epoll: Started thread with index 1 > [2018-05-08 03:33:48.998694] E [glusterfsd-mgmt.c:1590:mgmt_getspec_cbk] > 0-glusterfs: failed to get the 'volume file' from server > [2018-05-08 03:33:48.998721] E [glusterfsd-mgmt.c:1690:mgmt_getspec_cbk] > 0-mgmt: failed to fetch volume file (key:/gv0/kvm01/images/) > [2018-05-08 03:33:48.998891] W [glusterfsd.c:1327:cleanup_and_exit] > (-->/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_handle_reply+0x90) > [0x7f25cd69ba20] > -->/usr/sbin/glusterfs(mgmt_getspec_cbk+0x494) [0x558e7de496f4] > -->/usr/sbin/glusterfs(cleanup_and_exit+0x54) [0x558e7de43444] ) 0-: > received signum (0), s > hutting down > [2018-05-08 03:33:48.998923] I [fuse-bridge.c:5794:fini] 0-fuse: > Unmounting '/var/lib/libvirt/images'. > [2018-05-08 03:33:49.019805] W [glusterfsd.c:1327:cleanup_and_exit] > (-->/lib/x86_64-linux-gnu/libpthread.so.0(+0x7494) [0x7f25cc72c494] > -->/usr/sbin/gluster > fs(glusterfs_sigwaiter+0xf5) [0x558e7de435e5] -->/usr/sbin/glusterfs(cleanup_and_exit+0x54) > [0x558e7de43444] ) 0-: received signum (15), shutting down > root at kvm01:/var/lib/libvirt# > =========> > though, > > mount -t glusterfs glusterp1.graywitch.co.nz:/gv0 /isos > > works fine. > > ==========> root at kvm01:/var/lib/libvirt# df -h > Filesystem Size Used Avail Use% Mounted on > udev 7.8G 0 7.8G 0% /dev > tmpfs 1.6G 9.2M 1.6G 1% /run > /dev/mapper/kvm01--vg-root 23G 3.8G 18G 18% / > tmpfs 7.8G 0 7.8G 0% /dev/shm > tmpfs 5.0M 4.0K 5.0M 1% /run/lock > tmpfs 7.8G 0 7.8G 0% /sys/fs/cgroup > /dev/mapper/kvm01--vg-home 243G 61M 231G 1% /home > /dev/mapper/kvm01--vg-tmp 1.8G 5.6M 1.7G 1% /tmp > /dev/mapper/kvm01--vg-var 9.2G 302M 8.4G 4% /var > /dev/sda1 236M 63M 161M 28% /boot > tmpfs 1.6G 4.0K 1.6G 1% /run/user/115 > tmpfs 1.6G 0 1.6G 0% /run/user/1000 > glusterp1.graywitch.co.nz:/gv0 932G 247G 685G 27% /isos > > > also, I can mount the sub-directory fine on the gluster cluster itself, > > ======> [root at glustep1 libvirt]# df -h > Filesystem Size Used Avail Use% > Mounted on > /dev/mapper/centos-root 20G 3.4G 17G 17% / > devtmpfs 3.8G 0 3.8G 0% /dev > tmpfs 3.8G 6.1M 3.8G 1% > /dev/shm > tmpfs 3.8G 9.0M 3.8G 1% /run > tmpfs 3.8G 0 3.8G 0% > /sys/fs/cgroup > /dev/sda1 969M 206M 713M 23% /boot > /dev/mapper/centos-tmp 3.9G 33M 3.9G 1% /tmp > /dev/mapper/centos-home 50G 4.3G 46G 9% /home > /dev/mapper/centos-var 20G 341M 20G 2% /var > /dev/mapper/centos-data1 120G 36M 120G 1% /data1 > /dev/mapper/centos00-var_lib 9.4G 179M 9.2G 2% > /var/lib > /dev/mapper/vg--gluster--prod1-gluster--prod1 932G 233G 699G 25% > /bricks/brick1 > tmpfs 771M 12K 771M 1% > /run/user/42 > tmpfs 771M 32K 771M 1% > /run/user/1000 > glusterp1:gv0/glusterp1/images 932G 247G 685G 27% > /var/lib/libvirt/images > glusterp1:gv0 932G 247G 685G 27% /isos > [root at glustep1 libvirt]# > =======> > Is this a version mis-match thing? or what am I doing wrongly please? > > _______________________________________________ > Gluster-users mailing list > Gluster-users at gluster.org > http://lists.gluster.org/mailman/listinfo/gluster-users >-- Amar Tumballi (amarts) -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.gluster.org/pipermail/gluster-users/attachments/20180509/523311e8/attachment.html>