thr3ads.net - Gluster users - [Gluster-users] Mounting replicated volume fails - terminating upon getting ENODEV when reading /dev/fuse [Jul 2013]

If this information is useful, please help other people find it:
Share via:

Sankaravadivel Sivarajan

2013-Jul-04 06:15 UTC

[Gluster-users] Mounting replicated volume fails - terminating upon getting ENODEV when reading /dev/fuse

I have two storage servers running on Amazon Linux. I created a
replicated volume with these storage servers(glustervol)

I am trying to mount the volume on a Oracle Linux(I get this when I run
cat /etc/*-release -  Oracle Linux Server release 6.1
Red Hat Enterprise Linux Server release 6.1 (Santiago)
)
The mount fails with the following error

Mount failed. Please check the log file for more details.

the mount log looks like this

[2013-07-03 15:12:55.818849] D [client.c:2043:client_rpc_notify]
0-glustervol-client-0: got RPC_CLNT_CONNECT
[2013-07-03 15:12:55.818908] D [client-handshake.c:184:client_start_ping]
0-glustervol-client-0: returning as transport is already disconnected OR
there are no frames (1 || 1)
[2013-07-03 15:12:55.820335] I
[client-handshake.c:1636:select_server_supported_programs]
0-glustervol-client-0: Using Program GlusterFS 3.3.1, Num (1298437),
Version (330)
[2013-07-03 15:12:55.820393] D [client-handshake.c:184:client_start_ping]
0-glustervol-client-0: returning as transport is already disconnected OR
there are no frames (1 || 1)
[2013-07-03 15:12:55.821791] D
[client-handshake.c:1407:client_setvolume_cbk] 0-glustervol-client-0:
clnt-lk-version = 1, server-lk-version = 0
[2013-07-03 15:12:55.821816] I
[client-handshake.c:1433:client_setvolume_cbk] 0-glustervol-client-0:
Connected to10.96.37.122:24009, attached to remote volume
'/export/brick1'.
[2013-07-03 15:12:55.821831] I
[client-handshake.c:1445:client_setvolume_cbk] 0-glustervol-client-0:
Server and Client lk-version numbers are not same, reopening the fds
[2013-07-03 15:12:55.821845] D
[client-handshake.c:1295:client_post_handshake] 0-glustervol-client-0: No
fds to open - notifying all parents child up
[2013-07-03 15:12:55.821861] D
[client-handshake.c:489:client_set_lk_version] 0-glustervol-client-0:
Sending SET_LK_VERSION
[2013-07-03 15:12:55.821918] D [fuse-bridge.c:4209:notify] 0-fuse: got
event 5 on graph 0
[2013-07-03 15:12:55.830939] I [fuse-bridge.c:4191:fuse_graph_setup]
0-fuse: switched to graph 0
[2013-07-03 15:12:55.831144] I
[client-handshake.c:453:client_set_lk_version_cbk] 0-glustervol-client-0:
Server lk version = 1
[2013-07-03 15:12:55.831191] D [fuse-bridge.c:3888:fuse_get_mount_status]
0-fuse: mount status is 0
[2013-07-03 15:12:55.831267] D [fuse-bridge.c:3999:fuse_thread_proc]
0-glusterfs-fuse: terminating upon getting ENODEV when reading /dev/fuse
[2013-07-03 15:12:55.831293] I [fuse-bridge.c:4091:fuse_thread_proc]
0-fuse: unmounting /mnt/gluster
[2013-07-03 15:12:55.831754] W [glusterfsd.c:831:cleanup_and_exit]
(-->/lib64/libc.so.6(clone+0x6d) [0x3a358e890d]
(-->/lib64/libpthread.so.0() [0x3a36007851]
(-->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xdd) [0x405d4d]))) 0-:
received signum (15), shutting down
[2013-07-03 15:12:55.831786] D
[glusterfsd-mgmt.c:2178:glusterfs_mgmt_pmap_signout] 0-fsd-mgmt: portmapper
signout arguments not given
[2013-07-03 15:12:55.831810] I [fuse-bridge.c:4648:fini] 0-fuse: Unmounting
'/mnt/gluster'.

and the brick log looks like this

[2013-07-03 19:13:02.423625] D [server-handshake.c:434:server_setvolume]
0-glustervol-server: Connected to ip-10-86-131-26.ec2.internal-
24598-2013/07/03-15:12:51:785215-glustervol-client-0-0
[2013-07-03 19:13:02.423734] D [login.c:47:gf_auth] 0-auth/login: username
not found, returning DONT-CARE
[2013-07-03 19:13:02.423756] D [addr.c:205:gf_auth] 0-/export/brick1:
allowed = "*", received addr = "10.86.131.26"
[2013-07-03 19:13:02.423775] I [server-handshake.c:571:server_setvolume]
0-glustervol-server: accepted client from ip-10-86-131-26.ec2.internal-
24598-2013/07/03-15:12:51:785215-glustervol-client-0-0 (version: 3.3.1)
[2013-07-03 19:13:02.438619] D [socket.c:184:__socket_rwv]
0-tcp.glustervol-server: EOF from peer 10.86.131.26:1014
[2013-07-03 19:13:02.438708] D [socket.c:1798:socket_event_handler]
0-transport: disconnecting now
[2013-07-03 19:13:02.438783] I [server.c:703:server_rpc_notify]
0-glustervol-server: disconnecting connectionfrom
ip-10-86-131-26.ec2.internal-24598-2013/07/03-15:12:51:
785215-glustervol-client-0-0
[2013-07-03 19:13:02.438803] I [server-helpers.c:741:server_connection_put]
0-glustervol-server: Shutting down connection ip-10-86-131-26.ec2.internal-
24598-2013/07/03-15:12:51:785215-glustervol-client-0-0
[2013-07-03 19:13:02.438841] I [server-helpers.c:629:server_connection_destroy]
0-glustervol-server: destroyed connection of ip-10-86-131-26.ec2.internal-
24598-2013/07/03-15:12:51:785215-glustervol-client-0-0

When I try to mount the same volume on Amazon Linux it succeeds.

I am using gluster v3.3.1

I installed gluster on Oracle Linux from the following location

http://download.gluster.org/pub/gluster/glusterfs/3.3/3.3.1/RHEL/epel-6Server/x86_64/

Searched the forum, but couldn't find anything relevant to this.

Any help appreciated.

Thanks
Sankar
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://supercolony.gluster.org/pipermail/gluster-users/attachments/20130704/97f51406/attachment.html>

Krishnan Parthasarathi

2013-Jul-04 06:30 UTC

head link

[Gluster-users] Mounting replicated volume fails - terminating upon getting ENODEV when reading /dev/fuse

Did you install glusterfs-fuse-3.3.1-1.el6.x86_64.rpm on the machine yout
mounting
from?

thanks.
krish

----- Original Message -----> I have two storage servers running on Amazon Linux. I created a replicated
> volume with these storage servers(glustervol)
> 
> I am trying to mount the volume on a Oracle Linux(I get this when I run cat
> /etc/*-release - Oracle Linux Server release 6.1
> Red Hat Enterprise Linux Server release 6.1 (Santiago)
> )
> The mount fails with the following error
> 
> Mount failed. Please check the log file for more details.
> 
> the mount log looks like this
> 
> [2013-07-03 15:12:55.818849] D [client.c:2043:client_rpc_notify]
> 0-glustervol-client-0: got RPC_CLNT_CONNECT
> [2013-07-03 15:12:55.818908] D [client-handshake.c:184:client_start_ping]
> 0-glustervol-client-0: returning as transport is already disconnected OR
> there are no frames (1 || 1)
> [2013-07-03 15:12:55.820335] I
> [client-handshake.c:1636:select_server_supported_programs]
> 0-glustervol-client-0: Using Program GlusterFS 3.3.1, Num (1298437),
Version
> (330)
> [2013-07-03 15:12:55.820393] D [client-handshake.c:184:client_start_ping]
> 0-glustervol-client-0: returning as transport is already disconnected OR
> there are no frames (1 || 1)
> [2013-07-03 15:12:55.821791] D
[client-handshake.c:1407:client_setvolume_cbk]
> 0-glustervol-client-0: clnt-lk-version = 1, server-lk-version = 0
> [2013-07-03 15:12:55.821816] I
[client-handshake.c:1433:client_setvolume_cbk]
> 0-glustervol-client-0: Connected to 10.96.37.122:24009 , attached to remote
> volume '/export/brick1'.
> [2013-07-03 15:12:55.821831] I
[client-handshake.c:1445:client_setvolume_cbk]
> 0-glustervol-client-0: Server and Client lk-version numbers are not same,
> reopening the fds
> [2013-07-03 15:12:55.821845] D
> [client-handshake.c:1295:client_post_handshake] 0-glustervol-client-0: No
> fds to open - notifying all parents child up
> [2013-07-03 15:12:55.821861] D
[client-handshake.c:489:client_set_lk_version]
> 0-glustervol-client-0: Sending SET_LK_VERSION
> [2013-07-03 15:12:55.821918] D [fuse-bridge.c:4209:notify] 0-fuse: got
event
> 5 on graph 0
> [2013-07-03 15:12:55.830939] I [fuse-bridge.c:4191:fuse_graph_setup]
0-fuse:
> switched to graph 0
> [2013-07-03 15:12:55.831144] I
> [client-handshake.c:453:client_set_lk_version_cbk] 0-glustervol-client-0:
> Server lk version = 1
> [2013-07-03 15:12:55.831191] D [fuse-bridge.c:3888:fuse_get_mount_status]
> 0-fuse: mount status is 0
> [2013-07-03 15:12:55.831267] D [fuse-bridge.c:3999:fuse_thread_proc]
> 0-glusterfs-fuse: terminating upon getting ENODEV when reading /dev/fuse
> [2013-07-03 15:12:55.831293] I [fuse-bridge.c:4091:fuse_thread_proc]
0-fuse:
> unmounting /mnt/gluster
> [2013-07-03 15:12:55.831754] W [glusterfsd.c:831:cleanup_and_exit]
> (-->/lib64/libc.so.6(clone+0x6d) [0x3a358e890d]
(-->/lib64/libpthread.so.0()
> [0x3a36007851] (-->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xdd)
> [0x405d4d]))) 0-: received signum (15), shutting down
> [2013-07-03 15:12:55.831786] D
> [glusterfsd-mgmt.c:2178:glusterfs_mgmt_pmap_signout] 0-fsd-mgmt: portmapper
> signout arguments not given
> [2013-07-03 15:12:55.831810] I [fuse-bridge.c:4648:fini] 0-fuse: Unmounting
> '/mnt/gluster'.
> 
> and the brick log looks like this
> 
> [2013-07-03 19:13:02.423625] D [server-handshake.c:434: server_setvolume]
> 0-glustervol-server: Connected to ip-10-86-131-26.ec2.internal-
> 24598-2013/07/03-15:12:51: 785215-glustervol-client-0-0
> [2013-07-03 19:13:02.423734] D [login.c:47:gf_auth] 0-auth/login: username
> not found, returning DONT-CARE
> [2013-07-03 19:13:02.423756] D [addr.c:205:gf_auth] 0-/export/brick1:
allowed
> = "*", received addr = "10.86.131.26"
> [2013-07-03 19:13:02.423775] I [server-handshake.c:571: server_setvolume]
> 0-glustervol-server: accepted client from ip-10-86-131-26.ec2.internal-
> 24598-2013/07/03-15:12:51: 785215-glustervol-client-0-0 (version: 3.3.1)
> [2013-07-03 19:13:02.438619] D [socket.c:184:__socket_rwv]
> 0-tcp.glustervol-server: EOF from peer 10.86.131.26:1014
> [2013-07-03 19:13:02.438708] D [socket.c:1798:socket_event_ handler]
> 0-transport: disconnecting now
> [2013-07-03 19:13:02.438783] I [server.c:703:server_rpc_ notify]
> 0-glustervol-server: disconnecting connectionfrom
> ip-10-86-131-26.ec2.internal- 24598-2013/07/03-15:12:51:
> 785215-glustervol-client-0-0
> [2013-07-03 19:13:02.438803] I [server-helpers.c:741:server_
connection_put]
> 0-glustervol-server: Shutting down connection ip-10-86-131-26.ec2.internal-
> 24598-2013/07/03-15:12:51: 785215-glustervol-client-0-0
> [2013-07-03 19:13:02.438841] I [server-helpers.c:629:server_
> connection_destroy] 0-glustervol-server: destroyed connection of
> ip-10-86-131-26.ec2.internal- 24598-2013/07/03-15:12:51:
> 785215-glustervol-client-0-0
> 
> When I try to mount the same volume on Amazon Linux it succeeds.
> 
> I am using gluster v3.3.1
> 
> I installed gluster on Oracle Linux from the following location
> 
>
http://download.gluster.org/pub/gluster/glusterfs/3.3/3.3.1/RHEL/epel-6Server/x86_64/
> 
> Searched the forum, but couldn't find anything relevant to this.
> 
> Any help appreciated.
> 
> Thanks
> Sankar
> 
> _______________________________________________
> Gluster-users mailing list
> Gluster-users at gluster.org
> http://supercolony.gluster.org/mailman/listinfo/gluster-users

Sankaravadivel Sivarajan

2013-Jul-05 02:40 UTC

head link

[Gluster-users] Mounting replicated volume fails - terminatingupon getting ENODEV when reading /dev/fuse

Any suggestions? I am running out of ideas.


On Thu, Jul 4, 2013 at 12:00 PM, Krishnan Parthasarathi <kparthas at
redhat.com> wrote:
>  [image: Boxbe] <https://www.boxbe.com/overview> Krishnan
Parthasarathi (
> kparthas at redhat.com) is on your Guest
List<https://www.boxbe.com/approved-list?tc_serial=14535824202&tc_rand=215193171&utm_source=stf&utm_medium=email&utm_campaign=ANNO_SELF&utm_content=001&token=m1sWE18etHphLaC5FACmcwg3eppEAonIvYp2I9t5SoBzBoMXDQdAq5X22nlD2cQy&key=srUKFh7vDIgqx4uOjfrf4Q82bLfxpttlkv96fWWN8j0%3D>|
Delete
> this
guest<https://www.boxbe.com/anno?action=remove&tc_serial=14535824202&tc_rand=215193171&utm_source=stf&utm_medium=email&utm_campaign=ANNO_SELF&utm_content=001&token=m1sWE18etHphLaC5FACmcwg3eppEAonIvYp2I9t5SoBzBoMXDQdAq5X22nlD2cQy&key=srUKFh7vDIgqx4uOjfrf4Q82bLfxpttlkv96fWWN8j0%3D>
>
> Did you install glusterfs-fuse-3.3.1-1.el6.x86_64.rpm on the machine yout
> mounting
> from?
>
> thanks.
> krish
>
> ----- Original Message -----
> > I have two storage servers running on Amazon Linux. I created a
> replicated
> > volume with these storage servers(glustervol)
> >
> > I am trying to mount the volume on a Oracle Linux(I get this when I
run
> cat
> > /etc/*-release - Oracle Linux Server release 6.1
> > Red Hat Enterprise Linux Server release 6.1 (Santiago)
> > )
> > The mount fails with the following error
> >
> > Mount failed. Please check the log file for more details.
> >
> > the mount log looks like this
> >
> > [2013-07-03 15:12:55.818849] D [client.c:2043:client_rpc_notify]
> > 0-glustervol-client-0: got RPC_CLNT_CONNECT
> > [2013-07-03 15:12:55.818908] D
[client-handshake.c:184:client_start_ping]
> > 0-glustervol-client-0: returning as transport is already disconnected
OR
> > there are no frames (1 || 1)
> > [2013-07-03 15:12:55.820335] I
> > [client-handshake.c:1636:select_server_supported_programs]
> > 0-glustervol-client-0: Using Program GlusterFS 3.3.1, Num (1298437),
> Version
> > (330)
> > [2013-07-03 15:12:55.820393] D
[client-handshake.c:184:client_start_ping]
> > 0-glustervol-client-0: returning as transport is already disconnected
OR
> > there are no frames (1 || 1)
> > [2013-07-03 15:12:55.821791] D
> [client-handshake.c:1407:client_setvolume_cbk]
> > 0-glustervol-client-0: clnt-lk-version = 1, server-lk-version = 0
> > [2013-07-03 15:12:55.821816] I
> [client-handshake.c:1433:client_setvolume_cbk]
> > 0-glustervol-client-0: Connected to 10.96.37.122:24009 , attached to
> remote
> > volume '/export/brick1'.
> > [2013-07-03 15:12:55.821831] I
> [client-handshake.c:1445:client_setvolume_cbk]
> > 0-glustervol-client-0: Server and Client lk-version numbers are not
same,
> > reopening the fds
> > [2013-07-03 15:12:55.821845] D
> > [client-handshake.c:1295:client_post_handshake] 0-glustervol-client-0:
No
> > fds to open - notifying all parents child up
> > [2013-07-03 15:12:55.821861] D
> [client-handshake.c:489:client_set_lk_version]
> > 0-glustervol-client-0: Sending SET_LK_VERSION
> > [2013-07-03 15:12:55.821918] D [fuse-bridge.c:4209:notify] 0-fuse: got
> event
> > 5 on graph 0
> > [2013-07-03 15:12:55.830939] I [fuse-bridge.c:4191:fuse_graph_setup]
> 0-fuse:
> > switched to graph 0
> > [2013-07-03 15:12:55.831144] I
> > [client-handshake.c:453:client_set_lk_version_cbk]
0-glustervol-client-0:
> > Server lk version = 1
> > [2013-07-03 15:12:55.831191] D
[fuse-bridge.c:3888:fuse_get_mount_status]
> > 0-fuse: mount status is 0
> > [2013-07-03 15:12:55.831267] D [fuse-bridge.c:3999:fuse_thread_proc]
> > 0-glusterfs-fuse: terminating upon getting ENODEV when reading
/dev/fuse
> > [2013-07-03 15:12:55.831293] I [fuse-bridge.c:4091:fuse_thread_proc]
> 0-fuse:
> > unmounting /mnt/gluster
> > [2013-07-03 15:12:55.831754] W [glusterfsd.c:831:cleanup_and_exit]
> > (-->/lib64/libc.so.6(clone+0x6d) [0x3a358e890d]
> (-->/lib64/libpthread.so.0()
> > [0x3a36007851] (-->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xdd)
> > [0x405d4d]))) 0-: received signum (15), shutting down
> > [2013-07-03 15:12:55.831786] D
> > [glusterfsd-mgmt.c:2178:glusterfs_mgmt_pmap_signout] 0-fsd-mgmt:
> portmapper
> > signout arguments not given
> > [2013-07-03 15:12:55.831810] I [fuse-bridge.c:4648:fini] 0-fuse:
> Unmounting
> > '/mnt/gluster'.
> >
> > and the brick log looks like this
> >
> > [2013-07-03 19:13:02.423625] D [server-handshake.c:434:
server_setvolume]
> > 0-glustervol-server: Connected to ip-10-86-131-26.ec2.internal-
> > 24598-2013/07/03-15:12:51: 785215-glustervol-client-0-0
> > [2013-07-03 19:13:02.423734] D [login.c:47:gf_auth] 0-auth/login:
> username
> > not found, returning DONT-CARE
> > [2013-07-03 19:13:02.423756] D [addr.c:205:gf_auth] 0-/export/brick1:
> allowed
> > = "*", received addr = "10.86.131.26"
> > [2013-07-03 19:13:02.423775] I [server-handshake.c:571:
server_setvolume]
> > 0-glustervol-server: accepted client from
ip-10-86-131-26.ec2.internal-
> > 24598-2013/07/03-15:12:51: 785215-glustervol-client-0-0 (version:
3.3.1)
> > [2013-07-03 19:13:02.438619] D [socket.c:184:__socket_rwv]
> > 0-tcp.glustervol-server: EOF from peer 10.86.131.26:1014
> > [2013-07-03 19:13:02.438708] D [socket.c:1798:socket_event_ handler]
> > 0-transport: disconnecting now
> > [2013-07-03 19:13:02.438783] I [server.c:703:server_rpc_ notify]
> > 0-glustervol-server: disconnecting connectionfrom
> > ip-10-86-131-26.ec2.internal- 24598-2013/07/03-15:12:51:
> > 785215-glustervol-client-0-0
> > [2013-07-03 19:13:02.438803] I [server-helpers.c:741:server_
> connection_put]
> > 0-glustervol-server: Shutting down connection
> ip-10-86-131-26.ec2.internal-
> > 24598-2013/07/03-15:12:51: 785215-glustervol-client-0-0
> > [2013-07-03 19:13:02.438841] I [server-helpers.c:629:server_
> > connection_destroy] 0-glustervol-server: destroyed connection of
> > ip-10-86-131-26.ec2.internal- 24598-2013/07/03-15:12:51:
> > 785215-glustervol-client-0-0
> >
> > When I try to mount the same volume on Amazon Linux it succeeds.
> >
> > I am using gluster v3.3.1
> >
> > I installed gluster on Oracle Linux from the following location
> >
> >
>
http://download.gluster.org/pub/gluster/glusterfs/3.3/3.3.1/RHEL/epel-6Server/x86_64/
> >
> > Searched the forum, but couldn't find anything relevant to this.
> >
> > Any help appreciated.
> >
> > Thanks
> > Sankar
> >
> > _______________________________________________
> > Gluster-users mailing list
> > Gluster-users at gluster.org
> > http://supercolony.gluster.org/mailman/listinfo/gluster-users
>
>-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://supercolony.gluster.org/pipermail/gluster-users/attachments/20130705/8e62780d/attachment.html>

Gluster users - Jul 2013 - Mounting replicated volume fails - terminating upon getting ENODEV when reading /dev/fuse

[Gluster-users] Mounting replicated volume fails - terminating upon getting ENODEV when reading /dev/fuse

[Gluster-users] Mounting replicated volume fails - terminating upon getting ENODEV when reading /dev/fuse

[Gluster-users] Mounting replicated volume fails - terminatingupon getting ENODEV when reading /dev/fuse