Binh Pham Van
2016-Dec-07 04:07 UTC
[Gluster-users] [Glusterfs-client] Glusterfs client crashed
Hi, We have a problem with glusterfs client. This is detail information: - OS: CentOS Linux release 7.2.1511 - glusterfs server and client version: 3.7.11 - the error when glusterfs-client carsh: [2016-12-07 02:40:55.219009] E [MSGID: 108008] [afr-transaction.c:1989:afr_transaction] 0-cloudbkf01-replicate-0: Failing WRITE on gfid 9cb4e123-d742-46be-8d9f-584fbd57f24f: split-brain observed. [Input/output error] The message "E [MSGID: 108008] [afr-transaction.c:1989:afr_transaction] 0-cloudbkf01-replicate-0: Failing WRITE on gfid 9cb4e123-d742-46be-8d9f-584fbd57f24f: split-brain observed. [Input/output error]" repeated 25 times between [2016-12-07 02:40:55.219009] and [2016-12-07 02:41:20.068359] pending frames: frame : type(0) op(0) frame : type(0) op(0) frame : type(1) op(FLUSH) frame : type(1) op(OPEN) frame : type(0) op(0) frame : type(1) op(FLUSH) frame : type(1) op(FLUSH) frame : type(1) op(OPEN) frame : type(0) op(0) frame : type(1) op(FLUSH) frame : type(1) op(OPEN) frame : type(0) op(0) frame : type(1) op(FLUSH) frame : type(1) op(OPEN) frame : type(0) op(0) frame : type(1) op(OPEN) frame : type(1) op(OPEN) frame : type(0) op(0) frame : type(1) op(OPEN) frame : type(1) op(OPEN) frame : type(0) op(0) frame : type(1) op(FLUSH) frame : type(1) op(OPEN) frame : type(1) op(FLUSH) frame : type(1) op(LOOKUP) frame : type(1) op(OPEN) frame : type(1) op(OPEN) frame : type(1) op(OPEN) frame : type(1) op(OPEN) frame : type(1) op(OPEN) frame : type(1) op(OPEN) frame : type(1) op(OPEN) frame : type(1) op(OPEN) frame : type(1) op(FLUSH) frame : type(1) op(OPEN) frame : type(1) op(OPEN) frame : type(1) op(OPEN) frame : type(1) op(OPEN) frame : type(0) op(0) patchset: git://git.gluster.com/glusterfs.git signal received: 6 time of crash: 2016-12-07 02:45:17 configuration details: argp 1 backtrace 1 dlfcn 1 libpthread 1 llistxattr 1 setfsid 1 spinlock 1 epoll.h 1 xattr.h 1 st_atim.tv_nsec 1 package-string: glusterfs 3.7.11 /lib64/libglusterfs.so.0(_gf_msg_backtrace_nomem+0xc2)[0x7f9adf1e7072] /lib64/libglusterfs.so.0(gf_print_trace+0x31d)[0x7f9adf20366d] /lib64/libc.so.6(+0x35670)[0x7f9add8d5670] /lib64/libc.so.6(gsignal+0x37)[0x7f9add8d55f7] /lib64/libc.so.6(abort+0x148)[0x7f9add8d6ce8] /lib64/libc.so.6(+0x75317)[0x7f9add915317] /lib64/libc.so.6(+0x7d023)[0x7f9add91d023] /lib64/libglusterfs.so.0(data_destroy+0x55)[0x7f9adf1dee85] /lib64/libglusterfs.so.0(dict_destroy+0x40)[0x7f9adf1df600] /usr/lib64/glusterfs/3.7.11/xlator/cluster/replicate.so(afr_local_cleanup+0x7b)[0x7f9ad128839b] /usr/lib64/glusterfs/3.7.11/xlator/cluster/replicate.so(+0x4b72f)[0x7f9ad129072f] /usr/lib64/glusterfs/3.7.11/xlator/cluster/replicate.so(afr_lookup_metadata_heal_check+0x224)[0x7f9ad1291024] /usr/lib64/glusterfs/3.7.11/xlator/cluster/replicate.so(afr_lookup_cbk+0x24d)[0x7f9ad1291a9d] /usr/lib64/glusterfs/3.7.11/xlator/protocol/client.so(client3_3_lookup_cbk+0x707)[0x7f9ad14da417] /lib64/libgfrpc.so.0(rpc_clnt_handle_reply+0x90)[0x7f9adefb5ab0] /lib64/libgfrpc.so.0(rpc_clnt_notify+0x1bf)[0x7f9adefb5d6f] /lib64/libgfrpc.so.0(rpc_transport_notify+0x23)[0x7f9adefb1853] /usr/lib64/glusterfs/3.7.11/rpc-transport/socket.so(+0x6666)[0x7f9ad3bc1666] /usr/lib64/glusterfs/3.7.11/rpc-transport/socket.so(+0x92c4)[0x7f9ad3bc42c4] /lib64/libglusterfs.so.0(+0x87a4a)[0x7f9adf248a4a] /lib64/libpthread.so.0(+0x7dc5)[0x7f9ade04fdc5] /lib64/libc.so.6(clone+0x6d)[0x7f9add99628d] --------- ?We appreciate for your reply and hope you can help us fix this error. Thanks and best regards, ? -- *Ph?m V?n B?nh (Mr.)* *System Engineer ? GS Department* *VNG Corporation* 182 Le Dai Hanh St., Ward 15, Dist. 11, Ho Chi Minh City, Vietnam *T:* (+84 8) 3962 3888 (Ext: 6355) *M:* (+84) 1678 092 361 *F:* (+84 8) 3962 4666 *E:* binhpv at vng.com.vn *?*"*GS l? team h? tr? k? thu?t cho ph?t tri?n v? v?n h?nh game"**?* -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://www.gluster.org/pipermail/gluster-users/attachments/20161207/f97c5e09/attachment.html> -------------- next part -------------- A non-text attachment was scrubbed... Name: image003.png Type: image/png Size: 4924 bytes Desc: not available URL: <http://www.gluster.org/pipermail/gluster-users/attachments/20161207/f97c5e09/attachment.png>