search for: 109011

Hi, I see a lot of the following messages in the logs: [2018-02-04 03:22:01.544446] I [glusterfsd-mgmt.c:1821:mgmt_getspec_cbk] 0-glusterfs: No change in volfile,continuing [2018-02-04 07:41:16.189349] W [MSGID: 109011] [dht-layout.c:186:dht_layout_search] 48-gv0-dht: no subvolume for hash (value) = 122440868 [2018-02-04 07:41:16.244261] W [fuse-bridge.c:2398:fuse_writev_cbk] 0-glusterfs-fuse: 3615890: WRITE => -1 gfid=c73ca10f-e83e-42a9-9b0a-1de4e12c6798 fd=0x7ffa3802a5f0 (?????? ?????/??????) [2018-02-04 07:...

...Balachandran <nbalacha at redhat.com> wrote: > Hi, > > > I see a lot of the following messages in the logs: > [2018-02-04 03:22:01.544446] I [glusterfsd-mgmt.c:1821:mgmt_getspec_cbk] > 0-glusterfs: No change in volfile,continuing > [2018-02-04 07:41:16.189349] W [MSGID: 109011] > [dht-layout.c:186:dht_layout_search] 48-gv0-dht: no subvolume for hash > (value) = 122440868 > [2018-02-04 07:41:16.244261] W [fuse-bridge.c:2398:fuse_writev_cbk] > 0-glusterfs-fuse: 3615890: WRITE => -1 gfid=c73ca10f-e83e-42a9-9b0a-1de4e12c6798 > fd=0x7ffa3802a5f0 (?????? ????...

...com> > wrote: > >> Hi, >> >> >> I see a lot of the following messages in the logs: >> [2018-02-04 03:22:01.544446] I [glusterfsd-mgmt.c:1821:mgmt_getspec_cbk] >> 0-glusterfs: No change in volfile,continuing >> [2018-02-04 07:41:16.189349] W [MSGID: 109011] >> [dht-layout.c:186:dht_layout_search] 48-gv0-dht: no subvolume for hash >> (value) = 122440868 >> [2018-02-04 07:41:16.244261] W [fuse-bridge.c:2398:fuse_writev_cbk] >> 0-glusterfs-fuse: 3615890: WRITE => -1 gfid=c73ca10f-e83e-42a9-9b0a-1de4e12c6798 >> fd=0x7ffa3...

...;>> Hi, >>> >>> >>> I see a lot of the following messages in the logs: >>> [2018-02-04 03:22:01.544446] I [glusterfsd-mgmt.c:1821:mgmt_getspec_cbk] >>> 0-glusterfs: No change in volfile,continuing >>> [2018-02-04 07:41:16.189349] W [MSGID: 109011] >>> [dht-layout.c:186:dht_layout_search] 48-gv0-dht: no subvolume for hash >>> (value) = 122440868 >>> [2018-02-04 07:41:16.244261] W [fuse-bridge.c:2398:fuse_writev_cbk] >>> 0-glusterfs-fuse: 3615890: WRITE => -1 gfid=c73ca10f-e83e-42a9-9b0a-1de4e12c6798 &gt...

...og: >>> >>> [2017-10-19 17:52:07.519614] I [MSGID: 109038] >>> [tier.c:1169:tier_migrate_using_query_file] 0-<vol>-tier-dht: Promotion >>> failed for <file>(gfid:edaf97e1-02e0-4838-9d26-71ea3aab22fb) >>> [2017-10-19 17:52:07.525110] E [MSGID: 109011] >>> [dht-common.c:7188:dht_create] 0-<vol>-hot-dht: no subvolume in layout for >>> path=/path/to/<file> >>> [2017-10-19 17:52:07.526088] E [MSGID: 109023] >>> [dht-rebalance.c:757:__dht_rebalance_create_dst_file] 0-<vol>-tier-dht: >>>...

.../<vol>/tierd.log: >> >> [2017-10-19 17:52:07.519614] I [MSGID: 109038] >> [tier.c:1169:tier_migrate_using_query_file] 0-<vol>-tier-dht: Promotion >> failed for <file>(gfid:edaf97e1-02e0-4838-9d26-71ea3aab22fb) >> [2017-10-19 17:52:07.525110] E [MSGID: 109011] >> [dht-common.c:7188:dht_create] 0-<vol>-hot-dht: no subvolume in layout for >> path=/path/to/<file> >> [2017-10-19 17:52:07.526088] E [MSGID: 109023] >> [dht-rebalance.c:757:__dht_rebalance_create_dst_file] 0-<vol>-tier-dht: >> failed to create &lt...

...(scrubbed): Node 1 /var/log/glusterfs/tier/<vol>/tierd.log: [2017-10-19 17:52:07.519614] I [MSGID: 109038] [tier.c:1169:tier_migrate_using_query_file] 0-<vol>-tier-dht: Promotion failed for <file>(gfid:edaf97e1-02e0- 4838-9d26-71ea3aab22fb) [2017-10-19 17:52:07.525110] E [MSGID: 109011] [dht-common.c:7188:dht_create] 0-<vol>-hot-dht: no subvolume in layout for path=/path/to/<file> [2017-10-19 17:52:07.526088] E [MSGID: 109023] [dht-rebalance.c:757:__dht_rebalance_create_dst_file] 0-<vol>-tier-dht: failed to create <file> on <vol>-hot-dht [Input/outpu...

...If I changed the directory name, Client A worked without problems. It seemed that there were some problems with special bricks in special clients. But all the bricks were online. I saw this in the logs in the GlusterFS client after creating directory failure: [2017-11-06 11:55:18.420610] W [MSGID: 109011] [dht-layout.c:186:dht_layout_search] 0-data-dht: no subvolume for hash (value) = 4148753024 [2017-11-06 11:55:18.457744] W [fuse-bridge.c:521:fuse_entry_cbk] 0-glusterfs-fuse: 488: MKDIR() /xxx => -1 (Input/output error) The message "W [MSGID: 109011] [dht-layout.c:186:dht_layout_search] 0...

...r/log/glusterfs/tier/<vol>/tierd.log: > > [2017-10-19 17:52:07.519614] I [MSGID: 109038] > [tier.c:1169:tier_migrate_using_query_file] 0-<vol>-tier-dht: Promotion > failed for <file>(gfid:edaf97e1-02e0-4838-9d26-71ea3aab22fb) > [2017-10-19 17:52:07.525110] E [MSGID: 109011] > [dht-common.c:7188:dht_create] 0-<vol>-hot-dht: no subvolume in layout for > path=/path/to/<file> > [2017-10-19 17:52:07.526088] E [MSGID: 109023] > [dht-rebalance.c:757:__dht_rebalance_create_dst_file] 0-<vol>-tier-dht: > failed to create <file> on <vol...

.../<vol>/tierd.log: >> >> [2017-10-19 17:52:07.519614] I [MSGID: 109038] >> [tier.c:1169:tier_migrate_using_query_file] 0-<vol>-tier-dht: Promotion >> failed for <file>(gfid:edaf97e1-02e0-4838-9d26-71ea3aab22fb) >> [2017-10-19 17:52:07.525110] E [MSGID: 109011] >> [dht-common.c:7188:dht_create] 0-<vol>-hot-dht: no subvolume in layout for >> path=/path/to/<file> >> [2017-10-19 17:52:07.526088] E [MSGID: 109023] >> [dht-rebalance.c:757:__dht_rebalance_create_dst_file] 0-<vol>-tier-dht: >> failed to create &lt...

This looks like there could be some some problem requesting / leaking / whatever memory but without looking at the core its tought to tell for sure. Note: /usr/lib64/libglusterfs.so.0(_gf_msg_backtrace_nomem+0x78)[0x7f95bc54e618] Can you open up a bugzilla and get us the core file to review? -b ----- Original Message ----- > From: "???" <21291285 at qq.com> > To:

Hi, All, I used Infiniband to connect all GlusterFS nodes and the clients. Previously I run IP over IB and everything was OK. Now I used rdma transport mode instead. And then I ran the traffic. After I while, the glusterfs process exited because of segmentation fault. Here were the messages when I saw segmentation fault: pending frames: frame : type(0) op(0) frame : type(0) op(0)