search for: 0x9c

...see brick processes come online and system starts to answer commands like "gluster peer status".. [2017-08-23 06:46:02.150472] E [client_t.c:324:gf_client_ref] (-->/usr/lib64/libgfrpc.so.0(rpcsvc_request_create+0xf1) [0x7f5ae2c091b1] -->/usr/lib64/libgfrpc.so.0(rpcsvc_request_init+0x9c) [0x7f5ae2c0851c] -->/usr/lib64/libglusterfs.so.0(gf_client_ref+0x1a9) [0x7f5ae2ea3949] ) 0-client_t: null client [Invalid argument] [2017-08-23 06:46:02.152181] E [client_t.c:324:gf_client_ref] (-->/usr/lib64/libgfrpc.so.0(rpcsvc_request_create+0xf1) [0x7f5ae2c091b1] -->/usr/lib64/libgfrp...

...e online and system starts to answer commands like > "gluster peer status".. > > [2017-08-23 06:46:02.150472] E [client_t.c:324:gf_client_ref] > (-->/usr/lib64/libgfrpc.so.0(rpcsvc_request_create+0xf1) > [0x7f5ae2c091b1] -->/usr/lib64/libgfrpc.so.0(rpcsvc_request_init+0x9c) > [0x7f5ae2c0851c] -->/usr/lib64/libglusterfs.so.0(gf_client_ref+0x1a9) > [0x7f5ae2ea3949] ) 0-client_t: null client [Invalid argument] > [2017-08-23 06:46:02.152181] E [client_t.c:324:gf_client_ref] > (-->/usr/lib64/libgfrpc.so.0(rpcsvc_request_create+0xf1) > [0x7f5ae2c091b1]...

...s to answer commands like > > "gluster peer status".. > > > > [2017-08-23 06:46:02.150472] E [client_t.c:324:gf_client_ref] > > (-->/usr/lib64/libgfrpc.so.0(rpcsvc_request_create+0xf1) > > [0x7f5ae2c091b1] -->/usr/lib64/libgfrpc.so.0(rpcsvc_request_init+0x9c) > > [0x7f5ae2c0851c] -->/usr/lib64/libglusterfs.so.0(gf_client_ref+0x1a9) > > [0x7f5ae2ea3949] ) 0-client_t: null client [Invalid argument] > > [2017-08-23 06:46:02.152181] E [client_t.c:324:gf_client_ref] > > (-->/usr/lib64/libgfrpc.so.0(rpcsvc_request_create+0xf1) &...

...G attributes 0x0 trace:file:RtlDosPathNameToNtPathName_U (L"COM1",0x4066eed4,(nil),(nil)) trace:file:RtlGetFullPathName_U (L"COM1" 520 0x4066ec4c (nil)) trace:file:get_dos_device L"COM1" -> "/home/met/.wine/dosdevices/com1" trace:file:CreateFileW returning 0x9c fixme:comm:GetCommProperties (0x9c 0x4132b414 ) trace:comm:GetCommState handle 0x9c, ptr 0x4132b454 trace:comm:GetCommState OK trace:comm:GetCommState bytesize 8 baudrate 38400 fParity 0 Parity 2 stopbits 1 trace:comm:GetCommState ~IXON ~IXOFF trace:comm:GetCommState fOutxCtsFlow 1 fRtsControl 2 tr...

...like >> > "gluster peer status".. >> > >> > [2017-08-23 06:46:02.150472] E [client_t.c:324:gf_client_ref] >> > (-->/usr/lib64/libgfrpc.so.0(rpcsvc_request_create+0xf1) >> > [0x7f5ae2c091b1] -->/usr/lib64/libgfrpc.so.0(rpcsvc_request_init+0x9c) >> > [0x7f5ae2c0851c] -->/usr/lib64/libglusterfs.so.0(gf_client_ref+0x1a9) >> > [0x7f5ae2ea3949] ) 0-client_t: null client [Invalid argument] >> > [2017-08-23 06:46:02.152181] E [client_t.c:324:gf_client_ref] >> > (-->/usr/lib64/libgfrpc.so.0(rpcsvc_reques...

...gt; "gluster peer status".. >>> > >>> > [2017-08-23 06:46:02.150472] E [client_t.c:324:gf_client_ref] >>> > (-->/usr/lib64/libgfrpc.so.0(rpcsvc_request_create+0xf1) >>> > [0x7f5ae2c091b1] -->/usr/lib64/libgfrpc.so.0(rpcsvc_request_init+0x9c) >>> > [0x7f5ae2c0851c] -->/usr/lib64/libglusterfs.so.0(gf_client_ref+0x1a9) >>> > [0x7f5ae2ea3949] ) 0-client_t: null client [Invalid argument] >>> > [2017-08-23 06:46:02.152181] E [client_t.c:324:gf_client_ref] >>> > (-->/usr/lib64/libgfrpc.so...

...>>>> > > >>>> > [2017-08-23 06:46:02.150472] E [client_t.c:324:gf_client_ref] > >>>> > (-->/usr/lib64/libgfrpc.so.0(rpcsvc_request_create+0xf1) > >>>> > [0x7f5ae2c091b1] -->/usr/lib64/libgfrpc.so.0( > rpcsvc_request_init+0x9c) > >>>> > [0x7f5ae2c0851c] -->/usr/lib64/libglusterfs.so. > 0(gf_client_ref+0x1a9) > >>>> > [0x7f5ae2ea3949] ) 0-client_t: null client [Invalid argument] > >>>> > [2017-08-23 06:46:02.152181] E [client_t.c:324:gf_client_ref] > >>&...

...r peer status".. >>>> > >>>> > [2017-08-23 06:46:02.150472] E [client_t.c:324:gf_client_ref] >>>> > (-->/usr/lib64/libgfrpc.so.0(rpcsvc_request_create+0xf1) >>>> > [0x7f5ae2c091b1] -->/usr/lib64/libgfrpc.so.0(rpcsvc_request_init+0x9c) >>>> > [0x7f5ae2c0851c] -->/usr/lib64/libglusterfs.so.0(gf_client_ref+0x1a9) >>>> > [0x7f5ae2ea3949] ) 0-client_t: null client [Invalid argument] >>>> > [2017-08-23 06:46:02.152181] E [client_t.c:324:gf_client_ref] >>>> > (-->/usr/l...

...; [2017-08-23 06:46:02.150472] E [client_t.c:324:gf_client_ref] > >> >>>> > (-->/usr/lib64/libgfrpc.so.0(rpcsvc_request_create+0xf1) > >> >>>> > [0x7f5ae2c091b1] > >> >>>> > -->/usr/lib64/libgfrpc.so.0(rpcsvc_request_init+0x9c) > >> >>>> > [0x7f5ae2c0851c] > >> >>>> > -->/usr/lib64/libglusterfs.so.0(gf_client_ref+0x1a9) > >> >>>> > [0x7f5ae2ea3949] ) 0-client_t: null client [Invalid argument] > >> >>>> > [2017-08-23 06:46:0...

I reboot multiple times, also I destroyed the gluster configuration and recreate multiple times. The behavior is same. On Tue, Aug 22, 2017 at 6:47 PM, Atin Mukherjee <amukherj at redhat.com> wrote: > My guess is there is a corruption in vol list or peer list which has lead > glusterd to get into a infinite loop of traversing a peer/volume list and > CPU to hog up. Again this is a

...50472] E [client_t.c:324:gf_client_ref] >>> >> >>>> > (-->/usr/lib64/libgfrpc.so.0(rpcsvc_request_create+0xf1) >>> >> >>>> > [0x7f5ae2c091b1] >>> >> >>>> > -->/usr/lib64/libgfrpc.so.0(rpcsvc_request_init+0x9c) >>> >> >>>> > [0x7f5ae2c0851c] >>> >> >>>> > -->/usr/lib64/libglusterfs.so.0(gf_client_ref+0x1a9) >>> >> >>>> > [0x7f5ae2ea3949] ) 0-client_t: null client [Invalid argument] >>> >> >>&...

...gt;>> > [2017-08-23 06:46:02.150472] E [client_t.c:324:gf_client_ref] >> >>>> > (-->/usr/lib64/libgfrpc.so.0(rpcsvc_request_create+0xf1) >> >>>> > [0x7f5ae2c091b1] >> >>>> > -->/usr/lib64/libgfrpc.so.0(rpcsvc_request_init+0x9c) >> >>>> > [0x7f5ae2c0851c] >> >>>> > -->/usr/lib64/libglusterfs.so.0(gf_client_ref+0x1a9) >> >>>> > [0x7f5ae2ea3949] ) 0-client_t: null client [Invalid argument] >> >>>> > [2017-08-23 06:46:02.152181] E [client_...

...tus".. > >>> > > >>> > [2017-08-23 06:46:02.150472] E [client_t.c:324:gf_client_ref] > >>> > (-->/usr/lib64/libgfrpc.so.0(rpcsvc_request_create+0xf1) > >>> > [0x7f5ae2c091b1] -->/usr/lib64/libgfrpc.so.0( > rpcsvc_request_init+0x9c) > >>> > [0x7f5ae2c0851c] -->/usr/lib64/libglusterfs.so. > 0(gf_client_ref+0x1a9) > >>> > [0x7f5ae2ea3949] ) 0-client_t: null client [Invalid argument] > >>> > [2017-08-23 06:46:02.152181] E [client_t.c:324:gf_client_ref] > >>> > (--...

...>>> > >> >>> > [2017-08-23 06:46:02.150472] E [client_t.c:324:gf_client_ref] >> >>> > (-->/usr/lib64/libgfrpc.so.0(rpcsvc_request_create+0xf1) >> >>> > [0x7f5ae2c091b1] -->/usr/lib64/libgfrpc.so.0(rp >> csvc_request_init+0x9c) >> >>> > [0x7f5ae2c0851c] -->/usr/lib64/libglusterfs.so. >> 0(gf_client_ref+0x1a9) >> >>> > [0x7f5ae2ea3949] ) 0-client_t: null client [Invalid argument] >> >>> > [2017-08-23 06:46:02.152181] E [client_t.c:324:gf_client_ref] >> &...

...3 06:46:02.150472] E [client_t.c:324:gf_client_ref] >> >> >>>> > (-->/usr/lib64/libgfrpc.so.0(rpcsvc_request_create+0xf1) >> >> >>>> > [0x7f5ae2c091b1] >> >> >>>> > -->/usr/lib64/libgfrpc.so.0(rpcsvc_request_init+0x9c) >> >> >>>> > [0x7f5ae2c0851c] >> >> >>>> > -->/usr/lib64/libglusterfs.so.0(gf_client_ref+0x1a9) >> >> >>>> > [0x7f5ae2ea3949] ) 0-client_t: null client [Invalid argument] >> >> >>>> > [20...

..._client_ref] >> >>> >> >>>> > (-->/usr/lib64/libgfrpc.so.0(rpcsvc_request_create+0xf1) >> >>> >> >>>> > [0x7f5ae2c091b1] >> >>> >> >>>> > -->/usr/lib64/libgfrpc.so.0(rpcsvc_request_init+0x9c) >> >>> >> >>>> > [0x7f5ae2c0851c] >> >>> >> >>>> > -->/usr/lib64/libglusterfs.so.0(gf_client_ref+0x1a9) >> >>> >> >>>> > [0x7f5ae2ea3949] ) 0-client_t: null client [Invalid >> >&...

...t_t.c:324:gf_client_ref] > >>> >> >>>> > (-->/usr/lib64/libgfrpc.so.0(rpcsvc_request_create+0xf1) > >>> >> >>>> > [0x7f5ae2c091b1] > >>> >> >>>> > -->/usr/lib64/libgfrpc.so.0(rpcsvc_request_init+0x9c) > >>> >> >>>> > [0x7f5ae2c0851c] > >>> >> >>>> > -->/usr/lib64/libglusterfs.so.0(gf_client_ref+0x1a9) > >>> >> >>>> > [0x7f5ae2ea3949] ) 0-client_t: null client [Invalid argument] > >>&gt...

...; [2017-08-23 06:46:02.150472] E [client_t.c:324:gf_client_ref] > >>> >>> > (-->/usr/lib64/libgfrpc.so.0(rpcsvc_request_create+0xf1) > >>> >>> > [0x7f5ae2c091b1] > >>> >>> > -->/usr/lib64/libgfrpc.so.0(rpcsvc_request_init+0x9c) > >>> >>> > [0x7f5ae2c0851c] > >>> >>> > -->/usr/lib64/libglusterfs.so.0(gf_client_ref+0x1a9) > >>> >>> > [0x7f5ae2ea3949] ) 0-client_t: null client [Invalid argument] > >>> >>> > [2017-08-23 06:46:0...

...>>> >>> >> >>>> > (-->/usr/lib64/libgfrpc.so.0(rpcsvc_request_create+0xf1) >>> >>> >> >>>> > [0x7f5ae2c091b1] >>> >>> >> >>>> > -->/usr/lib64/libgfrpc.so.0(rpcsvc_request_init+0x9c) >>> >>> >> >>>> > [0x7f5ae2c0851c] >>> >>> >> >>>> > -->/usr/lib64/libglusterfs.so.0(gf_client_ref+0x1a9) >>> >>> >> >>>> > [0x7f5ae2ea3949] ) 0-client_t: null client [Invalid &g...

...gt;>> > [2017-08-23 06:46:02.150472] E [client_t.c:324:gf_client_ref] >>> >>> > (-->/usr/lib64/libgfrpc.so.0(rpcsvc_request_create+0xf1) >>> >>> > [0x7f5ae2c091b1] >>> >>> > -->/usr/lib64/libgfrpc.so.0(rpcsvc_request_init+0x9c) >>> >>> > [0x7f5ae2c0851c] >>> >>> > -->/usr/lib64/libglusterfs.so.0(gf_client_ref+0x1a9) >>> >>> > [0x7f5ae2ea3949] ) 0-client_t: null client [Invalid argument] >>> >>> > [2017-08-23 06:46:02.152181] E [client_...