search for: entrylk

...00 us 88.00 us 2 > FXATTROP > 0.01 177.00 us 177.00 us 177.00 us 1 > CREATE > 0.02 56.14 us 23.00 us 128.00 us 7 > LOOKUP > 0.02 259.00 us 20.00 us 498.00 us 2 > ENTRYLK > 99.94 59.23 us 17.00 us 10914.00 us 35635 > WRITE > Duration: 38 seconds > Data Read: 0 bytes > Data Written: 1073741824 bytes > Interval 0 Stats: > Block Size: 4096b+ 8192b+ > 16384b+ > No. of Reads:...

...g stale file handle error. After 18 minutes, I'm able to delete the directory. So could anyone help me in knowing what could have happened or when in general I get such errors. The following is NFS log: [2017-12-21 13:56:01.592256] I [MSGID: 108019] [afr-transaction.c:1903:afr_post_blocking_entrylk_cbk] 0-g_sitework2-replicate-5: Blocking entrylks failed. [2017-12-21 13:56:01.594350] W [MSGID: 108019] [afr-lk-common.c:1064:afr_log_entry_locks_failure] 0-g_sitework2-replicate-4: Unable to obtain sufficient blocking entry locks on at least one child while attempting RMDIR on {pgfid:23558c59-87...

...2 >> FXATTROP >> 0.01 177.00 us 177.00 us 177.00 us 1 >> CREATE >> 0.02 56.14 us 23.00 us 128.00 us 7 >> LOOKUP >> 0.02 259.00 us 20.00 us 498.00 us 2 >> ENTRYLK >> 99.94 59.23 us 17.00 us 10914.00 us 35635 >> WRITE >> Duration: 38 seconds >> Data Read: 0 bytes >> Data Written: 1073741824 bytes >> Interval 0 Stats: >> Block Size: 4096b+ 8192b+ >>...

...P >>> 0.01 177.00 us 177.00 us 177.00 us 1 >>> CREATE >>> 0.02 56.14 us 23.00 us 128.00 us 7 >>> LOOKUP >>> 0.02 259.00 us 20.00 us 498.00 us 2 >>> ENTRYLK >>> 99.94 59.23 us 17.00 us 10914.00 us 35635 >>> WRITE >>> Duration: 38 seconds >>> Data Read: 0 bytes >>> Data Written: 1073741824 bytes >>> Interval 0 Stats: >>> Block Size: 4096b+...

...r 18 minutes, I'm able to delete the directory. So could anyone help me > in knowing what could have happened or when in general I get such errors. > > > The following is NFS log: > > > [2017-12-21 13:56:01.592256] I [MSGID: 108019] [afr-transaction.c:1903:afr_post_blocking_entrylk_cbk] > 0-g_sitework2-replicate-5: Blocking entrylks failed. > > [2017-12-21 13:56:01.594350] W [MSGID: 108019] > [afr-lk-common.c:1064:afr_log_entry_locks_failure] > 0-g_sitework2-replicate-4: Unable to obtain sufficient blocking entry locks > on at least one child while attemptin...

...the directory. So could anyone help me >> in knowing what could have happened or when in general I get such errors. >> >> >> The following is NFS log: >> >> >> [2017-12-21 13:56:01.592256] I [MSGID: 108019] >> [afr-transaction.c:1903:afr_post_blocking_entrylk_cbk] >> 0-g_sitework2-replicate-5: Blocking entrylks failed. >> >> [2017-12-21 13:56:01.594350] W [MSGID: 108019] >> [afr-lk-common.c:1064:afr_log_entry_locks_failure] >> 0-g_sitework2-replicate-4: Unable to obtain sufficient blocking entry locks >> on at least o...

...ers.c:330:do_lock_table_cleanup] 0-adata-server: finodelk released on /files/random-file.dat [2013-02-25 19:59:46.438680] W [socket.c:195:__socket_rwv] 0-tcp.adata-server: readv failed (Connection timed out) [2013-02-25 20:03:01.825280] I [server-helpers.c:394:do_lock_table_cleanup] 0-adata-server: entrylk released on /files [2013-02-25 20:03:01.825309] I [server-helpers.c:474:do_fd_cleanup] 0-adata-server: fd cleanup on /files The most interesting parts from the client log are: [2013-02-25 19:44:43.568372] W [client3_1-fops.c:5306:client3_1_finodelk] 0-adata-client-7: (b468c831-5c04-4bbd-8b03-b94...

...s 0.00 us 1227 > RELEASE > 0.00 0.00 us 0.00 us 0.00 us 1035 > RELEASEDIR > 0.00 827.00 us 619.00 us 1199.00 us 10 > READDIRP > 0.00 98.38 us 30.00 us 535.00 us 144 > ENTRYLK > 0.00 180.11 us 121.00 us 257.00 us 94 > REMOVEXATTR > 0.00 208.03 us 23.00 us 1980.00 us 182 > GETXATTR > 0.00 1212.71 us 35.00 us 29459.00 us 38 > READDIR > 0.01 260.39 us 1...

...27 >> RELEASE >> 0.00 0.00 us 0.00 us 0.00 us 1035 >> RELEASEDIR >> 0.00 827.00 us 619.00 us 1199.00 us 10 >> READDIRP >> 0.00 98.38 us 30.00 us 535.00 us 144 >> ENTRYLK >> 0.00 180.11 us 121.00 us 257.00 us 94 >> REMOVEXATTR >> 0.00 208.03 us 23.00 us 1980.00 us 182 >> GETXATTR >> 0.00 1212.71 us 35.00 us 29459.00 us 38 >> READDIR >>...

...TING LOCK FOR SELF-HEAL : 2009-01-14 15:10:14 D [server-protocol.c:3288:server_lookup_resume] test-ds: LOOKUP '1/VERIFY_DIR' 2009-01-14 15:10:14 D [inode.c:323:__inode_retire] test-ds/inode: retiring inode(0) lru=2/1024 active=1 purge=1 2009-01-14 15:10:14 D [server-protocol.c:5712:server_entrylk_resume] test-ds: ENTRYLK '/ (1) ' 2009-01-14 15:10:14 C [posix.c:3189:posix_entrylk] test-ds: "features/posix-locks" translator is not loaded. You need to use it for proper functioning of GlusterFS 2009-01-14 15:10:14 E [server-protocol.c:3229:server_stub_resume] server: INODE...

...;>> 0.00 0.00 us 0.00 us 0.00 us 1035 >>> RELEASEDIR >>> 0.00 827.00 us 619.00 us 1199.00 us 10 >>> READDIRP >>> 0.00 98.38 us 30.00 us 535.00 us 144 >>> ENTRYLK >>> 0.00 180.11 us 121.00 us 257.00 us 94 >>> REMOVEXATTR >>> 0.00 208.03 us 23.00 us 1980.00 us 182 >>> GETXATTR >>> 0.00 1212.71 us 35.00 us 29459.00 us 38 >>&...

...0.00 us 0.00 us 0.00 us 1035 >>>> RELEASEDIR >>>> 0.00 827.00 us 619.00 us 1199.00 us 10 >>>> READDIRP >>>> 0.00 98.38 us 30.00 us 535.00 us 144 >>>> ENTRYLK >>>> 0.00 180.11 us 121.00 us 257.00 us 94 >>>> REMOVEXATTR >>>> 0.00 208.03 us 23.00 us 1980.00 us 182 >>>> GETXATTR >>>> 0.00 1212.71 us 35.00 us 29459.00 us...

OK my understanding is that with preallocated disks the performance with and without shard will be the same. In any case, please attach the volume profile[1], so we can see what else is slowing things down. -Krutika [1] - https://gluster.readthedocs.io/en/latest/Administrator%20Guide/Monitoring%20Workload/#running-glusterfs-volume-profile-command On Tue, Sep 5, 2017 at 2:32 PM, Abi Askushi

Hello, I have run into some performance issues after adding bricks to a 3.3.1 volume. Basically I am seeing very high CPU usage and extremely degraded performance. I started a re-balance but stopped it after a couple days. The logs have a lot of entries for split-brain as well as "Non Blocking entrylks failed for". For some of the directories on the client doing an ls will show multiple entires for the same directory ( ls below ). I am wondering if it is just spinning trying to heal itself? I have been able to fix some of these entries by removing gfid files, stat-ing etc, however I feel I...

Hi, everyone. Its nice meeting you. I am poor at English.... I am writing this because I'd like to update GlusterFS to 3.2.2-1,and I want to change from gluster mount to nfs mount. I have installed GlusterFS 3.2.1 one week ago,and replication 2 server. OS:CentOS5.5 64bit RPM:glusterfs-core-3.2.1-1 glusterfs-fuse-3.2.1-1 command gluster volume create syncdata replica 2 transport tcp

Hi Krutika, I already have a preallocated disk on VM. Now I am checking performance with dd on the hypervisors which have the gluster volume configured. I tried also several values of shard-block-size and I keep getting the same low values on write performance. Enabling client-io-threads also did not have any affect. The version of gluster I am using is glusterfs 3.8.12 built on May 11 2017

...1467 >> OPENDIR >> 0.01 148.59 us 21.00 us 64374.00 us 4454 >> STAT >> 0.02 783.02 us 16.00 us 93502.00 us 1902 >> GETXATTR >> 0.03 1516.10 us 17.00 us 210690.00 us 1364 >> ENTRYLK >> 0.03 2555.47 us 300.00 us 674454.00 us 1064 >> READDIRP >> 0.07 85.74 us 19.00 us 68340.00 us 62849 >> FSTAT >> 0.07 1978.12 us 59.00 us 202596.00 us 2729 >> OPEN >> 0.2...

Hi,we have use glusterfs for two years. After upgraded to 3.2.5,we discover that when one of replicate node reboot and startup the glusterd daemon,the gluster will crash cause by the other replicate node cpu usage reach 100%. Our gluster info: Type: Distributed-Replicate Status: Started Number of Bricks: 5 x 2 = 10 Transport-type: tcp Options Reconfigured: performance.cache-size: 3GB

...2017-09-20 13:34:23.352749] D [MSGID: 0] [dht-diskusage.c:96:dht_du_info_cbk] 0-gv0-dht: subvolume 'gv0-replicate-0': avail_percent is: 99.00 and avail_space is: 21425758208 and avail_inodes is: 99.00 [2017-09-20 13:34:23.353086] D [MSGID: 0] [afr-transaction.c:1934:afr_post_nonblocking_entrylk_cbk] 0-gv0-replicate-0: Non blocking entrylks done. Proceeding to FOP [2017-09-20 13:34:23.353722] D [MSGID: 0] [dht-selfheal.c:1879:dht_selfheal_layout_new_directory] 0-gv0-dht: chunk size = 0xffffffff / 20466 = 209858.658018 [2017-09-20 13:34:23.353748] D [MSGID: 0] [dht-selfheal.c:1920:dht_s...

...4454 >>>>>> STAT >>>>>> 0.02 783.02 us 16.00 us 93502.00 us 1902 >>>>>> GETXATTR >>>>>> 0.03 1516.10 us 17.00 us 210690.00 us 1364 >>>>>> ENTRYLK >>>>>> 0.03 2555.47 us 300.00 us 674454.00 us 1064 >>>>>> READDIRP >>>>>> 0.07 85.74 us 19.00 us 68340.00 us 62849 >>>>>> FSTAT >>>>>> 0.07 19...