Displaying 20 results from an estimated 20 matches for "afr_self_heal_completion_cbk".
2013 Feb 19
1
Problems running dbench on 3.3
.../PCBENCHM.PPT failed for handle 10003 (No such file or directory)
(610) ERROR: handle 10003 was not found,
Child failed with status 1
And the logs are full of things like this (ignore the initial timestamp, that's from our logging):
[2013-02-19 14:38:38.714493] E [afr-self-heal-common.c:2160:afr_self_heal_completion_cbk] 0-replicate0: background data missing-entry gfid self-heal failed on /clients/client5/~dmtmp/PM/MOVED.DOC,
[2013-02-19 14:38:38.724494] E [afr-self-heal-common.c:2160:afr_self_heal_completion_cbk] 0-replicate0: background entry self-heal failed on /clients/client3/~dmtmp,
[2013-02-19 14:38:38....
2013 Oct 26
1
Crashing (signal received: 11)
I am seeing this crashing happening, I am working on the self healing errors as well, not sure if the two are related. I would appreciate any direction on trying to resolve the issue, I have clients dropping connection daily.
[2013-10-26 15:35:46.935903] E [afr-self-heal-common.c:2160:afr_self_heal_completion_cbk] 0-ENTV04EP-replicate-9: background meta-data self-heal failed on /
[2013-10-26 15:35:47.944225] E [afr-self-heal-metadata.c:472:afr_sh_metadata_fix] 0-ENTV04EP-replicate-9: Unable to self-heal permissions/ownership of '/' (possible split-brain). Please fix the file on all backend volumes...
2012 Jan 13
1
Quota problems with Gluster3.3b2
...wx 5 user user 24576 Jan 13 12:03 ..
==========================
Gluster logs:
Unsuccessful write:
[2012-01-13 12:06:27.97140] I [afr-common.c:1225:afr_launch_self_heal]
0-r2-replicate-4: background entry self-heal triggered. path: /tmp
[2012-01-13 12:06:27.97704] I
[afr-self-heal-common.c:2022:afr_self_heal_completion_cbk]
0-r2-replicate-4: background entry self-heal completed on /tmp
[2012-01-13 12:06:27.102813] I [afr-common.c:1225:afr_launch_self_heal]
0-r2-replicate-4: background entry self-heal triggered. path: /test
[2012-01-13 12:06:27.103199] I
[afr-self-heal-common.c:2022:afr_self_heal_completion_cbk]...
2012 Nov 30
2
"layout is NULL", "Failed to get node-uuid for [...] and other errors during rebalancing in 3.3.1
I started rebalancing my volume after updating from 3.2.7 to 3.3.1.
After a few hours, I noticed a large number of failures in the rebalance
status:
> Node Rebalanced-files size scanned failures
> status
> --------- ----------- ----------- ----------- -----------
> ------------
> localhost 0 0Bytes 4288805
2013 Jan 07
0
access a file on one node, split brain, while it's normal on another node
.../XMTEXT/gfs1_000/000/000/095. proceeding to metadata
check
[2013-01-07 09:57:29.555507] I
[afr-self-heal-common.c:1050:afr_sh_missing_entries_done]
0-gfs1-replicate-5: split brain found, aborting selfheal of
/XMTEXT/gfs1_000/000/000/095
[2013-01-07 09:57:29.555531] E
[afr-self-heal-common.c:2190:afr_self_heal_completion_cbk]
0-gfs1-replicate-5: background data gfid self-heal failed on
/XMTEXT/gfs1_000/000/000/095
[2013-01-07 09:57:35.598229] W
[afr-common.c:931:afr_detect_self_heal_by_lookup_status] 0-gfs1-replicate-5:
split brain detected during lookup of /XMTEXT/gfs1_000/000/000/095.
[2013-01-07 09:57:35.598282]...
2013 Dec 09
0
Gluster - replica - Unable to self-heal contents of '/' (possible split-brain)
...mmon.c:197:afr_sh_print_split_brain_log]
0-stor1-replicate-0: Unable to self-heal contents of ''/'' (possible
split-brain). Please delete the file from all but the preferred subvolume.-
Pending matrix: [ [ 0 2 ] [ 2 0 ] ]
[2013-12-09 13:20:52.067386] E
[afr-self-heal-common.c:2212:afr_self_heal_completion_cbk]
0-stor1-replicate-0: background meta-data self-heal failed on /
[2013-12-09 13:20:52.067452] E [mount3.c:290:mnt3svc_lookup_mount_cbk]
0-nfs: error=Input/output error
[2013-12-09 13:20:53.092039] E
[afr-self-heal-common.c:197:afr_sh_print_split_brain_log]
0-stor1-replicate-0: Unable to self-hea...
2012 Mar 12
0
Data consistency with Gluster 3.2.5
...ng is when we switch live traffic to nodes in the
cluster, they almost immediately get out of sync. The issue seems to be
with cache files that are read/written a lot. Here is an excerpt
pointing to issues with our OpenX banner cache:
[2012-02-25 18:53:04.198326] E
[afr-self-heal-common.c:2074:afr_self_heal_completion_cbk]
0-web-pub-replicate-0: background meta-data data missing-entry
self-heal failed on
/cust/site1/www/openx/var/cache/deliverycache_f8e7a8862cb80b4933c58acdf65aaef5.php
[2012-02-25 18:53:04.199191] W
[afr-common.c:1121:afr_conflicting_iattrs] 0-web-pub-replicate-0:
/cust/site1/www/openx/var/cac...
2010 Nov 11
1
Possible split-brain
...d. path: /
[2010-11-11 14:18:49.636863] E [afr-self-heal-metadata.c:524:afr_sh_metadata_fix] datastore-replicate-0: Unable to self-heal permissions/ownership of '/' (possible split-brain). Please fix the file on all backend volumes
[2010-11-11 14:18:49.637080] I [afr-self-heal-common.c:1526:afr_self_heal_completion_cbk] datastore-replicate-0: background meta-data data self-heal completed on /
[2010-11-11 14:18:49.637561] I [afr-common.c:672:afr_lookup_done] datastore-replicate-0: split brain detected during lookup of /.
[2010-11-11 14:18:49.637588] I [afr-common.c:716:afr_lookup_done] datastore-replicate-0: back...
2011 Mar 03
3
Mac / NFS problems
...smoke:hunter david$ cat test
and get the following messages in the log:
[2011-03-03 08:51:13.957319] I [afr-common.c:716:afr_lookup_done]
glustervol1-replicate-0: background meta-data self-heal triggered. path:
/production/hunter/test
[2011-03-03 08:51:13.959466] I
[afr-self-heal-common.c:1526:afr_self_heal_completion_cbk]
glustervol1-replicate-0: background meta-data self-heal completed on
/production/hunter/test
If I do the same test on a linux machine (nfs) it's fine.
We get the same issue on all the macs. They are 10.6.6.
Gluster volume is mounted:
/n/auto/gv1 -rw,hard,tcp,rsize=32768,wsize=3...
2013 Feb 26
0
Replicated Volume Crashed
...-replicate-8: no missing files - /files/random-file.dat. proceeding
to metadata check
[2013-02-25 19:44:59.816525] I
[afr-self-heal-common.c:1941:afr_sh_post_nb_entrylk_conflicting_sh_cbk]
0-adata-replicate-1: Non blocking entrylks failed.
[2013-02-25 19:44:59.816554] E
[afr-self-heal-common.c:2160:afr_self_heal_completion_cbk]
0-adata-replicate-1: background data missing-entry gfid self-heal failed
on /files/random-file.dat
[2013-02-25 19:47:01.548989] I
[afr-self-heal-common.c:1941:afr_sh_post_nb_entrylk_conflicting_sh_cbk]
0-adata-replicate-8: Non blocking entrylks failed.
[2013-02-25 19:47:01.548996] E
[afr-self-hea...
2011 Oct 25
1
problems with gluster 3.2.4
Hi, we have 4 test machines (gluster01 to gluster04).
I've created a replicated volume with the 4 machines.
Then on the client machine i've executed:
mount -t glusterfs gluster01:/volume01 /mnt/gluster
And everything works ok.
The main problem occurs in every client machine that I do:
umount /mnt/gluster
and the
mount -t glusterfs gluster01:/volume01 /mnt/gluster
The client
2013 Sep 05
1
NFS cann't use by esxi with Striped Volume
After some test , I confirm that Esxi cann't use Striped-Replicate volume
on Glusterfs's nfs.
But could success on Distributed-Replicate .
Anyone know how or why ?
2013/9/5 higkoohk <higkoohk at gmail.com>
> Thanks Vijay !
>
> It run success after 'volume set images-stripe nfs.nlm off'.
>
> Now I can use Esxi with Glusterfs's nfs export .
>
> Many
2011 Aug 24
1
Input/output error
Hi, everyone.
Its nice meeting you.
I am poor at English....
I am writing this because I'd like to update GlusterFS to 3.2.2-1,and I want
to change from gluster mount to nfs mount.
I have installed GlusterFS 3.2.1 one week ago,and replication 2 server.
OS:CentOS5.5 64bit
RPM:glusterfs-core-3.2.1-1
glusterfs-fuse-3.2.1-1
command
gluster volume create syncdata replica 2 transport tcp
2013 Nov 27
0
NFS client problems
...eal-common.c:197:afr_sh_print_split_brain_log] 0-glustervol-replicate-0: Unable to self-heal contents of '/' (possible split-brain). Please delete the file from all but the preferred subvolume.- Pending matrix: [ [ 0 2 ] [ 2 0 ] ]
[2013-11-27 21:00:46.586009] E [afr-self-heal-common.c:2212:afr_self_heal_completion_cbk] 0-glustervol-replicate-0: background meta-data self-heal failed on /
[2013-11-27 21:00:46.586091] E [mount3.c:290:mnt3svc_lookup_mount_cbk] 0-nfs: error=Input/output error
Any help appreciated.
Thanks,
Al.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: &...
2012 Jun 16
5
Not real confident in 3.3
...the rest of the self-heals
[2012-06-16 13:37:35.243315] I
[afr-self-heal-common.c:994:afr_sh_missing_entries_done]
0-pub2-replicate-0: split brain found, aborting selfheal of
<gfid:4a787ad7-ab91-46ef-9b31-715e49f5f818>/log/secure
[2012-06-16 13:37:35.243350] E
[afr-self-heal-common.c:2156:afr_self_heal_completion_cbk]
0-pub2-replicate-0: background data gfid self-heal failed on
<gfid:4a787ad7-ab91-46ef-9b31-715e49f5f818>/log/secure
This still seems to be an INCREDIBLY fragile system. Why would it lock
solid while copying a large file? Why no errors in the logs?
I am the only one seeing this kind of...
2011 Jan 13
0
distribute-replicate setup GFS Client crashed
...g_entries_create] replicate-1: no
missing files - /streaming/set3/work/reduce.12.1294902171.dplog.temp.
proceeding to metadata check
[2011-01-13 08:33:49.501906] E [afr-common.c:110:afr_set_split_brain]
replicate-1: invalid argument: inode
[2011-01-13 08:33:49.501919] I
[afr-self-heal-common.c:1526:afr_self_heal_completion_cbk] replicate-1:
background data self-heal completed on
/streaming/set3/work/reduce.12.1294902171.dplog.temp
[2011-01-13 08:33:49.531838] I [dht-common.c:402:dht_revalidate_cbk]
distribute-1: linkfile found in revalidate for
/streaming/set3/work/mapped/dpabort/multiple_reduce.flash_pl.2.1294901929.1....
2012 May 29
2
When self-healing is triggered?
...0-client-4: Connected to 194.14.242.42:10000, attached to remote volume 'brick0'.[2012-05-22 17:21:30.895793] I [afr-common.c:716:afr_lookup_done] 0-replicate-3: background entry self-heal triggered. path: /02720-store0/2012-05-21[2012-05-22 17:21:30.914237] I [afr-self-heal-common.c:1527:afr_self_heal_completion_cbk] 0-replicate-3: background entry self-heal completed on /02720-store0/2012-05-21 Regards
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://supercolony.gluster.org/pipermail/gluster-users/attachments/20120529/2c24ed70/attachment.html>
2012 Feb 05
2
Would difference in size (and content) of a file on replicated bricks be healed?
...3.283344] D [afr-lk-common.c:410:transaction_lk_op]
0-d1-replicate-0: lk op is for a self heal
[2012-02-05 21:41:03.283379] D [afr-lk-common.c:597:afr_unlock_inodelk]
0-d1-replicate-0: attempting data unlock range 0 0 by 140191242417704
[2012-02-05 21:41:03.283879] I
[afr-self-heal-common.c:2022:afr_self_heal_completion_cbk]
0-d1-replicate-0: background data self-heal completed on /data.txt
[2012-02-05 21:41:03.283960] D
[afr-self-heal-common.c:139:afr_sh_print_pending_matrix]
0-d1-replicate-0: pending_matrix: [ 0 0 0 0 ]
[2012-02-05 21:41:03.284004] D
[afr-self-heal-common.c:139:afr_sh_print_pending_matrix]
0-d...
2011 Dec 14
1
glusterfs crash when the one of replicate node restart
Hi,we have use glusterfs for two years. After upgraded to 3.2.5,we discover
that when one of replicate node reboot and startup the glusterd daemon,the
gluster will crash cause by the other
replicate node cpu usage reach 100%.
Our gluster info:
Type: Distributed-Replicate
Status: Started
Number of Bricks: 5 x 2 = 10
Transport-type: tcp
Options Reconfigured:
performance.cache-size: 3GB
2012 Jun 07
2
Performance optimization tips Gluster 3.3? (small files / directory listings)
Hi,
I'm using Gluster 3.3.0-1.el6.x86_64, on two storage nodes, replicated mode
(fs1, fs2)
Node specs: CentOS 6.2 Intel Quad Core 2.8Ghz, 4Gb ram, 3ware raid, 2x500GB
sata 7200rpm (RAID1 for os), 6x1TB sata 7200rpm (RAID10 for /data), 1Gbit
network
I've it mounted data partition to web1 a Dual Quad 2.8Ghz, 8Gb ram, using
glusterfs. (also tried NFS -> Gluster mount)
We have 50Gb of