Gluster users - Mar 2011 - Both bricks autohealing the same two files every second...

Gluster appears to be self healing the same two files over and over and over and
those files haven't changed in a really long time.

Please help...

brick1:

[2011-03-20 22:54:39.876667] I
[afr-self-heal-common.c:1526:afr_self_heal_completion_cbk] content-replicate-0:
background  meta-data self-heal completed on /.htaccess
[2011-03-20 22:54:40.559655] I [afr-common.c:716:afr_lookup_done]
content-replicate-0: background  meta-data self-heal triggered. path:
/wp-content/w3-total-cache-config.php
[2011-03-20 22:54:40.560831] I
[afr-self-heal-common.c:1526:afr_self_heal_completion_cbk] content-replicate-0:
background  meta-data self-heal completed on
/wp-content/w3-total-cache-config.php
[2011-03-20 22:54:40.905484] I [afr-common.c:716:afr_lookup_done]
content-replicate-0: background  meta-data self-heal triggered. path: /.htaccess
[2011-03-20 22:54:40.907545] I
[afr-self-heal-common.c:1526:afr_self_heal_completion_cbk] content-replicate-0:
background  meta-data self-heal completed on /.htaccess

brick2:

[2011-03-20 22:55:12.900512] I [afr-common.c:716:afr_lookup_done]
content-replicate-0: background  meta-data self-heal triggered. path:
/wp-content/w3-total-cache-config.php
[2011-03-20 22:55:12.901936] I
[afr-self-heal-common.c:1526:afr_self_heal_completion_cbk] content-replicate-0:
background  meta-data self-heal completed on
/wp-content/w3-total-cache-config.php
[2011-03-20 22:55:13.740372] I [afr-common.c:716:afr_lookup_done]
content-replicate-0: background  meta-data self-heal triggered. path: /.htaccess
[2011-03-20 22:55:13.741732] I
[afr-self-heal-common.c:1526:afr_self_heal_completion_cbk] content-replicate-0:
background  meta-data self-heal completed on /.htaccess
[2011-03-20 22:55:13.958669] I [afr-common.c:716:afr_lookup_done]
content-replicate-0: background  meta-data self-heal triggered. path:
/wp-content/w3-total-cache-config.php
[2011-03-20 22:55:13.960944] I
[afr-self-heal-common.c:1526:afr_self_heal_completion_cbk] content-replicate-0:
background  meta-data self-heal completed on
/wp-content/w3-total-cache-config.php

it's been doing this since march 7th... thats a whole lot of wasted
performance.

Can anyone please tell me how to fix this?

thanks,
-Drew

-----Original Message-----
From: gluster-users-bounces at gluster.org [mailto:gluster-users-bounces at
gluster.org] On Behalf Of Drew Weaver
Sent: Sunday, March 20, 2011 11:57 PM
To: 'gluster-users at gluster.org'
Subject: [Gluster-users] Both bricks autohealing the same two files every
second...

Gluster appears to be self healing the same two files over and over and over and
those files haven't changed in a really long time.

Please help...

brick1:

[2011-03-20 22:54:39.876667] I
[afr-self-heal-common.c:1526:afr_self_heal_completion_cbk] content-replicate-0:
background  meta-data self-heal completed on /.htaccess [2011-03-20
22:54:40.559655] I [afr-common.c:716:afr_lookup_done] content-replicate-0:
background  meta-data self-heal triggered. path:
/wp-content/w3-total-cache-config.php
[2011-03-20 22:54:40.560831] I
[afr-self-heal-common.c:1526:afr_self_heal_completion_cbk] content-replicate-0:
background  meta-data self-heal completed on
/wp-content/w3-total-cache-config.php
[2011-03-20 22:54:40.905484] I [afr-common.c:716:afr_lookup_done]
content-replicate-0: background  meta-data self-heal triggered. path: /.htaccess
[2011-03-20 22:54:40.907545] I
[afr-self-heal-common.c:1526:afr_self_heal_completion_cbk] content-replicate-0:
background  meta-data self-heal completed on /.htaccess

brick2:

[2011-03-20 22:55:12.900512] I [afr-common.c:716:afr_lookup_done]
content-replicate-0: background  meta-data self-heal triggered. path:
/wp-content/w3-total-cache-config.php
[2011-03-20 22:55:12.901936] I
[afr-self-heal-common.c:1526:afr_self_heal_completion_cbk] content-replicate-0:
background  meta-data self-heal completed on
/wp-content/w3-total-cache-config.php
[2011-03-20 22:55:13.740372] I [afr-common.c:716:afr_lookup_done]
content-replicate-0: background  meta-data self-heal triggered. path: /.htaccess
[2011-03-20 22:55:13.741732] I
[afr-self-heal-common.c:1526:afr_self_heal_completion_cbk] content-replicate-0:
background  meta-data self-heal completed on /.htaccess [2011-03-20
22:55:13.958669] I [afr-common.c:716:afr_lookup_done] content-replicate-0:
background  meta-data self-heal triggered. path:
/wp-content/w3-total-cache-config.php
[2011-03-20 22:55:13.960944] I
[afr-self-heal-common.c:1526:afr_self_heal_completion_cbk] content-replicate-0:
background  meta-data self-heal completed on
/wp-content/w3-total-cache-config.php

it's been doing this since march 7th... thats a whole lot of wasted
performance.

Can anyone please tell me how to fix this?

thanks,
-Drew
----------------------
Update --

I found that if I just remove and replace these two files that this constant
self-healing goes away until wordpress tries to write to one of the files.

When wordpress tries to write to one of the files:

[2011-03-20 23:21:19.104190] W [fuse-bridge.c:652:fuse_setattr_cbk]
glusterfs-fuse: 1243697886: SETATTR() /wp-content/w3-total-cache-config.php
=> -1 (Operation not permitted)

then it starts trying to self-heal it forever, again.

Any thoughts on what might be going on?

thanks,
-Drew