Hi, I am having some strange problem with glusterfs , to explain it below is what the setup looks like: 2 machines( A1, A2) running glusterfsd (server) A1 = 192.168.1.4 A2 = 192.168.1.5 1 machine(B) running glusterfs (client) on which glusterfs file system is mounted (/mnt/glusterfs) B = 192.168.1.3 Data on glusterfs servers stored in /data/export directory. Following are the server and client volume files Server Volume file ---------------------------- volume posix type storage/posix option directory /data/export end-volume volume locks type features/locks subvolumes posix end-volume volume brick type performance/io-threads option thread-count 8 subvolumes locks end-volume volume server type protocol/server option transport-type tcp option auth.addr.brick.allow 192.168.1.* subvolumes brick end-volume Client Volume File --------------------------- ### Add client feature and attach to remote subvolume of server1 volume brick1 type protocol/client option transport-type tcp/client option remote-host 192.168.1.4 # IP address of the remote brick option remote-subvolume brick # name of the remote volume end-volume ### Add client feature and attach to remote subvolume of server2 volume brick2 type protocol/client option transport-type tcp/client option remote-host 192.168.1.5 # IP address of the remote brick option remote-subvolume brick # name of the remote volume end-volume #The replicated volume with data volume afr1 type cluster/replicate subvolumes brick1 brick2 end-volume The issue is when I delete a file from /data/export from machine A1 it gets deleted from /mnt/glusterfs on Machine B but remains on machine A2. If I specify A2's IP first in client volume file then deleting a file from /data/export on A2 deletes file from /mnt/glusterfs on Machine B but not from Machine A1. Is this behavior correct ? What could be the issue in this case ? Thank you in advance. -Paras
----- "Paras Fadte" <plfgoa at gmail.com> wrote:> Hi,> The issue is when I delete a file from /data/export from machine A1 > it gets deleted from /mnt/glusterfs on Machine B but remains on > machine A2. If I specify A2's IP first in client volume file then > deleting a file from /data/export on A2 deletes file from > /mnt/glusterfs on Machine B but not from Machine A1. Is this behavior > correct ? What could be the issue in this case ?This is a known issue in replicate. From the wiki: http://www.gluster.org/docs/index.php/Understanding_AFR_Translator "Self-heal of a file that does not exist on the first subvolume: If a file does not exist on the first subvolume but exists on some other subvolume, it will not show up in the output of 'ls'. This is because the replicate translator fetches the directory listing only from the first subvolume. Thus, the file that does not exist on the first subvolume is never seen and never healed. However, if you know the name of the file and do a 'stat' on the file or try to access it in any other way, the file will be properly healed and created on the first subvolume." Vikas -- Engineer - Z Research http://gluster.com/