Hi there I've just read about Glusterfs and was impressed enough to give it a go - but have hit a hurdle already. I've installed glusterfs-1.3.12 on a FC9 and CentOS5 server, and am using it to mount bricks on each via cluster/afr. Once the clients were mounted, I started copying a directory into the mount point, and sure enough, it started showing up under /home/export on both servers (as expected). However, I then Ctrl-C'ed the "cp" command I was running and I did a "du /home/export" on both servers - and they don't match! Same fs (ext3) on both. Obviously a lot of the files are the same, but there are some files on one that aren't on the other. How could that happen? The following line showed up in /var/log/glusterfs/glusterfs.log on ONE of the two servers when I did the Ctr-C 2008-10-10 21:32:30 W [fuse-bridge.c:411:fuse_entry_cbk] glusterfs-fuse: 4176: (34) /xxxxxxx => 40111986 Rehashing because st_nlink less than dentry maps Any ideas? Thanks -- Cheers Jason Haar Information Security Manager, Trimble Navigation Ltd. Phone: +64 3 9635 377 Fax: +64 3 9635 417 PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8422 C063 5EBB FE1D 66D1
Hello Jason, This behavior is normal since with AFR files are transfered on the other nodes only when they are requested from them. So in order to have the files replicated you should do find . in /home/export on all remote nodes. For more information please read this article: http://www.gluster.org/docs/index.php/Understanding_AFR_Translator Regards Marian On Friday 10 October 2008 11:57:01 Jason Haar wrote:> Hi there > > I've just read about Glusterfs and was impressed enough to give it a go > - but have hit a hurdle already. > > I've installed glusterfs-1.3.12 on a FC9 and CentOS5 server, and am > using it to mount bricks on each via cluster/afr. > > Once the clients were mounted, I started copying a directory into the > mount point, and sure enough, it started showing up under /home/export > on both servers (as expected). However, I then Ctrl-C'ed the "cp" > command I was running and I did a "du /home/export" on both servers - > and they don't match! Same fs (ext3) on both. Obviously a lot of the > files are the same, but there are some files on one that aren't on the > other. How could that happen? > > The following line showed up in /var/log/glusterfs/glusterfs.log on ONE > of the two servers when I did the Ctr-C > > 2008-10-10 21:32:30 W [fuse-bridge.c:411:fuse_entry_cbk] glusterfs-fuse: > 4176: (34) /xxxxxxx => 40111986 Rehashing because st_nlink less than > dentry maps > > Any ideas? Thanks