Hello, I am trying to test glusterfs for use as a backup/storage system. After installation everything seems to run fine. That is, until I run a particular rsync command against a glusterfs mounted directory. '/mnt/backups/' being the gluster mounted directory and '/mnt/control' containing various image files and directories. This command will crash gluster: backup0:/mnt# rsync -rav -X -i /mnt/control/ /mnt/backups/ with this error: [2010-03-17 19:07:22] W [fuse-bridge.c:722:fuse_attr_cbk] glusterfs-fuse: 16173: LOOKUP() / => -1 (Stale NFS file handle) Yet this command does not: backup0:/mnt/control# rsync -rav -X -i * /mnt/backups/ I need to figure out what is causing this as I can't have normal operations (and rsync will be used) causing these kinds of crashes in our production environment. I can post any logs/configs necessary. Any help is appreciated. ---------------------------------- Joe grace
Which version of GlusterFS are you using? Can you post the client log file and if possible the backtrace using gdb? ------------------------------ Vikas Gorur Engineer - Gluster, Inc. +1 (408) 770 1894 ------------------------------
Just to throw my experience on this, I'm currently using rsync over ssh (rsync -av /mnt/data user at server:/mnt/glusterfs) to sync data from a file server to two glusterfs servers running in raid1 mode. I've moved about 2 TB today, and it has not had any issues. I'm running 3.0.3 built from source on Debian Squeeze. HTH P On Wed, Mar 17, 2010 at 7:13 PM, Joe Grace <jgrace at photodex.com> wrote:> Hello, > > > > I am trying to test glusterfs for use as a backup/storage system. > > > > After installation everything seems to run fine. That is, until I run a > particular rsync command against a glusterfs mounted directory. > > > > '/mnt/backups/' being the gluster mounted directory and '/mnt/control' > containing various image files and directories. > > > > This command will crash gluster: > > backup0:/mnt# rsync -rav -X -i /mnt/control/ /mnt/backups/ > > > > with this error: > > [2010-03-17 19:07:22] W [fuse-bridge.c:722:fuse_attr_cbk] > glusterfs-fuse: 16173: LOOKUP() / => -1 (Stale NFS file handle) > > > > Yet this command does not: > > backup0:/mnt/control# rsync -rav -X -i * /mnt/backups/ > > > > I need to figure out what is causing this as I can't have normal > operations (and rsync will be used) causing these kinds of crashes in > our production environment. > > > > I can post any logs/configs necessary. Any help is appreciated. > > > > > > ---------------------------------- > > Joe grace > > > > > _______________________________________________ > Gluster-users mailing list > Gluster-users at gluster.org > http://gluster.org/cgi-bin/mailman/listinfo/gluster-users > >-- http://philcryer.com
Isn't the /mnt/control directory also exported via NFS? Do you have any ".nfsXXXXX..." files there? The second command, which you successfully used, doesn't attempt to rsync such files. Regards, Jan Pisacka Inst. of Plasma Physics AS CR On 18.3.2010 01:13, Joe Grace wrote:> Hello, > > > > I am trying to test glusterfs for use as a backup/storage system. > > > > After installation everything seems to run fine. That is, until I run a > particular rsync command against a glusterfs mounted directory. > > > > '/mnt/backups/' being the gluster mounted directory and '/mnt/control' > containing various image files and directories. > > > > This command will crash gluster: > > backup0:/mnt# rsync -rav -X -i /mnt/control/ /mnt/backups/ > > > > with this error: > > [2010-03-17 19:07:22] W [fuse-bridge.c:722:fuse_attr_cbk] > glusterfs-fuse: 16173: LOOKUP() / => -1 (Stale NFS file handle) > > > > Yet this command does not: > > backup0:/mnt/control# rsync -rav -X -i * /mnt/backups/ > > > > I need to figure out what is causing this as I can't have normal > operations (and rsync will be used) causing these kinds of crashes in > our production environment. > > > > I can post any logs/configs necessary. Any help is appreciated. > > > > > > ---------------------------------- > > Joe grace > > > > > > ------------------------------------------------------------------------ > > _______________________________________________ > Gluster-users mailing list > Gluster-users at gluster.org > http://gluster.org/cgi-bin/mailman/listinfo/gluster-users >
On Mar 19, 2010, at 9:47 AM, Joe Grace wrote:> Thank you for the reply. > > Version 3.0.2 from source on Debian sqeeze. > > Here is the client log:That is the client volume file. What I meant was the client log file you can usually find in /usr/local/var/log/glusterfs/glusterfs.log. If you have a core file from glusterfs (look in /core.*), you can get a backtrace by: # gdb /path/to/glusterfs /path/to/core/file (gdb) thread apply all bt full Please send us the output of that command. ------------------------------ Vikas Gorur Engineer - Gluster, Inc. +1 (408) 770 1894 ------------------------------