kenji kondo
2015-Jan-22 17:32 UTC
[Gluster-users] Can't delete files after add brick and rebalance.
Hi Guys, I'm using the GlusterFS version 3.3.2. I have a problem that unable to delete files as below --------------------- $ cat log/d0105f.ai.hook hello! $ rm log/d0105f.ai.hook rm: cannot remove `log/d0105f.ai.hook': No such file or directory --------------------- This problem was found after add brick and rebalance. I don't know this problem is relate to the rebalance. So I checked the log in /var/log/glusterfs, and I found below suspicious messages. --------------------- $ tail /var/log/glusterfs/grid-kk.hs.log [2015-01-20 09:49:44.491634] W [client3_1-fops.c:647:client3_1_unlink_cbk] 1-vol12-client-11: remote operation failed: No such file or directory [2015-01-20 09:49:44.491696] W [fuse-bridge.c:1029:fuse_unlink_cbk] 0-glusterfs-fuse: 2982544: UNLINK() /hotchip/log/d0105f.ai.hook => -1 (No such file or directory) --------------------- I know above text file 'd0105f.ai.hook' exist in one gluster server with below command. --------------------- $ sudo getfattr -m . -n trusted.glusterfs.pathinfo log/d0105f.ai.hook trusted.glusterfs.pathinfo="(<DISTRIBUTE:vol12-dht> <POSIX(/export12/brick):gfs14:/export12/brick/hotchip/log/d0105f.ai.hook>)" $ ssh gfs14 [@gfs14 /]$ ls /export12/brick/hotchip/log/d0105f.ai.hook /export12/brick/rdcurve/log/d0105f.ai.book.o1441124.100 --------------------- Exactly, I could find the file in the brick on the server 'gfs14'. Additionally I knew two facts that if I rename the file name to another with 'mv' command, I can delete it with new file name. Furthermore, if I mount the volume newly, I could delete the file. I think this situation is strange. Is this bug or something? Best regards, K. Kondo -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://www.gluster.org/pipermail/gluster-users/attachments/20150123/f7f92d42/attachment.html>
Lalatendu Mohanty
2015-Jan-22 19:44 UTC
[Gluster-users] Can't delete files after add brick and rebalance.
On 01/22/2015 11:02 PM, kenji kondo wrote:> Hi Guys, > > I'm using the GlusterFS version 3.3.2. > I have a problem that unable to delete files as below > > --------------------- > $ cat log/d0105f.ai.hook > hello! > $ rm log/d0105f.ai.hook > rm: cannot remove `log/d0105f.ai.hook': No such file or directory > --------------------- > > This problem was found after add brick and rebalance. > I don't know this problem is relate to the rebalance. > So I checked the log in /var/log/glusterfs, and I found below > suspicious messages. > --------------------- > $ tail /var/log/glusterfs/grid-kk.hs.log > [2015-01-20 09:49:44.491634] W > [client3_1-fops.c:647:client3_1_unlink_cbk] 1-vol12-client-11: remote > operation failed: No such file or directory > [2015-01-20 09:49:44.491696] W [fuse-bridge.c:1029:fuse_unlink_cbk] > 0-glusterfs-fuse: 2982544: UNLINK() /hotchip/log/d0105f.ai.hook => -1 > (No such file or directory) > --------------------- > > > I know above text file 'd0105f.ai.hook' exist in one gluster server > with below command. > > --------------------- > $ sudo getfattr -m . -n trusted.glusterfs.pathinfo log/d0105f.ai.hook > trusted.glusterfs.pathinfo="(<DISTRIBUTE:vol12-dht> > <POSIX(/export12/brick):gfs14:/export12/brick/hotchip/log/d0105f.ai.hook>)" > > $ ssh gfs14 > [@gfs14 /]$ ls /export12/brick/hotchip/log/d0105f.ai.hook > /export12/brick/rdcurve/log/d0105f.ai.book.o1441124.100 > --------------------- > > Exactly, I could find the file in the brick on the server 'gfs14'. > Additionally I knew two facts that if I rename the file name to > another with 'mv' command, > I can delete it with new file name. > Furthermore, if I mount the volume newly, I could delete the file. > > I think this situation is strange. Is this bug or something? > > > Best regards, > K. Kondo >Gluster 3.3.2 is old and not a maintained version from Gluster community point of view. It is likely that this issue is fixed and is not present current maintained versions i.e. 3.4.6 , 3.5.3 and 3.6.1. So it would be hard to get help on this, so I will highly recommend you to move to a newer version i.e. 3.6.1 Thanks, Lala> > > > _______________________________________________ > Gluster-users mailing list > Gluster-users at gluster.org > http://www.gluster.org/mailman/listinfo/gluster-users-------------- next part -------------- An HTML attachment was scrubbed... URL: <http://www.gluster.org/pipermail/gluster-users/attachments/20150123/8b76f7a3/attachment.html>