Hi HUANG,
I got that problem some time. It came for my different volumes when one
node quit the volume management because of a network problem, or more
often because of a glusterd daemon stop.
So You have to control that all the glusterd daemon are on on each node
"service glusterd status" if you find one stopped restart it.
Then you have to do a rebalance operation on each volume manage by all
the node of your glusterd file system :
gluster volume rebalance <volumeName> start
...
That take some time in backgroud, depending of the node number and the
size. After that you will get back the logical vision of your file s.
I do that yesterday on my 14 nodes gluster cluster. The question is now
to monitor the glusterd daemon in order to restart it when it stop. I
will use webmin which can monitor any services.
Hoping that it help you.
Pierre L?onard> Dear all,
>
> I found a strange cases that I remove the directory from server side
including the hide files under .gluster/, while I can still list the directory.
>
>
> Server side:
>
>
> ls:
/data1/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log:
No such file or directory
> ls:
/data2/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log:
No such file or directory
> ls:
/data3/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log:
No such file or directory
> ls:
/data4/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log:
No such file or directory
> ls:
/data5/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log:
No such file or directory
> ls:
/data6/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log:
No such file or directory
> ls:
/data7/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log:
No such file or directory
> ls:
/data8/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log:
No such file or directory
> ls:
/data9/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log:
No such file or directory
> ls:
/data10/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log:
No such file or directory
> ls:
/data11/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log:
No such file or directory
> ls:
/data12/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log:
No such file or directory
> ls:
/data13/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log:
No such file or directory
> ls:
/data14/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log:
No such file or directory
> ls:
/data15/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log:
No such file or directory
> ls:
/data16/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log:
No such file or directory
> ls:
/data17/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log:
No such file or directory
> ls:
/data18/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log:
No such file or directory
>
> Client side:
>
> [root at hep ~]# ls
/datafs/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log/ -l
> total 0
> ?--------- ? ? ? ? ? ana101.csh
> ?--------- ? ? ? ? ? ana103.csh
> ?--------- ? ? ? ? ? ana39.csh
> ?--------- ? ? ? ? ? ana45.csh
> ?--------- ? ? ? ? ? ana55.csh
> ?--------- ? ? ? ? ? ana5.csh
> ?--------- ? ? ? ? ? ana65.csh
> ?--------- ? ? ? ? ? ana68.csh
> ?--------- ? ? ? ? ? ana69.csh
> ?--------- ? ? ? ? ? ana82.csh
> ?--------- ? ? ? ? ? ana83.csh
> ?--------- ? ? ? ? ? ana87.csh
> ?--------- ? ? ? ? ? ana99.csh
>
> So, it's weird that we can see the deleted directory exist from client.
>
> We deployed glusterfs-3.5.2 and set 2 replicas.
>
> Did someone know this issue? And how can I delete the directory clearly?
>
> Thank you very much in advance. Looking forward to your reply.
>
> Thanks,
> Qiulan
>
>
>
> _______________________________________________
> Gluster-users mailing list
> Gluster-users at gluster.org
> http://www.gluster.org/mailman/listinfo/gluster-users