Hi Pierre, Thank you for your constructive suggestion.
I'll have a try and let you know. I have one question about what you mentioned the logical version of files. Does it mean all the files in gluster labeled with version? Thank you very much! Cheers, Qiulan > -----Original Messages----- > From: "Pierre Léonard" <[email protected]> > Sent Time: Wednesday, May 27, 2015 > To: "HUANG Qiulan" <[email protected]>, [email protected] > Cc: [email protected] > Subject: Re: [Gluster-users] Cannot remove files > > Hi HUANG, > > I got that problem some time. It came for my different volumes when one > node quit the volume management because of a network problem, or more > often because of a glusterd daemon stop. > > So You have to control that all the glusterd daemon are on on each node > "service glusterd status" if you find one stopped restart it. > Then you have to do a rebalance operation on each volume manage by all > the node of your glusterd file system : > > gluster volume rebalance <volumeName> start > ... > > That take some time in backgroud, depending of the node number and the > size. After that you will get back the logical vision of your file s. > > I do that yesterday on my 14 nodes gluster cluster. The question is now > to monitor the glusterd daemon in order to restart it when it stop. I > will use webmin which can monitor any services. > > Hoping that it help you. > > Pierre Léonard > > Dear all, > > > > I found a strange cases that I remove the directory from server side > > including the hide files under .gluster/, while I can still list the > > directory. > > > > > > Server side: > > > > > > ls: > > /data1/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: > > No such file or directory > > ls: > > /data2/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: > > No such file or directory > > ls: > > /data3/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: > > No such file or directory > > ls: > > /data4/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: > > No such file or directory > > ls: > > /data5/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: > > No such file or directory > > ls: > > /data6/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: > > No such file or directory > > ls: > > /data7/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: > > No such file or directory > > ls: > > /data8/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: > > No such file or directory > > ls: > > /data9/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: > > No such file or directory > > ls: > > /data10/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: > > No such file or directory > > ls: > > /data11/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: > > No such file or directory > > ls: > > /data12/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: > > No such file or directory > > ls: > > /data13/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: > > No such file or directory > > ls: > > /data14/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: > > No such file or directory > > ls: > > /data15/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: > > No such file or directory > > ls: > > /data16/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: > > No such file or directory > > ls: > > /data17/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: > > No such file or directory > > ls: > > /data18/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: > > No such file or directory > > > > Client side: > > > > [root@hep ~]# ls > > /datafs/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log/ > > -l > > total 0 > > ?--------- ? ? ? ? ? ana101.csh > > ?--------- ? ? ? ? ? ana103.csh > > ?--------- ? ? ? ? ? ana39.csh > > ?--------- ? ? ? ? ? ana45.csh > > ?--------- ? ? ? ? ? ana55.csh > > ?--------- ? ? ? ? ? ana5.csh > > ?--------- ? ? ? ? ? ana65.csh > > ?--------- ? ? ? ? ? ana68.csh > > ?--------- ? ? ? ? ? ana69.csh > > ?--------- ? ? ? ? ? ana82.csh > > ?--------- ? ? ? ? ? ana83.csh > > ?--------- ? ? ? ? ? ana87.csh > > ?--------- ? ? ? ? ? ana99.csh > > > > So, it's weird that we can see the deleted directory exist from client. > > > > We deployed glusterfs-3.5.2 and set 2 replicas. > > > > Did someone know this issue? And how can I delete the directory clearly? > > > > Thank you very much in advance. Looking forward to your reply. > > > > Thanks, > > Qiulan > > > > > > > > _______________________________________________ > > Gluster-users mailing list > > [email protected] > > http://www.gluster.org/mailman/listinfo/gluster-users > _______________________________________________ Gluster-users mailing list [email protected] http://www.gluster.org/mailman/listinfo/gluster-users
