On 02/07/2018 10:39 AM, Zhou, Cynthia (NSB - CN/Hangzhou) wrote:
Hi glusterfs expert:
Good day.
Lately, we meet a glusterfs split brain problem in our env in
/mnt/export/testdir. We start 3 ior process (IOR tool) from non-sn
nodes, which is creating/removing files repeatedly in testdir. then we
reboot sn nodes(sn0 and sn1) by sequence. Then we meet following problem.
Do you have some comments on how this could happen? And how to fix it
in this situation? Thanks!
Is the problem that split-brain is happening? Is this a replica 2
volume? If yes, then it looks like it is expected behavior?
Regards
Ravi
gluster volume heal export info
Brick sn-0.local:/mnt/bricks/export/brick
Status: Connected
Number of entries: 0
Brick sn-1.local:/mnt/bricks/export/brick
/testdir - Is in split-brain
/testdir - Possibly undergoing heal
Status: Connected
Number of entries: 2
wait for a while …..
gluster volume heal export info
Brick sn-0.local:/mnt/bricks/export/brick
Status: Connected
Number of entries: 0
Brick sn-1.local:/mnt/bricks/export/brick
/testdir - Possibly undergoing heal
/testdir - Possibly undergoing heal
and finally:
[root@sn-0:/root <http://sn-0/root>]
# gluster v heal export info
Brick sn-0.local:/mnt/bricks/export/brick
<http://local/mnt/bricks/export/brick>
Status: Connected
Number of entries: 0
Brick sn-1.local:/mnt/bricks/export/brick
<http://local/mnt/bricks/export/brick>
/testdir - Is in split-brain
Status: Connected
Number of entries: 1
[root@sn-0:/root <http://sn-0/root>]
# getfattr -m .* -d -e hex /mnt/bricks/export/brick/testdir
getfattr: Removing leading '/' from absolute path names
# file: mnt/bricks/export/brick/testdir
trusted.gfid=0x5622cff893b3484dbdb6a20a0edb0e77
trusted.glusterfs.dht=0x000000010000000000000000ffffffff
[root@sn-1:/root <http://sn-1/root>]
# getfattr -m .* -d -e hex /mnt/bricks/export/brick/testdir
getfattr: Removing leading '/' from absolute path names
# file: mnt/bricks/export/brick/testdir
trusted.afr.dirty=0x000000000000000000000001
trusted.afr.export-client-0=0x000000000000000000000038
trusted.gfid=0x5622cff893b3484dbdb6a20a0edb0e77
trusted.glusterfs.dht=0x000000010000000000000000ffffffff
_______________________________________________
Gluster-devel mailing list
[email protected]
http://lists.gluster.org/mailman/listinfo/gluster-devel
