Apache9 commented on PR #5016:
URL: https://github.com/apache/hbase/pull/5016#issuecomment-1425469807

   > I tested morning, sadly still something wrong...The problem is focus on 
one scenario, replicated mostly whole row deletes. It seems should not be 
relevant to the operation, but I can't find more relevant changes. We have 
already reset the compress context to fix the issue in the last months, it 
resolved most problems and seems more stable than before. But we have one 
circumstance, the replication always stuck. The senerio is as follows. There is 
two-way replications between cluster A and cluster B(both using wal group), A 
without WAL compression, B with WAL compression, write operations only on A. 
Now there are many whole row deletes on A, the replication of A->B is OK, the 
replication of B->A is always stucks, and the stuck is not rare, it is very 
easy to happen. I can not reproduce this problem locally until now, maybe it's 
not relevant to the uncompress progress, maybe something wrong when compress 
and the WAL is corrupt. I used WALPrettyPrinter to read these WALs, the printe
 r always stopped at the same position for one WAL, and no exceptions output, 
but the end read position of the printer is in the middle of the WAL.
   
   If WALPrettyPrinter can not output correct result, I think the problem is 
not about the replication implementation then, it should be something wrong 
when writing the WAL file. And I believe it will also make WAL splitting 
incorrect?
   
   Do you also enabled WAL value compression? Or just the dictionary based 
compression...
   
   Thanks.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to