Andrew Wong created KUDU-3260:
---------------------------------

             Summary: Reduce the on-disk footprint of transaction metadata in 
participants
                 Key: KUDU-3260
                 URL: https://issues.apache.org/jira/browse/KUDU-3260
             Project: Kudu
          Issue Type: Improvement
          Components: server, transactions
            Reporter: Andrew Wong


We should remove the commit timestamp and txn metadata once we've flushed all 
in-memory stores that rely on metadata for determining commit timestamp. If we 
see tablets serving more frequent transactions, the persisted metadata may 
become less negligible.

One thing to watch out for here is that we currently use metadata to determine 
whether a transaction has _ever_ existed on the participant – if we simply get 
rid of the metadata, we will lose out on this knowledge. More thought should be 
given to how and when to do this safely, and ensure that we clean up the 
metadata in such a way that no invariants are broken with regards to knowing 
about transaction existence (e.g. perhaps only clean up the txn metadata if the 
corresponding TxnStatusManager has been deleted?).



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to