[ https://issues.apache.org/jira/browse/CASSANDRA-9669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15283354#comment-15283354 ]
Caleb Rackliffe commented on CASSANDRA-9669: -------------------------------------------- I've been able to reproduce this with a plain custom 2i: {noformat} cqlsh> CREATE KEYSPACE truncation_test WITH replication = {'class': 'NetworkTopologyStrategy' , 'DC1': '1'}; cqlsh> use truncation_test ; cqlsh:truncation_test> CREATE TABLE simple_table (id text, value text, PRIMARY KEY (id)); cqlsh:truncation_test> CREATE CUSTOM INDEX value_index ON simple_table (value) USING 'c.d.b.util.DummyIndex'; cqlsh:truncation_test> INSERT INTO simple_table(id,value) VALUES('1','value1'); cqlsh:truncation_test> TRUNCATE simple_table; OperationTimedOut: errors={}, last_host=127.0.0.1 {noformat} > If sstable flushes complete out of order, on restart we can fail to replay > necessary commit log records > ------------------------------------------------------------------------------------------------------- > > Key: CASSANDRA-9669 > URL: https://issues.apache.org/jira/browse/CASSANDRA-9669 > Project: Cassandra > Issue Type: Bug > Components: Local Write-Read Paths > Reporter: Benedict > Assignee: Benedict > Priority: Critical > Labels: correctness > Fix For: 2.2.7, 3.7, 3.0.7 > > > While {{postFlushExecutor}} ensures it never expires CL entries out-of-order, > on restart we simply take the maximum replay position of any sstable on disk, > and ignore anything prior. > It is quite possible for there to be two flushes triggered for a given table, > and for the second to finish first by virtue of containing a much smaller > quantity of live data (or perhaps the disk is just under less pressure). If > we crash before the first sstable has been written, then on restart the data > it would have represented will disappear, since we will not replay the CL > records. > This looks to be a bug present since time immemorial, and also seems pretty > serious. -- This message was sent by Atlassian JIRA (v6.3.4#6332)