[ 
https://issues.apache.org/jira/browse/CASSANDRA-459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12759989#action_12759989
 ] 

Teodor Sigaev commented on CASSANDRA-459:
-----------------------------------------

Patch doesn't change anything :(   I use the same test script as for 
CASSANDRA-458.
Immediately after test start:
% ls -l /spool/cassandra/commitlog /spool/cassandra/data/Keyspace1
/spool/cassandra/commitlog:
total 784
-rw-r--r--  1 teodor  wheel  786432 Sep 27 02:42 CommitLog-1254004919295.log

/spool/cassandra/data/Keyspace1:
total 0

After night
% ls -l /spool/cassandra/commitlog /spool/cassandra/data/Keyspace1
/spool/cassandra/commitlog:
total 3856720
-rw-r--r--  1 teodor  wheel  134217971 Sep 27 09:52 CommitLog-1254004919295.log
-rw-r--r--  1 teodor  wheel  134217839 Sep 27 09:52 CommitLog-1254005826443.log
-rw-r--r--  1 teodor  wheel  134218376 Sep 27 09:52 CommitLog-1254006732843.log
-rw-r--r--  1 teodor  wheel  134217734 Sep 27 09:52 CommitLog-1254007676088.log
-rw-r--r--  1 teodor  wheel  134218324 Sep 27 09:52 CommitLog-1254008589671.log
-rw-r--r--  1 teodor  wheel  134218501 Sep 27 09:52 CommitLog-1254009457777.log
-rw-r--r--  1 teodor  wheel  134217841 Sep 27 09:52 CommitLog-1254010329142.log
-rw-r--r--  1 teodor  wheel  134218312 Sep 27 09:52 CommitLog-1254011183824.log
-rw-r--r--  1 teodor  wheel  134217795 Sep 27 09:52 CommitLog-1254012066380.log
-rw-r--r--  1 teodor  wheel  134218031 Sep 27 09:52 CommitLog-1254012920007.log
-rw-r--r--  1 teodor  wheel  134217764 Sep 27 09:52 CommitLog-1254013812856.log
-rw-r--r--  1 teodor  wheel  134217888 Sep 27 09:52 CommitLog-1254014728895.log
-rw-r--r--  1 teodor  wheel  134217842 Sep 27 09:52 CommitLog-1254015574082.log
-rw-r--r--  1 teodor  wheel  134217861 Sep 27 09:52 CommitLog-1254016456859.log
-rw-r--r--  1 teodor  wheel  134218257 Sep 27 09:52 CommitLog-1254017313996.log
-rw-r--r--  1 teodor  wheel  134217874 Sep 27 09:52 CommitLog-1254018190196.log
-rw-r--r--  1 teodor  wheel  134218228 Sep 27 09:52 CommitLog-1254019039153.log
-rw-r--r--  1 teodor  wheel  134217768 Sep 27 09:52 CommitLog-1254019901588.log
-rw-r--r--  1 teodor  wheel  134218072 Sep 27 09:52 CommitLog-1254020850481.log
-rw-r--r--  1 teodor  wheel  134218463 Sep 27 09:52 CommitLog-1254021705210.log
-rw-r--r--  1 teodor  wheel  134217787 Sep 27 09:52 CommitLog-1254022584617.log
-rw-r--r--  1 teodor  wheel  134217817 Sep 27 09:52 CommitLog-1254023445022.log
-rw-r--r--  1 teodor  wheel  134218548 Sep 27 09:52 CommitLog-1254024325493.log
-rw-r--r--  1 teodor  wheel  134217870 Sep 27 09:52 CommitLog-1254025178129.log
-rw-r--r--  1 teodor  wheel  134217763 Sep 27 09:52 CommitLog-1254026031303.log
-rw-r--r--  1 teodor  wheel  134217782 Sep 27 09:52 CommitLog-1254026990171.log
-rw-r--r--  1 teodor  wheel  134217781 Sep 27 09:52 CommitLog-1254027844609.log
-rw-r--r--  1 teodor  wheel  134217742 Sep 27 09:52 CommitLog-1254028740042.log
-rw-r--r--  1 teodor  wheel  134217810 Sep 27 09:52 CommitLog-1254029593664.log
-rw-r--r--  1 teodor  wheel   54067200 Sep 27 09:53 CommitLog-1254030447553.log

/spool/cassandra/data/Keyspace1:
total 785468
-rw-r--r--  1 teodor  wheel  215470950 Sep 27 08:48 Standard1-372-Data.db
-rw-r--r--  1 teodor  wheel    3833605 Sep 27 08:48 Standard1-372-Filter.db
-rw-r--r--  1 teodor  wheel   88353365 Sep 27 08:48 Standard1-372-Index.db
-rw-r--r--  1 teodor  wheel  204226037 Sep 27 09:18 Standard1-408-Data.db
-rw-r--r--  1 teodor  wheel     812005 Sep 27 09:18 Standard1-408-Filter.db
-rw-r--r--  1 teodor  wheel   32812386 Sep 27 09:18 Standard1-408-Index.db
-rw-r--r--  1 teodor  wheel   10467605 Sep 27 09:51 Standard1-444-Data.db
-rw-r--r--  1 teodor  wheel      30349 Sep 27 09:51 Standard1-444-Filter.db
-rw-r--r--  1 teodor  wheel    1442137 Sep 27 09:51 Standard1-444-Index.db
-rw-r--r--  1 teodor  wheel  201238111 Sep 27 09:53 Standard1-445-Data.db
-rw-r--r--  1 teodor  wheel     795205 Sep 27 09:53 Standard1-445-Filter.db
-rw-r--r--  1 teodor  wheel   32237630 Sep 27 09:53 Standard1-445-Index.db
-rw-r--r--  1 teodor  wheel   10458480 Sep 27 09:52 Standard1-446-Data.db
-rw-r--r--  1 teodor  wheel      30261 Sep 27 09:52 Standard1-446-Filter.db
-rw-r--r--  1 teodor  wheel    1438054 Sep 27 09:52 Standard1-446-Index.db

The single problem in logs is:
 WARN [MINOR-COMPACTION-POOL:1] 2009-09-27 09:41:59,422 ColumnFamilyStore.java 
(line 1034) Nothing to compact (all files empty or corrupt)
 WARN [MINOR-COMPACTION-POOL:1] 2009-09-27 03:41:59,303 ColumnFamilyStore.java 
(line 1034) Nothing to compact (all files empty or corrupt)
 WARN [MINOR-COMPACTION-POOL:1] 2009-09-27 04:41:59,234 ColumnFamilyStore.java 
(line 1034) Nothing to compact (all files empty or corrupt)
 WARN [MINOR-COMPACTION-POOL:1] 2009-09-27 05:41:59,355 ColumnFamilyStore.java 
(line 1034) Nothing to compact (all files empty or corrupt)
 WARN [MINOR-COMPACTION-POOL:1] 2009-09-27 06:41:59,386 ColumnFamilyStore.java 
(line 1034) Nothing to compact (all files empty or corrupt)
 WARN [MINOR-COMPACTION-POOL:1] 2009-09-27 07:41:59,392 ColumnFamilyStore.java 
(line 1034) Nothing to compact (all files empty or corrupt)
 WARN [MINOR-COMPACTION-POOL:1] 2009-09-27 08:48:58,819 ColumnFamilyStore.java 
(line 1034) Nothing to compact (all files empty or corrupt)

Log fragment of one of that warnings:
 INFO [MINOR-COMPACTION-POOL:1] 2009-09-27 09:41:53,827 ColumnFamilyStore.java 
(line 1155) Compacted to /spool/cassandra/data/Keyspace1/Standard1-434-Data.db. 
 0/67462071 bytes for 111274/107527 keys read/written.  Time: 31884ms.
 INFO [PERIODIC-FLUSHER-POOL:1] 2009-09-27 09:41:59,033 ColumnFamilyStore.java 
(line 367) Standard1 has reached its threshold; switching in a fresh Memtable
 INFO [PERIODIC-FLUSHER-POOL:1] 2009-09-27 09:41:59,033 ColumnFamilyStore.java 
(line 1178) Enqueuing flush of Memtable(Standard1)@8993320
 INFO [MEMTABLE-FLUSHER-POOL:1] 2009-09-27 09:41:59,033 Memtable.java (line 
186) Flushing Memtable(Standard1)@8993320
 INFO [MINOR-COMPACTION-POOL:1] 2009-09-27 09:41:59,422 ColumnFamilyStore.java 
(line 1013) Compacting []
 WARN [MINOR-COMPACTION-POOL:1] 2009-09-27 09:41:59,422 ColumnFamilyStore.java 
(line 1034) Nothing to compact (all files empty or corrupt)
 INFO [MEMTABLE-FLUSHER-POOL:1] 2009-09-27 09:42:06,148 Memtable.java (line 
220) Completed flushing Memtable(Standard1)@8993320



> Commitlog segments don't get deleted
> ------------------------------------
>
>                 Key: CASSANDRA-459
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-459
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Core
>            Reporter: Jonathan Ellis
>            Assignee: Jonathan Ellis
>             Fix For: 0.4, 0.5
>
>         Attachments: 
> 0001-CASSANDRA-459-flush-system-table-every-five-minutes.txt, 0002-logging.txt
>
>
> System table is not created with a periodic flush, so any update there (such 
> as storing token info) can prevent commitlog segments from being deleted.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply via email to