[
https://issues.apache.org/jira/browse/CASSANDRA-3269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Yang updated CASSANDRA-3269:
---------------------------------
Comment: was deleted
(was: I was suspecting there could be something wrong with the
CommitLog.discardCompletedSegmentsInternal():
if (segment.id == context.segment)
{
// Only unmark this segment if there were not write since the
// ReplayPosition was grabbed.
segment.turnOffIfNotWritten(id, context.position);
maybeDiscardSegment(segment, iter);
then inside CommitLogSegment:
void turnOffIfNotWritten(Integer cfId, Integer flushPosition)
{
Integer lastWritten = cfLastWrite.get(cfId);
if (lastWritten == null || lastWritten < flushPosition)
cfLastWrite.remove(cfId);
}
should the comparison "lastWritten < flushPosition" be "<= " ?? I don't know
the exact semantic of the "flushPosition",
then I looked at CommitLogSegment.write(), here the position comes from the
underlying writer. but it only calls logWriter.stream.xxxxx , and not any
update on the positions
Jonathan could you please briefly explain the logic on the position update of
CommitLogSegment.write() ?
Thanks a lot
Yang)
> accumulated 100GB of commit logs
> --------------------------------
>
> Key: CASSANDRA-3269
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3269
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 1.0.0
> Reporter: Yang Yang
>
> I ran my cluster for about 2 days. the cluster has 2 nodes. I restarted one
> box several times, and the other one was always running. the one always
> running ended up accumulating 100GB of commit logs.
> this is 1.0.0 code from about Sept 15 in github. I kept the original setting
> for
> #commitlog_total_space_in_mb: 4096
> i.e. commented out
> here is some sample of the output:
> -rw-r--r-- 1 yyang yyang 134217857 2011-09-28 03:51
> CommitLog-1317181834810.log
> -rw-r--r-- 1 yyang yyang 134217869 2011-09-28 03:50
> CommitLog-1317181764105.log
> -rw-r--r-- 1 yyang yyang 134217783 2011-09-28 03:49
> CommitLog-1317181694633.log
> -rw-r--r-- 1 yyang yyang 134217750 2011-09-28 02:39
> CommitLog-1317176955102.log
> yyang@ip-10-71-21-46:/mnt/cass/log/cassandra$ ls -lt
> /mnt/cass/lib//cassandra/commitlog/|wc -l
> 727
> yyang@ip-10-71-21-46:/mnt/cass/log/cassandra$ du -s
> /mnt/cass/lib/cassandra/commitlog/
> 95095316 /mnt/cass/lib/cassandra/commitlog/
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
