[
https://issues.apache.org/jira/browse/CASSANDRA-1902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13016551#comment-13016551
]
Pavel Yaskevich edited comment on CASSANDRA-1902 at 4/6/11 9:37 PM:
--------------------------------------------------------------------
removed @finalize from MappedFileDataInput which was dropping page cache. Now I
see the following results with migration enabled:
options: -S 1024 -c 10 -n 100000 (server 4 GB RAM, Quad-Core AMD Opteron(tm)
Processor 2374 HE)
188 (write)
16 (read)
14 (read)
191 (write)
--- reads during compaction ---
21 16 16 27 41 22 16 15 14 15 16 18 14 13
--- after compaction ----------
13 12 14 13
was (Author: xedin):
removed @finalize from MappedFileDataInput which was dropping page cache.
Now I see the following results with migration enabled:
options: -S 1024 -c 10 -n 100000
188 (write)
16 (read)
14 (read)
191 (write)
--- reads during compaction ---
21 16 16 27 41 22 16 15 14 15 16 18 14 13
---
after compaction
13 12 14 13
> Migrate cached pages during compaction
> ---------------------------------------
>
> Key: CASSANDRA-1902
> URL: https://issues.apache.org/jira/browse/CASSANDRA-1902
> Project: Cassandra
> Issue Type: Improvement
> Components: Core
> Affects Versions: 0.7.1
> Reporter: T Jake Luciani
> Assignee: Pavel Yaskevich
> Fix For: 0.7.5, 0.8
>
> Attachments:
> 0001-CASSANDRA-1902-cache-migration-impl-with-config-option.txt,
> 1902-BufferedSegmentedFile-logandsleep.txt, 1902-formatted.txt,
> 1902-per-column-migration-rebase2.txt, 1902-per-column-migration.txt,
> CASSANDRA-1902-v3.patch, CASSANDRA-1902-v4.patch, CASSANDRA-1902-v5.patch,
> CASSANDRA-1902-v6.patch, CASSANDRA-1902-v7.patch, CASSANDRA-1902-v8.patch
>
> Original Estimate: 32h
> Time Spent: 56h
> Remaining Estimate: 0h
>
> Post CASSANDRA-1470 there is an opportunity to migrate cached pages from a
> pre-compacted CF during the compaction process. This is now important since
> CASSANDRA-1470 caches effectively nothing.
> For example an active CF being compacted hurts reads since nothing is cached
> in the new SSTable.
> The purpose of this ticket then is to make sure SOME data is cached from
> active CFs. This can be done my monitoring which Old SSTables are in the page
> cache and caching active rows in the New SStable.
> A simpler yet similar approach is described here:
> http://insights.oetiker.ch/linux/fadvise/
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
