Re: datastax community ami -- broken? --- datastax-agent conflicts with opscenter-agent

2013-12-06 Thread Franc Carter
/installer.log). Exit code: 1 -- *Franc Carter* | Systems architect | Sirca Ltd marc.zianideferra...@sirca.org.au franc.car...@sirca.org.au | www.sirca.org.au Tel: +61 2 8355 2514 Level 4, 55 Harrington St, The Rocks NSW 2000 PO Box H58, Australia Square, Sydney NSW 1215

Re: How would you model that?

2013-11-08 Thread Franc Carter
is restricted by an EQ or an IN. How would you model the thing? Just need to have a list of users based on their last activity timestamp... Thanks! -- *Franc Carter* | Systems architect | Sirca Ltd marc.zianideferra...@sirca.org.au franc.car...@sirca.org.au | www.sirca.org.au Tel: +61 2 8355

Re: Storage management during rapid growth

2013-10-31 Thread Franc Carter
storage to the cluster? What type of SAN have you used, and what issues have you run into? 3) Am I missing a way of economically scaling storage? Thanks for any insight. Dave -- *Franc Carter* | Systems architect | Sirca Ltd marc.zianideferra...@sirca.org.au franc.car...@sirca.org.au

Re: Recommended hardware

2013-09-24 Thread Franc Carter
could point me to for both physical and virtual (cloud) type environments. Thank you, Tim Sent from my iPhone -- *Franc Carter* | Systems architect | Sirca Ltd marc.zianideferra...@sirca.org.au franc.car...@sirca.org.au | www.sirca.org.au Tel: +61 2 8355 2514 Level 4, 55 Harrington St

Re: cassandra just gone..no heap dump, no log info

2013-09-18 Thread Franc Carter
fine. I find it odd 1. No logs of why it exited at all 2. No heap dump which would imply there would be no logs as it crashed Is there any other way a process can die and linux would log it somehow? (like running out of memory) Thanks, Dean -- *Franc Carter* | Systems architect

Question about 'duplicate' columns

2013-08-06 Thread Franc Carter
understood correctly ? thanks -- *Franc Carter* | Systems architect | Sirca Ltd marc.zianideferra...@sirca.org.au franc.car...@sirca.org.au | www.sirca.org.au Tel: +61 2 8355 2514 Level 4, 55 Harrington St, The Rocks NSW 2000 PO Box H58, Australia Square, Sydney NSW 1215

Re: Question about 'duplicate' columns

2013-08-06 Thread Franc Carter
Cassandra Consultant New Zealand @aaronmorton http://www.thelastpickle.com On 6/08/2013, at 6:48 PM, Franc Carter franc.car...@sirca.org.au wrote: I've been thinking through some cases that I can see happening at some point and thought I'd ask on the list to see if my understanding

Re: schema management

2013-07-03 Thread Franc Carter
-Mutagen cheers On Mon, Jul 1, 2013 at 5:55 PM, Franc Carter franc.car...@sirca.org.auwrote: On Tue, Jul 2, 2013 at 10:33 AM, Todd Fast t...@digitalexistence.comwrote: Franc-- I think you will find Mutagen Cassandra very interesting; it is similar to schema management tools like Flyway for SQL

schema management

2013-07-01 Thread Franc Carter
Hi, I've been giving some thought to the way we deploy schemas and am looking for something better than out current approach, which is to use cassandra-cli scripts. What do people use for this ? cheers -- *Franc Carter* | Systems architect | Sirca Ltd marc.zianideferra...@sirca.org.au

Re: schema management

2013-07-01 Thread Franc Carter
kohlisank...@gmail.comwrote: You can generate schema through the code. That is also one option. On Mon, Jul 1, 2013 at 4:10 PM, Franc Carter franc.car...@sirca.org.auwrote: Hi, I've been giving some thought to the way we deploy schemas and am looking for something better than out current

Re: crashed while running repair

2013-06-22 Thread Franc Carter
that. cheers On Fri, Jun 21, 2013 at 3:22 PM, Franc Carter franc.car...@sirca.org.auwrote: Hi, I am experimenting with Cassandra-1.2.4, and got a crash while running repair. The nodes has 24GB of ram with an 8GB heap. Any ideas on my I may have missed in the config ? Log is below

Re: Updated sstable size for LCS, ran upgradesstables, file sizes didn't change

2013-06-22 Thread Franc Carter
) repeat 2-4 I am not sure if there is anything about level compaction which makes this infeasible. =Rob [1] https://github.com/pcmanus/cassandra/tree/sstable_split -- *Franc Carter* | Systems architect | Sirca Ltd marc.zianideferra...@sirca.org.au franc.car...@sirca.org.au

Re: Compaction not running

2013-06-21 Thread Franc Carter
Cheers - Aaron Morton Freelance Cassandra Consultant New Zealand @aaronmorton http://www.thelastpickle.com On 20/06/2013, at 9:41 PM, Franc Carter franc.car...@sirca.org.au wrote: On Thu, Jun 20, 2013 at 7:27 PM, aaron morton aa...@thelastpickle.comwrote: nodetool

crashed while running repair

2013-06-21 Thread Franc Carter
:05,865 FileUtils.java (line 375) Stopping gossiper thanks -- *Franc Carter* | Systems architect | Sirca Ltd marc.zianideferra...@sirca.org.au franc.car...@sirca.org.au | www.sirca.org.au Tel: +61 2 8355 2514 Level 4, 55 Harrington St, The Rocks NSW 2000 PO Box H58, Australia Square, Sydney

Re: Compaction not running

2013-06-20 Thread Franc Carter
://www.thelastpickle.com On 19/06/2013, at 11:41 AM, Franc Carter franc.car...@sirca.org.au wrote: On Wed, Jun 19, 2013 at 9:34 AM, Bryan Talbot btal...@aeriagames.comwrote: Manual compaction for LCS doesn't really do much. It certainly doesn't compact all those little files into bigger files. What makes you

Re: Performance Difference between Cassandra version

2013-06-19 Thread Franc Carter
and that's a reasonable trade-off cheers -- *Franc Carter* | Systems architect | Sirca Ltd marc.zianideferra...@sirca.org.au franc.car...@sirca.org.au | www.sirca.org.au Tel: +61 2 8355 2514 Level 4, 55 Harrington St, The Rocks NSW 2000 PO Box H58, Australia Square, Sydney NSW 1215

Re: Large number of files for Leveled Compaction

2013-06-18 Thread Franc Carter
On Mon, Jun 17, 2013 at 3:37 PM, Franc Carter franc.car...@sirca.org.auwrote: On Mon, Jun 17, 2013 at 3:28 PM, Wei Zhu wz1...@yahoo.com wrote: default value of 5MB is way too small in practice. Too many files in one directory is not a good thing. It's not clear what should be a good number

Re: Compaction not running

2013-06-18 Thread Franc Carter
On Sat, Jun 15, 2013 at 11:49 AM, Franc Carter franc.car...@sirca.org.auwrote: On Sat, Jun 15, 2013 at 8:48 AM, Robert Coli rc...@eventbrite.com wrote: On Wed, Jun 12, 2013 at 3:26 PM, Franc Carter franc.car...@sirca.org.au wrote: We are running a test system with Leveled compaction

Re: Compaction not running

2013-06-18 Thread Franc Carter
'manually compacted', and when the pending tasks reached low numbers (stuck on 9) then latencies were back to low milliseconds cheers -Bryan On Tue, Jun 18, 2013 at 3:59 PM, Franc Carter franc.car...@sirca.org.auwrote: On Sat, Jun 15, 2013 at 11:49 AM, Franc Carter franc.car...@sirca.org.au

Re: Large number of files for Leveled Compaction

2013-06-16 Thread Franc Carter
On Fri, Jun 7, 2013 at 2:44 PM, Franc Carter franc.car...@sirca.org.auwrote: Hi, We are trialling Cassandra-1.2(.4) with Leveled compaction as it looks like it may be a win for us. The first step of testing was to push a fairly large slab of data into the Column Family - we did this much

Re: Large number of files for Leveled Compaction

2013-06-16 Thread Franc Carter
? thanks Cheers Manoj On Fri, Jun 7, 2013 at 1:44 PM, Franc Carter franc.car...@sirca.org.auwrote: Hi, We are trialling Cassandra-1.2(.4) with Leveled compaction as it looks like it may be a win for us. The first step of testing was to push a fairly large slab of data into the Column

Re: Large number of files for Leveled Compaction

2013-06-16 Thread Franc Carter
in figure 4. to mean that once a level fills up it gets compacted into a higher level cheers Cheers Manoj On Mon, Jun 17, 2013 at 1:54 PM, Franc Carter franc.car...@sirca.org.auwrote: On Mon, Jun 17, 2013 at 2:47 PM, Manoj Mainali mainalima...@gmail.comwrote: With LeveledCompaction, each

Re: Large number of files for Leveled Compaction

2013-06-16 Thread Franc Carter
a right number. Interesting - 50MB is the low end of what people are using - 5MB is a lot lower. I'll try a 50MB set cheers -Wei -- *From: *Franc Carter franc.car...@sirca.org.au *To: *user@cassandra.apache.org *Sent: *Sunday, June 16, 2013 10:15:22 PM *Subject

Re: Compaction not running

2013-06-14 Thread Franc Carter
On Sat, Jun 15, 2013 at 8:48 AM, Robert Coli rc...@eventbrite.com wrote: On Wed, Jun 12, 2013 at 3:26 PM, Franc Carter franc.car...@sirca.org.au wrote: We are running a test system with Leveled compaction on Cassandra-1.2.4. While doing an initial load of the data one of the nodes ran out

Compaction not running

2013-06-12 Thread Franc Carter
Hi, We are running a test system with Leveled compaction on Cassandra-1.2.4. While doing an initial load of the data one of the nodes ran out of file descriptors and since then it hasn't been automatically compacting. Any suggestions on how to fix this ? thanks -- *Franc Carter* | Systems

Re: Cassandra (1.2.5) + Pig (0.11.1) Errors with large column families

2013-06-10 Thread Franc Carter
-- Forwarded message -- From: Mark Lewandowski mark.e.lewandow...@gmail.com Date: Jun 8, 2013 8:03 AM Subject: Cassandra (1.2.5) + Pig (0.11.1) Errors with large column families To: user@cassandra.apache.org Cc: I'm cur.rently trying to get Cassandra (1.2.5) and Pig (0.11.1) to

Large number of files for Leveled Compaction

2013-06-06 Thread Franc Carter
nodes. Is this number of files expected/normal ? cheers -- *Franc Carter* | Systems architect | Sirca Ltd marc.zianideferra...@sirca.org.au franc.car...@sirca.org.au | www.sirca.org.au Tel: +61 2 8355 2514 Level 4, 55 Harrington St, The Rocks NSW 2000 PO Box H58, Australia Square, Sydney

Re: two-node cassandra cluster

2012-08-26 Thread Franc Carter
with provisioned IOPs you should be able to make the transition reasonably quickly. cheers -- *Franc Carter* | Systems architect | Sirca Ltd marc.zianideferra...@sirca.org.au franc.car...@sirca.org.au | www.sirca.org.au Tel: +61 2 9236 9118 Level 9, 80 Clarence St, Sydney NSW 2000 PO Box H58, Australia

Re: Ball is rolling on High Performance Cassandra Cookbook second edition

2012-06-27 Thread Franc Carter
attempt to cover the ground between the old school and the new school thinking. Edward -- *Franc Carter* | Systems architect | Sirca Ltd marc.zianideferra...@sirca.org.au franc.car...@sirca.org.au | www.sirca.org.au Tel: +61 2 9236 9118 Level 9, 80 Clarence St, Sydney NSW 2000 PO Box H58

Re: enforcing ordering

2012-06-12 Thread Franc Carter
to use a large number of loading processes to insert the historical data that is pretty large in a short period of time. Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 10/05/2012, at 3:03 PM, Franc Carter wrote: On Tue, May 8

Re: Query

2012-06-04 Thread Franc Carter
/pycassa/pycassa) which works well cheers Regards Arshad -- *Franc Carter* | Systems architect | Sirca Ltd marc.zianideferra...@sirca.org.au franc.car...@sirca.org.au | www.sirca.org.au Tel: +61 2 9236 9118 Level 9, 80 Clarence St, Sydney NSW 2000 PO Box H58, Australia Square, Sydney

Re: Number of keyspaces

2012-05-23 Thread Franc Carter
. Yep, that's certainly possible - it's habit I tend towards ;-( cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 23/05/2012, at 1:52 PM, Franc Carter wrote: On Wed, May 23, 2012 at 7:42 AM, aaron morton aa...@thelastpickle.comwrote

Re: Number of keyspaces

2012-05-22 Thread Franc Carter
the overall cassandra performance? Cumprimentos, Luís Ferreira -- With kind regards, Robin Verlangen www.robinverlangen.nl -- *Franc Carter* | Systems architect | Sirca Ltd marc.zianideferra...@sirca.org.au franc.car...@sirca.org.au | www.sirca.org.au Tel: +61 2 9236 9118 Level

Re: Number of keyspaces

2012-05-22 Thread Franc Carter
this be beneficial? On May 22, 2012, at 12:56 PM, samal wrote: Not ideally, now cass has global memtable tuning. Each cf correspond to memory in ram. Year wise cf means it will be in read only state for next year, memtable will still consume ram. On 22-May-2012 5:01 PM, Franc Carter

Re: enforcing ordering

2012-05-10 Thread Franc Carter
is interesting becuse i am not a database guy, but yet I still have these ingrained ways of thinking cheers Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 10/05/2012, at 3:03 PM, Franc Carter wrote: On Tue, May 8, 2012 at 8:21 PM

Re: enforcing ordering

2012-05-09 Thread Franc Carter
On Tue, May 8, 2012 at 8:21 PM, Franc Carter franc.car...@sirca.org.auwrote: On Tue, May 8, 2012 at 8:09 PM, aaron morton aa...@thelastpickle.comwrote: Can you store the corrections in a separate CF? We sat down and thought about this harder - it looks like a good solution for us that may

enforcing ordering

2012-05-08 Thread Franc Carter
- correct ?) thanks -- *Franc Carter* | Systems architect | Sirca Ltd marc.zianideferra...@sirca.org.au franc.car...@sirca.org.au | www.sirca.org.au Tel: +61 2 9236 9118 Level 9, 80 Clarence St, Sydney NSW 2000 PO Box H58, Australia Square, Sydney NSW 1215

Re: enforcing ordering

2012-05-08 Thread Franc Carter
. . . cheers Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 8/05/2012, at 9:35 PM, Franc Carter wrote: Hi, I'm wondering if there is a common 'pattern' to address a scenario we will have to deal with. We will be storing a set

Re: 200TB in Cassandra ?

2012-04-20 Thread Franc Carter
/2012, at 12:55 AM, Dave Brosius wrote: I think your math is 'relatively' correct. It would seem to me you should focus on how you can reduce the amount of storage you are using per item, if at all possible, if that node count is prohibitive. On 04/19/2012 07:12 AM, Franc Carter wrote: Hi

Re: 200TB in Cassandra ?

2012-04-20 Thread Franc Carter
/2012 07:12 AM, Franc Carter wrote: Hi, One of the projects I am working on is going to need to store about 200TB of data - generally in manageable binary chunks. However, after doing some rough calculations based on rules of thumb I have seen for how much storage should be on each node I'm

200TB in Cassandra ?

2012-04-19 Thread Franc Carter
= 600,000GB Which is 1000 nodes at 600GB per node I'm hoping I've missed something as 1000 nodes is not viable for us. cheers -- *Franc Carter* | Systems architect | Sirca Ltd marc.zianideferra...@sirca.org.au franc.car...@sirca.org.au | www.sirca.org.au Tel: +61 2 9236 9118 Level 9, 80

Re: RE 200TB in Cassandra ?

2012-04-19 Thread Franc Carter
storage should be on each node I'm worried. 200TB with RF=3 is 600TB = 600,000GB Which is 1000 nodes at 600GB per node I'm hoping I've missed something as 1000 nodes is not viable for us. cheers -- Franc Carter | Systems architect | Sirca Ltd franc.car...@sirca.org.au

Re: 200TB in Cassandra ?

2012-04-19 Thread Franc Carter
On Thu, Apr 19, 2012 at 10:07 PM, John Doe jd...@yahoo.com wrote: Franc Carter franc.car...@sirca.org.au One of the projects I am working on is going to need to store about 200TB of data - generally in manageable binary chunks. However, after doing some rough calculations based on rules

Re: RE 200TB in Cassandra ?

2012-04-19 Thread Franc Carter
. The bit I am trying to understand is whether my figure of 400TB/node in practice for Cassandra is correct, or whether we can push the GB/node higher and if so how high cheers -- Y. On Thu, Apr 19, 2012 at 7:54 AM, Franc Carter franc.car...@sirca.org.auwrote: On Thu, Apr 19, 2012 at 9:38 PM

Re: Largest 'sensible' value

2012-04-03 Thread Franc Carter
On Wed, Apr 4, 2012 at 8:56 AM, Jonathan Ellis jbel...@gmail.com wrote: We use 2MB chunks for our CFS implementation of HDFS: http://www.datastax.com/dev/blog/cassandra-file-system-design thanks On Mon, Apr 2, 2012 at 4:23 AM, Franc Carter franc.car...@sirca.org.au wrote: Hi, We

Largest 'sensible' value

2012-04-02 Thread Franc Carter
of comments that you shouldn't put large chunks in to a value - however 'large' is not well defined for the range of people using these solutions ;-) Doe anyone have a rough rule of thumb for how big a single value can be before we are outside sanity? thanks -- *Franc Carter* | Systems architect

Re: Largest 'sensible' value

2012-04-02 Thread Franc Carter
your specific use case to see what 'too big' is for you. On Mon, Apr 2, 2012 at 9:23 AM, Franc Carter franc.car...@sirca.org.auwrote: Hi, We are in the early stages of thinking about a project that needs to store data that will be accessed by Hadoop. One of the concerns we have is around

Re: sstable image/pic ?

2012-02-28 Thread Franc Carter
on, in this specific case the storage requirements are roughly the same on Cassandra and MySQL. Good to know - thanks * Is data in an sstable sorted by key then column or column then key Sorted by key and then sorted by column. thanks -- *Franc Carter* | Systems architect | Sirca Ltd

sstable image/pic ?

2012-02-27 Thread Franc Carter
Hi, does anyone know of a picture/image that shows the layout of keys/columns/values in an sstable - I haven't been able to find one and am having a hard time visualising the layout from various descriptions and various overviews thanks -- *Franc Carter* | Systems architect | Sirca Ltd

data model advice

2012-02-23 Thread Franc Carter
simplistic approach as the Days are super columns, the types are column and then I don't have a col/val map left for data. Does anyone have advice on a good approach ? thanks -- *Franc Carter* | Systems architect | Sirca Ltd marc.zianideferra...@sirca.org.au franc.car...@sirca.org.au

Re: data model advice

2012-02-23 Thread Franc Carter
: {col1:val1, col2:val2, . . . } It is better to avoid super columns.. -indra On Thu, Feb 23, 2012 at 6:36 PM, Franc Carter franc.car...@sirca.org.auwrote: Hi, I've finished my first model and experiments with Cassandra with result I'm pretty happy with - so I thought I'd move

Re: data model advice

2012-02-23 Thread Franc Carter
, col2:val2, . . . } Entity.Day1.TypeB: {col1:val1, col2:val2, . . . } . . Entity.DayN.TypeA: {col1:val1, col2:val2, . . . } Entity.DayN.TypeB: {col1:val1, col2:val2, . . . } It is better to avoid super columns.. -indra On Thu, Feb 23, 2012 at 6:36 PM, Franc Carter franc.car

Re: List all keys with RandomPartitioner

2012-02-22 Thread Franc Carter
? http://wiki.apache.org/cassandra/FAQ#iter_world cheers Thanks Flavio -- *Franc Carter* | Systems architect | Sirca Ltd marc.zianideferra...@sirca.org.au franc.car...@sirca.org.au | www.sirca.org.au Tel: +61 2 9236 9118 Level 9, 80 Clarence St, Sydney NSW 2000 PO Box H58, Australia

Re: reads/s suddenly dropped

2012-02-22 Thread Franc Carter
On Mon, Feb 20, 2012 at 9:42 PM, Franc Carter franc.car...@sirca.org.auwrote: On Mon, Feb 20, 2012 at 12:00 PM, aaron morton aa...@thelastpickle.comwrote: Aside from iostats.. nodetool cfstats will give you read and write latency for each CF. This is the latency for the operation on each

Re: reads/s suddenly dropped

2012-02-20 Thread Franc Carter
@aaronmorton http://www.thelastpickle.com On 20/02/2012, at 9:31 AM, Franc Carter wrote: On Mon, Feb 20, 2012 at 4:10 AM, Philippe watche...@gmail.com wrote: Perhaps your dataset can no longer be held in memory. Check iostats I have been flushing the keycache and dropping the linux disk caches

reads/s suddenly dropped

2012-02-19 Thread Franc Carter
-- *Franc Carter* | Systems architect | Sirca Ltd marc.zianideferra...@sirca.org.au franc.car...@sirca.org.au | www.sirca.org.au Tel: +61 2 9236 9118 Level 9, 80 Clarence St, Sydney NSW 2000 PO Box H58, Australia Square, Sydney NSW 1215

Re: reads/s suddenly dropped

2012-02-19 Thread Franc Carter
of is that the success keys are now 'far enough away' that they are not being included in the previous read and hence the seek penalty has to be paid a lot more often - viable ? cheers Le 19 févr. 2012 11:24, Franc Carter franc.car...@sirca.org.au a écrit : I've been testing Cassandra - primarily

Re: Key cache hit rate issue

2012-02-16 Thread Franc Carter
On 17/02/2012 8:53 AM, Eran Chinthaka Withana eran.chinth...@gmail.com wrote: Hi Jonathan, Thanks for the reply. Yes there is a possibility that the keys can be distributed in multiple SSTables, but my data access patterns are such that I always read/write the whole row. So I expect all the

Re: stalled bootstrap

2012-02-15 Thread Franc Carter
On 15/02/2012, at 12:42 AM, Franc Carter wrote: Hi, I'm running the DataSatx 1.0.7 AMI in ec2. I started with two nodes and have just added a third node on the way to expanding to a four node cluster. The bootstrapping was going along ok for a while, but has stalled. In /var/log/cassandra

stalled bootstrap

2012-02-14 Thread Franc Carter
(IncomingTcpConnection.java:185) at org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:81) Any advice on how to resolve this ? thanks -- *Franc Carter* | Systems architect | Sirca Ltd marc.zianideferra...@sirca.org.au franc.car...@sirca.org.au | www.sirca.org.au Tel

Re: active/pending queue lengths

2012-02-14 Thread Franc Carter
. A - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 14/02/2012, at 12:43 PM, Franc Carter wrote: On Tue, Feb 14, 2012 at 6:06 AM, aaron morton aa...@thelastpickle.comwrote: What CL are you reading at ? Quorum Write ops go to RF number of nodes, read

nodetool removetoken

2012-02-14 Thread Franc Carter
) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:662) Any ideas on how to deal with this ? thanks -- *Franc Carter* | Systems architect | Sirca Ltd marc.zianideferra...@sirca.org.au franc.car...@sirca.org.au | www.sirca.org.au

Re: nodetool removetoken

2012-02-14 Thread Franc Carter
On Wed, Feb 15, 2012 at 8:49 AM, Brandon Williams dri...@gmail.com wrote: Before 1.0.8, use https://issues.apache.org/jira/browse/CASSANDRA-3337 to remove it. I'm missing something ;-( I don't see a solution in this link . . cheers On Tue, Feb 14, 2012 at 3:44 PM, Franc Carter franc.car

Re: nodetool removetoken

2012-02-14 Thread Franc Carter
On Wed, Feb 15, 2012 at 9:25 AM, Rob Coli rc...@palominodb.com wrote: On Tue, Feb 14, 2012 at 2:02 PM, Franc Carter franc.car...@sirca.org.auwrote: On Wed, Feb 15, 2012 at 8:49 AM, Brandon Williams dri...@gmail.comwrote: Before 1.0.8, use https://issues.apache.org/jira/browse/CASSANDRA

Re: keycache persisted to disk ?

2012-02-13 Thread Franc Carter
the O/S buffer cache and then bought it back up. The performance wasn't significantly different to the pre-flush performance cheers 2012/2/13 Franc Carter franc.car...@sirca.org.au On Mon, Feb 13, 2012 at 5:03 PM, zhangcheng zhangch...@jike.com wrote: ** I think the keycaches and rowcahches

Re: keycache persisted to disk ?

2012-02-13 Thread Franc Carter
down why it is sometimes much faster even though I have (tried) to replicate the same conditions -- / Peter Schuller (@scode, http://worldmodscode.wordpress.com) -- *Franc Carter* | Systems architect | Sirca Ltd marc.zianideferra...@sirca.org.au franc.car...@sirca.org.au

Re: keycache persisted to disk ?

2012-02-13 Thread Franc Carter
my keycache set to 2 million, and am only querying ~900,000 keys. so after the first time I'm assuming they are in the cache. cheers 2012/2/13 Franc Carter franc.car...@sirca.org.au 2012/2/13 R. Verlangen ro...@us2.nl This is because of the warm up of Cassandra as it starts. On a start

Re: keycache persisted to disk ?

2012-02-13 Thread Franc Carter
(but as usual, it may still be in the operating system page cache). Yep - I haven't enabled row caches, my calculations at the moment indicate that the hit-ratio won't be great - but I'll be testing that later -- / Peter Schuller (@scode, http://worldmodscode.wordpress.com) -- *Franc Carter

Re: keycache persisted to disk ?

2012-02-13 Thread Franc Carter
) -- *Franc Carter* | Systems architect | Sirca Ltd marc.zianideferra...@sirca.org.au franc.car...@sirca.org.au | www.sirca.org.au Tel: +61 2 9236 9118 Level 9, 80 Clarence St, Sydney NSW 2000 PO Box H58, Australia Square, Sydney NSW 1215

Re: keycache persisted to disk ?

2012-02-13 Thread Franc Carter
in an environment that is pretty well controlled - other than being on ec2 -- / Peter Schuller (@scode, http://worldmodscode.wordpress.com) -- *Franc Carter* | Systems architect | Sirca Ltd marc.zianideferra...@sirca.org.au franc.car...@sirca.org.au | www.sirca.org.au Tel: +61 2 9236

Re: keycache persisted to disk ?

2012-02-13 Thread Franc Carter
got to a rather odd number -- / Peter Schuller (@scode, http://worldmodscode.wordpress.com) -- *Franc Carter* | Systems architect | Sirca Ltd marc.zianideferra...@sirca.org.au franc.car...@sirca.org.au | www.sirca.org.au Tel: +61 2 9236 9118 Level 9, 80 Clarence St, Sydney NSW 2000

Re: keycache persisted to disk ?

2012-02-13 Thread Franc Carter
exhibit un-evenness and have an affect on latency. -- / Peter Schuller (@scode, http://worldmodscode.wordpress.com) -- *Franc Carter* | Systems architect | Sirca Ltd marc.zianideferra...@sirca.org.au franc.car...@sirca.org.au | www.sirca.org.au Tel: +61 2 9236 9118 Level 9, 80 Clarence St

Re: keycache persisted to disk ?

2012-02-13 Thread Franc Carter
and couldn't see anything that looked like that -- / Peter Schuller (@scode, http://worldmodscode.wordpress.com) -- *Franc Carter* | Systems architect | Sirca Ltd marc.zianideferra...@sirca.org.au franc.car...@sirca.org.au | www.sirca.org.au Tel: +61 2 9236 9118 Level 9, 80 Clarence St

Re: active/pending queue lengths

2012-02-13 Thread Franc Carter
keys don't overlap and I would expect/assume the keys are in the keycache I am looking at the output of nodetool -h tpstats cheers Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 14/02/2012, at 12:47 AM, Franc Carter wrote: Hi

keycache persisted to disk ?

2012-02-12 Thread Franc Carter
Hi, I am testing Cassandra on Amazon and finding performance can vary fairly wildly. I'm leaning towards it being an artifact of the AWS I/O system but have one other possibility. Are keycaches persisted to disk and restored on a clean shutdown and restart ? cheers -- *Franc Carter

Re: keycache persisted to disk ?

2012-02-12 Thread Franc Carter
2012-02-13 -- zhangcheng -- *发件人:* Franc Carter *发送时间:* 2012-02-13 13:53:56 *收件人:* user *抄送:* *主题:* keycache persisted to disk ? Hi, I am testing Cassandra on Amazon and finding performance can vary fairly wildly. I'm leaning

Re: sensible data model ?

2012-02-07 Thread Franc Carter
Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 7/02/2012, at 2:28 PM, Franc Carter wrote: On Tue, Feb 7, 2012 at 6:39 AM, aaron morton aa...@thelastpickle.comwrote: Sounds like a good start. Super columns are not a great fit for modeling time series data for a few

Re: sensible data model ?

2012-02-06 Thread Franc Carter
://www.thelastpickle.com On 5/02/2012, at 12:12 AM, Franc Carter wrote: Hi, I'm pretty new to Cassandra and am currently doing a proof of concept, and thought it would be a good idea to ask if my data model is sane . . . The data I have, and need to query, is reasonably simple. It consists of about

sensible data model ?

2012-02-04 Thread Franc Carter
this mostly because it seemed more complex for a gain I didn't really understand. Does this seem sensible ? thanks -- *Franc Carter* | Systems architect | Sirca Ltd marc.zianideferra...@sirca.org.au franc.car...@sirca.org.au | www.sirca.org.au Tel: +61 2 9236 9118 Level 9, 80 Clarence St