Re: SSTables are not getting removed

2015-10-30 Thread Nate McCall
> > > memtable_offheap_space_in_mb: 4096 > > memtable_cleanup_threshold: 0.99 > ^ What led to this setting? You are basically telling Cassandra to not flush the highest-traffic memtable until the memtable space is 99% full. With that many tables and keyspaces, you are basically locking up

Re: cassandra state listener sends duplicate signals one with public ip and another with private ip

2015-10-30 Thread Robert Coli
On Thu, Oct 29, 2015 at 8:35 PM, Dhyan Muralidharan < d.muralidha...@yottaa.com> wrote: > Can some one respond to this ? > > > http://stackoverflow.com/questions/33428094/cassandra-state-listener-sends-duplicate-signals-one-with-public-ip-and-another > If you actually post your question to the

Re: terrible read/write latency fluctuation

2015-10-30 Thread Anishek Agarwal
if its some sort of timeseries DTCS might turn out to be better for compaction. also some disk monitoring might help to understand if disk is the bottleneck. On Sun, Oct 25, 2015 at 3:47 PM, 曹志富 wrote: > I will try to trace a read that take > 20msec > . > > just HDD.no

Cassandra Data Model with Narrow partition

2015-10-30 Thread chandrasekar.krc
Hi, Could you please suggest if Narrow partition is a good choice for the below use case. 1) Write heavy event log table with 50m inserts per day with a peak load of 20K transaction per sec. There aren't any updates/deletes to records inserted. Records are inserted with a TTL of 60

Re: Weird replace_address issue in 1.2

2015-10-30 Thread Carlos Alonso
Well, everything was fine. The streams finished and after that the node joined the ring nicely and everyone removed the old one. :) Thanks! Carlos Alonso | Software Engineer | @calonso On 29 October 2015 at 21:45, Robert Coli wrote: > On

Re: Cassandra Data Model with Narrow partition

2015-10-30 Thread Carlos Alonso
Hi Chandra, Narrow partition is probably your best choice, but you need to bucket data somehow, otherwise your partitions will soon become unmanageable and you'll have problems reading them, both because the partitions will become very big and also because of the tombstones that your expired

nodetool upgradesstables skip major version

2015-10-30 Thread Xu Zhongxing
Can I run nodetool upgradesstables after updating a Cassandra 2.0 node directly to Cassandra 3.0? Or do I have to upgrade to 2.1 and then upgrade to 3.0?

Re: Cassandra Data Model with Narrow partition

2015-10-30 Thread Kai Wang
agree with Carlos, you should bucket your key, for example, into (pk, day, hour). Otherwise your partition is going to be large enough to cause problems. On Fri, Oct 30, 2015 at 8:04 AM, Carlos Alonso wrote: > Hi Chandra, > > Narrow partition is probably your best choice,

Re: Cassandra 2.2.1 on Windows (disk_access_mode: mmap_index_only)

2015-10-30 Thread Alaa Zubaidi (PDF)
Hi, Just an update... we changed the disk_access_mode to mmap_index_only and the memory problem disappeared. However, we did NOT confirm yet, the exact affect on performance, but in general acceptable so far, it could due to the fact that its not optimized anyways yet, since we just started using

[Announcement]: Achilles 4 released

2015-10-30 Thread DuyHai Doan
Hello all I am pleased to announce the release of Achilles 4.0.0 After 6 months of incubation, the latest version is out. This new version is a *complete rewrite* of the framework, using *compile-code code generation* to provide *better type-safety*, fluent *DSL for query* as well as latest

Re: Cassandra stalls and dropped messages not due to GC

2015-10-30 Thread Nate McCall
Does tpstats show unusually high counts for blocked flush writers? As Sebastian suggests, running ttop will paint a clearer picture about what is happening within C*. I would however recommend going back to CMS in this case as that is the devil we all know and more folks will be able to offer

SSTables are not getting removed

2015-10-30 Thread Walsh, Stephen
Hey all, First off, thank you for taking the time to read this. --- SYSTEM SPEC --- We're using Cassandra Version 2.1.6 (please don't ask us to upgrade just yet less you are aware of an existing bug for this issue) We are running on AWS 4 core . 16 GB server We

Re: SSTables are not getting removed

2015-10-30 Thread Jeff Jirsa
After 15 hours, you have "112000 SSTables over all nodes for all CF’s” - assuming I’m parsing that correctly, that’s about 30 per table (100 KS * 10 tables * 4 nodes), which is actually not unreasonable with LCS. Your symptom is heavy GC and you’re running 2.1.6 and don’t want to upgrade

Re: Cassandra Data Model with Narrow partition

2015-10-30 Thread Jeff Jirsa
I’m going to disagree with Carlos in two points. You do have a lot of columns, so many that it’s likely to impact performance. Rather than using collections, serializing those into a single JSON field is far more performant. Since you write each record exactly once, this should be easily