Re: CPU hotspot at BloomFilterSerializer#deserialize

2013-02-04 Thread aaron morton
, run it once to reset the counts , then do your test, then run it again. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 4/02/2013, at 4:13 AM, Edward Capriolo edlinuxg...@gmail.com wrote: It is interesting

Re: cassandra cqlsh error

2013-02-04 Thread aaron morton
Grab 1.2.1, it's fixed there http://cassandra.apache.org/download/ Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 5/02/2013, at 4:37 AM, Kumar, Anjani anjani.ku...@infogroup.com wrote: I am facing problem while

Re: Pycassa vs YCSB results.

2013-02-05 Thread aaron morton
- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 5/02/2013, at 7:15 AM, Pradeep Kumar Mantha pradeep...@gmail.com wrote: Hi, Could some one please let me know any hints, why the pycassa client(attached) is much slower than the YCSB

Re: Pycassa vs YCSB results.

2013-02-05 Thread aaron morton
The simple thing to do would be use the multiprocessing package and eliminate all shared state. On a multicore box python threads can run on different cores and battle over obtaining the GIL. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http

Re: Operation Consideration with Counter Column Families

2013-02-05 Thread aaron morton
as regular CF's. How do they effect compaction? None. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 6/02/2013, at 7:47 AM, Drew Kutcharian d...@venarc.com wrote: Hey Guys, Are there any specific operational

Re: unbalanced ring

2013-02-05 Thread aaron morton
Use nodetool status with vnodes http://www.datastax.com/dev/blog/upgrading-an-existing-cluster-to-vnodes The different load can be caused by rack affinity, are all the nodes in the same rack ? Another simple check is have you created some very big rows? Cheers - Aaron Morton

Re: Clarification on num_tokens setting

2013-02-05 Thread aaron morton
. Correct? Even without vnodes there is no guarantee that nodes had contiguous key ranges. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 6/02/2013, at 5:43 AM, Baron Schwartz ba...@xaprb.com wrote: As I understand

Re: Clarification on num_tokens setting

2013-02-05 Thread aaron morton
There is always num_tokens tokens in the ring. I got this wrong. Each node *does* have num_tokens tokens. With N nodes, the ring is divided into N*num_tokens. Correct? Yes In other words it is cluster wide parameter. Correct? Yes. Cheers - Aaron Morton Freelance

Re: Operation Consideration with Counter Column Families

2013-02-06 Thread aaron morton
- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 6/02/2013, at 11:15 AM, Drew Kutcharian d...@venarc.com wrote: Thanks Aaron, so will there only be one value for each counter column per sstable just like regular columns? For some reason I

Re: DataModel Question

2013-02-06 Thread aaron morton
), message_sequence, message_id) (phone_number, day) is the partition key, same the thrift row key. message_sequence, message_id is the grouping columns, all instances will be grouped / ordered by these columns. Hope that helps. - Aaron Morton Freelance Cassandra Developer New Zealand

Re: Cassandra 1.1.8 timeouts on clients

2013-02-07 Thread aaron morton
First check your node for IO errors. You have some bad data there. When you restart cassandra it may identify which sstables are corrupt. You can then stop the node and remove them. You will then need to run repair to replace the missing data. Hope that helps. - Aaron

Re: Directory structure after upgrading 1.0.8 to 1.2.1

2013-02-07 Thread aaron morton
the -old.json is an artefact of Levelled Compaction. You should see a non -old file in the current CF folder. I'm not sure what would have created the -old CF dir. Does the timestamp indicate it was created the time the server first started as a 1.2 node? Cheers - Aaron

Re: Can't remove contents of table with truncate or drop

2013-02-07 Thread aaron morton
Double check the truncate worked, all nodes must be available for it execute. If you can provide the output from the cqlsh from truncating and selecting that would be helpful. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http

Re: DataModel Question

2013-02-07 Thread aaron morton
the last time stamp seen by the client. Then make as many queries as necessary to get the missing data. I guess this makes the data model span across many CFs ? Yes. Sorry I have not considered conversations. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand

Re: Netflix/Astynax Client for Cassandra

2013-02-07 Thread aaron morton
I'm going to guess Netflix are running Astynax in production with Cassandra 1.1. cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 8/02/2013, at 6:50 AM, Cassa L lcas...@gmail.com wrote: Thank you all

Re: are CFs consistent after a repair

2013-02-07 Thread aaron morton
+ QUROUM ) will be consistent. Can you drill down into the consistency problem? Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 8/02/2013, at 7:01 AM, Brian Jeltema brian.jelt...@digitalenvoy.net wrote: I'm confused

Re: High CPU usage during repair

2013-02-10 Thread aaron morton
for the repair. Which may in turn add additional IO load, CPU load and GC pressure. You probably do not want to do this. Try reducing the compaction throughput to say 12 normally and see the effect. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton

Re: Read-repair working, repair not working?

2013-02-10 Thread aaron morton
] session completed with the following error, getName()), exception); Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 10/02/2013, at 9:56 PM, Brian Fleming bigbrianflem...@gmail.com wrote: Hi, I have

Re: Issues with writing data to Cassandra column family using a Hive script

2013-02-10 Thread aaron morton
Don't use the variable length Cassandra integer, use the Int32Type. It also sounds like you want to use a DoubleType rather than FloatType. http://www.datastax.com/docs/datastax_enterprise2.2/solutions/about_hive#hive-to-cassandra-table-mapping Cheers - Aaron Morton

Re: Cassandra 1.1.2 - 1.1.8 upgrade

2013-02-10 Thread aaron morton
I would do #1. You can play with nodetool setcompactionthroughput to speed things up, but beware nothing comes for free. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 10/02/2013, at 6:40 AM, Mike mthero

Re: Cassandra flush spin?

2013-02-10 Thread aaron morton
check the JVM and yaml settings are as expected. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 10/02/2013, at 6:29 AM, Mike mthero...@yahoo.com wrote: Hello, We just hit a very odd issue in our Cassandra cluster

Re: persisted ring state

2013-02-10 Thread aaron morton
to changes to seed/listen_address ? it's used when a node somehow as a bad view of the ring, and you want it to forget things. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 10/02/2013, at 3:35 AM, S C

Re: High CPU usage during repair

2013-02-11 Thread aaron morton
attribute most of the problems you have described to using m1.large. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 11/02/2013, at 9:16 AM, Tamar Fraenkel ta...@tok-media.com wrote: Hi! Thanks for the response

Re: CQL 3 compound row key error

2013-02-11 Thread aaron morton
That sounds like a bug, or something that is still under work. Sylvain has his finger on all things CQL. Can you raise a ticket on https://issues.apache.org/jira/browse/CASSANDRA Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http

Re: Read-repair working, repair not working?

2013-02-11 Thread aaron morton
with a new data centre (3 nodes, RF=2) I Do all DC's have the same number of nodes ? Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 11/02/2013, at 9:13 PM, Brian Fleming bigbrianflem...@gmail.com wrote: Hi Aaron

Re: Cassandra 1.1.2 - 1.1.8 upgrade

2013-02-11 Thread aaron morton
crazy. I then upgrade all the nodes and run through the upgrade table. You can stagger upgrade table to be every RF'th node in the cluster to reduce the impact. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 11/02/2013

Re: Cassandra jmx stats ReadCount

2013-02-11 Thread aaron morton
Are you using counters? They require a read before write. Also secondary index CF's require a read before write. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 8/02/2013, at 1:26 PM, Daning Wang dan...@netseer.com

Re: Directory structure after upgrading 1.0.8 to 1.2.1

2013-02-11 Thread aaron morton
I think it's a little more subtle that that https://issues.apache.org/jira/browse/CASSANDRA-5242 Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 8/02/2013, at 10:21 PM, Desimpel, Ignace ignace.desim...@nuance.com

Re: Healthy JVM GC

2013-02-12 Thread aaron morton
to the CMS occupancy setting. If you have a lot of rows, 100's of millions, consider reducing the bloom filter false positive ratio. Or just upgrade to 1.2 which uses less JVM memory. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http

Re: Bootstrapping a new node to a virtual node cluster

2013-02-12 Thread aaron morton
Just checking if this sorted it's self out? Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 10/02/2013, at 1:15 AM, Jouni Hartikainen jouni.hartikai...@reaktor.fi wrote: Hello all, I have a cluster of three

Re: Deleting old items

2013-02-12 Thread aaron morton
the min_compaction_level_threshold on the CF to 2 Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 12/02/2013, at 4:21 AM, Alain RODRIGUEZ arodr...@gmail.com wrote: Hi, I would like to know if there is a way to delete old

Re: RuntimeException during leveled compaction

2013-02-12 Thread aaron morton
- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 12/02/2013, at 6:13 AM, Andre Sprenger andre.spren...@getanet.de wrote: Hi, I'm running a 6 node Cassandra 1.1.5 cluster on EC2. We have switched to leveled compaction

Re: Cassandra becnhmark

2013-02-12 Thread aaron morton
I see the same keys in both nodes. Replication is not enabled. Why do you say that ? Check the schema for Keyspace1 using the cassandra-cli. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 12/02/2013, at 9:31 AM

Re: what addresses to use in EC2 cluster (whenever an instance restarts it gets a new private ip)?

2013-02-12 Thread aaron morton
Cassandra handles nodes changing IP. The import thing to Cassandra is the token, not the IP. In your case did the replacement node have the same token as the failed one? You can normally work around these issues using commands like nodetool removetoken. Cheers - Aaron

Re: Cassandra 1.1.2 - 1.1.8 upgrade

2013-02-12 Thread aaron morton
You have linked to the 1.2 news file, which branched from 1.1 at some point. Look at the news file in the distribution you are installing or here https://github.com/apache/cassandra/blob/cassandra-1.1/NEWS.txt Cheers - Aaron Morton Freelance Cassandra Developer New Zealand

Re: Cassandra 1.1.2 - 1.1.8 upgrade

2013-02-12 Thread aaron morton
Can anyone know the impact of not running upgrade sstables? Or possible not running it for several days? nodetool repair will not work. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 12/02/2013, at 11:54 AM, Mike

Re: Upgrade to Cassandra 1.2

2013-02-12 Thread aaron morton
things are stable. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 12/02/2013, at 2:55 PM, Daning Wang dan...@netseer.com wrote: Thanks Aaron. I tried to migrate existing cluster(ver 1.1.0) to 1.2.1 but failed

Re: Cassandra 1.2.1 key cache error

2013-02-12 Thread aaron morton
This looks like a bug in 1.2 beta https://issues.apache.org/jira/browse/CASSANDRA-4553 Can you confirm you are running 1.2.1 and if you can re-create this with a clean install please create a ticket on https://issues.apache.org/jira/browse/CASSANDRA Thanks - Aaron Morton

Re: Upgrade to Cassandra 1.2

2013-02-12 Thread aaron morton
Restore the settings for num_tokens and intial_token to what they were before you upgraded. They should not be changed just because you are upgrading to 1.2, they are used to enable virtual nodes. Which are not necessary to run 1.2. Cheers - Aaron Morton Freelance Cassandra

Re: RuntimeException during leveled compaction

2013-02-16 Thread aaron morton
if there if compactions are not running they should start again. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 13/02/2013, at 8:11 PM, Andre Sprenger andre.spren...@getanet.de wrote: Aaron, thanks for your help. I ran

Re: Deleting old items

2013-02-16 Thread aaron morton
. Can you point to the docs. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 13/02/2013, at 10:14 PM, Alain RODRIGUEZ arodr...@gmail.com wrote: Hi Aaron, once again thanks for this answer. So is it possible to delete

Re: Deleting old items during compaction (WAS: Deleting old items)

2013-02-17 Thread aaron morton
That's what the TTL does. Manually delete all the older data now, then start using TTL. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 13/02/2013, at 11:08 PM, Ilya Grebnov i...@metricshub.com wrote: Hi, We

Re: Mutation dropped

2013-02-17 Thread aaron morton
- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 15/02/2013, at 9:42 AM, Kanwar Sangha kan...@mavenir.com wrote: Hi – Is there a parameter which can be tuned to prevent the mutations from being dropped ? Is this logic correct ? Node A and B

Re: [nodetool] repair with vNodes

2013-02-17 Thread aaron morton
has been running for almost 24hours and I can’t see any activity from the logs or JMX. Grep for session completed Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 15/02/2013, at 11:38 PM, Haithem Jarraya haithem.jarr

Re: Question on Cassandra Snapshot

2013-02-17 Thread aaron morton
are these timestamp directories? Probably automatic snapshot from dropping KS or CF's Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 16/02/2013, at 4:41 AM, S C as...@outlook.com wrote: I appreciate any advise

Re: odd production issue today 1.1.4

2013-02-17 Thread aaron morton
There is always this old chestnut http://wiki.apache.org/cassandra/FAQ#ubuntu_hangs A - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 16/02/2013, at 8:22 AM, Edward Capriolo edlinuxg...@gmail.com wrote: With hyper

Re: cassandra vs. mongodb quick question

2013-02-17 Thread aaron morton
to replace a node, the memory considerations for 100's of millions of rows. If you the performance of those operations is acceptable to you, then go crazy. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 16/02/2013, at 9

Re: can we pull rows out compressed from cassandra(lots of rows)?

2013-02-17 Thread aaron morton
- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 16/02/2013, at 9:35 AM, Hiller, Dean dean.hil...@nrel.gov wrote: Thanks, Dean

Re: Deleting old items

2013-02-17 Thread aaron morton
I'll email the docs people. I believe they are saying use compaction throttling rather than this not this does nothing Although I used this in the last month on a machine with very little ram to limit compaction memory use. Cheers - Aaron Morton Freelance Cassandra Developer

Re: Is there any consolidated literature about Read/Write and Data Consistency in Cassandra ?

2013-02-17 Thread aaron morton
If you want the underlying ideas try the Dynamo paper, the Big Table paper and the original Cassandra paper from facebook. Start here http://www.allthingsdistributed.com/2007/10/amazons_dynamo.html Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton

Re: nodetool repair with vnodes

2013-02-17 Thread aaron morton
Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 18/02/2013, at 12:51 AM, Marco Matarazzo marco.matara...@hexkeep.com wrote: Greetings. I'm trying to run nodetool repair on a Cassandra 1.2.1 cluster of 3 nodes with 256

Re: Deleting old items during compaction (WAS: Deleting old items)

2013-02-18 Thread aaron morton
disk, depending on the workload. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 18/02/2013, at 10:43 AM, Ilya Grebnov i...@metricshub.com wrote: According to https://issues.apache.org/jira/browse/CASSANDRA-2103

Re: nodetool repair with vnodes

2013-02-18 Thread aaron morton
repaired. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 18/02/2013, at 11:12 AM, Marco Matarazzo marco.matara...@hexkeep.com wrote: So, to me, it's like the nodetool repair command is running always on the same

Re: Cassandra on Red Hat 6.3

2013-02-18 Thread aaron morton
Nothing jumps out. Check /var/log/cassandra/output.log , that's where stdout and std err are directed. Check file permissions. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 18/02/2013, at 9:08 PM, amulya

Re: NPE in running ClientOnlyExample

2013-02-18 Thread aaron morton
An you can never go wrong relying on the documentation for the python pycassa library, it has some handy tutorials for getting started. http://pycassa.github.com/pycassa/ cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com

Re: cassandra vs. mongodb quick question

2013-02-18 Thread aaron morton
of a number of cases where people had 1 TB on a single node and they were surprised it took days to repair or replace. If you know how long things may take, and that fits in your operations then go with it. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton

Re: Mutation dropped

2013-02-19 Thread aaron morton
. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 19/02/2013, at 1:48 AM, Kanwar Sangha kan...@mavenir.com wrote: Thanks Aaron. Does the rpc_timeout not control the client timeout ? Is there any param which

Re: Testing compaction strategies on a single production server?

2013-02-20 Thread aaron morton
kind. While it may be more work I personally would use one node in write survey to test LCS Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 20/02/2013, at 6:28 AM, Henrik Schröder skro...@gmail.com wrote: Well

Re: Cassandra network latency tuning

2013-02-21 Thread aaron morton
. - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 20/02/2013, at 1:44 PM, Brandon Walsh brandon_9021...@yahoo.com wrote: I have a 5 node cluster and currently running ver 1.2. Prior to full scale deployment, I'm running some

Re: How to limit query results like from row 50 to 100

2013-02-21 Thread aaron morton
CQL does not support offset but does have limit. See http://www.datastax.com/docs/1.2/cql_cli/cql/SELECT#specifying-rows-returned-using-limit Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 20/02/2013, at 1:47 PM

Re: Heap is N.N full. Immediately on startup

2013-02-21 Thread aaron morton
My first guess would be the bloom filter and index sampling from lots-o-rows Check the row count in cfstats Check the bloom filter size in cfstats. Background on memory requirements http://www.mail-archive.com/user@cassandra.apache.org/msg25762.html Cheers - Aaron Morton

Re: SSTable Num

2013-02-21 Thread aaron morton
. Or will the sstable compaction continue and eventually we will have 1 file ? No. The default size tiered strategy compacts files what are roughly the same size, and only when there are more than 4 (default) of them. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton

Re: how to debug slowdowns from these log snippets-more info 2

2013-02-21 Thread aaron morton
tenuring cause issues with wide rows / long reads. Hope that helps. - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 21/02/2013, at 4:35 AM, Hiller, Dean dean.hil...@nrel.gov wrote: Oh, and my startup command that cassandra

Re: Mutation dropped

2013-02-21 Thread aaron morton
long a request takes in your system. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 21/02/2013, at 6:56 AM, Wei Zhu wz1...@yahoo.com wrote: What does rpc_timeout control? Only the reads/writes? How about other

Re: very confused by jmap dump of cassandra

2013-02-21 Thread aaron morton
. If you see compactions using a lot of sstables in the logs, reduce max_compaction_threshold. I can easily go higher than 8G on these systems as I have 32gig each node, but there was docs that said 8G is better for GC. More JVM memory is not the answer. Cheers - Aaron

Re: cassandra vs. mongodb quick question(good additional info)

2013-02-21 Thread aaron morton
If you are lazy like me wolfram alpha can help http://www.wolframalpha.com/input/?i=transfer+42TB+at+10GbEa=UnitClash_*TB.*Tebibytes-- 10 hours 15 minutes 43.59 seconds Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com

Re: key cache size

2013-02-21 Thread aaron morton
This is the key cache entry https://github.com/apache/cassandra/blob/trunk/src/java/org/apache/cassandra/cache/KeyCacheKey.java Note that the Descriptor is re-used. If you want to see key cache metrics, including bytes used, use nodetool info. Cheers - Aaron Morton Freelance

Re: Read IO

2013-02-22 Thread aaron morton
AFAIk this is still roughly correct http://thelastpickle.com/2011/04/28/Forces-of-Write-and-Read/ It includes information on the page size read from disk. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 22/02/2013

Re: SSTable Num

2013-02-22 Thread aaron morton
working correctly as you have described it http://www.datastax.com/dev/blog/when-to-use-leveled-compaction Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 22/02/2013, at 6:39 AM, Kanwar Sangha kan...@mavenir.com wrote

Re: Heap is N.N full. Immediately on startup

2013-02-22 Thread aaron morton
To get a good idea of how GC is performing turn on the GC logging in cassandra-env.sh. After a full cms GC event, see how big the tenured heap is. If it's not reducing enough then GC will never get far enough ahead. Cheers - Aaron Morton Freelance Cassandra Developer New

Re: Mutation dropped

2013-02-22 Thread aaron morton
if the request throughput is at it's maximum for the cluster. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 22/02/2013, at 8:15 PM, Wei Zhu wz1...@yahoo.com wrote: Thanks Aaron for the great information

Re: Adding new nodes in a cluster with virtual nodes

2013-02-22 Thread aaron morton
are worried about things like this throw in a nodetool repair. If you are using QUOURM for read and writes you will still be getting consistent data, so long as you have only added one node. Or one node every RF'th nodes. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand

Re: operations progress on DBA operations?

2013-02-22 Thread aaron morton
nodetool compactionstats Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 23/02/2013, at 3:44 AM, Hiller, Dean dean.hil...@nrel.gov wrote: I am used to systems running a first phase calculating how much files

Re: ReverseIndexExample

2013-02-22 Thread aaron morton
We are trying to answer client library specific questions on the client-dev list, see the link at the bottom here http://cassandra.apache.org/ If you can ask a more specific question I'll answer it there. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand

Re: disabling bloomfilter not working? or did I do this wrong?

2013-02-22 Thread aaron morton
Bloom Filter Space Used: 2318392048 Just to be sane do a quick check of the -Filter.db files on disk for this CF. If they are very small try a restart on the node. Number of Keys (estimate): 1249133696 Hey a billion rows on a node, what an age we live in :) Cheers - Aaron

Re: How wide rows are structured in CQL3

2013-02-22 Thread aaron morton
STORAGE and CLUSTERING. Some info here, does not cover compact storage http://thelastpickle.com/2013/01/11/primary-keys-in-cql/ Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 23/02/2013, at 4:36 AM, Boris Solovyov

Re: Q on schema migratins

2013-02-22 Thread aaron morton
. If they are in disagreement see this http://wiki.apache.org/cassandra/FAQ#schema_disagreement Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 23/02/2013, at 5:17 AM, Igor i...@4friends.od.ua wrote: Hello

Re: is there a way to drain node(and prevent reads) and upgrade sstables offline?

2013-02-22 Thread aaron morton
the compaction throughput using nodetool multithreaded_compaction = true temporarily Unless you have SSD leave this guy alone. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 23/02/2013, at 6:04 AM, Michael Kjellman mkjell

Re: Size Tiered - Leveled Compaction

2013-02-24 Thread aaron morton
Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 23/02/2013, at 6:56 AM, Mike mthero...@yahoo.com wrote: Hello, Still doing research before we potentially move one of our column families from Size Tiered-Leveled

Re: Bulk Loading-Unable to select from CQL3 tables with NO COMPACT STORAGE option after Bulk Loading - Cassandra version 1.2.1

2013-02-26 Thread aaron morton
CQL 3 tables that do not use compact storage store use Composite Types , which other code may not be expecting. Take a look at the CQL 3 table definitions through cassandra-cli and you may see the changes you need to make when creating the SSTables. Cheers - Aaron Morton

Re: disabling bloomfilter not working? memory numbers don't add up?

2013-02-28 Thread aaron morton
reported by the JVM that all you can say is since the server was started it has allocated at least 5.2 GB of memory it's not there is 5.2GB of live memory in use Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 25/02/2013

Re: Retrieving local data

2013-02-28 Thread aaron morton
Take a look at the token function with the select statement http://www.datastax.com/docs/1.2/cql_cli/cql/SELECT Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 25/02/2013, at 10:06 AM, Everton Lima peitin.inu

Re: cluster with cross data center and local

2013-02-28 Thread aaron morton
- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 25/02/2013, at 10:41 AM, Keith Wright kwri...@nanigans.com wrote: Hi all, I have a cluster with 2 data centers with an RF 2 keyspace using network topology on 1.1.10. I would like

Re: please explain read path when key not in database

2013-02-28 Thread aaron morton
This is my understanding from using cassandra for probably around 2 years Sounds about right. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 26/02/2013, at 7:43 AM, Hiller, Dean dean.hil...@nrel.gov wrote

Re: no backwards compatibility for thrift in 1.2.2? (we get utter failure)

2013-03-03 Thread aaron morton
Dean, Is this an issue with tables created using CQL 3 ? OR… An issue with tables created in 1.1.4 using the CLI not been readable after an in place upgrade to 1.2.2 ? I did a quick test and it worked. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand

Re: Select X amount of column families in a super column family in Cassandra using PHP?

2013-03-03 Thread aaron morton
- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 2/03/2013, at 2:10 PM, Crocker Jordan jcrocker.115...@students.smu.ac.uk wrote: I'm using Kallaspriit's Cassandra/PHP library ( https://github.com/kallaspriit/Cassandra-PHP-Client

Re: Column Slice Query performance after deletions

2013-03-03 Thread aaron morton
guessing this is not something you do, just mentioning it). You next option is to change the data model so you don't use the same row all day. After that, consider a message queue. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http

Re: reading the updated values

2013-03-03 Thread aaron morton
my question is how do i get the updated data in cassandra for last 1 hour or so to be indexed in elasticsearch. You cannot. The best approach is to update elastic search at the same time you update cassandra. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand

Re: no backwards compatibility for thrift in 1.2.2? (we get utter failure)

2013-03-04 Thread aaron morton
ok, we are talking about all thrift / cli / hector / no CQL tables not been read after an upgrade. If you can get some repo steps that would be handy. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 4/03/2013

Re: Unable to instantiate cache provider org.apache.cassandra.cache.SerializingCacheProvider

2013-03-04 Thread aaron morton
What version are you using ? As of 1.1 off heap caches no longer require JNA https://github.com/apache/cassandra/blob/trunk/NEWS.txt#L327 Also the row and key caches are now set globally not per CF https://github.com/apache/cassandra/blob/trunk/NEWS.txt#L324 Cheers - Aaron

Re: backing up and restoring from only 1 replica?

2013-03-04 Thread aaron morton
That would be OK only if you never had node go down (e.g. a restart) or drop messages. It's not something I would consider trying. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 28/02/2013, at 3:21 PM, Mike Koh

Re: Retrieving local data

2013-03-04 Thread aaron morton
Yes. You can get the token ranges via astynax and only ask for rows that are within the token ranges. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 28/02/2013, at 2:25 PM, Everton Lima peitin.inu...@gmail.com

Re: Unable to instantiate cache provider org.apache.cassandra.cache.SerializingCacheProvider

2013-03-05 Thread aaron morton
Details are here https://issues.apache.org/jira/browse/CASSANDRA-3271 Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 4/03/2013, at 8:04 AM, Jason Wee peich...@gmail.com wrote: version 1.0.8 Just curious, what

Re: backing up and restoring from only 1 replica?

2013-03-05 Thread aaron morton
. In specific cases it may not. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 4/03/2013, at 10:40 AM, Mike Koh defmike...@gmail.com wrote: Thanks for the response. Could you elaborate more on the bad things that happen

Re: anyone see this user-cassandra thread get answered...

2013-03-05 Thread aaron morton
Was probably this https://issues.apache.org/jira/browse/CASSANDRA-4597 Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 4/03/2013, at 2:05 PM, Hiller, Dean dean.hil...@nrel.gov wrote: I was reading http://mail

Re: Consistent problem when solve Digest mismatch

2013-03-05 Thread aaron morton
-For-Humans/ Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 4/03/2013, at 4:30 PM, Jason Tang ares.t...@gmail.com wrote: Hi The timestamp provided by my client is unix timestamp (with ntp), and as I said, due

Re: hinted handoff disabling trade-offs

2013-03-05 Thread aaron morton
reads (see my presentation here http://www.datastax.com/events/cassandrasummit2012/presentations), and your caching is bang on. Then consider if you can tune the CL, and if your client is token aware so it directs traffic to a node that has it. Cheers - Aaron Morton Freelance

Re: Replacing dead node when num_tokens is used

2013-03-05 Thread aaron morton
AFAIK you just fire up the new one and let nature take it's course :) http://www.datastax.com/docs/1.2/operations/add_replace_nodes#replace-node i.e. you do not need to use -Dcassandra.replace_token. Hope that helps. - Aaron Morton Freelance Cassandra Developer New Zealand

Re: old data / tombstones are not deleted after ttl

2013-03-05 Thread aaron morton
/CompactionManagerMBean.java#L67 Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 5/03/2013, at 1:52 AM, Michal Michalski mich...@opera.com wrote: I have read in the documentation, that after a major compaction

Re: what size file for LCS is best for 300-500G per node?

2013-03-05 Thread aaron morton
Don't forget you can test things http://www.datastax.com/dev/blog/whats-new-in-cassandra-1-1-live-traffic-sampling Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 5/03/2013, at 7:37 AM, Hiller, Dean dean.hil

<    1   2   3   4   5   6   7   8   9   10   >