Visiting Auckland

2011-06-16 Thread aaron morton
So long as the Volcanic Ash stays away I'll be visiting Auckland next week on the 23rd and 24th. Drop me an email if you would like to meet to talk about things Cassandra. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com

Re: Cassandra JVM GC settings

2011-06-16 Thread aaron morton
It would help if you can provide some log messages from the GCInspector so people can see how much GC is going on. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 17 Jun 2011, at 02:46, Sebastien Coutu wrote: Hi Everyone

Re: client API

2011-06-16 Thread aaron morton
The Thrift Java compiler creates code that is not compliant with Java 5. https://issues.apache.org/jira/browse/THRIFT-1170 So you may have trouble getting the thrift API to run. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com

Re: Docs: Token Selection

2011-06-16 Thread aaron morton
But, I'm thinking about using OldNetworkTopStrat. NetworkTopologyStrategy is where it's at. A - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 17 Jun 2011, at 01:39, AJ wrote: Thanks Eric! I've finally got it! I feel like I've just

Re: Easy way to overload a single node on purpose?

2011-06-17 Thread aaron morton
- Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 17 Jun 2011, at 10:25, Suan Aik Yeo wrote: Having a ping column can work if every key is replicated to every node. It would tell you the cluster is working, sort of. Once the number of nodes

Re: cassandra crash

2011-06-17 Thread aaron morton
/ console. If you are using a packed distro it will probably be in /var/log/cassandra/output.log Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 17 Jun 2011, at 19:18, Donna Li wrote: All: Can you find some exception from the last

Re: Cassandra.yaml

2011-06-19 Thread aaron morton
/src/java/org/apache/cassandra/config/CFMetaData.java#L642 It is in the trunk and the current trunk and builds. Can you try the nightly here https://builds.apache.org/job/Cassandra-0.8/ Hope that helps. - Aaron Morton Freelance Cassandra Developer @aaronmorton http

Re: MemoryMeter uninitialized (jamm not specified as java agent)

2011-06-19 Thread aaron morton
to the java process should include -javaagent:bin/../lib/jamm-0.2.2.jar Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 17 Jun 2011, at 22:18, Rene Kochen wrote: Since using cassandra 0.8, I see the following warning: WARN

Re: Re : last record rowId

2011-06-19 Thread aaron morton
get_range_slice() api call allows you to iterate of the keys in the DB. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 18 Jun 2011, at 05:00, karim abbouh wrote: is there any way to remember the keys (rowId) inserted

Re: Error trying to move a node - 0.7

2011-06-19 Thread aaron morton
I *think* someone had a similar problem once before, moving a node that was the only node in a DC. Whats version are you using ? - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 17 Jun 2011, at 07:42, Ben Frank wrote: Hi All, I'm

Re: framed transport and buffered transport

2011-06-20 Thread aaron morton
From changes.txt = https://github.com/apache/cassandra/blob/cassandra-0.8.0/CHANGES.txt#L687 make framed transport the default so malformed requests can't OOM the=20= server (CASSANDRA-475) btw, you *really* should upgrade. Cheers - Aaron Morton Freelance Cassandra Developer

Re: Secondary indexes performance

2011-06-21 Thread aaron morton
that using the other predicates. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 21 Jun 2011, at 09:04, Wojciech Pietrzok wrote: Hello, I've noticed that queries using secondary indexes seems to be getting rather slow. Right

Re: OOM during restart

2011-06-21 Thread aaron morton
only one at a time. The JVM option D.cassandra_ring=false will stop the node from joining the cluster and stop other nodes sending requests to it until you have sorted it out. Hope that helps. - Aaron Morton Freelance Cassandra Developer @aaronmorton http

Re: Create columnFamily

2011-06-21 Thread aaron morton
inserted. Hope that helps. - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 21 Jun 2011, at 19:06, Vivek Mishra wrote: I understand that I might be missing something on my end. But somehow I cannot get this working using Cassandra-cli

Re: Flushing behavior in Cassandra 0.8

2011-06-21 Thread aaron morton
The new memtable_total_space_in_mb option is kicking in https://github.com/apache/cassandra/blob/cassandra-0.8.0/NEWS.txt#L34 http://thelastpickle.com/2011/05/04/How-are-Memtables-measured/ Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http

Re: CommitLog replay

2011-06-21 Thread aaron morton
/cassandra-0.8.0/NEWS.txt#L34 http://thelastpickle.com/2011/05/04/How-are-Memtables-measured/ Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 22 Jun 2011, at 01:51, Stephen Pope wrote: I've only got one cf, and haven't changed

Re: Compressing data types

2011-06-21 Thread aaron morton
Also https://issues.apache.org/jira/browse/HADOOP-7206 Now part of brisk http://www.datastax.com/dev/blog/brisk-1-0-beta-2-released Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 22 Jun 2011, at 04:04, Vijay wrote: You might

Re: Storing files in blob into Cassandra

2011-06-22 Thread aaron morton
the network / taken out of rotation for maintenance. There are lots of reasons for a server to not be doing what it should be. - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 22 Jun 2011, at 23:10, Damien Picard wrote: 2011/6/22

Re: Secondary indexes performance

2011-06-22 Thread aaron morton
it will probably be better to denormalize and store some precomputed data Yes, if you know there are queries you need to serve it is better to support those directly in the data model. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http

Re: insufficient space to compact even the two smallest files, aborting

2011-06-22 Thread aaron morton
compaction once the memtables have been flushed - check the logs for messages from 'CompactionManager' - when done grab the output from `ls -lah` again. Hope that helps. - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 23 Jun 2011, at 02:04

Re: Strange Connection error of nodetool

2011-06-22 Thread aaron morton
Check the list here http://wiki.apache.org/cassandra/JmxGotchas I *think* the jmx server tells the client to connect back on another host/port. Hope that helps. - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 22 Jun 2011, at 21:02

Re: unsubscribe

2011-06-22 Thread aaron morton
http://wiki.apache.org/cassandra/FAQ#unsubscribe - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 23 Jun 2011, at 06:02, Carey Hollenbeck wrote: unsubscribe From: William Oberman [mailto:ober...@civicscience.com] Sent: Wednesday

Re: Atomicity Strategies

2011-06-22 Thread aaron morton
Atomic on a single machine yes. - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 23 Jun 2011, at 09:42, AJ wrote: On 4/9/2011 7:52 PM, aaron morton wrote: My understanding of what they did with locking (based on the examples

Re: Backup/Restore: Coordinating Cassandra Nodetool Snapshots with Amazon EBS Snapshots?

2011-06-22 Thread aaron morton
to be from the time of the first one. Previous discussion on AWS backup http://www.mail-archive.com/user@cassandra.apache.org/msg12831.html Hope that helps. - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 23 Jun 2011, at 10:48, Thoku

Re: Decorator Algorithm

2011-06-23 Thread aaron morton
which endpoints contain replicas is done by the AbstractReplicationStrategy.calculateNaturalEndpoints() implementations. Does that help? - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 23 Jun 2011, at 19:58, Jonathan Colby wrote: Hi

Re: insufficient space to compact even the two smallest files, aborting

2011-06-23 Thread aaron morton
Missed that in the history, cheers. A - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 23 Jun 2011, at 20:26, Sylvain Lebresne wrote: As Jonathan said earlier, you are hitting https://issues.apache.org/jira/browse/CASSANDRA-2765

Re: get_range_slices result

2011-06-23 Thread aaron morton
Not sure what your question is. Does this help ? http://wiki.apache.org/cassandra/FAQ#range_rp Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 23 Jun 2011, at 21:59, karim abbouh wrote: how can get_range_slices() function

Re: RAID or no RAID

2011-06-27 Thread aaron morton
RAID0 so you have one big volume. For performance (cassandra does not stripe sstables across the data dirs) and otherwise you'll have fragmentation and wont be able to utilise all your space. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http

Re: Clock skew

2011-06-27 Thread aaron morton
. - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 28 Jun 2011, at 10:03, A J wrote: During writes, the timestamp field in the column is the system-time of that node (correct me if that is not the case and the system-time of the co-ordinator

Re: RAID or no RAID

2011-06-27 Thread aaron morton
Not sure what the intended purpose is, but we've mostly used it as an emergency disk-capacity-increase option Thats what I've used it for. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 28 Jun 2011, at 15:55, Dan Kuebrich

Re: remove all the columns of a key in a column family

2011-06-28 Thread aaron morton
That error is thrown if you send a Deletion with a predicate that has neither columns or a SliceRange. Send a Deletion that does not have a predicate. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 28 Jun 2011, at 18:11

Re: Truncate introspection

2011-06-28 Thread aaron morton
- Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 28 Jun 2011, at 20:00, David Boxenhorn wrote: Does drop work in a similar way? When I drop a CF and add it back with a different schema, it seems to work. But I notice that in between the drop

Re: Re : Re : get_range_slices result

2011-06-28 Thread aaron morton
- Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 28 Jun 2011, at 22:20, karim abbouh wrote: can i have an example for usingTimeUUIDType as comparator in a client java code. De : karim abbouh karim_...@yahoo.fr À : user@cassandra.apache.org user

Re: Query indexed column with key filter‏

2011-06-28 Thread aaron morton
reasonable. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 29 Jun 2011, at 05:31, Daning wrote: I found this code // Start and finish keys, *and* column relations (KEY foo AND KEY bar and name1 = value1

Re: Server-side CQL parameters substitution

2011-06-28 Thread aaron morton
see https://issues.apache.org/jira/browse/CASSANDRA-2475 - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 29 Jun 2011, at 08:45, Michal Augustýn wrote: Hi all, in most SQL implementations, it's possible to declare parameters in SQL

Re: custom reconciling columns?

2011-06-28 Thread aaron morton
with the data churn, data model and query before looking at serialisation. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 29 Jun 2011, at 10:37, Yang wrote: I can see that as my user history grows, the reads time proportionally

Re: Cannot set column value to zero

2011-06-29 Thread aaron morton
does not ring any bells. Let us know if it happens again. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 30 Jun 2011, at 02:13, dnalls...@taz.qinetiq.com wrote: I had a strange problem recently where I was unable to set the value

Re: hadoop results

2011-06-29 Thread aaron morton
How about get_slice() with reversed == true and count = 1 to get the highest time UUID ? Or you can also store a column with a magic name that have the value of the timeuuid that is the current metric to use. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton

Re: Chunking if size 64MB

2011-06-29 Thread aaron morton
AFAIK there is no server side chunking of column values. This link http://wiki.apache.org/cassandra/FAQ#large_file_and_blob_storage is just suggesting in the app you do not store more than 64MB per column. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http

Re: SimpleAuthenticator

2011-06-30 Thread aaron morton
/access.properties btw at a minimum you should upgrade from 0.7.2 to 0.7.6-2 see https://github.com/apache/cassandra/blob/cassandra-0.7.6-2/NEWS.txt#L61 Hope that helps. - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 1 Jul 2011, at 02:20

Re: Repair doesn't work after upgrading to 0.8.1

2011-06-30 Thread aaron morton
with the 2818 patch applied may work. Starting with Dcassandra.load_ring_state=false causes the node to rediscover the ring which may help (just a guess really). But if there is bad node start been passed around in gossip it will just get the bad state again. Anyone else ? - Aaron

Re: incomplete schema sync for new node

2011-07-03 Thread aaron morton
- Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 2 Jul 2011, at 12:58, Jeremy Stribling wrote: Oops, forgot to mention that we're using Cassandra 0.7.2. On 07/01/2011 05:46 PM, Jeremy Stribling wrote: Hi all, I'm running into a problem

Re: flushing issue

2011-07-04 Thread aaron morton
by using nodetool cfstats. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 4 Jul 2011, at 22:28, Vivek Mishra wrote: Hi, I know, I might be missing something here. I am currently facing 1 issue. I have 2 cassandra clients(1

Re: copy data from multi-node cluster to single node

2011-07-04 Thread aaron morton
to have *everything* from the prod cluster then copy the data from all 3 nodes onto the dev node and compact it down. Hope that helps. - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 5 Jul 2011, at 03:05, Ross Black wrote: Hi, I am

Re: copy data from multi-node cluster to single node

2011-07-05 Thread aaron morton
multiple nodes onto one you will need to manually update them. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 5 Jul 2011, at 14:59, Zhu Han wrote: On Tue, Jul 5, 2011 at 8:58 AM, aaron morton aa...@thelastpickle.com wrote: How do

Re: Problems Iterating over tokens in 0.7.5

2011-07-06 Thread Aaron Morton
If you still have problems send through some details of where you get incorrect results. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 6/07/2011, at 3:23 AM, Anand Somani meatfor...@gmail.com wrote: Hi, Using thrift

Re: deleting keys

2011-07-06 Thread Aaron Morton
See http://wiki.apache.org/cassandra/FAQ#range_ghosts Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 6/07/2011, at 3:46 AM, karim abbouh karim_...@yahoo.fr wrote: i use get_range_slice to get the list of keys, then i call

Re: Details of 'nodetool move'

2011-07-06 Thread Aaron Morton
, it will also be sent writes while it is bootstrapping. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 6/07/2011, at 10:35 AM, A J s5a...@gmail.com wrote: Hello, Where can I find details of nodetool move. Most places just mention

Re: memory

2011-07-06 Thread Aaron Morton
That advice is a little out of date, specially in the future world of 0.8 memory management, see http://thelastpickle.com/2011/05/04/How-are-Memtables-measured/ Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 6/07/2011, at 5:51

Re: result sorted by keys in reversed

2011-07-06 Thread Aaron Morton
else may have requested it) Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 7/07/2011, at 1:39 AM, Monnom Monprenom accountfor...@yahoo.fr wrote: Hi, I am using get_range_slice and I get the results sorted by keys

Re: commitlogs not draining

2011-07-06 Thread Aaron Morton
draining logs may be this https://issues.apache.org/jira/browse/CASSANDRA-2829 . If a node tool flush does not clear them a restart will. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 7/07/2011, at 12:26 PM, Scott Dworkis s

Re: Running hadoop jobs against data in remote data center

2011-07-06 Thread Aaron Morton
to get on with it's life without worrying about the other DC. Hope that helps. - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 7/07/2011, at 1:29 PM, Jason Baker ja...@apture.com wrote: I'm just setting up a Cassandra cluster for my company

Re: Pig pulling an older value from cassandra

2011-07-08 Thread aaron morton
Jeremy did you get anywhere with this ? If you are reading at CL ONE Read Repair will run in the background, so it may only be visible to subsequent reads. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 6 Jul 2011, at 20:52

Re: Re : result sorted by keys in reversed

2011-07-08 Thread aaron morton
Is it possible to have same results sorting in reversed by another method without get_range_slice in JAVA ? Sorry I don't understand your question. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 7 Jul 2011, at 01:56, Monnom

Re: List nodes where write was applied to

2011-07-08 Thread aaron morton
on the replicas. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 7 Jul 2011, at 10:01, A J wrote: Is there a way to find what all nodes was a write applied to ? It could be a successful write (i.e. w was met) or unsuccessful write (i.e

Re: how large cassandra could scale when it need to do manual operation?

2011-07-08 Thread aaron morton
with your current installation ? Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 8 Jul 2011, at 08:50, Yan Chunlu wrote: hi, all: I am curious about how large that Cassandra can scale? from the information I can get, the largest

Re: Corrupted data

2011-07-08 Thread aaron morton
You may not lose data. - What version and whats the upgrade history? - What RF / node count / CL ? - Have you been running repair consistently ? - Is this on a single node or all nodes ? Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http

Re: how large cassandra could scale when it need to do manual operation?

2011-07-09 Thread aaron morton
Hope that helps. - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 9 Jul 2011, at 02:01, Chris Goffinet wrote: As mentioned by Aaron, yes we run hundreds of Cassandra nodes across multiple clusters. We run with RF of 2 and 3 (most common

Re: Cassandra Secondary index/Twissandra

2011-07-09 Thread aaron morton
. - - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 9 Jul 2011, at 12:15, Eldad Yamin wrote: Hi, I have few questions: Secondary index Is there a limit on the number of columns in a single column family that serve as secondary

Re: Corrupted data

2011-07-09 Thread aaron morton
to run repair. Try running it on a single CF to start with. Good luck - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 9 Jul 2011, at 16:45, Héctor Izquierdo Seliva wrote: Hi Peter. I have a problem with repair, and it's that it always

Re: Cassandra Secondary index/Twissandra

2011-07-10 Thread aaron morton
. But may still be plenty fast enough, depending on scale and throughput and all those other things. see http://thelastpickle.com/2011/07/04/Cassandra-Query-Plans/ Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 10 Jul 2011, at 00:14

Re: Corrupted data

2011-07-10 Thread aaron morton
more information ? Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 10 Jul 2011, at 03:26, Yan Chunlu wrote: I am running RF=2(I have changed it from 2-3 and back to 2) and 3 nodes and didn't running node repair more than 10

Re: node stuck leaving

2011-07-10 Thread aaron morton
which thing the missing node is up with using the Dcassandra.load_ring_state=false JVM property. But you may have to take more drastic action. http://www.datastax.com/docs/0.8/troubleshooting/index#view-of-ring-differs-between-some-nodes Cheers - Aaron Morton Freelance Cassandra

Re: R: Re: Re: AntiEntropy?

2011-07-12 Thread aaron morton
Running nodetool repair causes Cassandra to execute a major compaction This is not what I would call factually accurate. Repair does not run a major compaction. Major compaction is when all SSTables for a CF are compacted down to one SSTable. Cheers - Aaron Morton Freelance

Re: commitlog replay missing data

2011-07-13 Thread Aaron Morton
, and is never decremented. Deletes and overwrites will inflate this value. What was your workload like? As of 0.8 we now have global memory management for cf's that tracks actual JVM bytes used by a CF. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http

Re: Storing counters in the standard column families along with non-counter columns ?

2011-07-13 Thread Aaron Morton
If you can provide some more details on the use case we may be able to provide some data model help. You can always use a dedicated CF for the counters, and use the same row key. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com

Re: Range query ordering with CQL JDBC

2011-07-17 Thread aaron morton
. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 16 Jul 2011, at 06:09, Matthieu Nahoum wrote: Hi Eric, I am using the default partitioner, which is the RandomPartitioner I guess. The key type is String. Are Strings ordered

Re: Data overhead discussion in Cassandra

2011-07-17 Thread aaron morton
offset for the data file. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 15 Jul 2011, at 07:09, Sameer Farooqui wrote: We just set up a demo cluster with Cassandra 0.8.1 with 12 nodes and loaded 1.5 TB of data into it. However

Re: Thrift Java Client - Get a column family from a Keyspace

2011-07-17 Thread aaron morton
they also provide connection management and retry features that are dead handy. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 14 Jul 2011, at 23:59, Chandrasekhar M wrote: Hi I have been playing around with Cassandra

Re: What available Cassandra schema documentation is available?

2011-07-18 Thread aaron morton
Indexes are not supported on sub columns. Also, you definition seems to mix standard and sub columns together in the CF. For a super CF all top level columns contain sub columns. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com

Re: thrift install

2011-07-18 Thread aaron morton
Why are you installing thrift ? The cassandra binary packages contain all the dependancies. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 19 Jul 2011, at 07:51, Sal Lopez wrote: Does anyone have documentation/tips

Re: How to keep only exactly column of key

2011-07-18 Thread aaron morton
no longer need. You could also try Redis. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 19 Jul 2011, at 03:22, JKnight JKnight wrote: Dear all, I want to keep only 100 column of a key: when I add a column for a key

Re: b-tree

2011-07-20 Thread aaron morton
depend on your data. The top sets may get very big, . Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 21 Jul 2011, at 08:33, Jeffrey Kesselman wrote: Im not sure if I have an answer for you, anyway, but I'm curious A b-tree

Re: Data Visualization Best Practices

2011-07-20 Thread aaron morton
This project may provide some inspiration https://github.com/driftx/chiton Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 21 Jul 2011, at 06:36, Selcuk Bozdag wrote: Hi, Cassandra provides a flexible scheme-less data

Re: Repair taking a long, long time

2011-07-20 Thread aaron morton
on. If you want to dive deeper look for a log messages on the machine you started the repair on from the AnitEntropyService. Hope that helps. - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 21 Jul 2011, at 02:31, David Boxenhorn wrote: As I

Re: node repair eat up all disk io and slow down entire cluster(3 nodes)

2011-07-20 Thread Aaron Morton
the min and max thresholds to 0 via node tool. hope that helps. - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 20/07/2011, at 11:46 PM, Yan Chunlu springri...@gmail.com wrote: just found this: https://issues.apache.org/jira/browse

Re: PHPCassa get number of rows

2011-07-20 Thread Aaron Morton
keys and counting the columns. NOTE: counting columns just reads aol the columns, for a big row it can result in an OOM. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 20/07/2011, at 8:29 AM, Jean-Nicolas Boulay Desjardins jnbdzjn

Re: with proof Re: cassandra goes infinite loop and data lost.....

2011-07-20 Thread aaron morton
Personally I would do a repair first if you need to do one, just so you are confident everything is where is should be. Then do the move as described in the wiki. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 21 Jul 2011

Re: reset keys_cached

2011-07-21 Thread aaron morton
To clear the key cache use the invalidateKeyCache() operation on the column family in JConsole / JMX Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 21 Jul 2011, at 18:15, 魏金仙 wrote: Can any one tell how to reset keys_cached

Re: Memtables stored in which location

2011-07-21 Thread aaron morton
to the commit log first, then the memtable in memory, which is later flushed to disk. A read is from potentially multiple sstables and memtables. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 21 Jul 2011, at 21:17, CASSANDRA

Re: cassandra massive write perfomance problem

2011-07-21 Thread aaron morton
#cleaning_compacted_tables You may also want to track things by looking at nodetool tpstats and cfstats (for latency). Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 21 Jul 2011, at 21:49, lebron james wrote: Please help me solve one problem

Re: node repair eat up all disk io and slow down entire cluster(3 nodes)

2011-07-21 Thread aaron morton
What are you seeing in compaction stats ? You may see some of https://issues.apache.org/jira/browse/CASSANDRA-2280 Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 21 Jul 2011, at 23:17, Yan Chunlu wrote: after tried nodetool

Re: Memtables stored in which location

2011-07-21 Thread aaron morton
The data file with rows and columns, the bloom filter for the rows in the data file, the index for rows in the data file and the statistics. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 21 Jul 2011, at 23:26, Nilabja

Re: Need help json2sstable

2011-07-21 Thread aaron morton
mmm, there is no -f option for sstable2json / SSTableExport. Datastax guys/girls ?? this works for me bin/sstable2json /var/lib/cassandra/data/dev/data-g-1-Data.db -k 666f6f output.txt NOTE: key is binary, so thats the ascii encoding for foo Cheers - Aaron Morton

Re: b-tree

2011-07-21 Thread aaron morton
But how will you be able to maintain it while it evolves and new data is added without transactions? What is the situation you think you need transactions for ? Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 22 Jul 2011

Re: Compacting manual managing and optimization

2011-07-21 Thread aaron morton
up or make some other changes. What does your cluster look like ? # nodes, load per node, throughput, # clients etc Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 22 Jul 2011, at 00:30, lebron james wrote: Hi! Tell me please

Re: Need help json2sstable

2011-07-21 Thread aaron morton
you have either set a key_validation_class for the CF or used the assume statement). If one way does not work try the other. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 22 Jul 2011, at 01:15, Nilabja Banerjee wrote: Thank

Re: Modeling troubles

2011-07-21 Thread aaron morton
perspective. - each column name is the byte array for the possible positions of the other colour Good luck. - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 22 Jul 2011, at 01:18, Stephen Pope wrote: For a side project I’m working on I

Re: Is it safe to stop a read repair and any suggestion on speeding up repairs

2011-07-21 Thread aaron morton
node. The reason for this recommendation is so that things like repair, compaction, node moves, etc are managable and because the loss of a single node has less of an impact. I would not recommend running a live system with that much data per node. Hope that helps. - Aaron

Re: cassandra fatal error when compaction

2011-07-21 Thread aaron morton
Looks like nodetool drain has been run. Anything else in the logs ? - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 22 Jul 2011, at 05:48, lebron james wrote: Why cassandra fall when i start comaction with nodetool on 35+gb database

Re: Cassandra 0.8.1: request for a sub-column still deserializes all sub-columns for that super column?

2011-07-21 Thread aaron morton
Yes - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 22 Jul 2011, at 10:06, Oleg Tsvinev wrote: Hi All, Cassandra documentation here: http://www.datastax.com/docs/0.8/data_model/supercolumns states that: Any request for a sub

Re: Repair fails with java.io.IOError: java.io.EOFException

2011-07-21 Thread aaron morton
Check /var/log/cassandra/output.log (assuming the default init scripts) A - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 22 Jul 2011, at 10:13, Sameer Farooqui wrote: Hmm. Just looked at the log more closely. So, what actually

Re: Repair fails with java.io.IOError: java.io.EOFException

2011-07-21 Thread aaron morton
AbstractCassandraDaemon.java (line 78) Logging initialised ? Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 22 Jul 2011, at 10:50, Sameer Farooqui wrote: Hey Aaron, I don't have any output.log files in that folder: ubuntu@ip-10-2-x-x

Re: Stress test using Java-based stress utility

2011-07-22 Thread aaron morton
the server side logs as Kirk says. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 22 Jul 2011, at 18:37, Kirk True wrote: Have you checked the logs on the nodes to see if there are any errors? On 7/21/11 10:43 PM, Nilabja Banerjee

Re: b-tree

2011-07-22 Thread aaron morton
You can use something like Zoo Keeper to coordinate processes doing page splits. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 22 Jul 2011, at 19:05, Eldad Yamin wrote: In order order to split the nodes. SimpleGeo have max

Re: cassandra fatal error when compaction

2011-07-22 Thread aaron morton
Something has shutdown the mutation stage thread pool. This happens during drain or decommission / move. Restart the service and it should be ok. if it happens again without anyone running something like drain, decommission or move let us know. Cheers - Aaron Morton

Re: eliminate need to repair by using column TTL??

2011-07-22 Thread aaron morton
etc. There are plans to improve it though. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 22 Jul 2011, at 19:55, jonathan.co...@gmail.com wrote: One of the main reasons for regularly running repair is to make sure deletes

Re: Predictable low RW latency, SLABS and STW GC

2011-07-24 Thread aaron morton
- Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 23 Jul 2011, at 05:34, Milind Parikh wrote: In order to be predicable @ big data scale, the intensity and periodicity of STW Garbage Collection has to be brought down. Assume that SLABS (Cass 2252

Re: question on setup for writes into 2 datacenters

2011-07-24 Thread aaron morton
Quick reminder, with RF == 2 the QUORUM is 2 as well. So when using LOCAL_QUORUM with RF 2+2 you will effectively be using LOCAL_ALL which may not be what you want. As De La Soul sang, 3 is the magic number for minimum fault tolerance (QUORUM is then 2). Cheers - Aaron

Re: select * from A join B using(common_id) where A.id == a and B.id == b

2011-07-24 Thread aaron morton
my fall-back approach is, since A and B do not change a lot, I'll pre-generate the join of A and B (not very large) keyed on A.id + B.id, then do the get(a+b) +1 materialise views / joins you know you want ahead of time. Trade space for time. Cheers - Aaron Morton

<    5   6   7   8   9   10   11   12   13   14   >