Re: getting error for decimal type data

2013-01-29 Thread aaron morton
hey are all needed. cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 29/01/2013, at 10:41 PM, Rishabh Agrawal wrote: > Did u trt accessing this cf from CQL, I think it must work from there, also > try accessing it

Re: problem with Cassandra map-reduce support

2013-01-29 Thread aaron morton
Brian, Could you raise a ticket at https://issues.apache.org/jira/browse/CASSANDRA ? Thanks - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 30/01/2013, at 1:23 AM, Brian Jeltema wrote: > In hadoop-0.2

Re: SStable Writer and composite key

2013-01-30 Thread aaron morton
ate-value, request-value, "data1") and has the value of data1. Hope that helps. ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 30/01/2013, at 3:11 AM, POUGET Laurent wrote: > Hi, > > > I have

Re: Problem on node join the ring

2013-01-30 Thread aaron morton
anserver.PerInterface.invoke(PerInterface.java:138) > at com.sun.jmx.mbeanserver.MBeanSupport.invoke(MBeanSupport.java:250) > at > com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.invoke(DefaultMBeanServerInterceptor.java:819) > > > > On Mon, Jan 28, 20

Re: Cass returns Incorrect column data on writes during flushing

2013-01-30 Thread aaron morton
The looks bug like, can you create a ticket on https://issues.apache.org/jira/browse/CASSANDRA Please include the C* version, the table and insert statements, and if you can repo is using CQL 3. Thanks Aaron - Aaron Morton Freelance Cassandra Developer New Zealand

Re: why set replica placement strategy at keyspace level ?

2013-01-30 Thread aaron morton
> I think a row mutation is isolated now, but is it across column families? Correct they are isolated, but only for an individual CF. > By the way, the wiki page really needs updating. You can update if you would like to. Cheers - Aaron Morton Freelance Cassandra Develop

Re: Start token sorts after end token

2013-01-31 Thread aaron morton
Out of interest do you have the ticket? A - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 31/01/2013, at 3:19 AM, Edward Capriolo wrote: > Fix is simply to switch to random partitioner. > > On Wednesday, January

Re: Node selection when both partition key and secondary index field constrained?

2013-01-31 Thread aaron morton
nodes which have a token range that intersect with the token range you have supplied. So if your query token range is included in one Node Token Range, the query will be sent to CL nodes that replicate that token range. Cheers ----- Aaron Morton Freelance Cassandra Developer

Re: Nodetool can not get to 7199 after migrating to 1.2.1

2013-01-31 Thread aaron morton
Check the JMX port listed in /etc/cassandra/cassandra-env.sh If it's not default you can pass it to nodetool using the --jmx-port option. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 31/01/2013, at 3:

Re: Suggestion: Move some threads to the client-dev mailing list

2013-01-31 Thread aaron morton
+1 Also where can I learn more about pyhtondra ? Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 31/01/2013, at 8:09 AM, Rob Coli wrote: > On Wed, Jan 30, 2013 at 7:21 AM, Edward Capriolo > wrote: >> M

Re: Inserting via thrift interface to column family created with Compound Key via cql3

2013-02-01 Thread aaron morton
Whats the full error stack on the client ? Are you using a pre-build thrift client or you own ? If the later try using a pre built client first, like Hector or pycassa. If it works there look into how that code works and go from there. Cheers - Aaron Morton Freelance

Re: cluster issues

2013-02-01 Thread aaron morton
For Data Stax Enterprise specific questions try the support forums http://www.datastax.com/support-forums/ Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 31/01/2013, at 8:27 AM, S C wrote: > I am us

Re: CASSANDRA-5152

2013-02-01 Thread aaron morton
Can you update the ticket with your experiences ? https://issues.apache.org/jira/browse/CASSANDRA-5152 Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 31/01/2013, at 11:13 AM, yen-fen_...@mcafee.com wrote: > I

Re: why set replica placement strategy at keyspace level ?

2013-02-01 Thread aaron morton
primary key) is important and identifies the storage "container" that has the columns. Your milage may vary - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 31/01/2013, at 4:43 PM, Edward Capriolo wrote: >

Re: Cassandra pending compaction tasks keeps increasing

2013-02-01 Thread aaron morton
k the help for the CLI or the CQL docs. > Any side effect? Since we are using SSD, a bit bigger SSD won't slow down the > read too much, I suppose that is the main concern for bigger size of SSTable? Do some experiments to see how it works, and let others know :) Cheers -

Re: CPU hotspot at BloomFilterSerializer#deserialize

2013-02-01 Thread aaron morton
using the natural column order. Get the last 10 columns using the reversed order. Hope that helps. ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 31/01/2013, at 7:20 PM, Takenori Sato wrote: > Hi all, > > We hav

Re: Understanding Virtual Nodes on Cassandra 1.2

2013-02-01 Thread aaron morton
the IRC channel. Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 31/01/2013, at 11:47 PM, Manu Zhang wrote: > On Thu 31 Jan 2013 03:43:32 AM CST, Zhong Li wrote: >> Are there tickets/documents ex

Re: JDBC : CreateresultSet fails with null column in CqlResultSet

2013-02-01 Thread aaron morton
I think http://code.google.com/a/apache-extras.org/p/cassandra-jdbc/issues/list is the place to raise the issue. Can you update the mail thread with the ticket as well? Thanks - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com

Re: CQL binary protocol

2013-02-01 Thread aaron morton
The spec for the protocol is here https://git-wip-us.apache.org/repos/asf?p=cassandra.git;a=blob_plain;f=doc/native_protocol.spec;hb=refs/heads/cassandra-1.2 Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 1/02/2013

Re: rangeQuery to traverse keys backward?

2013-02-01 Thread aaron morton
to not require precise range scans ? Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 1/02/2013, at 1:36 PM, Yuhan Zhang wrote: > Hi all, > > I'm tryinng to use get_range to traverse the rows by page

Re: Secondary index query + 2 Datacenters + Row Cache + Restart = 0 rows

2013-02-02 Thread aaron morton
Can you run the select in cqlsh and enabling tracing (see the cqlsh online help). If you can replicate it then place raise a ticket on https://issues.apache.org/jira/browse/CASSANDRA and update email thread. Thanks - Aaron Morton Freelance Cassandra Developer New Zealand

Re: Possible issue in IndexedSliceReader.java ?

2013-02-02 Thread aaron morton
nk to exercise that code is create a CQL 3 table with a list column, add some elements to it and then delete the column. That should trigger a multi range read, see the code in DeleteStatement. Good catch, can you raise a ticket if you find a problem ? Thanks - Aaron Morton Free

Re: conditional update or insert

2013-02-02 Thread aaron morton
ences, cassandra will always return the values with the highest sequence as it will also be the cassandra timestamp. Hope that helps. --------- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 2/02/2013, at 7:51 AM, Jay Svc wrote: > H

Re: initial_token

2013-02-02 Thread aaron morton
If you are using Murmur3 partitioner and do not wish to partake in vnodes you can still calculate inital_tokens. There is a guide here http://www.datastax.com/docs/1.2/initialize/token_generation#calculating-tokens-for-the-murmur3partitioner Cheers - Aaron Morton Freelance

Re: BloomFilter

2013-02-04 Thread aaron morton
re data on each node. In 1.2 there are things that make replacing a node faster, but they tend to kick in at higher node counts. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 3/02/2013, at 6:45 AM, Kanwar San

Re: Index file

2013-02-04 Thread aaron morton
-Index.db components only contain the index. In v1.2+ -Summary.db contains a sampling of the index read at startup. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 3/02/2013, at 11:03 AM, Kanwar Sangha wrote: >

Re: Upgrade to Cassandra 1.2

2013-02-04 Thread aaron morton
(Default: localhost) -th, --thrift-host Thrift hostname or IP address (Default: JMX host) Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 3/02/2013, at 11:32 PM, Manu Zhang wrote: > On Sun 03 Feb 2013 05:45

Re: CPU hotspot at BloomFilterSerializer#deserialize

2013-02-04 Thread aaron morton
nodetool cfhistorgrams will let you know, run it once to reset the counts , then do your test, then run it again. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 4/02/2013, at 4:13 AM, Edward Capriolo wrote: &g

Re: cassandra cqlsh error

2013-02-04 Thread aaron morton
Grab 1.2.1, it's fixed there http://cassandra.apache.org/download/ Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 5/02/2013, at 4:37 AM, "Kumar, Anjani" wrote: > > I am facing problem whil

Re: Pycassa vs YCSB results.

2013-02-05 Thread aaron morton
heers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 5/02/2013, at 7:15 AM, Pradeep Kumar Mantha wrote: > Hi, > > Could some one please let me know any hints, why the pycassa client(attached) > is much slower than the YCSB? >

Re: Pycassa vs YCSB results.

2013-02-05 Thread aaron morton
The simple thing to do would be use the multiprocessing package and eliminate all shared state. On a multicore box python threads can run on different cores and battle over obtaining the GIL. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http

Re: Operation Consideration with Counter Column Families

2013-02-05 Thread aaron morton
Same as regular CF's. > How do they effect compaction? None. Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 6/02/2013, at 7:47 AM, Drew Kutcharian wrote: > Hey Guys, > > Are there any specific oper

Re: unbalanced ring

2013-02-05 Thread aaron morton
Use nodetool status with vnodes http://www.datastax.com/dev/blog/upgrading-an-existing-cluster-to-vnodes The different load can be caused by rack affinity, are all the nodes in the same rack ? Another simple check is have you created some very big rows? Cheers - Aaron Morton

Re: Clarification on num_tokens setting

2013-02-05 Thread aaron morton
y large ranges. Correct? Even without vnodes there is no guarantee that nodes had contiguous key ranges. Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 6/02/2013, at 5:43 AM, Baron Schwartz wrote: > As I understa

Re: Clarification on num_tokens setting

2013-02-05 Thread aaron morton
> There is always num_tokens tokens in the ring. I got this wrong. Each node *does* have num_tokens tokens. >> With N nodes, the ring is divided into N*num_tokens. Correct? Yes > In other words it is cluster wide parameter. Correct? Yes. Cheers ----- Aaron Mort

Re: Operation Consideration with Counter Column Families

2013-02-06 Thread aaron morton
I understand. Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 6/02/2013, at 11:15 AM, Drew Kutcharian wrote: > Thanks Aaron, so will there only be one "value" for each counter column per > sstable just like regular co

Re: DataModel Question

2013-02-06 Thread aaron morton
) is the partition key, same the thrift row key. message_sequence, message_id is the grouping columns, all instances will be grouped / ordered by these columns. Hope that helps. ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com

Re: Cassandra 1.1.8 timeouts on clients

2013-02-07 Thread aaron morton
First check your node for IO errors. You have some bad data there. When you restart cassandra it may identify which sstables are corrupt. You can then stop the node and remove them. You will then need to run repair to replace the missing data. Hope that helps. - Aaron

Re: Directory structure after upgrading 1.0.8 to 1.2.1

2013-02-07 Thread aaron morton
the -old.json is an artefact of Levelled Compaction. You should see a non -old file in the current CF folder. I'm not sure what would have created the -old CF dir. Does the timestamp indicate it was created the time the server first started as a 1.2 node? Cheers -

Re: Can't remove contents of table with truncate or drop

2013-02-07 Thread aaron morton
Double check the truncate worked, all nodes must be available for it execute. If you can provide the output from the cqlsh from truncating and selecting that would be helpful. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http

Re: DataModel Question

2013-02-07 Thread aaron morton
ort of token that includes the last time stamp seen by the client. Then make as many queries as necessary to get the missing data. > > I guess this makes the data model span across many CFs ? Yes. Sorry I have not considered conversations. Cheers ----- Aaron Morton Freelance

Re: Netflix/Astynax Client for Cassandra

2013-02-07 Thread aaron morton
I'm going to guess Netflix are running Astynax in production with Cassandra 1.1. cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 8/02/2013, at 6:50 AM, Cassa L wrote: > Thank you all for the responses

Re: are CFs consistent after a repair

2013-02-07 Thread aaron morton
t;N (e.g. QUORUM + QUROUM ) will be consistent. Can you drill down into the consistency problem? Cheers --------- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 8/02/2013, at 7:01 AM, Brian Jeltema wrote: > I'm confused about

Re: High CPU usage during repair

2013-02-10 Thread aaron morton
the validation compaction used for the repair. Which may in turn add additional IO load, CPU load and GC pressure. You probably do not want to do this. Try reducing the compaction throughput to say 12 normally and see the effect. Cheers - Aaron Morton Freelance Cassa

Re: Read-repair working, repair not working?

2013-02-10 Thread aaron morton
successfully", getName())); Or this on failure logger.error(String.format("[repair #%s] session completed with the following error", getName()), exception); Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com

Re: Issues with writing data to Cassandra column family using a Hive script

2013-02-10 Thread aaron morton
Don't use the variable length Cassandra integer, use the Int32Type. It also sounds like you want to use a DoubleType rather than FloatType. http://www.datastax.com/docs/datastax_enterprise2.2/solutions/about_hive#hive-to-cassandra-table-mapping Cheers - Aaron M

Re: Cassandra 1.1.2 -> 1.1.8 upgrade

2013-02-10 Thread aaron morton
I would do #1. You can play with nodetool setcompactionthroughput to speed things up, but beware nothing comes for free. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 10/02/2013, at 6:40 AM, Mike wrote: > Th

Re: Cassandra flush spin?

2013-02-10 Thread aaron morton
check the JVM and yaml settings are as expected. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 10/02/2013, at 6:29 AM, Mike wrote: > Hello, > > We just hit a very odd issue in our Cassandra cluster. We ar

Re: persisted ring state

2013-02-10 Thread aaron morton
rue is only limited to changes to > seed/listen_address ? it's used when a node somehow as a bad view of the ring, and you want it to forget things. Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 10/02/2013, at

Re: High CPU usage during repair

2013-02-11 Thread aaron morton
ion or repair try reducing the throughput. I would attribute most of the problems you have described to using m1.large. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 11/02/2013, at 9:16 AM, Tamar Fraenkel wrote:

Re: CQL 3 compound row key error

2013-02-11 Thread aaron morton
That sounds like a bug, or something that is still under work. Sylvain has his finger on all things CQL. Can you raise a ticket on https://issues.apache.org/jira/browse/CASSANDRA Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http

Re: Read-repair working, repair not working?

2013-02-11 Thread aaron morton
en 5 data centres, >>> I’ve had some intermittent issues with a new data centre (3 nodes, RF=2) I Do all DC's have the same number of nodes ? Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 11/02/2013, at 9:13 PM

Re: Cassandra 1.1.2 -> 1.1.8 upgrade

2013-02-11 Thread aaron morton
crazy. I then upgrade all the nodes and run through the upgrade table. You can stagger upgrade table to be every RF'th node in the cluster to reduce the impact. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 11/02

Re: unbalanced ring

2013-02-11 Thread aaron morton
each node the initial_token yaml setting is commented out, and that num_tokens is set to 256. If you can reproduce this fault with a clean setup please raise a ticket at https://issues.apache.org/jira/browse/CASSANDRA Cheers - Aaron Morton Freelance Cassandra Developer New

Re: Cassandra jmx stats ReadCount

2013-02-11 Thread aaron morton
Are you using counters? They require a read before write. Also secondary index CF's require a read before write. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 8/02/2013, at 1:26 PM, Daning Wang wrote: >

Re: Why CQL returns data in byte format, while Hive de-serialize and return the data in readable format

2013-02-11 Thread aaron morton
I suggest trying Int32Type and Double http://www.datastax.com/docs/datastax_enterprise2.1/analytics/about_hive#mapping-hive-external-tables-to-cassandra-column-families Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On

Re: Directory structure after upgrading 1.0.8 to 1.2.1

2013-02-11 Thread aaron morton
I think it's a little more subtle that that https://issues.apache.org/jira/browse/CASSANDRA-5242 Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 8/02/2013, at 10:21 PM, "Desimpel, Ignace" wrote: &

Re: Healthy JVM GC

2013-02-12 Thread aaron morton
t is different to the CMS occupancy setting. If you have a lot of rows, 100's of millions, consider reducing the bloom filter false positive ratio. Or just upgrade to 1.2 which uses less JVM memory. Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand

Re: Bootstrapping a new node to a virtual node cluster

2013-02-12 Thread aaron morton
Just checking if this sorted it's self out? Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 10/02/2013, at 1:15 AM, Jouni Hartikainen wrote: > Hello all, > > I have a cluster of three nodes running

Re: Deleting old items

2013-02-12 Thread aaron morton
der reducing the min_compaction_level_threshold on the CF to 2 Cheers --------- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 12/02/2013, at 4:21 AM, Alain RODRIGUEZ wrote: > Hi, > > I would like to know if there is a way

Re: RuntimeException during leveled compaction

2013-02-12 Thread aaron morton
n the logs. Cheers --------- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 12/02/2013, at 6:13 AM, Andre Sprenger wrote: > Hi, > > I'm running a 6 node Cassandra 1.1.5 cluster on EC2. We have switched to > lev

Re: Cassandra becnhmark

2013-02-12 Thread aaron morton
> I see the same keys in both nodes. Replication is not enabled. Why do you say that ? Check the schema for Keyspace1 using the cassandra-cli. Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 12/02/2013, at 9

Re: what addresses to use in EC2 cluster (whenever an instance restarts it gets a new private ip)?

2013-02-12 Thread aaron morton
Cassandra handles nodes changing IP. The import thing to Cassandra is the token, not the IP. In your case did the replacement node have the same token as the failed one? You can normally work around these issues using commands like nodetool removetoken. Cheers - Aaron

Re: Cassandra 1.1.2 -> 1.1.8 upgrade

2013-02-12 Thread aaron morton
You have linked to the 1.2 news file, which branched from 1.1 at some point. Look at the news file in the distribution you are installing or here https://github.com/apache/cassandra/blob/cassandra-1.1/NEWS.txt Cheers - Aaron Morton Freelance Cassandra Developer New Zealand

Re: Cassandra 1.1.2 -> 1.1.8 upgrade

2013-02-12 Thread aaron morton
> Can anyone know the impact of not running upgrade sstables? Or possible not > running it for several days? nodetool repair will not work. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 12/02/2013, at 11

Re: Upgrade to Cassandra 1.2

2013-02-12 Thread aaron morton
things are stable. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 12/02/2013, at 2:55 PM, Daning Wang wrote: > Thanks Aaron. > > I tried to migrate existing cluster(ver 1.1.0) to 1.2.1 but failed. > &g

Re: Cassandra 1.2.1 key cache error

2013-02-12 Thread aaron morton
This looks like a bug in 1.2 beta https://issues.apache.org/jira/browse/CASSANDRA-4553 Can you confirm you are running 1.2.1 and if you can re-create this with a clean install please create a ticket on https://issues.apache.org/jira/browse/CASSANDRA Thanks - Aaron Morton

Re: Upgrade to Cassandra 1.2

2013-02-12 Thread aaron morton
Restore the settings for num_tokens and intial_token to what they were before you upgraded. They should not be changed just because you are upgrading to 1.2, they are used to enable virtual nodes. Which are not necessary to run 1.2. Cheers - Aaron Morton Freelance Cassandra

Re: RuntimeException during leveled compaction

2013-02-16 Thread aaron morton
compactions are not running they should start again. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 13/02/2013, at 8:11 PM, Andre Sprenger wrote: > > Aaron, > > thanks for your help. > > I ran &#

Re: Deleting old items

2013-02-16 Thread aaron morton
e may be some confusion about the location of the settings in CLI vs CQL. Can you point to the docs. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 13/02/2013, at 10:14 PM, Alain RODRIGUEZ wrote: > Hi Aaron, on

Re: Deleting old items during compaction (WAS: Deleting old items)

2013-02-17 Thread aaron morton
That's what the TTL does. Manually delete all the older data now, then start using TTL. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 13/02/2013, at 11:08 PM, Ilya Grebnov wrote: > Hi, > >

Re: Mutation dropped

2013-02-17 Thread aaron morton
heers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 15/02/2013, at 9:42 AM, Kanwar Sangha wrote: > Hi – Is there a parameter which can be tuned to prevent the mutations from > being dropped ? Is this logic correct ? > > Node A and B

Re: [nodetool] repair with vNodes

2013-02-17 Thread aaron morton
command has been running for almost 24hours and I can’t see > any activity from the logs or JMX. Grep for "session completed" Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 15/02/2013, at 11:38 PM, H

Re: Question on Cassandra Snapshot

2013-02-17 Thread aaron morton
ily/snapshots/-ColumnFamily/ > what are these directories? Probably automatic snapshot from dropping KS or CF's Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 16/02/2013, at 4:41 AM, S C wrote: > I

Re: odd production issue today 1.1.4

2013-02-17 Thread aaron morton
There is always this old chestnut http://wiki.apache.org/cassandra/FAQ#ubuntu_hangs A - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 16/02/2013, at 8:22 AM, Edward Capriolo wrote: > With hyper threading a core can show

Re: cassandra vs. mongodb quick question

2013-02-17 Thread aaron morton
replace a node, the memory considerations for 100's of millions of rows. If you the performance of those operations is acceptable to you, then go crazy. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 16/02/2013,

Re: can we pull rows out compressed from cassandra(lots of rows)?

2013-02-17 Thread aaron morton
- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 16/02/2013, at 9:35 AM, "Hiller, Dean" wrote: > > Thanks, > Dean

Re: Deleting old items

2013-02-17 Thread aaron morton
I'll email the docs people. I believe they are saying "use compaction throttling rather than this" not "this does nothing" Although I used this in the last month on a machine with very little ram to limit compaction memory use. Cheers - Aaron M

Re: Is there any consolidated literature about Read/Write and Data Consistency in Cassandra ?

2013-02-17 Thread aaron morton
If you want the underlying ideas try the Dynamo paper, the Big Table paper and the original Cassandra paper from facebook. Start here http://www.allthingsdistributed.com/2007/10/amazons_dynamo.html Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton

Re: nodetool repair with vnodes

2013-02-17 Thread aaron morton
ges with "session completed" in the log from the AntiEntropyService Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 18/02/2013, at 12:51 AM, Marco Matarazzo wrote: > Greetings. > > I'm trying to run &quo

Re: Deleting old items during compaction (WAS: Deleting old items)

2013-02-18 Thread aaron morton
e to purge from disk, depending on the workload. Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 18/02/2013, at 10:43 AM, Ilya Grebnov wrote: > According to https://issues.apache.org/jira/browse/CASSANDRA-210

Re: nodetool repair with vnodes

2013-02-18 Thread aaron morton
ir with -pr on one of nodes not already repaired. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 18/02/2013, at 11:12 AM, Marco Matarazzo wrote: >>> So, to me, it's like the "nodetool repair" co

Re: Cassandra on Red Hat 6.3

2013-02-18 Thread aaron morton
Nothing jumps out. Check /var/log/cassandra/output.log , that's where stdout and std err are directed. Check file permissions. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 18/02/2013, at 9:08 PM, a

Re: NPE in running "ClientOnlyExample"

2013-02-18 Thread aaron morton
An you can never go wrong relying on the documentation for the python pycassa library, it has some handy tutorials for getting started. http://pycassa.github.com/pycassa/ cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com

Re: cassandra vs. mongodb quick question

2013-02-18 Thread aaron morton
number of cases where people had 1 TB on a single node and they were surprised it took days to repair or replace. If you know how long things may take, and that fits in your operations then go with it. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton

Re: Firewall logging to Cassandra

2013-02-18 Thread aaron morton
You may be interested in something like this for connecting to flume https://github.com/thobbs/flume-cassandra-plugin There is probably something similar for kafka out there. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http

Re: Hanging after OutOfMemory exception

2013-02-19 Thread aaron morton
Nice. Can you please raise a ticket at https://issues.apache.org/jira/browse/CASSANDRA an include the version you were using. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 19/02/2013, at 1:44 AM, "Des

Re: Mutation dropped

2013-02-19 Thread aaron morton
quest complete. Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 19/02/2013, at 1:48 AM, Kanwar Sangha wrote: > Thanks Aaron. > > Does the rpc_timeout not control the client timeout ? Is there any param >

Re: Cassandra backup

2013-02-20 Thread aaron morton
You'll need to use two CF's to achieve that. Denormalising to support a workload like that is not a terrible idea. Depending on how big the 7 days hot set is you may get benefit from using a large row cache with one CF. Maybe worth doing some testing. CHeers ----- Aa

Re: Testing compaction strategies on a single production server?

2013-02-20 Thread aaron morton
kind. While it may be more work I personally would use one node in write survey to test LCS Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 20/02/2013, at 6:28 AM, Henrik Schröder wrote: > Well, that answer did

Re: Cassandra network latency & tuning

2013-02-21 Thread aaron morton
eup. Hope that helps. ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 20/02/2013, at 1:44 PM, Brandon Walsh wrote: > I have a 5 node cluster and currently running ver 1.2. Prior to full scale > deployment, I'm ru

Re: How to limit query results like "from row 50 to 100"

2013-02-21 Thread aaron morton
CQL does not support offset but does have limit. See http://www.datastax.com/docs/1.2/cql_cli/cql/SELECT#specifying-rows-returned-using-limit Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 20/02/2013, at 1:47 PM

Re: "Heap is N.N full." Immediately on startup

2013-02-21 Thread aaron morton
My first guess would be the bloom filter and index sampling from lots-o-rows Check the row count in cfstats Check the bloom filter size in cfstats. Background on memory requirements http://www.mail-archive.com/user@cassandra.apache.org/msg25762.html Cheers - Aaron Morton

Re: SSTable Num

2013-02-21 Thread aaron morton
ll the sstable compaction continue and eventually we will have 1 file ? No. The default size tiered strategy compacts files what are roughly the same size, and only when there are more than 4 (default) of them. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaron

Re: how to debug slowdowns from these log snippets-more info 2

2013-02-21 Thread aaron morton
ature tenuring cause issues with wide rows / long reads. Hope that helps. - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 21/02/2013, at 4:35 AM, "Hiller, Dean" wrote: > Oh, and my startup command that cassandra

Re: Mutation dropped

2013-02-21 Thread aaron morton
o get a better idea of how long a request takes in your system. Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 21/02/2013, at 6:56 AM, Wei Zhu wrote: > What does rpc_timeout control? Only the reads/writes? How

Re: Data Model - Additional Column Families or one CF?

2013-02-21 Thread aaron morton
y having different CF's allows you to use different cache settings, compactions settings and even storage mediums. Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 21/02/2013, at 7:43 AM, Adam Venturella wrote: &g

Re: very confused by jmap dump of cassandra

2013-02-21 Thread aaron morton
answer. Cheers --------- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 21/02/2013, at 7:49 AM, "Hiller, Dean" wrote: > I took this jmap dump of cassandra(in production). Before I restarted the > whole production cluster, I had some

Re: Adding new nodes in a cluster with virtual nodes

2013-02-21 Thread aaron morton
?) Potentially yes. The simple thing would be to wait until a full repair cycle (on all nodes) to complete. Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 22/02/2013, at 3:44 AM, Jean-Armel Luce wrote: > Hel

Re: cassandra vs. mongodb quick question(good additional info)

2013-02-21 Thread aaron morton
If you are lazy like me wolfram alpha can help http://www.wolframalpha.com/input/?i=transfer+42TB+at+10GbE&a=UnitClash_*TB.*Tebibytes-- 10 hours 15 minutes 43.59 seconds Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle

<    1   2   3   4   5   6   7   8   9   10   >