Re: Does Memtable resides in Heap?

How about the bloom filter and index samples, are they part of off-heap? Starting from C* 1.2 bloom filters are stored off-heap. Index samples are stored on heap. M.

Configuring 2 node Cassandra cluster

Hello Guys, I am trying to setup a 2 node Cassandra clustesr. My parameters are: *Node1(ip1):* initial_token: 0 rpc_address: ip1 listen_address: ip1 seeds: “ip1 *Node2(ip2):* initial_token: 85070591730234615865843651857942052864 rpc_address: ip1 listen_address: ip1 seeds: “ip1 and in Node2

Re: Configuring 2 node Cassandra cluster

Could we have the logs after starting each node ? 2013/4/16 Sai Kumar Ganji saikumarganj...@gmail.com Hello Guys, I am trying to setup a 2 node Cassandra clustesr. My parameters are: *Node1(ip1):* initial_token: 0 rpc_address: ip1 listen_address: ip1 seeds: “ip1 *Node2(ip2):*

Re: Reduce Cassandra GC

How do you calculate the heap / data size ratio? Is this a linear ratio? Each node has slightly more than 12 GB right now though. 2013/4/16 Viktor Jevdokimov viktor.jevdoki...@adform.com For a 40GB of data 1GB of heap is too low. ** ** Best regards / Pagarbiai *Viktor Jevdokimov*

MySQL Cluster performing faster than Cassandra cluster on single table

Hi, I was wondering if anybody here had any insight into this. I was running some tests on cassandra and mysql performance, with a two node and three node cassandra cluster, and a five node mysql cluster (mgmt, 2 x api, 2 x data). On the cassandra 2 node cluster vs mysql cluster, I was

Re: MySQL Cluster performing faster than Cassandra cluster on single table

Hi Hannah, mysql-cluster is a in-memory database. In-memory is fast. But I dont think you ever be able to store hundreds of Gigabytes of data on a node, which is something you can do with Cassandra. If your dataset is small, then maybe NDB is the better choice for you. I myself will not even

Re: Lost data after expanding cluster c* 1.2.3-1

Thanks aaron, I feel that rebuilding indexes went well, but the result of my query (SELECT * FROM userdata WHERE login='kais';) is still emty. INFO [Creating index: userdata.userdata_login_idx] 2013-03-30 01:16:33,110 SecondaryIndex.java (line 175) Submitting index build of

Re: Does Memtable resides in Heap?

Thanks Edward.! On Fri, Apr 12, 2013 at 9:46 AM, Edward Capriolo edlinuxg...@gmail.comwrote: This issue describes the design of the arena allocation of memtabes. https://issues.apache.org/jira/browse/CASSANDRA-2252 On Fri, Apr 12, 2013 at 1:35 AM, Viktor Jevdokimov

Re: Configuring 2 node Cassandra cluster

*Node2(ip2):* initial_token: 85070591730234615865843651857942052864 rpc_address: ip*1* Should be *ip2* listen_address: ip*1* Should be *ip2* seeds: “ip1 On Tue, Apr 16, 2013 at 5:43 PM, Alain RODRIGUEZ arodr...@gmail.com wrote: Could we have the logs after starting each

Re: Configuring 2 node Cassandra cluster

If you are using a two node cassandra cluster locally use ccm, it builds all the configuration files for you. https://github.com/pcmanus/ccm On Tue, Apr 16, 2013 at 11:06 AM, Alicia Leong lccali...@gmail.com wrote: *Node2(ip2):* initial_token: 85070591730234615865843651857942052864

Re: MySQL Cluster performing faster than Cassandra cluster on single table

Ah, I see, that makes sense. Have you got a source for the storing of hundreds of gigabytes? And does Cassandra not store anything in memory? Yeah, my dataset is small at the moment - perhaps I should have chosen something larger for the work I'm doing (University dissertation), however, it is

Re: MySQL Cluster performing faster than Cassandra cluster on single table

Yeah, I remember reading about that, but the schema had already been set and submitted. I will have to take that into consideration when discussing the results. Thanks, Hannah On 16 Apr 2013, at 17:42, Robert Coli rc...@eventbrite.com wrote: On Tue, Apr 16, 2013 at 3:56 AM, jrdn hannah

Re: MySQL Cluster performing faster than Cassandra cluster on single table

On Tue, Apr 16, 2013 at 3:56 AM, jrdn hannah j...@jrdnhannah.co.uk wrote: For example, on updating a single table in MySQL, with the equivalent super column in Cassandra, I was getting results of 0.231 ms for MySQL and 1.248ms for Cassandra to perform the update 1000 times. You probably do

Re: MySQL Cluster performing faster than Cassandra cluster on single table

Ah, I see, that makes sense. Have you got a source for the storing of hundreds of gigabytes? And does Cassandra not store anything in memory? It stores bloom filters and index-samples in memory. But they are much smaller than the actual data and they can be configured. Yeah, my dataset is

RE: Reduce Cassandra GC

How one could provide any help without any knowledge about your cluster, node and environment settings? 40GB was calculated from 2 nodes with RF=2 (each has 100% data range), 2.4-2.5M rows * 6 cols * 3kB as a minimum without compression and any overhead (sstable, bloom filters and indexes).

Re: Any experience of 20 node mini-itx cassandra cluster

I already have thanks. I'll do the tests with the hardware arrives. Thanks Jabbar Azam On 16 April 2013 22:27, aaron morton aa...@thelastpickle.com wrote: Can't we use LCS? Do some reading and some tests… http://www.datastax.com/dev/blog/leveled-compaction-in-apache-cassandra

Re: Extracting data from SSTable files with MapReduce

I did try to upgrade to 1.2 but it did not work out. Maybe to many versions in between. Newer versions should be able to read older file formats. What was the error? Why would later formats make this easier you think? it will be easier to write against the current code base and you find it

Re: StatusLogger format?

99% sure it's in bytes. +1 to your confidence level. Cheers - Aaron Morton Freelance Cassandra Consultant New Zealand @aaronmorton http://www.thelastpickle.com On 16/04/2013, at 6:14 AM, William Oberman ober...@civicscience.com wrote: 99% sure it's in bytes. On Mon,

Re: Thrift message length exceeded

Can you confirm the you are using the same thrift version that ships 1.2.3 ? Cheers - Aaron Morton Freelance Cassandra Consultant New Zealand @aaronmorton http://www.thelastpickle.com On 16/04/2013, at 10:17 AM, Lanny Ripple la...@spotright.com wrote: A bump to say I found

Re: C* consumes all RAM

You are probably seeing this http://wiki.apache.org/cassandra/FAQ#mmap Cheers - Aaron Morton Freelance Cassandra Consultant New Zealand @aaronmorton http://www.thelastpickle.com On 16/04/2013, at 8:43 PM, Mikhail Mazursky ash...@gmail.com wrote: More details: USER

Re: Lost data after expanding cluster c* 1.2.3-1

Sorry can you repost the details of that issue including the CL you are using. Aaron - Aaron Morton Freelance Cassandra Consultant New Zealand @aaronmorton http://www.thelastpickle.com On 17/04/2013, at 12:57 AM, Kais Ahmed k...@neteck-fr.com wrote: Thanks aaron, I feel

Re: Does Memtable resides in Heap?

Compression Meta data is also off heap http://www.datastax.com/dev/blog/performance-improvements-in-cassandra-1-2 Cheers - Aaron Morton Freelance Cassandra Consultant New Zealand @aaronmorton http://www.thelastpickle.com On 17/04/2013, at 3:02 AM, Jay Svc jaytechg...@gmail.com

Repair Freeze / Gossip Invisibility / EC2 Public IP configuration

TL;DR; An EC2 Multi-Region Setup's Repair/Gossip Works with 1.1.10 but with 1.2.4, gossip does not see the nodes after restarting all nodes at once, and repair gets stuck. This is a working configuration: Cassandra 1.1.10 Cluster with 12 nodes in us-east-1 and 12 nodes in us-west-2 Using

Re: Repair Freeze / Gossip Invisibility / EC2 Public IP configuration

So cassandra does inter node compression. I have not checked but this might be accidentally getting turned on by default. Because the storage port is typically 7000. Not sure why you are allowing 7100. In any case try allowing 7000 or with internode compression off. On Tue, Apr 16, 2013 at 6:42

Re: unexplained hinted handoff

On Sun, Apr 14, 2013 at 11:28 AM, aaron morton aa...@thelastpickle.com wrote: If hints are being stored, doesn't that imply DOWN nodes, and why don't I see that in the logs? Hints are stored for two reasons. First if the node is down when the write request starts, second if the node does not

How to stop Cassandra and then restart it in windows?

Hello, I installed single node cluster in my local dev box which is running Windows 7 and it was working fine. Due to some reason, I need to restart my desktop and then after that whenever I am doing like this on the command prompt, it always gives me the below exception- S:\Apache

Cassandra Client Recommendation

Hello, I have recently started working with Cassandra Database. Now I am in the process of evaluating which Cassandra client I should go forward with. I am mainly interested in these three- --1) Astyanax client 2--) New Datastax client that uses Binary protocol. --3) Pelops

Re: MySQL Cluster performing faster than Cassandra cluster on single table

MySQL cluster also has the index in ram. So with lots of rows the ram becomes a limiting factor. That's what my colleague found and hence why were sticking with Cassandra. On 16 Apr 2013 21:05, horschi hors...@gmail.com wrote: Ah, I see, that makes sense. Have you got a source for the

Re: C* consumes all RAM

Thank you, Aaron. p.s. we're on 1.1.9 - i forgot to mention that. 2013/4/17 aaron morton aa...@thelastpickle.com You are probably seeing this http://wiki.apache.org/cassandra/FAQ#mmap Cheers - Aaron Morton Freelance Cassandra Consultant New Zealand @aaronmorton

Commit Log question

I'm looking into a case where it appears that recycling a commit log segment and flushing the dirty CF's results in 46 CF's being flushed. Out of 47 in the keyspace. All this flush activity blocks writes. Before I dig further I wanted to confirm my understanding. At 10:46 the MeteredFlusher

Re: Added extra column as composite key while creation counter column family

cassandra 1.2.0 Is it a bug in 1.2.0 ? Thanks KK On Wed, Apr 17, 2013 at 2:56 AM, aaron morton aa...@thelastpickle.comwrote: What version are you using ? WIth 1.2.4 … cqlsh:dev CREATE TABLE counters ( ... key text, ... value counter, ... PRIMARY KEY (key)