Re: Invalid Counter Shard errors?

2012-09-03 Thread Alain RODRIGUEZ
Hello, I'm running a 1.1.2 Cassandra 2 nodes wide cluster with RF=2 (CL = 1, nodes are m1.large from Amazon). I had this error 524 times last month on the node 1 and 2805 time on the second node. Should I worry about it ? How can I fix these errors ? Alain 2012/6/2 Peter Schuller

Re: Invalid Counter Shard errors?

2012-09-06 Thread Alain RODRIGUEZ
Hi nobody knows about this ? Alain 2012/9/3 Alain RODRIGUEZ arodr...@gmail.com Hello, I'm running a 1.1.2 Cassandra 2 nodes wide cluster with RF=2 (CL = 1, nodes are m1.large from Amazon). I had this error 524 times last month on the node 1 and 2805 time on the second node. Should I

Re: Invalid Counter Shard errors?

2012-09-07 Thread Alain RODRIGUEZ
This problem is not new to 1.1 That's what I understood from your last comment. Is there a way to fix this error ? What is its impact on my data ? Alain 2012/9/7 Peter Schuller peter.schul...@infidyne.com This problem is not new to 1.1. On Sep 6, 2012 5:51 AM, Radim Kolar h...@filez.com

Re: are counters stable enough for production?

2012-09-18 Thread Alain RODRIGUEZ
Hi @Robin, about the log message: Sometimes you can see log messages that indicate that counters are out of sync in the cluster and they get repaired. My guess would be that the repairs actually destroys it, however I have no knowledge of the underlying techniques. Here you got an answer form

Re: Invalid Counter Shard errors?

2012-09-18 Thread Alain RODRIGUEZ
I would like to understand or do my best helping you to understand this issue. I got the following (shortened) logs: (03a227f0-a5c3-11e1--b7f5e49dceff, 3, 3) and (03a227f0-a5c3-11e1--b7f5e49dceff, 3, 0) (03a227f0-a5c3-11e1--b7f5e49dceff, 6, 6) and

Re: Invalid Counter Shard errors?

2012-09-20 Thread Alain RODRIGUEZ
I think that's inconsistent with the hypothesis that unclean shutdown is the sole cause of these problems I agree, we just never shut down any node, neither had any crash, and yet we have these bugs. About your side note : We know about it, but we couldn't find any other way to be able to

Re: Invalid Counter Shard errors?

2012-09-20 Thread Alain RODRIGUEZ
--b7f5e49dceff, 19, -3) and (03a227f0-a5c3-11e1--b7f5e49dceff, 19, 19) The counts on the left parentheses are negative values and we never decrements counters. Thanks for your explanations. Alain 2012/9/20 Alain RODRIGUEZ arodr...@gmail.com I think that's inconsistent with the hypothesis

Re: unbalanced ring

2012-10-10 Thread Alain RODRIGUEZ
Hi, Same thing here: 2 nodes, RF = 2. RCL = 1, WCL = 1. Like Tamar I never ran a major compaction and repair once a week each node. 10.59.21.241eu-west 1b Up Normal 133.02 GB 50.00% 0 10.58.83.109eu-west 1b Up Normal 98.12 GB 50.00%

Re: unbalanced ring

2012-10-11 Thread Alain RODRIGUEZ
. cassandra does not auto-delete data that it doesn't use anymore just in case you want to move the tokens again or otherwise undo. try nodetool cleanup On Wed, Oct 10, 2012 at 2:01 AM, Alain RODRIGUEZ arodr...@gmail.comwrote: Hi, Same thing here: 2 nodes, RF = 2. RCL = 1, WCL = 1

Re: Why my Cassandra is compacting like mad

2012-10-15 Thread Alain RODRIGUEZ
Well I guess we will need some information to help you... At least: -Hardware ? -Version of Cassandra ? -Any specific action before restarting ? -cassandra.yaml (options about compaction) ? -... Alain 2012/10/15 Manu Zhang owenzhang1...@gmail.com My Cassandra is compacting like mad (look at

Re: Cassandra nodes loaded unequally

2012-10-17 Thread Alain RODRIGUEZ
I've got the same problem, and other people in the mailing list are reporting the same issue. I don't know what is happening here. RF 2, 2 nodes : 10.59.21.241eu-west 1b Up Normal 137.53 GB 50.00% 0 10.58.83.109eu-west 1b Up Normal 102.46

Re: run repair on each node or every R nodes?

2012-10-17 Thread Alain RODRIGUEZ
I see. So if I don't use the '-pr' option, triggering repair on node-00 is sufficient to repair the first 3 nodes. No need to cron a repair on node-{01,02}. correct? forget it. this was nonsense. In my mind it does make sense, and what you're saying is correct. But I read that it was better to

Re: potential data loss in Cassandra 1.1.0 .. 1.1.4

2012-10-18 Thread Alain RODRIGUEZ
Hi Jonathan. We are currently running the datastax AMI on amazon. Cassandra is in version 1.1.2. I guess that the datastax repo (deb http://debian.datastax.com/communitystable main) will be updated directly in 1.1.6 ? Replaying already-flushed data a second time is harmless -- except for

Re: compression

2012-10-29 Thread Alain RODRIGUEZ
I have no clue. I never did it even if I am planning to do so. 1 - Did you just spent 1 month with a cluster in an unstable state ? Had you any issue during this time related to the transitional state of your cluster ? I am currently storing counters with: row = objectId, column name =

Re: Multiple counters value after restart

2012-10-31 Thread Alain RODRIGUEZ
http://www.thelastpickle.com On 31/10/2012, at 3:39 AM, Jason Wee peich...@gmail.com wrote: maybe enable the debug in log4j-server.properties and going through the log to see what actually happen? On Tue, Oct 30, 2012 at 7:31 PM, Alain RODRIGUEZ arodr...@gmail.comwrote: Hi, I have an issue

Re: Multiple counters value after restart

2012-11-01 Thread Alain RODRIGUEZ
guess it don't drain before... I was asking to understand how you did the upgrade. Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 1/11/2012, at 11:39 AM, Alain RODRIGUEZ arodr...@gmail.com wrote: What version of cassandra

Re: Multiple counters value after restart

2012-11-02 Thread Alain RODRIGUEZ
, get a value that none of other existing node has ? Is there a way to fix the data (isn't repair supposed to do it) ? Alain 2012/11/1 Alain RODRIGUEZ arodr...@gmail.com Can you try it thought, or run a repair ? Repairing didn't help My first thought is to use QUOURM This fix the problem

Re: Questions around the heap

2012-11-07 Thread Alain RODRIGUEZ
-bloomfilters On Nov 7, 2012, at 4:56 AM, Alain RODRIGUEZ wrote: Hi, We just had some issue in production that we finally solve upgrading hardware and increasing the heap. Now we have 3 xLarge servers from AWS (15G RAM, 4 cpu - 8 cores). We add them and then removed the old ones

Re: Compact and Repair

2012-11-08 Thread Alain RODRIGUEZ
Did you change the RF or had a node down since you repaired last time ? 2012/11/8 Henrik Schröder skro...@gmail.com No, we're not using columns with TTL, and I performed a major compaction before the repair, so there shouldn't be vast amounts of tombstones moving around. And the increase

Re: How to search User (Entity) columns without sec. index?

2012-11-09 Thread Alain RODRIGUEZ
I think there is just a few solutions. - Secondary index on username - CF used as an index (store username as row and all the uuid of users with this username as columns) - Get all the data and filter after (really poor performances depending on the size of the data set) I can't see an other way

Re: Remove crashed node

2012-11-09 Thread Alain RODRIGUEZ
On cassandra-cli if you describe cluster; I guess you will see an UNREACHABLE node. If you do so, there is a way to remove this unreachable node. Go to the JMX management console (ip_of_one_up_node:8081 by default) Then go to the org.apache.cassandra.net:type=Gossiper link and use the

Re: Remove crashed node

2012-11-09 Thread Alain RODRIGUEZ
this message and any copies. On Fri, Nov 9, 2012 at 2:50 PM, Alain RODRIGUEZ arodr...@gmail.comwrote: On cassandra-cli if you describe cluster; I guess you will see an UNREACHABLE node. If you do so, there is a way to remove this unreachable node. Go to the JMX management console

Re: Indexing Data in Cassandra with Elastic Search

2012-11-09 Thread Alain RODRIGUEZ
Thanks for sharing this. We are also using Cassandra + Storm + Queue messaging (Kestrel for now) and are always glad to learn. Alain 2012/11/9 Brian O'Neill b...@alumni.brown.edu For those looking to index data in Cassandra with Elastic Search, here is what we decided to do:

Re: leveled compaction and tombstoned data

2012-11-10 Thread Alain RODRIGUEZ
@Rob Coli Does the sstablesplit function exists somewhere ? 2012/11/10 Jim Cistaro jcist...@netflix.com For some of our clusters, we have taken the periodic major compaction route. There are a few things to consider: 1) Once you start major compacting, depending on data size, you may be

Re: Questions around the heap

2012-11-12 Thread Alain RODRIGUEZ
It's been Does anybody has an answer to any of these questions ? Alain 2012/11/7 Hiller, Dean dean.hil...@nrel.gov +1, I am interested in this answer as well. From: Alain RODRIGUEZ arodr...@gmail.commailto:arodr...@gmail.com Reply-To: user@cassandra.apache.orgmailto:user

Re: Enable compression Cassandra 1.1.2

2012-11-14 Thread Alain RODRIGUEZ
- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 14/11/2012, at 11:39 PM, Alain RODRIGUEZ arodr...@gmail.com wrote: Hi, I am running C* 1.1.2 and there is no way to turn the compression on for a CF. Here is the command I

Re: Enable compression Cassandra 1.1.2

2012-11-15 Thread Alain RODRIGUEZ
We just upgrade to C* 1.1.6 We can now change anything using the CLI or cqlsh. So problem solved. 2012/11/14 Alain RODRIGUEZ arodr...@gmail.com Oh! That's obviously the exact same issue. I didn't find this thread while searching about my issue. We will upgrade. Thanks for the link

Re: Upgrade 1.1.2 - 1.1.6

2012-11-15 Thread Alain RODRIGUEZ
New Zealand @aaronmorton http://www.thelastpickle.com On 16/11/2012, at 3:21 AM, Alain RODRIGUEZ arodr...@gmail.com wrote: We had an issue with counters over-counting even using the nodetool drain command before upgrading... Here is my bash history 69 cp /etc/cassandra/cassandra.yaml

Re: Upgrade 1.1.2 - 1.1.6

2012-11-19 Thread Alain RODRIGUEZ
This looks like the counters were more out of sync before the upgrade than after? My guess is the update makes some counters over-count since I saw the value of the sum of our daily counter increase by 2000 after each restart at the exact moment that the node is marked as being up. This counter

Re: Remove crashed node

2012-11-19 Thread Alain RODRIGUEZ
, disclose, distribute, copy, print or rely on this e-mail. If you have received this message in error, please contact the sender immediately and irrevocably delete this message and any copies. On Fri, Nov 9, 2012 at 4:21 PM, Alain RODRIGUEZ arodr...@gmail.comwrote: You have to install mx4j

Re: Invalid argument

2012-11-20 Thread Alain RODRIGUEZ
://www.thelastpickle.com On 20/11/2012, at 6:27 AM, Alain RODRIGUEZ arodr...@gmail.com wrote: I have backed up production sstables from one of my 3 production nodes (RF=3) and I want to use them on my dev environment.(C* 1.1.6 on both environments) My dev server is a 4 core, 4 GB RAM hardware runing on ubuntu

Re: Upgrade 1.1.2 - 1.1.6

2012-11-20 Thread Alain RODRIGUEZ
if it was already stopped before the install. However annoying, I have found this to be the default for most Ubuntu daemon packages. Mike On Thu, Nov 15, 2012 at 9:21 AM, Alain RODRIGUEZ arodr...@gmail.comwrote: We had an issue with counters over-counting even using the nodetool drain command before

Re: Looking for a good Ruby client

2012-11-20 Thread Alain RODRIGUEZ
@Mat Well I guess you could add your Ruby client to this list since there is not a lot of them yet. http://wiki.apache.org/cassandra/ClientOptions Alain 2012/11/20 Mat Brown m...@brewster.com As the author of Cequel, I can assure you it is excellent ; ) We use it in production at Brewster

Re: Invalid argument

2012-11-21 Thread Alain RODRIGUEZ
INFO 12:10:09,233 JNA mlockall successful So I guess I do. 2012/11/21 Rob Coli rc...@palominodb.com On Tue, Nov 20, 2012 at 2:03 AM, Alain RODRIGUEZ arodr...@gmail.com wrote: ] Thanks for the work around, setting disk_access_mode: standard worked. Do you have working JNA, for reference

Re: Invalid argument

2012-11-21 Thread Alain RODRIGUEZ
hmmm, it's only a work around. It's only a dev server... :). But if you want me to try some things (configurations or whatever) on it just let me know. Alain 2012/11/21 Alain RODRIGUEZ arodr...@gmail.com INFO 12:10:09,233 JNA mlockall successful So I guess I do. 2012/11/21 Rob Coli rc

Re: Freeing up disk space on Cassandra 1.1.5 with Size-Tiered compaction.

2012-11-22 Thread Alain RODRIGUEZ
Hi Alexandru, We are running a 3 node Cassandra 1.1.5 cluster with a 3TB Raid 0 disk per node for the data dir and separate disk for the commitlog, 12 cores, 24 GB RAM I think you should tune your architecture in a very different way. From what I know having too much data on one node is bad, not

Re: about take snaphots

2012-11-26 Thread Alain RODRIGUEZ
Hi Francisco, Snapshots folders are inside the CF folders for a few weeks (months ?). It is a modification that have been made in a recent version of C*. Is this the normal behavior of nodetool? Yes, it is the normal behaviour for snapshots. 2012/11/26 Francisco Trujillo Hacha

Re: Why Secondary indexes is so slowly by my test?

2012-12-13 Thread Alain RODRIGUEZ
Hi Edward, can you share the link to this blog ? Alain 2012/12/13 Edward Capriolo edlinuxg...@gmail.com Ed ENuff s

Re: High disk read throughput on only one node.

2012-12-20 Thread Alain RODRIGUEZ
19, 2012 at 2:30 PM, Alain RODRIGUEZ arodr...@gmail.comwrote: @Aaron Is there a sustained difference or did it settle back ? Sustained, clearly. During the day all nodes read at about 6MB/s while this one reads at 30-40 MB/s. At night while other reads 2MB/s the broken nodes reads at 8-10MB/s

Re: High disk read throughput on only one node.

2012-12-21 Thread Alain RODRIGUEZ
it, hopping this will fix my issue... I wait a bit more because I am hopping we will find out what is the issue and this will help the C* community. 2012/12/20 Alain RODRIGUEZ arodr...@gmail.com routing more traffic to it? So shouldn't I see more network in on that node in the AWS console

Re: Error after 1.2.0 upgrade

2013-01-03 Thread Alain RODRIGUEZ
node cluster which I am slowly massaging into a good state I haven't seen this in 15+ hours of operation… This looks related to JNA? From: Alain RODRIGUEZ arodr...@gmail.com Reply-To: user@cassandra.apache.org user@cassandra.apache.org Date: Thursday, January 3, 2013 8:42 AM To: user

Re: Error after 1.2.0 upgrade

2013-01-04 Thread Alain RODRIGUEZ
of operation… This looks related to JNA? From: Alain RODRIGUEZ arodr...@gmail.com Reply-To: user@cassandra.apache.org user@cassandra.apache.org Date: Thursday, January 3, 2013 8:42 AM To: user@cassandra.apache.org user@cassandra.apache.org Subject: Error after 1.2.0 upgrade In a dev env, C* 1.1.7

Re: property 'disk_access_mode' not found in cassandra.yaml

2013-01-04 Thread Alain RODRIGUEZ
Is the default 'auto' the best possible option so that no one has to worry about it anymore ? Yes something like that I guess. You can add the disk_access_mode property to your cassandra.yaml and set it to standard to disable memory mapped access, it will work. It's the same thing for the

Re: change cluster name retaining keypsace

2013-01-10 Thread Alain RODRIGUEZ
By the way, The cluster name is only cosmetic. It may not be worth to change it since it induce a downtime and considering the mishandling risk. Alain 2013/1/10 Michael Kjellman mkjell...@barracuda.com I think Arron meant /var/lib/cassandra (by default) Check there (unless you changed you

Re: VNodes, Replication and Minimum cluster size

2013-01-10 Thread Alain RODRIGUEZ
I am curious to know if vnodes would change that or if that statement was valid to begin with! This question was answered yesterday by Jonathan Ellis during the Datastax C*ollege Webinar: http://www.datastax.com/resources/webinars/whatsnewincassandra12 (about the end of the video). The answer is

Re: VNodes, Replication and Minimum cluster size

2013-01-10 Thread Alain RODRIGUEZ
The key advantage of vnodes in this case is that you do not need to manually rebalance the cluster when adding or removing nodes. Well, I thing that a bigger key advantage of vnodes would rather be the performance improvement due to the evenly distributed load while streaming data. But it indeed

Re: Starting Cassandra

2013-01-10 Thread Alain RODRIGUEZ
If I remember well the default minimum heap size is 1 GB. That may cause you a problem. You have to run with more RAM CPU. Maybe can you try with 2 VM with twice CPU RAM for your test. You will need at least 4 GB RAM to run in production (8GB is better) and I would say at least 2 cpu (4 would

Re: [VOTE] Release Apache Cassandra 1.1.9

2013-01-14 Thread Alain RODRIGUEZ
Shouldn't this vote be addressed to the Developers mailing list instead of the Users one ? Just in case it wasn't done on purpose and to be sure that you reach those concerned about this vote :). Alain 2013/1/14 Sylvain Lebresne sylv...@datastax.com We've fixed our fair share of bugs since

Re: Unavaliable Exception

2013-01-25 Thread Alain RODRIGUEZ
fwiw, I have a mixed ubuntu 11.10 / 12.04 6 node cluster (AWS m1.xlarge). The load average is always between 0 and 5 for 11.10 nodes while 12.04 nodes shows all the time a load between 2 and 20. I have the same configuration on each node and the average request latency is a few better on 12.04

Re: unsubscribe

2013-01-28 Thread Alain RODRIGUEZ
You can try it a third time or you can rather try writing to user-unsubscr...@cassandra.apache.org Alain 2013/1/28 Olivier Devos olde...@gmail.com unsubscribe

Re: too many warnings of Heap is full

2013-01-31 Thread Alain RODRIGUEZ
@Bryan Other space is used but can be more easily controlled by tuning for - memtable - compaction - key cache - *row cache* Isn't row cache stored off-heap since a while ? 2013/1/31 Bryan Talbot btal...@aeriagames.com On Wed, Jan 30, 2013 at 2:44 PM, Guillermo Barbero

Re: Cassandra 1.1.2 - 1.1.8 upgrade

2013-02-11 Thread Alain RODRIGUEZ
Not sure this will be useful for you but nodetool drain doesn't work properly well for a while. If you are using counters I recommend you to remove commit logs after you drained ans stopped the node, before restarting the node to avoid replaying counts.

Re: unbalanced ring

2013-02-13 Thread Alain RODRIGUEZ
Maybe people think that 1.2 = Vnodes, when Vnodes are actually not mandatory and furthermore it is advised to upgrade and then, after a while, when all is running smooth, eventually switch to vnodes... 2013/2/13 Brandon Williams dri...@gmail.com On Tue, Feb 12, 2013 at 6:13 PM, Edward Capriolo

Re: Deleting old items

2013-02-13 Thread Alain RODRIGUEZ
. If you are deleting parts of wide rows consider reducing the min_compaction_level_threshold on the CF to 2 Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 12/02/2013, at 4:21 AM, Alain RODRIGUEZ arodr

Re: Write performance expectations...

2013-02-13 Thread Alain RODRIGUEZ
Is there a particular reason for you to use EBS ? Instance Store are recommended because they improve performances by reducing the I/O throttling. An other thing you should be aware of is that replicating the data to all node reduce your performance, it is more or less like if you had only one

Re: Cluster not accepting insert while one node is down

2013-02-13 Thread Alain RODRIGUEZ
We probably need more info like the RF of your cluster and CL of your reads and writes. Maybe could you also tell us if you use vnodes or not. I heard that Astyanax was not running very smoothly on 1.2.0, but a bit better on 1.2.1. Yet, Netflix didn't release a version of Astyanax for C*1.2.

Re: Cluster not accepting insert while one node is down

2013-02-14 Thread Alain RODRIGUEZ
] describe; Keyspace: TestSpace: Replication Strategy: org.apache.cassandra.locator.NetworkTopologyStrategy Durable Writes: true Options: [datacenter1:1] As for the CL it the Astyanax default, which is 1 for both reads and writes. Traian. 2013/2/13 Alain RODRIGUEZ arodr...@gmail.com

Re: Cluster not accepting insert while one node is down

2013-02-14 Thread Alain RODRIGUEZ
was expecting. Thank you for the reply! Traian. 2013/2/14 Alain RODRIGUEZ arodr...@gmail.com Hi Traian, There is your problem. You are using RF=1, meaning that each node is responsible for its range, and nothing more. So when a node goes down, do the math, you just can't read 1/5

Re: Write performance expectations...

2013-02-14 Thread Alain RODRIGUEZ
. If you don't use EBS, how is data persistence then maintained in the event that an instance goes down for whatever reason? Ken -- *From: *Alain RODRIGUEZ arodr...@gmail.com *To: *user@cassandra.apache.org *Sent: *Thursday, February 14, 2013 8:34:06 AM

Re: Upgrade to Cassandra 1.2

2013-02-14 Thread Alain RODRIGUEZ
From: http://www.datastax.com/docs/1.2/configuration/node_configuration#num-tokens About num_tokens: If left unspecified, Cassandra uses the default value of 1 token (for legacy compatibility) and uses the initial_token. If you already have a cluster with one token per node, and wish to migrate

Re: Upgrade to Cassandra 1.2

2013-02-15 Thread Alain RODRIGUEZ
-to-vnodes Alain 2013/2/15 Daning Wang dan...@netseer.com Thanks! suppose I can upgrade to 1.2.x with 1 token by commenting out num_tokens, how can I changed to multiple tokens? could not find doc clearly stating about this. On Thu, Feb 14, 2013 at 10:54 AM, Alain RODRIGUEZ arodr...@gmail.comwrote

Re: Deleting old items

2013-02-16 Thread Alain RODRIGUEZ
- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 13/02/2013, at 10:14 PM, Alain RODRIGUEZ arodr...@gmail.com wrote: Hi Aaron, once again thanks for this answer. So is it possible to delete all the data inserted in some CF between 2

Re: Deleting old items during compaction (WAS: Deleting old items)

2013-02-18 Thread Alain RODRIGUEZ
, at 4:21 AM, Alain RODRIGUEZ arodr...@gmail.com wrote: Hi, I would like to know if there is a way to delete old/unused data easily ?* *** I know about TTL but there are 2 limitations of TTL: - AFAIK, there is no TTL on counter columns - TTL need

Re: unsubscribe

2013-02-19 Thread Alain RODRIGUEZ
Read the message you answered to, and help yourself ! Alain 2013/2/19 Anurag Gujral anurag.guj...@gmail.com Unsubscribe me please. Thanks A

Re: Size Tiered - Leveled Compaction

2013-02-25 Thread Alain RODRIGUEZ
I am confused. I thought running compact turns off the minor compactions and users are actually supposed to run upgradesstables (maybe I am on old documentation?) Well, that's not true. What happens is that compaction use sstables with an aproximate same size. So if you run a major

Re: Size Tiered - Leveled Compaction

2013-02-25 Thread Alain RODRIGUEZ
:( :( and we(my project) want minor compactions to continue. Thanks, Dean From: Alain RODRIGUEZ arodr...@gmail.commailto:arodr...@gmail.com Reply-To: user@cassandra.apache.orgmailto:user@cassandra.apache.org user@cassandra.apache.orgmailto:user@cassandra.apache.org Date: Monday, February 25

Re: NULL values

2013-02-27 Thread Alain RODRIGUEZ
Cassandra (C*) has no NULL values. C* is column schemaless, meaning you can have different columns on each row of the same ColumnFamily (CF). So if you want to check if a certain column is NULL for a row, you just check if it exist. By the way, you can store a column with a name and no value

Re: range queries

2013-02-27 Thread Alain RODRIGUEZ
What am I doing wrong here? You are probably using a RandomPartitioner (or Murmur3Partitioner) which randomize keys to avoid hot spots. Basically, you just can't use range query because 'nlxx' is stored as md5('nlxx'). You should better modify your model to use column slice,

Re: range queries

2013-02-27 Thread Alain RODRIGUEZ
Things you can find searching on the web : http://wiki.apache.org/cassandra/DataModel#Range_queries 2013/2/27 Alain RODRIGUEZ arodr...@gmail.com What am I doing wrong here? You are probably using a RandomPartitioner (or Murmur3Partitioner) which randomize keys to avoid hot spots

Re: Understanding system.log

2013-02-27 Thread Alain RODRIGUEZ
Hi Victor. AFAIK, there is nothing like that. But I am quite sure that if you don't understand a log entry someone in this mailing list will be able to help you with it. Alain 2013/2/25 Víctor Hugo Oliveira Molinar vhmoli...@gmail.com Hello everyone! I'd like to know if there is any guide

Re: nodetool compactionstats doesn't work for repair status?

2013-02-28 Thread Alain RODRIGUEZ
I read this recently: 1.1.9 (also 1.2.1) * ... * nodetool repair command now prints progress (CASSANDRA-4767) * ... Not sure how it works, I am still using the 1.1.6 version of C* but you might be interested in reading this. https://github.com/apache/cassandra/blob/trunk/CHANGES.txt

Re: CQL3 and counters

2013-03-01 Thread Alain RODRIGUEZ
DO *NOT* USE THAT!!! Crystal clear ;-). Thanks for the warning. Alain 2013/3/1 Sylvain Lebresne sylv...@datastax.com On C* 1.2.1 I see that the following query works: update counters set value=value+5 where owner_id='1' and counter_type='trash'; ...while the following one gives an

Re: Ghost nodes

2013-03-05 Thread Alain RODRIGUEZ
Any clue on this ? 2013/2/25 Alain RODRIGUEZ arodr...@gmail.com Hi, I am having issues after decommissioning 3 nodes one by one of my 1.1.6 C* cluster (RF=3): On the c.164 node, which was added a week after removing the 3 nodes, with gossipinfo I have: /a.135 RPC_ADDRESS:0.0.0.0

Re: Ghost nodes

2013-03-05 Thread Alain RODRIGUEZ
Jason Wee peich...@gmail.com try assasinate from the jmx? http://nartax.com/2012/09/assassinate-cassandra-node/ or try cassandra -Dcassandra.load_ring_state=false http://www.datastax.com/docs/1.0/references/cassandra#options On Tue, Mar 5, 2013 at 6:54 PM, Alain RODRIGUEZ arodr

Re: LCS and counters

2013-03-05 Thread Alain RODRIGUEZ
anymore. Repairs do easily trigger a few hundred compactions though, but it's not that bad. /Janne On Feb 25, 2013, at 17:10 , Alain RODRIGUEZ arodr...@gmail.com wrote: Hi I am just wondering... Wouldn't it always be worth it to use LCS on counter CF since LCS is optimized for reads

Re: Can I create a counter column family with many rows in 1.1.10?

2013-03-06 Thread Alain RODRIGUEZ
What would be the exact CQL3 syntax to create a counter CF with composite row key and not predefined column names ? Is the following supposed to work ? CREATE TABLE composite_counter ( aid text, key1 text, key2 text, key3 text, value counter,

Re: anyone see this user-cassandra thread get answered...

2013-03-06 Thread Alain RODRIGUEZ
Wow, that's quite new... Threadjack to ask how to unsubscribe, amazing. Help yourself: https://www.google.com/search?q=unsubscribe+cassandra Any of the first results should help you. Goodbye ! 2013/3/6 deepansh jain deepanshcri...@gmail.com how to unsubscribe from mailing list On Wed, Mar

Re: Size Tiered - Leveled Compaction

2013-03-08 Thread Alain RODRIGUEZ
I'm still wondering about how to chose the size of the sstable under LCS. Defaul is 5MB, people use to configure it to 10MB and now you configure it at 128MB. What are the benefits or inconveniants of a very small size (let's say 5 MB) vs big size (like 128MB) ? Alain 2013/3/8 Al Tobey

Row cache off-heap ?

2013-03-08 Thread Alain RODRIGUEZ
Hi, We have some issue having a high read throughput. I wanted to alleviate things by turning the row cache ON. I set the row cache to 200 on one node and enable caching 'ALL' on the 3 most read CF. There is the effect this operation had on my JVM:

Re: Row cache off-heap ?

2013-03-11 Thread Alain RODRIGUEZ
Any clue on this ? Row cache well configured could avoid us a lot of disk read, and IO is definitely our bottleneck... If someone could explain why the row cache has so much impact on my JVM and how to avoid it, it would be appreciated :). 2013/3/8 Alain RODRIGUEZ arodr...@gmail.com Hi, We

Re: Row cache off-heap ?

2013-03-11 Thread Alain RODRIGUEZ
I can add that I have JNA corectly loaded, from the logs: JNA mlockall successful 2013/3/11 Alain RODRIGUEZ arodr...@gmail.com Any clue on this ? Row cache well configured could avoid us a lot of disk read, and IO is definitely our bottleneck... If someone could explain why the row cache

Re: Row cache off-heap ?

2013-03-12 Thread Alain RODRIGUEZ
- Aaron Morton Freelance Cassandra Consultant New Zealand @aaronmorton http://www.thelastpickle.com On 11/03/2013, at 5:30 AM, Sávio Teles savio.te...@lupa.inf.ufg.br wrote: I have the same problem! 2013/3/11 Alain RODRIGUEZ arodr...@gmail.com I can add that I have JNA

Re: About the heap

2013-03-13 Thread Alain RODRIGUEZ
out cassandra code now to dig a little deeper into this property. Dean From: Alain RODRIGUEZ arodr...@gmail.commailto:arodr...@gmail.com Reply-To: user@cassandra.apache.orgmailto:user@cassandra.apache.org user@cassandra.apache.orgmailto:user@cassandra.apache.org Date: Wednesday, March 13, 2013

Re: About the heap

2013-03-13 Thread Alain RODRIGUEZ
. Ok, but why am I always running between 4 and 6 GB heap used, even when there is no traffic ? 2013/3/13 Alain RODRIGUEZ arodr...@gmail.com called index_interval set to 128 I think this is for BloomFilters actually. 2013/3/13 Hiller, Dean dean.hil...@nrel.gov Going to 1.2.2 helped us

Re: Row cache off-heap ?

2013-03-14 Thread Alain RODRIGUEZ
of {} MBs and provider { Cheers - Aaron Morton Freelance Cassandra Consultant New Zealand @aaronmorton http://www.thelastpickle.com On 12/03/2013, at 1:44 AM, Alain RODRIGUEZ arodr...@gmail.com wrote: I am using C*1.1.6. Did you restart the node after changing

Failed migration from 1.1.6 to 1.2.2

2013-03-14 Thread Alain RODRIGUEZ
Hi We just tried to migrate our production cluster from C* 1.1.6 to 1.2.2. This has been a disaster. I just switch one node to 1.2.2, updated its configuration (cassandra.yaml / cassandra-env.sh) and restart it. It resulted on error on all the 5 remaining 1.1.6 nodes : ERROR

Re: Failed migration from 1.1.6 to 1.2.2

2013-03-14 Thread Alain RODRIGUEZ
. Regards. Jean Armel 2013/3/14 Alain RODRIGUEZ arodr...@gmail.com Hi We just tried to migrate our production cluster from C* 1.1.6 to 1.2.2. This has been a disaster. I just switch one node to 1.2.2, updated its configuration (cassandra.yaml / cassandra-env.sh) and restart it. It resulted

Re: Failed migration from 1.1.6 to 1.2.2

2013-03-14 Thread Alain RODRIGUEZ
CassandraDaemon.java (line 133) Exception in thread Thread[WRITE-/SOME-IP,5,**main] java.lang.RuntimeException: Unknown host /0.0.0.0 with no default configured It will happen if your rpc_address is set to 0.0.0.0. M. W dniu 14.03.2013 13:03, Alain RODRIGUEZ pisze: Thanks for this pointer but I

Re: Failed migration from 1.1.6 to 1.2.2

2013-03-14 Thread Alain RODRIGUEZ
that is not defined in your cluster's config (e.g. in cassandra-topology.properties for PropertyFileSnitch) M. M. W dniu 14.03.2013 13:03, Alain RODRIGUEZ pisze: Thanks for this pointer but I don't think this is the source of our problem since we use 1 data center and Ec2Snitch. 2013/3/14

Re: About the heap

2013-03-14 Thread Alain RODRIGUEZ
think it is. By turning that to 512 or maybe even 1024, you will consume less ram there as well though I ran this test in QA and my key cache size stayed the same so I am really not sure(I am actually checking out cassandra code now to dig a little deeper into this property. Dean From: Alain

Re: Failed migration from 1.1.6 to 1.2.2

2013-03-14 Thread Alain RODRIGUEZ
to LT releases so we know we can always safely first upgrade to an LT release and then upgrade to another LT release from that one…just a thought. This would also get more people using/testing the same upgrade paths which would help everyone. Dean From: Alain RODRIGUEZ arodr

Re: Failed migration from 1.1.6 to 1.2.2

2013-03-14 Thread Alain RODRIGUEZ
testing if at least to get comfortable with the process. Dean From: Alain RODRIGUEZ arodr...@gmail.commailto:arodr...@gmail.com Reply-To: user@cassandra.apache.orgmailto:user@cassandra.apache.org user@cassandra.apache.orgmailto:user@cassandra.apache.org Date: Thursday, March 14, 2013 7:41 AM

Re: Failed migration from 1.1.6 to 1.2.2

2013-03-14 Thread Alain RODRIGUEZ
From output.log with debug enable i have more information. ... DEBUG 15:29:58,885 collecting 0 of 2147483647: users:bloom_filter_fp_chance:false:8@1363254809666000 DEBUG 15:29:58,885 collecting 1 of 2147483647: users:caching:false:9@1363254809666000 DEBUG 15:29:58,886 collecting 2 of 2147483647:

Re: Failed migration from 1.1.6 to 1.2.2

2013-03-14 Thread Alain RODRIGUEZ
as well. Later, Dean From: Alain RODRIGUEZ arodr...@gmail.commailto:arodr...@gmail.com Reply-To: user@cassandra.apache.orgmailto:user@cassandra.apache.org user@cassandra.apache.orgmailto:user@cassandra.apache.org Date: Thursday, March 14, 2013 8:09 AM To: user

Re: Recovering from a faulty cassandra node

2013-03-19 Thread Alain RODRIGUEZ
In 1.2, you may want to use the nodetool removenode if your server i broken or unreachable, else I guess nodetool decommission remains the good way to remove a node. (http://www.datastax.com/docs/1.2/references/nodetool) When this node is out, rm -rf /yourpath/cassandra/* on this serveur, change

Re: Recovering from a faulty cassandra node

2013-03-19 Thread Alain RODRIGUEZ
...@hexkeep.com Is nodetool removenode / decommission actually needed having a RF 1 ? What does it do, exactly ? Il giorno 19/mar/2013, alle ore 16:45, Alain RODRIGUEZ arodr...@gmail.com ha scritto: In 1.2, you may want to use the nodetool removenode if your server i broken or unreachable

Re: removing old nodes

2013-03-21 Thread Alain RODRIGUEZ
Using the unsafeAssassinateEndpoint function with old IPs from JMX should do the trick. This was already discussed in this mailing list, search using unsafeAssassinateEndpoint as keyword to know all that you need to know about it. Hope you'll be ok after that. Alain 2013/3/21 Ben Chobot

Re: removing old nodes

2013-03-21 Thread Alain RODRIGUEZ
? On Mar 21, 2013, at 11:53 AM, Alain RODRIGUEZ wrote: Using the unsafeAssassinateEndpoint function with old IPs from JMX should do the trick. This was already discussed in this mailing list, search using unsafeAssassinateEndpoint as keyword to know all that you need to know about it. Hope

Re: Size Tiered - Leveled Compaction

2013-03-26 Thread Alain RODRIGUEZ
: Alain RODRIGUEZ arodr...@gmail.commailto:arodr...@gmail.com To: user@cassandra.apache.orgmailto:user@cassandra.apache.org Cc: Wei Zhu wz1...@yahoo.commailto:wz1...@yahoo.com Sent: Friday, March 8, 2013 1:25 AM Subject: Re: Size Tiered - Leveled Compaction I'm still wondering about how

weird behavior with RAID 0 on EC2

2013-03-26 Thread Alain RODRIGUEZ
We use C* on m1.xLarge AWS EC2 servers, with 4 disks xvdb, xvdc, xvdd, xvde parts of a logical Raid0 (md0). I use to see their use increasing in the same way. This morning there was a normal minor compaction followed by messages dropped on one node (out of 12). Looking closely at this node I saw

  1   2   3   4   5   6   7   >