Re: Commit log + Data directory on same partition (software raid)

2012-08-11 Thread Thibaut Britz
Unfortunately ssd drives are no option at the moment. I have to use 2 regular hds. Has anyone tried above scenario? THanks, Thibaut On Fri, Aug 10, 2012 at 3:30 PM, Radim Kolar h...@filez.com wrote: I was thinking about putting both the commit log and the data directory on a software raid

Commit log + Data directory on same partition (software raid)

2012-08-10 Thread Thibaut Britz
Hi, Has anyone of you made some experience with software raid (raid 1, mirroring 2 disks)? Our workload is rather read based at the moment (Commit Log directory only grows by 128MB every 2-3 minutes), while the second hd is under high load due to the read requests to our cassandra cluster. I

cassandra 0.8.7 + hector 0.8.3: All Quorum reads result in writes?

2012-04-11 Thread Thibaut Britz
Hi, I just diagnosted this strange behavior: When I fetch a rangeslice through hector and set the consistency level to quorum, according to cfstats (and also to the output files on the hd), cassandra seems to execute a write request for each read I execute. The write count in cfstats is

Re: cassandra 0.8.7 + hector 0.8.3: All Quorum reads result in writes?

2012-04-11 Thread Thibaut Britz
Also executing the same multiget rangeslice query over the same range again will trigger the same writes again and again. On Wed, Apr 11, 2012 at 5:41 PM, Thibaut Britz thibaut.br...@trendiction.com wrote: Hi, I just diagnosted this strange behavior: When I fetch a rangeslice through

Re: cassandra 0.8.7 + hector 0.8.3: All Quorum reads result in writes?

2012-04-11 Thread Thibaut Britz
PM, R. Verlangen ro...@us2.nl wrote: Are you sure this isn't read-repair? http://wiki.apache.org/cassandra/ReadRepair 2012/4/11 Thibaut Britz thibaut.br...@trendiction.com Also executing the same multiget rangeslice query over the same range again will trigger the same writes again and again

Re: cassandra 0.8.7 + hector 0.8.3: All Quorum reads result in writes?

2012-04-11 Thread Thibaut Britz
Fixed in https://issues.apache.org/jira/browse/CASSANDRA-3843 On Wed, Apr 11, 2012 at 5:58 PM, Thibaut Britz thibaut.br...@trendiction.com wrote: We have read repair disabled (0.0). Even if this would be the case, this also doesn't explain why the writes are executed again and again when

Re: cassandra 0.8.7 + hector 0.8.3: All Quorum reads result in writes?

2012-04-11 Thread Thibaut Britz
(as I outlined in my parallel post) but if it fixes it for you, then beautiful. Just wanted to let you know our experience with similar symptoms. On Apr 11, 2012, at 11:56 AM, Thibaut Britz wrote: Fixed in https://issues.apache.org/jira/browse/CASSANDRA-3843 On Wed, Apr 11, 2012

Re: how stable is 1.0 these days?

2012-03-05 Thread Thibaut Britz
for what was fixed. 2012/3/2 Marcus Eriksson krum...@gmail.com beware of https://issues.apache.org/jira/browse/CASSANDRA-3820 though if you have many keys per node other than that, yep, it seems solid /Marcus On Wed, Feb 29, 2012 at 6:20 PM, Thibaut Britz thibaut.br...@trendiction.com

Re: how stable is 1.0 these days?

2012-02-29 Thread Thibaut Britz
Any more feedback on larger deployments of 1.0.*? We are eager to try out the new features in production, but don't want to run into bugs as on former 0.7 and 0.8 versions. Thanks, Thibaut On Tue, Jan 31, 2012 at 6:59 AM, Ben Coverston ben.covers...@datastax.comwrote: I'm not sure what

Re: Accessing expired data

2012-01-03 Thread Thibaut Britz
Thanks Sylvain! That's exactly what I needed to know. On Mon, Jan 2, 2012 at 12:49 PM, Sylvain Lebresne sylv...@datastax.comwrote: On Mon, Jan 2, 2012 at 11:51 AM, Thibaut Britz thibaut.br...@trendiction.com wrote: Hi, due to a misconfiguration on our site, some parts of our data got

Accessing expired data

2012-01-02 Thread Thibaut Britz
Hi, due to a misconfiguration on our site, some parts of our data got saved with a wrong expiration date, which expired just recently. How can I recover the data? Is it sufficient to copy over a backup of the tables into the table directory and iterate over the table (e.g. Read.ALL). Does

Re: 0.8.1: JVM Crash Segmentation Fault

2011-11-02 Thread Thibaut Britz
Hi, We use these type of crashes as indicator that the node might have some hardware errors. Did you check the ram? (eg memtest86) Thibaut On Wed, Nov 2, 2011 at 2:03 PM, Jahangir Mohammed md.jahangi...@gmail.comwrote: Hello All, JVM is crashing on the cassandra nodes. Re-start doesn't

Re: [RELEASE] Apache Cassandra 1.0 released

2011-10-18 Thread Thibaut Britz
Great news! Especially the improved read performance and compactions are great! Thanks, Thibaut On Tue, Oct 18, 2011 at 2:11 PM, Jonathan Ellis jbel...@gmail.com wrote: Thanks for the help, everyone!  This is a great milestone for Cassandra. On Tue, Oct 18, 2011 at 7:01 AM, Sylvain Lebresne

Re: Cluster key distribution wrong after upgrading to 0.8.4

2011-08-22 Thread Thibaut Britz
- Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 22/08/2011, at 3:33 AM, Thibaut Britz wrote: Hi, I will wait until this is fixed beforeI upgrade, just to be sure. Shall I open a new ticket for this issue? Thanks, Thibaut On Sun, Aug 21, 2011

Re: Cluster key distribution wrong after upgrading to 0.8.4

2011-08-21 Thread Thibaut Britz
. - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 19/08/2011, at 9:42 PM, Thibaut Britz wrote: Hi, we were using apache-cassandra-2011-06-28_08-04-46.jar so far in production and wanted to upgrade to 0.8.4. Our cluster was well balanced and we

Cluster key distribution wrong after upgrading to 0.8.4

2011-08-19 Thread Thibaut Britz
Hi, we were using apache-cassandra-2011-06-28_08-04-46.jar so far in production and wanted to upgrade to 0.8.4. Our cluster was well balanced and we only saved keys with a lower case md5 prefix. (Orderpreserving partitioner). Each node owned 20% of the tokens, which was also displayed on each

Re: Native heap leaks?

2011-05-05 Thread Thibaut Britz
Reading this, I tried it again (this time on a freshly formated node due to hd failure). Before crashing, my data dir was only 7.7M big. Using nmap_indexonly (mlockall was successfull) on a 64bit machine. Anything else I could try to get this to work? Ps. All the other nodes (and this node) run

Re: OOM on heavy write load

2011-04-28 Thread Thibaut Britz
Could this be related as well to https://issues.apache.org/jira/browse/CASSANDRA-2463? Thibaut On Wed, Apr 27, 2011 at 11:35 PM, Aaron Morton aa...@thelastpickle.comwrote: I'm a bit confused by the two different cases you described, so cannot comment specially on your case. In general if

Re: SSTable Corruption

2011-03-24 Thread Thibaut Britz
Just accidently hard resetet a node running 0.7.2 (with some patches from 0.7.3) and had the same problem. I'm a little hesitating upgrading to 0.7.4 Can I always delete the Statistics.db without any data loss? Thibaut On Thu, Mar 24, 2011 at 1:37 AM, Brandon Williams dri...@gmail.com wrote:

Re: Upgrade to a different version?

2011-03-17 Thread Thibaut Britz
If it helps you to sleep better, we use cassandra (0.7.2 with the flush fix) in production on 100 servers. Thibaut On Thu, Mar 17, 2011 at 5:58 PM, Paul Pak p...@yellowseo.com wrote: I'm at a crossroads right now. We built an application around .7 and the features in .7, so going back to

Re: Upgrade to a different version?

2011-03-17 Thread Thibaut Britz
As for the version, we will wait a few more days, and if nothing really bad shows up, move to 0.7.4. On Thu, Mar 17, 2011 at 10:40 PM, Thibaut Britz thibaut.br...@trendiction.com wrote: Hi Paul, It's more of a scientific mining app. We crawl websites and extract information from

Re: Upgrade to a different version?

2011-03-17 Thread Thibaut Britz
, Mar 17, 2011 at 6:53 PM, Paul Pak p...@yellowseo.com wrote: On 3/17/2011 1:06 PM, Thibaut Britz wrote: If it helps you to sleep better, we use cassandra (0.7.2 with the flush fix) in production on 100 servers. Thibaut Thanks Thibaut, believe it or not, it does. :) Is your use

Re: Fill disks more than 50%

2011-02-24 Thread Thibaut Britz
Hi, How would you use rsync instead of repair in case of a node failure? Rsync all files from the data directories from the adjacant nodes (which are part of the quorum group) and then run a compactation which will? remove all the unneeded keys? Thanks, Thibaut On Thu, Feb 24, 2011 at 4:22

Re: What if write consistency level cannot me met ?

2011-02-15 Thread Thibaut Britz
Your write will fail. But if the write has reached at least one node, it will eventually reach all the other nodes as well. So it won't rollback. On Tue, Feb 15, 2011 at 7:38 PM, A J s5a...@gmail.com wrote: Say I set write consistency level to ALL and all but one node are down. What happens

Re: Benchmarking Cassandra with YCSB

2011-02-15 Thread Thibaut Britz
Cassandra is very CPU hungry so you might be hitting a CPU bottleneck. What's your CPU usage during these tests? On Tue, Feb 15, 2011 at 8:45 PM, Markus Klems mar...@klems.eu wrote: Hi there, we are currently benchmarking a Cassandra 0.6.5 cluster with 3 High-Mem Quadruple Extra Large EC2

Re: [0.7.1] more exceptions: Illegal mode

2011-02-07 Thread Thibaut Britz
I think this is related to a faulty disk. On Mon, Feb 7, 2011 at 3:35 PM, Patrik Modesto patrik.mode...@gmail.com wrote: INFO 15:30:49,647 Compacted to /www/foo/cassandra/data/foo/Url-tmp-f-767-Data.db.  4,199,999,762 to 4,162,579,242 (~99% of original) bytes for 379,179 keys.  Time:

Re: Bootstrapping taking long

2011-01-05 Thread Thibaut Britz
https://issues.apache.org/jira/browse/CASSANDRA-1676 you have to use at least 0.6.7 On Wed, Jan 5, 2011 at 4:19 PM, Edward Capriolo edlinuxg...@gmail.comwrote: On Wed, Jan 5, 2011 at 10:05 AM, Ran Tavory ran...@gmail.com wrote: In storage-conf I see this comment [1] from which I understand

Re: Bootstrapping taking long

2011-01-05 Thread Thibaut Britz
dropping messages off the client request path (CASSANDRA-1676) related to the bootstrap questions I had? On Wed, Jan 5, 2011 at 5:23 PM, Thibaut Britz thibaut.br...@trendiction.com wrote: https://issues.apache.org/jira/browse/CASSANDRA-1676 you have to use at least 0.6.7 On Wed, Jan 5

Re: Quorum: killing 1 out of 3 server kills the cluster (?)

2010-12-09 Thread Thibaut Britz
Hi, The UnavailableExceptions will be thrown because quorum of size 2 needs at least 2 nodes to be alive (as for qurom of size 3 as well). The data won't be automatically redistributed to other nodes. Thibaut On Thu, Dec 9, 2010 at 4:40 PM, Timo Nentwig timo.nent...@toptarif.de wrote: Hi!

Re: Question about consitency level data propagation eventually consistent

2010-11-11 Thread Thibaut Britz
, Thibaut Britz thibaut.br...@trendiction.com wrote: Assuming I'm reading and writing with consitency level 1 (one), read repair turned off, I have a few questions about data propagation. Data is being stored at consistency level 3. 1) If all nodes are up: - Will all writes eventually reach

Re: New nodes won't bootstrap on .66

2010-11-08 Thread Thibaut Britz
Maybe yourStoragePort7000/StoragePort is being blocked by iptables or some firewall or maybe you have it bound (ListenAddress tag ) to localhost instead an ip address. Hope this helps, Dimitry. On Thu, Oct 28, 2010 at 5:35 PM, Thibaut Britz thibaut.br...@trendiction.com wrote: Hi

Re: Cluster load balancing?

2010-10-28 Thread Thibaut Britz
On Wed, Oct 27, 2010 at 1:46 PM, Thibaut Britz thibaut.br...@trendiction.com wrote: Depending on the range I choose, choosing manually a token will also fail. (node will never exit boostrap, streams doesn't list any open streams) INFO [Thread-53] 2010-10-27 20:33:37,399 SSTableReader.java

Re: New nodes won't bootstrap on .66

2010-10-28 Thread Thibaut Britz
Hi, I have the same problem with 0.6.5 New nodes will hang forever in bootstrap mode (no streams are being opened) and the receiver thread just waits for data forever: INFO [Thread-53] 2010-10-27 20:33:37,399 SSTableReader.java (line 120) Sampling index for /hd2/cassandra/data/table_xyz/

Re: Cluster load balancing?

2010-10-27 Thread Thibaut Britz
$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:662) On Wed, Oct 27, 2010 at 8:27 PM, Thibaut Britz thibaut.br...@trendiction.com wrote: Hello Tyler, thanksf or the quick answer. That's true, I should have noticed. I also tried kicking out one node

Re: Job Opportunity in Europe (Nosql, hadoop, crawling)

2010-08-25 Thread Thibaut Britz
PM, Thibaut Britz tbr...@gmail.com wrote: Hi, We are searching at least 3 more developers in the fields of search automatic content/site extraction, crawling, duplicate content, news/spam detection. We do content fetching and aggregation (news,message boards, blogs, ...) for market

Job Opportunity in Europe (Nosql, hadoop, crawling)

2010-08-18 Thread Thibaut Britz
Hi, We are searching at least 3 more developers in the fields of search automatic content/site extraction, crawling, duplicate content, news/spam detection. We do content fetching and aggregation (news,message boards, blogs, ...) for market research institutes, media analytics companies, etc...