Deleting the datadir for system keyspace in 0.7

2010-11-15 Thread Utku Can Topçu
Hello All, I'm wondering before restarting the a node in a cluster. If I delete the system keyspace, what data would I be losing, would I be losing anything? Regards, Utku

RE: iteration does not yield all data with consistency ONE

2010-11-15 Thread Eric van Orsouw
Jonathan, I have downloaded 0.6.8 and the iteration problem is fixed. Thanks, Eric -Original Message- From: Jonathan Ellis [mailto:jbel...@gmail.com] Sent: donderdag 11 november 2010 23:05 To: user Subject: Re: iteration does not yield all data with consistency ONE Can you try with the

Re: Rows missing after new node bootstrapped

2010-11-15 Thread Christian Decker
I'm using tag cassandra-0.7.0-beta3. I wouldn't know why I need range scans since I perform a multi_get on the indexed keys. Regards, Chris On Sun, Nov 14, 2010 at 9:51 AM, Jonathan Ellis jbel...@gmail.com wrote: Are you using a version with working range scans? On Sat, Nov 13, 2010 at 6:11

Re: iteration does not yield all data with consistency ONE

2010-11-15 Thread Jonathan Ellis
Great. Thanks for helping us track that down! On Mon, Nov 15, 2010 at 6:45 AM, Eric van Orsouw eric.van.ors...@eventis.nl wrote: Jonathan, I have downloaded 0.6.8 and the iteration problem is fixed. Thanks, Eric -Original Message- From: Jonathan Ellis [mailto:jbel...@gmail.com]

Re: Deleting the datadir for system keyspace in 0.7

2010-11-15 Thread Gary Dusbabek
Mostly these things: stored schema information, cached cluster info, the token, hints. Everything but the hints can be replaced. Gary. On Mon, Nov 15, 2010 at 06:29, Utku Can Topçu u...@topcu.gen.tr wrote: Hello All, I'm wondering before restarting the a node in a cluster. If I delete the

Re: Deleting the datadir for system keyspace in 0.7

2010-11-15 Thread Jonathan Ellis
... but blowing away your saved token is a great way to lose data if you don't know what you're doing. On Mon, Nov 15, 2010 at 8:17 AM, Gary Dusbabek gdusba...@gmail.com wrote: Mostly these things: stored schema information, cached cluster info, the token, hints.  Everything but the hints can

Re: Deleting the datadir for system keyspace in 0.7

2010-11-15 Thread Utku Can Topçu
So, The practice of deleting the system datadir and setting the token in the configuration (so that we're not losing it) can be treated as a safe(!) operation if we're OK to lose the hints? Or are there other things to be aware of? Regards, Utku On Mon, Nov 15, 2010 at 3:25 PM, Jonathan Ellis

OPP and controlling partitioning

2010-11-15 Thread Claudio Martella
Hello list, I'm in the process of writing an application which uses cassandra as a storage backend. The application is a graph database and it's supposed to be a baseline application for further development in the field. The idea is to implement a property graph: a multigraph (multiple edges

Re: Rows in decreasing order

2010-11-15 Thread Casey Deccio
On Sun, Nov 14, 2010 at 12:50 AM, Jonathan Ellis jbel...@gmail.com wrote: As you may have guessed from the lack of a reversed option on the range slice api, backward scans are not supported.  The standard thing to do is load the keys you are interested in as columns to a row. That makes

Re: repair takes two days, and ends up stuck: stream at 1096% (yes, really)

2010-11-15 Thread Reverend Chip
Did I answer the question sufficiently? I need repair to work, and the cluster is sick. On 11/14/2010 2:17 PM, Jonathan Ellis wrote: What exception is causing it to fail/retry? On Sun, Nov 14, 2010 at 3:49 PM, Chip Salzenberg rev.c...@gmail.com wrote: My by-now infamous eight-node cluster

Re: repair takes two days, and ends up stuck: stream at 1096% (yes, really)

2010-11-15 Thread Jonathan Ellis
Is X.20 spewing these errors constantly now? Did X.21 log anything when/before the errors started on X.20? It looks to me like you had an out-of-Cassandra's-control network problem (or maybe X.21 restarted) and the retry code isn't working. On Sun, Nov 14, 2010 at 7:26 PM, Chip Salzenberg

Re: using SimpleAuthenticator is not working

2010-11-15 Thread Alaa Zubaidi
I tried both setting authority to org.apache.cassandra.auth.SimpleAuthority and AllowAllAuthority... I uncommitted the Application logging options in log4j-server.properties, is this enough? Thanks, On 11/14/2010 8:10 AM, Eric Evans wrote: On Fri, 2010-11-12 at 17:07 -0800, Alaa Zubaidi

Re: Gossip yoyo under write load

2010-11-15 Thread Rob Coli
On 11/13/10 11:59 AM, Reverend Chip wrote: Swapping could conceivably be a factor; the JVM is 32G out of 72G, but the machine is 2.5G into swap anyway. I'm going to disable swap and see if the gossip issues resolve. Are you using JNA/memlock to prevent the JVM's heap from being swapped?

Re: using SimpleAuthenticator is not working

2010-11-15 Thread Eric Evans
On Mon, 2010-11-15 at 11:30 -0800, Alaa Zubaidi wrote: I tried both setting authority to org.apache.cassandra.auth.SimpleAuthority and AllowAllAuthority... If you are using SimpleAuthenticator then you should be using SimpleAuthority. I uncommitted the Application logging options in

Re: OPP and controlling partitioning

2010-11-15 Thread Aaron Morton
Rows are distributed around the cluster according to the ordering from the Partitioner used, and the Replication Strategy. All data for the same key will be stored together, and then replicated RF times.To answer your questions...1) Each node is responsible for the keys between the previous nodes

Re: Gossip yoyo under write load

2010-11-15 Thread Reverend Chip
On 11/15/2010 11:34 AM, Rob Coli wrote: On 11/13/10 11:59 AM, Reverend Chip wrote: Swapping could conceivably be a factor; the JVM is 32G out of 72G, but the machine is 2.5G into swap anyway. I'm going to disable swap and see if the gossip issues resolve. Are you using JNA/memlock to

Re: repair takes two days, and ends up stuck: stream at 1096% (yes, really)

2010-11-15 Thread Jonathan Ellis
On Mon, Nov 15, 2010 at 1:03 PM, Reverend Chip rev.c...@gmail.com wrote: I find X.21's data disk is full.  nodetool ring says that X.21 has a load of only 326.2 GB, but the 1T partition is full. Load only tracks live data -- is the rest tmp files. Somehow repair decided it needed to triple

Re: Gossip yoyo under write load

2010-11-15 Thread Jonathan Ellis
On Mon, Nov 15, 2010 at 2:08 PM, Reverend Chip rev.c...@gmail.com wrote: None of those messages has appeared in either output.log or system.log.  ? This was only added to 0.6/0.7 branches a couple days ago. -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of Riptano, the source for

Re: Gossip yoyo under write load

2010-11-15 Thread Rob Coli
On 11/15/10 12:08 PM, Reverend Chip wrote: logger_.warn(Unable to lock JVM memory (ENOMEM). or logger.warn(Unknown mlockall error + errno(e)); Trunk also logs if it is successful : logger.info(JNA mlockall successful); None of those messages has appeared in either output.log or

Re: OPP and controlling partitioning

2010-11-15 Thread Adi
1) So if your node tokens are set as vertexid_ all keys with the same prefix will be in the same range. Adding to Aaron's comment - This will be the case if you use OrderPreservingPartitioner. RandomPartitioner(the default) will distribute the tokens randomly across nodes. On Mon, Nov 15, 2010

Re: using SimpleAuthenticator is not working

2010-11-15 Thread Alaa Zubaidi
I set authority to SimpleAuthority and log4j.rootLogger=DEBUG,stdout,R and its still the same, the error in my application is $batch_mutate_result.read(Cassandra.java:16477) InvalidRequestException(why: you have not logged in) and in the system.log after DEBUG .. Disseminating load

Re: repair takes two days, and ends up stuck: stream at 1096% (yes, really)

2010-11-15 Thread Reverend Chip
On 11/15/2010 12:09 PM, Jonathan Ellis wrote: On Mon, Nov 15, 2010 at 1:03 PM, Reverend Chip rev.c...@gmail.com wrote: I find X.21's data disk is full. nodetool ring says that X.21 has a load of only 326.2 GB, but the 1T partition is full. Load only tracks live data -- is the rest tmp files.

Re: using SimpleAuthenticator is not working

2010-11-15 Thread Eric Evans
On Mon, 2010-11-15 at 12:26 -0800, Alaa Zubaidi wrote: I set authority to SimpleAuthority and log4j.rootLogger=DEBUG,stdout,R and its still the same, the error in my application is $batch_mutate_result.read(Cassandra.java:16477) InvalidRequestException(why: you have not logged in) and

Re: repair takes two days, and ends up stuck: stream at 1096% (yes, really)

2010-11-15 Thread Jonathan Ellis
On Mon, Nov 15, 2010 at 3:05 PM, Reverend Chip rev.c...@gmail.com wrote: On 11/15/2010 12:09 PM, Jonathan Ellis wrote: On Mon, Nov 15, 2010 at 1:03 PM, Reverend Chip rev.c...@gmail.com wrote: I find X.21's data disk is full.  nodetool ring says that X.21 has a load of only 326.2 GB, but the 1T

Re: repair takes two days, and ends up stuck: stream at 1096% (yes, really)

2010-11-15 Thread Reverend Chip
On 11/15/2010 2:01 PM, Jonathan Ellis wrote: On Mon, Nov 15, 2010 at 3:05 PM, Reverend Chip rev.c...@gmail.com wrote: There are a lot of non-tmps that were not included in the load figure. Having stopped the server and deleted tmp files, the data are still using way more space than ring

Re: repair takes two days, and ends up stuck: stream at 1096% (yes, really)

2010-11-15 Thread Jonathan Ellis
On Mon, Nov 15, 2010 at 5:05 PM, Reverend Chip rev.c...@gmail.com wrote: You can move the data files do a node with more space, compact there, and move them back, but if you don't care about the data rebuilding is more straightforward. The nodes are configured identically.  What's the point

Getting Exception when doing a range query using token (worked in 6.5 not in 6.6)

2010-11-15 Thread Anand Somani
Hi Problem: Call - client.get_range_slices(). Using tokens (not keys), fails with TimedoutException which I think is misleading (Read on) Server : Works with 6.5 server, but not with 6.6 or 6.8 Client: have tried both 6.5 and 6.6 I am getting a TimedoutException when I do a

Re: using SimpleAuthenticator is not working

2010-11-15 Thread Alaa Zubaidi
I removed the exception handling and It seems that the login() is hanging? On 11/15/2010 1:36 PM, Eric Evans wrote: On Mon, 2010-11-15 at 12:26 -0800, Alaa Zubaidi wrote: I set authority to SimpleAuthority and log4j.rootLogger=DEBUG,stdout,R and its still the same, the error in my application

Re: Getting Exception when doing a range query using token (worked in 6.5 not in 6.6)

2010-11-15 Thread Jonathan Ellis
TimedOutException means the host that your client is talking to sent the request to another machine, which threw the logged exception and thus did not reply. You're doing an illegal query; token-based queries have to be on non-wrapping ranges (left token right token), or a wrapping range of

Re: using SimpleAuthenticator is not working

2010-11-15 Thread Aaron Morton
Can you try using the command line cassandra-cli tool ? fire it up and look at the online help, if you pass a user name and password to the "use" statement it will perform a login after setting the keyspace for the connection.Try testing the login that way, and see what is logged server side (with

Re: Getting Exception when doing a range query using token (worked in 6.5 not in 6.6)

2010-11-15 Thread Anand Somani
I only have 1 node (not a cluster), so not sure what another machine it is trying to send to? This is a very basic test that I am doing, hence only 1 node. I use describe_ring to get a list of TokenRanges (1 in this case) and use the end_token and start_token from it to get_range_slices. So what