Re: Weird timeouts

2014-03-10 Thread Joel Samuelsson
I am on Cassandra 2.0.5. How can I use the trace functionality? I did not check for exceptions. I will rerun and check. Thanks for suggestions. /Joel 2014-03-07 17:54 GMT+01:00 Duncan Sands duncan.sa...@gmail.com: Hi Joel, On 07/03/14 15:22, Joel Samuelsson wrote: I try to fetch all

Re: need help with Cassandra 1.2 Full GCing -- output of jmap histogram

2014-03-10 Thread Oleg Dulin
I get that :) What I'd like to know is how to fix that :) On 2014-03-09 20:24:54 +, Takenori Sato said: You have millions of org.apache.cassandra.db.DeletedColumn instances on the snapshot. This means you have lots of column tombstones, and I guess, which are read into memory by slice

RE: How many Data centers can Cassandra support?

2014-03-10 Thread Lu, Boying
This is very helpful. Thanks a lot :) From: Tupshin Harper [mailto:tups...@tupshin.com] Sent: 2014年3月9日 23:36 To: user@cassandra.apache.org Subject: Re: How many Data centers can Cassandra support? 20, easily. Probably far more, but I lack data points beyond that. -Tupshin On Mar 9, 2014

Replication with virtual nodes

2014-03-10 Thread motta.lrd
Hello, I have just learnt about virtual nodes in Cassandra. Let's assume this scenario where we have 16 tokens, 4 physical nodes, and each physical node is responsible of 4 tokens.

Cassandra DSC 2.0.5 not starting - * could not access pidfile for Cassandra

2014-03-10 Thread user 01
I installed DSC 2.0.5 on ubuntu 12.04 with Oracle JRE 7 but dsc 2.0.5 does not start after installation. When I check the running status.. *$ sudo service cassandra status* it says ** could not access pidfile for Cassandra* no other messages or anything in logs. This is happening with

Re: Cassandra DSC 2.0.5 not starting - * could not access pidfile for Cassandra

2014-03-10 Thread user 01
If it was not very clear, I could not manually start cassandra *$ sudo service cassandra start* ** could not access pidfile for Cassandra* On Mon, Mar 10, 2014 at 5:41 PM, user 01 user...@gmail.com wrote: I installed DSC 2.0.5 on ubuntu 12.04 with Oracle JRE 7 but dsc 2.0.5 does not

sending notifications through data replication on remote clusters

2014-03-10 Thread DE VITO Dominique
Hi, I have the following use case: If I update a data on DC1, I just want apps connected-first to DC2 to be informed when this data is available on DC2 after replication. When using Thrift, one way could be to modify CassandraServer class, to send notification to apps according to data coming

Re: need help with Cassandra 1.2 Full GCing -- output of jmap histogram

2014-03-10 Thread Jonathan Lacefield
Hello, You have several options: 1) going forward lower gc_grace_seconds http://www.datastax.com/documentation/cassandra/1.2/cassandra/configuration/configStorage_r.html?pagename=docsversion=1.2file=configuration/storage_configuration#gc-grace-seconds - this is very use case specific.

Re: Cassandra DSC 2.0.5 not starting - * could not access pidfile for Cassandra

2014-03-10 Thread Duncan Sands
Hi user 01, On 10/03/14 13:11, user 01 wrote: I installed DSC 2.0.5 on ubuntu 12.04 with Oracle JRE 7 but dsc 2.0.5 does not start after installation. When I check the running status.. *$ sudo service cassandra status* it says ** could not access pidfile for Cassandra* no other

Re: need help with Cassandra 1.2 Full GCing -- output of jmap histogram

2014-03-10 Thread Keith Wright
I also want to point out an issue I filed that was closed as not an issue: CASSANDRA-6654 Basically if you’re using mixed TTLs on columns in a row, the “oldest” TTL is used to determine if tombstones of other columns can be removed. In other words, if you have a column with a 1 day TTL and a

Re: sending notifications through data replication on remote clusters

2014-03-10 Thread Michael Shuler
On 03/10/2014 07:49 AM, DE VITO Dominique wrote: If I update a data on DC1, I just want apps “connected-first” to DC2 to be informed when this data is available on DC2 after replication. If I run a SELECT, I'm going to receive the latest data per the read conditions (ONE, TWO, QUORUM),

RE: sending notifications through data replication on remote clusters

2014-03-10 Thread DE VITO Dominique
On 03/10/2014 07:49 AM, DE VITO Dominique wrote: If I update a data on DC1, I just want apps connected-first to DC2 to be informed when this data is available on DC2 after replication. If I run a SELECT, I'm going to receive the latest data per the read conditions (ONE, TWO, QUORUM),

Re: sending notifications through data replication on remote clusters

2014-03-10 Thread Eric Plowe
You should be able to achieve what you're looking for with a trigger vs. a modification to the core of Cassandra. http://www.datastax.com/dev/blog/whats-new-in-cassandra-2-0-prototype-triggers-support On Mon, Mar 10, 2014 at 10:06 AM, DE VITO Dominique dominique.dev...@thalesgroup.com wrote:

about trigger execution ??? // RE: sending notifications through data replication on remote clusters

2014-03-10 Thread DE VITO Dominique
You should be able to achieve what you're looking for with a trigger vs. a modification to the core of Cassandra. http://www.datastax.com/dev/blog/whats-new-in-cassandra-2-0-prototype-triggers-support Well, good point. It leads to the question: (a) are triggers executed on all

Re: Cassandra DSC 2.0.5 not starting - * could not access pidfile for Cassandra

2014-03-10 Thread user 01
Thanks Duncan. very helpful response indeed! Now I can run cassandra very properly in the foreground using* cassandra -f *but when I try to run cassandra as a service in ubuntu that fails. Initially I get the status as *running* but very soon it says* * could not access pidfile for Cassandra*

Re: about trigger execution ??? // RE: sending notifications through data replication on remote clusters

2014-03-10 Thread Edward Capriolo
Just so you know you should probably apply the [jira] [Commented] (*CASSANDRA*-6790) *Triggers* are broken in trunk

Re: Cassandra DSC 2.0.5 not starting - * could not access pidfile for Cassandra

2014-03-10 Thread Michael Shuler
As the cassandra user? (is your install from packages or tar?) $ sudo -iu cassandra # you should now be the cassandra user $ cassandra -f -p /var/run/cassandra/cassandra.pid # not sure if -f also works with -p - might drop -f and look at # /var/log/cassandra/system.log -- Michael On

[RELEASE] Apache Cassandra 2.0.6 released

2014-03-10 Thread Sylvain Lebresne
The Cassandra team is pleased to announce the release of Apache Cassandra version 2.0.6. Cassandra is a highly scalable second-generation distributed database, bringing together Dynamo's fully distributed design and Bigtable's ColumnFamily-based data model. You can read more here:

RE: about trigger execution ??? // RE: sending notifications through data replication on remote clusters

2014-03-10 Thread DE VITO Dominique
Thanks a lot. [@@ THALES GROUP INTERNAL @@] De : Edward Capriolo [mailto:edlinuxg...@gmail.com] Envoyé : lundi 10 mars 2014 16:47 À : user@cassandra.apache.org Objet : Re: about trigger execution ??? // RE: sending notifications through data replication on remote clusters Just so you know you

Re: Replication with virtual nodes

2014-03-10 Thread motta.lrd
I will reply to myself and raise a flag in case someone is interested. Assuming the tokens are replicated as follows: Request to update row X Compute the token from the row key Identify the server with that token Place one replica there Increment the token until you get to a different

NULL in CQL

2014-03-10 Thread Rahul Gupta
Hi, How do I check for NULL values in CQL3? I am trying to write a CQL equivalent for below SQL: SELECT * FROM table1 WHERE col2 IS NULL; While inserting data into C*, CQL won't let me insert NULL, I have to pass '' for Strings and 0 for integers. I have '' and 0s as valid data so that's

Re: Cassandra DSC 2.0.5 not starting - * could not access pidfile for Cassandra

2014-03-10 Thread user 01
When running as root everything works fine, however when I run your commands a normal user, here is what happens.. user01@server1:~$ *sudo -iu cassandra* user01@server1:~$ * cassandra -f -p /var/run/cassandra/cassandra.pid* *...* ERROR 16:46:09,355 Exception encountered during startup

Re: Cassandra DSC 2.0.5 not starting - * could not access pidfile for Cassandra

2014-03-10 Thread Michael Shuler
On 03/10/2014 11:56 AM, user 01 wrote: When running as root everything works fine, however when I run your commands a normal user, here is what happens.. user01@server1:~$ sudo -iu cassandra Yeah, you never actually became the cassandra user. Of course, root works ;)

Re: Cassandra DSC 2.0.5 not starting - * could not access pidfile for Cassandra

2014-03-10 Thread user 01
$* sudo su - cassandra* I don't know why but this isn't actually working. It does not switch me to *cassandra* user[btw .. should this actually switch me to cassandra user?? ]. This user switching on my servers does not work for users like *tomcat7*user, *cassandra* user but works for users

RE: Cassandra DSC 2.0.5 not starting - * could not access pidfile for Cassandra

2014-03-10 Thread Donald Smith
You may need to do chown -R cassandra /var/lib/cassandra /var/log/cassandra . Don From: user 01 [mailto:user...@gmail.com] Sent: Monday, March 10, 2014 10:23 AM To: user@cassandra.apache.org Subject: Re: Cassandra DSC 2.0.5 not starting - * could not access pidfile for Cassandra $ sudo su -

Re: Cassandra DSC 2.0.5 not starting - * could not access pidfile for Cassandra

2014-03-10 Thread Sholes, Joshua
Depending on how it was installed, try making sure that the cassandra user has an actual login shell defined in /etc/passwd and not something like /sbin/nologin or /bin/false. From: user 01 user...@gmail.commailto:user...@gmail.com Reply-To:

Re: Cassandra DSC 2.0.5 not starting - * could not access pidfile for Cassandra

2014-03-10 Thread user 01
@Donald: This did not worked out.. Also as I already have shown above (I think) folder permissions seem to be correct for both *cassandra /var/lib/cassandra* /*var/log/cassandra *folders On Mon, Mar 10, 2014 at 11:06 PM, Donald Smith donald.sm...@audiencescience.com wrote: You may need to

Re: Cassandra DSC 2.0.5 not starting - * could not access pidfile for Cassandra

2014-03-10 Thread user 01
@Sholes, Joshua: It was installed using Datastax DSC20 package for cassandra 2.0.5. Checked out * /etc/passwd . *An entry for cassandra user does seem to exist. Looks like this: *cassandra:x:107:113:Cassandra database,,,:/var/lib/cassandra:/bin/false* On Mon, Mar 10, 2014 at 11:21 PM, user 01

Re: Cassandra DSC 2.0.5 not starting - * could not access pidfile for Cassandra

2014-03-10 Thread Michael Shuler
That all makes sense, then. I, personally, would not give the c* user a valid shell, unless it was just for a little testing - then change it back to /bin/false as intended. Since the initial problem was that the service commaned had trouble with the PID file, and OP has tinkered with

Authoritative failed write: Using paxos to cancel failed quorum writes

2014-03-10 Thread Wayne Schroeder
As I understand it, even though a quorum write fails, the data is still (more than likely) saved and will become eventually consistent through the well known mechanisms. I have a case where I would rather this not happen--where I would prefer that if the quorum write fails, that data NEVER

Re: Authoritative failed write: Using paxos to cancel failed quorum writes

2014-03-10 Thread Tupshin Harper
Take a 3 node cluster with RF=3, and QUORUM reads and writes. Consistency is achieved by ensuring that at least two nodes acknowledge a write, and at least two nodes have to participate in a read. As a result, you know that at least one of the two nodes that you are reading from has received the

Re: NULL in CQL

2014-03-10 Thread Mikhail Stepura
You can use blobAsType functions to insert empty blobs/values right into your cells, for example blobAsInt(0x) will insert an *empty* integer. http://cassandra.apache.org/doc/cql3/CQL.html#blobFun On 3/10/14, 9:56, Rahul Gupta wrote: Hi, How do I check for NULL values in CQL3? I am trying

Re: GCInspector GC for ConcurrentMarkSweep running every 15 seconds

2014-03-10 Thread Jeremiah D Jordan
Also it might be: https://issues.apache.org/jira/browse/CASSANDRA-6541 That is causing the high heap. -Jeremiah On Feb 18, 2014, at 5:01 PM, Jonathan Ellis jbel...@gmail.com wrote: Sounds like you have CMSInitiatingOccupancyFraction set close to 60. You can raise that and/or figure out how

Re: NULL in CQL

2014-03-10 Thread DuyHai Doan
@Rahul *Null *has a special semantics for CQL3. Setting a column value to *null *means deleting it... On Mon, Mar 10, 2014 at 5:56 PM, Rahul Gupta rgu...@dekaresearch.comwrote: Hi, How do I check for NULL values in CQL3? I am trying to write a CQL equivalent for below SQL: SELECT *

Re: Authoritative failed write: Using paxos to cancel failed quorum writes

2014-03-10 Thread Tupshin Harper
Oh sorry, I misunderstood. But now I'm confused about how what you are trying to do is not accomplished with the existing IF NOT EXISTS syntax. http://www.datastax.com/documentation/cassandra/2.0/cassandra/dml/dml_ltwt_transaction_c.html -Tupshin On Mar 10, 2014 4:24 PM, Wayne Schroeder

Re: Authoritative failed write: Using paxos to cancel failed quorum writes

2014-03-10 Thread Wayne Schroeder
The plan IS to do the whole write as a lightweight transaction because I do need to rely on the behavior. I am just vetting the expected behavior--that doing it as a conditional update, i.e. a light weight transaction, that I am not missing something and it will behave as I outlined without

Re: NULL in CQL

2014-03-10 Thread Tupshin Harper
And to be clear, and to elaborate, null is the default state for a Cassandra cell if you don't write to it, so you can always create a row with a null column by writing the row without that column being specified. Additionally, cql's delete statement optionally takes a columns argument, so if you

Re: Cassandra DSC 2.0.5 not starting - * could not access pidfile for Cassandra

2014-03-10 Thread Michael Shuler
On 03/10/2014 04:12 PM, user 01 wrote: As I mentioned I had given ownership to cassandra user for the cassandra.pid containing folder, var/lib/cassandra /var/log/cassandra. All of them are owned by cassandra as I verified. However after suggestion by someone, I tried removing the folders

Re: Cassandra DSC 2.0.5 not starting - * could not access pidfile for Cassandra

2014-03-10 Thread Michael Shuler
On 03/10/2014 05:15 PM, Michael Shuler wrote: I did find a bug with the same behavior you described. I have no idea why someone *removed* the dependency on a functional JRE from the cassandra package - this is *not* the same Depends: line as the upstream OSS cassandra package Quick follow-up