Re: Cassandra Insert Rate

2015-06-09 Thread SHANKAR REDDY
Thanks for BR for the quick response on this and Appreciate it. That helps for Batch load. If 10 million users are inserting new records at a time ( 1 record for one user ) then how do we increase the same. My sample program assumes request from 10 million records. -Shankar On Tue, Jun 9,

Re: How to minimize Cassandra memory usage for test environment?

2015-06-09 Thread Jason Wee
for a start, maybe you can see the setting use by raspberry pi project, for instance http://ac31004.blogspot.com/2012/05/apache-cassandra-on-raspberry-pi.html you can look at these two files, to tune down the settings for test environment. cassandra-env.sh cassandra.yaml hth jason On Tue, Jun

How to minimize Cassandra memory usage for test environment?

2015-06-09 Thread Eax Melanhovich
Hello. We are running integration tests, using real Cassandra (not a mock) under Vagrant. MAX_HEAP_SIZE is set to 500M. As I discovered, lower value causes 'out of memory' after some time. Could memory usage be decreased somehow? Developers don't usually have a lot of free RAM and performance

Re: sstableloader usage doubts

2015-06-09 Thread ZeroUno
Il 08/06/15 20:11, Robert Coli ha scritto: On Mon, Jun 8, 2015 at 6:58 AM, ZeroUno zerozerouno...@gmail.com mailto:zerozerouno...@gmail.com wrote: So... if I stop the two nodes on the first DC, restore their sstables' files, and then restart the nodes, nothing else needs to be done

Cassandra Insert Rate

2015-06-09 Thread SHANKAR REDDY
Team, I have a sample insert query which loads around 10 million records and found that the insert rate is around 1500 per second. This is very slow. The Source code I am using available at the below location. I am using the very latest version 2.1.6 with default seetings and single node VM

Re: Cassandra Insert Rate

2015-06-09 Thread Marcus Olsson
Hi Shankar, I would say: * Prepared statements to avoid sending the whole statement with every query and instead just send the values. * Using session.executeAsync() to improve concurrency. So you would start by creating a prepared statement, something like: PreparedStatement ps =

Re: Support for ad-hoc query

2015-06-09 Thread Brian O'Neill
Cassandra isn¹t great at ad hoc queries. Many of us have paired it with an indexing engine like SOLR or Elastic Search. (built-into the DSE solution) As of late, I think there are a few of us exploring Spark SQL. (which you can then use via JDBC or REST) -brian --- Brian O'Neill Chief

Re: How to minimize Cassandra memory usage for test environment?

2015-06-09 Thread horschi
Hi Eax, are you truncating/dropping tables between tests? Are your issues perhaps related to that? If you are, you should disable autoSnapshots and enable -DunsafeSystem=true to make it run smoother. kind regards, Christian On Tue, Jun 9, 2015 at 11:25 AM, Jason Wee peich...@gmail.com wrote:

Support for ad-hoc query

2015-06-09 Thread Srinivasa T N
Hi All, I have an web application running with my backend data stored in cassandra. Now I want to do some analysis on the data stored which requires some ad-hoc queries fired on cassandra. How can I do the same? Regards, Seenu.

Re: Hundreds of sstables after every Repair

2015-06-09 Thread Carlos Rolo
Hello, Do you have your clocks synced across your cluster? Are you using NTP and have it properly configured? Sometimes clock out of sync can trigger weird behaviour. Regards, Carlos Juzarte Rolo Cassandra Consultant Pythian - Love your data rolo@pythian | Twitter: cjrolo | Linkedin:

Re: cassandra installation

2015-06-09 Thread ICHIBA Sara
cool , thank you for the suggestion. 2015-06-09 17:40 GMT+02:00 Carlos Rolo r...@pythian.com: (Some self-promotion here) You can follow this blog to help you out: http://www.pythian.com/blog/from-0-to-cassandra-an-exhaustive-approach-to-installing-cassandra/ Regards, Carlos Juzarte Rolo

Re: cassandra installation

2015-06-09 Thread ICHIBA Sara
Ok thank you very much. I got my answer :) 2015-06-09 17:34 GMT+02:00 Alex Popescu al...@datastax.com: The JVM is the runtime platform for Cassandra. You can use any driver with it (there's no default driver). DataStax provides quite a few open source drivers [1] and there are also community

Re: Hundreds of sstables after every Repair

2015-06-09 Thread Anuj Wadehra
Any suggestions or comments on this one? Thanks Anuj Wadehra Sent from Yahoo Mail on Android From:Anuj Wadehra anujw_2...@yahoo.co.in Date:Sun, 7 Jun, 2015 at 1:54 am Subject:Hundreds of sstables after every Repair Hi, We are using 2.0.3 and vnodes. After every repair -pr operation  50+

Re: Hundreds of sstables after every Repair

2015-06-09 Thread Ken Hancock
I think this came up recently in another thread. If you're getting large numbers of SSTables after repairs, that means that your nodes are diverging from the keys that they're supposed to be having. Likely you're dropping mutations. Do a nodetool tpstats on each of your nodes and look at the

Re: Hundreds of sstables after every Repair

2015-06-09 Thread Anuj Wadehra
We were facing dropped mutations earlier and we increased flush writers. Now there are no dropped mutations in tpstats. To repair the damaged vnodes / inconsistent data we executed repair -pr on all nodes. Still, we see the same problem.  When we analyze repair logs we see 2 strange things:

cassandra installation

2015-06-09 Thread ICHIBA Sara
hey there, In order to install cassandra, java has to be installed first. is that mean that the default driver of cassandra is java? what if we wanna use the cpp driver? P.S 1: my questions might be so dump, but I will really appreciate an answer. PS 2: I'm intern and i'm completely new to

Re: cassandra installation

2015-06-09 Thread Alex Popescu
The JVM is the runtime platform for Cassandra. You can use any driver with it (there's no default driver). DataStax provides quite a few open source drivers [1] and there are also community maintained drivers [2] [1]: https://github.com/datastax/ [2]:

Re: Restoring all cluster from snapshots

2015-06-09 Thread Alain RODRIGUEZ
Hi, Not sure why this isn't working. Some thoughts, just in case: - Have you check the files rights / owner ? - Have you tried copying files after directory creation through your cqlsh -f schema step ? - Have you tried without setting tokens manually ? - Are you sure to put the right sstables at

Re: Hundreds of sstables after every Repair

2015-06-09 Thread Anuj Wadehra
Yes. We use NTP. We also thought that drift is creating problems. Our NTP Output is as under: [root@node1 ~]# ntpq -p remote   refid  st t when poll reach   delay   offset  jitter == +10.x.x.x

Re: C* 2.0.15 - java.lang.NegativeArraySizeException

2015-06-09 Thread Aiman Parvaiz
Quick update, saw the same error on another new node, again the node isn't really misbehaving uptill now. Thanks On Mon, Jun 8, 2015 at 9:48 PM, Aiman Parvaiz ai...@flipagram.com wrote: Hi everyone I am running C* 2.0.9 and decided to do a rolling upgrade. Added a node of C* 2.0.15 in the

Re: Restoring all cluster from snapshots

2015-06-09 Thread Robert Coli
On Tue, Jun 9, 2015 at 6:32 AM, Anton Koshevoy nowa...@gmail.com wrote: - /etc/init.d/cassandra restart Cassandra reads and makes live any files it finds in its data directory. If you write to the keyspace and flush, is it flushing the new file in the directory you've put your sstable in?

RE: C* 2.0.15 - java.lang.NegativeArraySizeException

2015-06-09 Thread SEAN_R_DURITY
In my experience, you don’t want to do streaming operations (repairs or bootstraps) with mixed Cassandra versions. Upgrade the ring to the new version, and then add nodes (or add the nodes at the current version, and then upgrade). Sean Durity From: Aiman Parvaiz [mailto:ai...@flipagram.com]

Re: sstableloader usage doubts

2015-06-09 Thread Robert Coli
On Tue, Jun 9, 2015 at 1:48 AM, ZeroUno zerozerouno...@gmail.com wrote: As far as I read from the docs, bootstrapping happens when adding a new node to the cluster, but in my situation the nodes already exist, I'm only adding data back into them. If you don't have the contents of the system

Apache Cassandra 2.2.0-rc1: calling all Windows users

2015-06-09 Thread Josh McKenzie
With the upcoming release of Cassandra-2.2 Windows is finally an officially supported operating system. While many months of JIRA tickets https://issues.apache.org/jira/issues/?filter=-1jql=project%20%3D%20cassandra%20and%20labels%20%3D%20Windows, bug fixes, and contributions have gone into making

Re: C* 2.0.15 - java.lang.NegativeArraySizeException

2015-06-09 Thread Robert Coli
On Tue, Jun 9, 2015 at 2:35 PM, Aiman Parvaiz ai...@flipagram.com wrote: Thanks Sean, in this scenario also I would end up running 2 versions of Cassandra as I am planning to do a rolling upgrade and hence zero downtime. Upgrading in place one node at a time would lead to running 2 versions,

Re: C* 2.0.15 - java.lang.NegativeArraySizeException

2015-06-09 Thread Aiman Parvaiz
Thanks Sean, in this scenario also I would end up running 2 versions of Cassandra as I am planning to do a rolling upgrade and hence zero downtime. Upgrading in place one node at a time would lead to running 2 versions, please let me know if I am missing something here. On Tue, Jun 9, 2015 at

Re: Support for ad-hoc query

2015-06-09 Thread Peter Lin
what do you mean by ad-hoc queries? Do you mean simple queries against a single column family aka table? Or do you mean MDX style queries that looks at multiple tables? if it's MDX style queries, many people extract data from Cassandra into a data warehouse that support multi-dimensional cubes.

Re: Support for ad-hoc query

2015-06-09 Thread Srinivasa T N
Thanks guys for the inputs. By ad-hoc queries I mean that I don't know the queries during cf design time. The data may be from single cf or multiple cf. (This feature maybe required if I want to do analysis on the data stored in cassandra, do you have any better ideas)? Regards, Seenu. On

Re: Restoring all cluster from snapshots

2015-06-09 Thread Anton Koshevoy
Ok, new sequence: …. - rm -rf /db/cassandra/cr/data0*/system/* - /etc/init.d/cassandra start - cqlsh -f schema(here is the schema for cr_production keyspace only) - /etc/init.d/cassandra restart I see the new keyspace, but it’s empty: cqlsh describe keyspaces; system_traces  cr_production