Re: Materialized views and composite partition keys

2016-02-10 Thread Abdul Jabbar Azam
<doanduy...@gmail.com> wrote: > You can't have more than 1 non-pk column from the base table as primary > key column of the view. All is explained here: > http://www.doanduyhai.com/blog/?p=1930 > > On Wed, Feb 10, 2016 at 10:43 AM, Abdul Jabbar Azam <aja...@gmail.com> > wr

Materialized views and composite partition keys

2016-02-10 Thread Abdul Jabbar Azam
Abdul Jabbar Azam twitter: @ajazam

Re: Materialized views and composite partition keys

2016-02-10 Thread Abdul Jabbar Azam
here: > http://www.doanduyhai.com/blog/?p=1930 > > On Wed, Feb 10, 2016 at 10:43 AM, Abdul Jabbar Azam <aja...@gmail.com> > wrote: > >> Hello, >> >> I tried creating a material view using a composite partition key but I >> got an error. I can't remember the error but it

cassandra client testing

2016-02-09 Thread Abdul Jabbar Azam
Hello, What do people do to test their cassandra client code? Do you a) mock out the cassandra code b) use a framework which simulates cassandra c) actually use cassandra, perhaps inside docker -- Regards Abdul Jabbar Azam twitter: @ajazam

Re: cassandra client testing

2016-02-09 Thread Abdul Jabbar Azam
andra.org/ > > From: Abdul Jabbar Azam > Reply-To: "user@cassandra.apache.org" > Date: Tuesday, February 9, 2016 at 2:23 PM > To: "user@cassandra.apache.org" > Subject: cassandra client testing > > Hello, > > What do people do to test their cassandra clie

Re: cassandra client testing

2016-02-09 Thread Abdul Jabbar Azam
Engagement Engine > Atlassian > > My pronoun is "they". <http://pronoun.is/they> > > > > On Tue, Feb 9, 2016 at 2:47 PM, Jeff Jirsa <jeff.ji...@crowdstrike.com> > wrote: > >> http://www.scassandra.org/ >> >> From: Abdul Jabbar A

Re: What are the best ways to learn Apache Cassandra

2015-12-19 Thread Abdul Jabbar Azam
; Essentially I am looking for all tips that will help shorten the learning > curve. > > Thanks > Regards, > Akhil Mehra > -- Regards Abdul Jabbar Azam twitter: @ajazam

Re: Using Cassandra for geospacial search

2015-01-26 Thread Jabbar Azam
Hello, You'll find this useful http://www.slideshare.net/mobile/mmalone/working-with-dimensional-data-in-distributed-hash-tables Its how simplegeo used geohashing and Cassandra for geolocation. On Mon, 26 Jan 2015 15:48 SEGALIS Morgan msega...@gmail.com wrote: Hi everyone, I wanted to know

Re: Best approach in Cassandra (+ Spark?) for Continuous Queries?

2015-01-03 Thread Jabbar Azam
Hello, Or you can have a look at akka http://www.akka.io for event processing and use cassandra for persistence(Peters suggestion). On Sat Jan 03 2015 at 11:59:45 AM Peter Lin wool...@gmail.com wrote: It looks like you're using the wrong tool and architecture. If the use case really needs

Re: Wide rows best practices and GC impact

2014-12-04 Thread Jabbar Azam
Hello, I saw this earlier yesterday but didn't want to reply because I didn't know what the cause was. Basically I using wide rows with cassandra 1.x and was inserting data constantly. After about 18 hours the JVM would crash with a dump file. For some reason I removed the compaction throttling

Re: Storing time-series and geospatial data in C*

2014-11-27 Thread Jabbar Azam
of warning though with elastic search. It does not provide simple linear scalability like cassandra, nor is it easy to setup for cross datacentre operation. Datastax enterprise has Solr integrated so you could use that http://digbigdata.com/geospatial-search-cassandra-datastax-enterprise/ Jabbar Azam

Re: Redundancy inside a cassandra node

2014-11-08 Thread Jabbar Azam
to think that the servers must be super robust. Personally I'm not sure if that should be the case. The node Thanks Jabbar Azam On 8 November 2014 02:56, Plotnik, Alexey aplot...@rhonda.ru wrote: Cassandra is a cluster itself, it's not necessary to have redundant each node. Cassandra has

Re: Redundancy inside a cassandra node

2014-11-08 Thread Jabbar Azam
Hello Jack, Some really good points. I never thought of issues with the JVM or OOM issues. Thanks Jabbar Azam On 8 November 2014 16:52, Jack Krupansky j...@basetechnology.com wrote: About the only thing you can say is two specific points: 1. A more resilient node is great

Re: Re[2]: Redundancy inside a cassandra node

2014-11-08 Thread Jabbar Azam
no redundancy they are not taken seriously for production nodes. They're not rack mount, which is a big no with respect to the IT department. Thanks Jabbar Azam On 8 November 2014 12:31, Plotnik, Alexey aplot...@rhonda.ru wrote: Let me speak from my heart. I maintenance 200+TB Cassandra cluster

Re: Re[2]: Redundancy inside a cassandra node

2014-11-08 Thread Jabbar Azam
Hello Eric, You make a good point about resiliency being applied at a higher level in the stack. Thanks Jabbar Azam On 8 November 2014 14:24, Eric Stevens migh...@gmail.com wrote: They do not use Raid10 on the node, they don't use dual power as well, because it's not cheap in cluster

Redundancy inside a cassandra node

2014-11-07 Thread Jabbar Azam
. Thanks Jabbar Azam

Re: Scala driver

2014-09-02 Thread Jabbar Azam
Hello, I'm also using the Java driver. Its evolving the fastest and is simple to use Thanks Jabbar Azam On 2 Sep 2014 06:15, Gary Zhao garyz...@gmail.com wrote: Thanks Jan. I decided to use Java driver directly. It's not hard to use. On Sun, Aug 31, 2014 at 1:08 AM, Jan Algermissen

Re: Backup Cassandra to

2014-06-12 Thread Jabbar Azam
Yes, I never thought of that. Thanks Jabbar Azam On 12 June 2014 19:45, Jeremy Jongsma jer...@barchart.com wrote: That will not necessarily scale, and I wouldn't recommend it - your backup node will need as much disk space as an entire replica of the cluster data. For a cluster

Re: CQL query regarding indexes

2014-06-12 Thread Jabbar Azam
In this use case you don't need the secondary index. Instead use Primary key(partition_id, senttime) Thanks Jabbar Azam On 12 Jun 2014 23:44, Roshan codeva...@gmail.com wrote: Hi Cassandra - 2.0.8 DataStax driver - 2.0.2 I have create a keyspace and a table with indexes like below

Re: autoscaling cassandra cluster

2014-05-22 Thread Jabbar Azam
leave this problem for more intelligent people than me and concentrate on the application logic, which can scale by adding or removing application and front end servers. Thanks for all your comments. Thanks Jabbar Azam On 22 May 2014 19:55, Robert Coli rc...@eventbrite.com wrote: On Wed, May 21

autoscaling cassandra cluster

2014-05-21 Thread Jabbar Azam
be interested to know whether people out there are autoscaling cassandra on demand. Thanks Jabbar Azam

Re: autoscaling cassandra cluster

2014-05-21 Thread Jabbar Azam
/articles/auto-scaling-on-the-google-cloud-platformand how instances can be created and destroyed. I Thanks Jabbar Azam On 21 May 2014 13:09, Prem Yadav ipremya...@gmail.com wrote: Hi Jabbar, with vnodes, scaling up should not be a problem. You could just add a machines with the cluster/seed

Re: autoscaling cassandra cluster

2014-05-21 Thread Jabbar Azam
That sounds interesting. I was thinking of using coreos with docker containers for the business logic, frontend and Cassandra. I'll also have a look at cassandra-mesos Thanks Jabbar Azam On 21 May 2014 14:04, Panagiotis Garefalakis panga...@gmail.com wrote: I agree with Prem, but recently

Re: How to enable a Cassandra node to participate in multiple cluster

2014-05-21 Thread Jabbar Azam
and accurate detail. If your saving on hardware then you could think about using docker or virtualisation , but you'll have problems with performance. A bit like the problems you get when you have small instances at Amazon. Thanks Jabbar Azam On 21 May 2014 19:07, Salih Kardan karda...@gmail.com

Re: autoscaling cassandra cluster

2014-05-21 Thread Jabbar Azam
will have to run nodetool to add and remove the nodes from the cluster and also the node cleanup. Disclaimer: this is not a production system but something Im experimenting with in my own time. Thanks Jabbar Azam On 21 May 2014 15:51, James Horey j...@opencore.io wrote: If you're interested

Re: autoscaling cassandra cluster

2014-05-21 Thread Jabbar Azam
Hello Ben, I''m looking forward to reading the netflix links. Thanks :) Thanks Jabbar Azam On 21 May 2014 18:08, Ben Bromhead b...@instaclustr.com wrote: The mechanics for it are simple compared to figuring out when to scale, especially when you want to be scaling before peak load on your

Re: idempotent counters

2014-05-19 Thread Jabbar Azam
Thanks Aaron. I've mitigated this by removing the dependency on idempotent counters. But its good to know the limitations of counters. Thanks Jabbar Azam On 19 May 2014 08:36, Aaron Morton aa...@thelastpickle.com wrote: Does anybody else use another technique for achieving this idempotency

Re: CQL Datatype in Cassandra

2013-11-06 Thread Jabbar Azam
Hello Techy Teck, Couldn't find any evidence on the datastax website but found this http://wiki.apache.org/cassandra/CassandraLimitations which I believe is correct. Thanks Jabbar Azam On 6 November 2013 20:19, Techy Teck comptechge...@gmail.com wrote: We are using CQL table like

Re: CQL Datatype in Cassandra

2013-11-06 Thread Jabbar Azam
Forget. The text value can be upto 2GB in size, but in practice it will be less. Thanks Jabbar Azam On 6 November 2013 21:12, Jabbar Azam aja...@gmail.com wrote: Hello Techy Teck, Couldn't find any evidence on the datastax website but found this http://wiki.apache.org/cassandra

Re: videos of 2013 summit

2013-07-04 Thread Jabbar Azam
http://www.youtube.com/playlist?list=PLqcm6qE9lgKJzVvwHprow9h7KMpb5hcUU Thanks Jabbar Azam On 4 Jul 2013 18:17, S Ahmed sahmed1...@gmail.com wrote: Hi, Are the videos online anywhere for the 2013 summit?

Re: Cassandra driver performance question...

2013-06-24 Thread Jabbar Azam
Hello tony, I couldnt reply earlier because I've been decorating over the weekend so have been a bit busy. Let me know what's happens. Out of couriosity why are you using and not a cql3 native driver? Thanks Jabbar Azam On 24 Jun 2013 00:32, Tony Anecito adanec...@yahoo.com wrote: Hi Jabbar

Re: Cassandra driver performance question...

2013-06-24 Thread Jabbar Azam
/Netflix/astyanax/wiki/Getting-Started Thanks Jabbar Azam On 24 June 2013 15:34, Tony Anecito adanec...@yahoo.com wrote: Hi Jabbar, I am using JDBC driver because almost no examples exist about what you mention. Even most of the JDBC examples I find do not work because they are incomplete

Re: Cassandra terminates with OutOfMemory (OOM) error

2013-06-21 Thread Jabbar Azam
GC collectors. Bear in mind though that the OS will need memory, so will the row cache and the filing system. Although memory usage will depend on the workload of your system. I'm sure you'll also get good advice from other members of the mailing list. Thanks Jabbar Azam On 21 June 2013 18:49

Re: Cassandra driver performance question...

2013-06-21 Thread Jabbar Azam
Jabbar Azam On 21 June 2013 21:29, Tony Anecito adanec...@yahoo.com wrote: Hi All, I am using jdbc driver and noticed that if I run the same query twice the second time it is much faster. I setup the row cache and column family cache and it not seem to make a difference. I am wondering how

Re: CQL3 Driver, DESCRIBE

2013-06-09 Thread Jabbar Azam
Hello Joe, I would use cqlsh and run table in there I'm not sure why you want to run that from the driver! Thanks Jabbar Azam On 9 June 2013 23:49, Joe Greenawalt joe.greenaw...@gmail.com wrote: Hi, I was playing around with the datastax driver today, and I wanted to call DESCRIBE

Re: CQL3 Driver, DESCRIBE

2013-06-09 Thread Jabbar Azam
Oops I meant describe table ... Thanks Jabbar Azam On 10 June 2013 00:16, Jabbar Azam aja...@gmail.com wrote: Hello Joe, I would use cqlsh and run table in there I'm not sure why you want to run that from the driver! Thanks Jabbar Azam On 9 June 2013 23:49, Joe Greenawalt

Re: Is there anyone who implemented time range partitions with column families?

2013-05-29 Thread Jabbar Azam
Hello Cem, You can get a similar effect by specifying a TTL value for data you save to a table. If the data becomes older than the TTL value then it will automatically be deleted by C* Thanks Jabbar Azam On 29 May 2013 17:01, cem cayiro...@gmail.com wrote: Thank you very much for the fast

Re: Compaction causing OutOfHeap

2013-05-27 Thread Jabbar Azam
doing lots of inserts so switching off compaction throttling was ok. Thanks Jabbar Azam On 27 May 2013 04:29, John Watson j...@disqus.com wrote: Having (2) 1.2.5 nodes constantly crashing due to OutOfHeap errors. It always happens when the same large compaction is about to finish (they re-run

Look table structuring advice

2013-05-04 Thread Jabbar Azam
I've read the roles once then I can cache them. Thanks Jabbar Azam

Re: Look table structuring advice

2013-05-04 Thread Jabbar Azam
I never thought about using a synthetic key, but in this instance with about a dozen rows it's probably ok. Thanks for your great idea. Where did you read about the synthetic key idea? I've not come across it before. Thanks Jabbar Azam On 4 May 2013 19:30, Dave Brosius dbros

Re: cql query

2013-05-02 Thread Jabbar Azam
Hello Sri, As far as I know you can if name and age are part of your partition key and timestamp is the cluster key e.g. create table columnfamily ( name varchar, age varchar, tstamp timestamp, partition key((name, age), tstamp) ); Thanks Jabbar Azam On 2 May 2013 11:45

Re: Cassandra multi-datacenter

2013-05-02 Thread Jabbar Azam
the blanks :) Thanks Jabbar Azam On 2 May 2013 20:28, Daning Wang dan...@netseer.com wrote: Hi all, We are deploying Cassandra on two data centers. there is slower network connection between data centers. Looks casandra should use internal ip to communicate with nodes in the same data

Re: Any experience of 20 node mini-itx cassandra cluster

2013-04-16 Thread Jabbar Azam
I already have thanks. I'll do the tests with the hardware arrives. Thanks Jabbar Azam On 16 April 2013 22:27, aaron morton aa...@thelastpickle.com wrote: Can't we use LCS? Do some reading and some tests… http://www.datastax.com/dev/blog/leveled-compaction-in-apache-cassandra http

Re: MySQL Cluster performing faster than Cassandra cluster on single table

2013-04-16 Thread Jabbar Azam
MySQL cluster also has the index in ram. So with lots of rows the ram becomes a limiting factor. That's what my colleague found and hence why were sticking with Cassandra. On 16 Apr 2013 21:05, horschi hors...@gmail.com wrote: Ah, I see, that makes sense. Have you got a source for the

Re: Any experience of 20 node mini-itx cassandra cluster

2013-04-15 Thread Jabbar Azam
I know the SSD's are a bit small but they should be enough for our application. Out test data is 1.6 TB(including replication of rf=3). Can't we use LCS? This will give us more space at the expensive of more I/O but SSD's have loads of I/Os. Thanks Jabbar Azam On 14 April 2013 20:20

Re: Any experience of 20 node mini-itx cassandra cluster

2013-04-14 Thread Jabbar Azam
Thanks Aaron. Thanks Jabbar Azam On 14 April 2013 19:39, aaron morton aa...@thelastpickle.com wrote: That's better. The SSD size is a bit small, and be warned that you will want to leave 50Gb to 100GB free to allow room for compaction (using the default size tiered). On the ram side

Re: Anyway To Query Just The Partition Key?

2013-04-13 Thread Jabbar Azam
With your example you can do an equality search with surname and city and then use in with country Eg. Select * from yourtable where surname=blah and city=blah blah and country in (country1, country2) Hope that helps Jabbar Azam On 13 Apr 2013 07:06, Gareth Collins gareth.o.coll...@gmail.com

Any experience of 20 node mini-itx cassandra cluster

2013-04-12 Thread Jabbar Azam
? I do realise the CPU is fairly low computational power but I'm going to assume the system is going to be IO bound hence the RAM and SSD's. Thanks Jabbar Azam

Re: Any experience of 20 node mini-itx cassandra cluster

2013-04-12 Thread Jabbar Azam
That's my guess. My colleague is still looking at CPU's so I'm hoping he can get quad core CPU's for the servers. Thanks Jabbar Azam On 12 April 2013 16:48, Colin Blower cblo...@barracuda.com wrote: If you have not seen it already, checkout the Netflix blog post on their performance

Re: multiple Datacenter values in PropertyFileSnitch

2013-04-11 Thread Jabbar Azam
the nodes in the cluster. Thanks Jabbar Azam On 11 April 2013 14:13, Matthias Zeilinger matthias.zeilin...@bwinparty.com wrote: Hi, ** ** I would like to create big cluster for many applications. Within this cluster I would like to separate the data for each application, which can

Re: Two Cluster each with 12 nodes- Cassandra database

2013-04-11 Thread Jabbar Azam
Hello, I don't know what pelops is. I'm not sure why you want two clusters. I would have two clusters if I want to have data stored on totally separate servers for perhaps security reasons. If you are going to have the servers in one location then you might as well have one cluster. You'll have

Re: Backup strategies in a multi DC cluster

2013-03-26 Thread Jabbar Azam
in another part of the model. Cheers - Aaron Morton Freelance Cassandra Consultant New Zealand @aaronmorton http://www.thelastpickle.com On 25/03/2013, at 8:19 AM, Jabbar Azam aja...@gmail.com wrote: Thanks Aaron. I have a hypothetical question. Assume you have four

Re: Recovering from a faulty cassandra node

2013-03-25 Thread Jabbar Azam
there are in the cluster. My next email will be the last in the thread. I thought the info might be useful to other people in the community. On 21 March 2013 21:59, Jabbar Azam aja...@gmail.com wrote: nodetool cleanup command removes keys which can be deleted from the node the command is run. So

Re: cfhistograms

2013-03-25 Thread Jabbar Azam
40277 72 0122906 2896 0 1735 ** ** ** ** Thanks Kanwar ** ** -- Thanks Jabbar Azam

Re: Backup strategies in a multi DC cluster

2013-03-24 Thread Jabbar Azam
or https://github.com/synack/tablesnap to get things off node. Cheers - Aaron Morton Freelance Cassandra Consultant New Zealand @aaronmorton http://www.thelastpickle.com On 23/03/2013, at 4:37 AM, Jabbar Azam aja...@gmail.com wrote: Hello, I've been experimenting

Backup strategies in a multi DC cluster

2013-03-22 Thread Jabbar Azam
Jabbar Azam

Re: cannot start Cassandra on Windows7

2013-03-22 Thread Jabbar Azam
not find the main class: org.apache.cassandra.service.CassandraDaemon. Pr ogram will exit. -- Thanks Jabbar Azam

Re: cannot start Cassandra on Windows7

2013-03-22 Thread Jabbar Azam
the log4j ones. Do I need to configure anything else on Winows ? I did not find any Windows- specific installation/setup/startup instructions - if there are such documents somewhere, please let me know! Thanks, Marina -- Thanks Jabbar Azam

Re: cannot start Cassandra on Windows7

2013-03-22 Thread Jabbar Azam
of my colleagues and now it's documented ;)* * * * On 22 March 2013 15:47, Jabbar Azam aja...@gmail.com wrote: Viktor, you're right. I didn't get any errors on my windows console but cassandra.yaml and log4j-server.properties need modifying. On 22 March 2013 15:44, Viktor Jevdokimov

Re: Recovering from a faulty cassandra node

2013-03-21 Thread Jabbar Azam
-topology.properties file. Cheers - Aaron Morton Freelance Cassandra Consultant New Zealand @aaronmorton http://www.thelastpickle.com On 21/03/2013, at 1:34 AM, Jabbar Azam aja...@gmail.com wrote: I've added the node with a different IP address and after disabling the firewall

Re: Recovering from a faulty cassandra node

2013-03-21 Thread Jabbar Azam
Can I do a multiple node nodetool cleanup on my test cluster? On 21 Mar 2013 17:12, Jabbar Azam aja...@gmail.com wrote: All cassandra-topology.properties are the same. The node add appears to be successful. I can see it using nodetool status. I'm doing a node cleanup on the old nodes

Re: Recovering from a faulty cassandra node

2013-03-21 Thread Jabbar Azam
nodetool cleanup command removes keys which can be deleted from the node the command is run. So I'm assuming I can run nodetool cleanup on all the old nodes in parallel. Wouldn't do this on a live cluster as it's I/O intensive on each node. On 21 March 2013 17:26, Jabbar Azam aja...@gmail.com

Re: Recovering from a faulty cassandra node

2013-03-20 Thread Jabbar Azam
and restarted them. I also found I had iptables switched on and couldn't understand why the wiped node couldn't see the cluster. Not sure if I needed to change cassandra-topology.properties file on the existing nodes. On 19 March 2013 15:49, Jabbar Azam aja...@gmail.com wrote: Do I use removenode

RE: java.lang.OutOfMemoryError: unable to create new native thread

2013-03-20 Thread Jabbar Azam
Hello, Also have a look at http://www.datastax.com/docs/1.2/install/recommended_settings On 21 Mar 2013 00:06, S C as...@outlook.com wrote: Apparently max user process was set very low on the machine. How to check? ulimit -u Set it to unlimited /etc/security/limits.conf * soft nprocs

Recovering from a faulty cassandra node

2013-03-19 Thread Jabbar Azam
to achieve each step. Can anybody help? -- Thanks Jabbar Azam

Re: Recovering from a faulty cassandra node

2013-03-19 Thread Jabbar Azam
are in that token range. Dean From: Jabbar Azam aja...@gmail.commailto:aja...@gmail.com Reply-To: user@cassandra.apache.orgmailto:user@cassandra.apache.org user@cassandra.apache.orgmailto:user@cassandra.apache.org Date: Tuesday, March 19, 2013 8:51 AM To: user@cassandra.apache.orgmailto:user

Re: Recovering from a faulty cassandra node

2013-03-19 Thread Jabbar Azam
, it IS the replacement node. Dean From: Jabbar Azam aja...@gmail.commailto:aja...@gmail.com Reply-To: user@cassandra.apache.orgmailto:user@cassandra.apache.org user@cassandra.apache.orgmailto:user@cassandra.apache.org Date: Tuesday, March 19, 2013 9:29 AM To: user@cassandra.apache.orgmailto:user

Re: Recovering from a faulty cassandra node

2013-03-19 Thread Jabbar Azam
luck. 2013/3/19 Hiller, Dean dean.hil...@nrel.gov Since you cleared out that node, it IS the replacement node. Dean From: Jabbar Azam aja...@gmail.commailto:aja...@gmail.com Reply-To: user@cassandra.apache.orgmailto:user@cassandra.apache.org user@cassandra.apache.orgmailto:user

Re: Backup solution

2013-03-14 Thread Jabbar Azam
Hello, If the live data centre disappears restoring the data from the backup is going to take ages especially if the data is going from one data centre to another, unless you have a high bandwidth connection between data centres or you have a small amount of data. Jabbar Azam On 14 Mar 2013 14

Re: Compaction statistics information

2013-03-03 Thread Jabbar Azam
sstables, and 6865 were spread across all four. On Fri, Mar 1, 2013 at 11:07 AM, Jabbar Azam aja...@gmail.com wrote: Hello, I'm seeing compaction statistics which look like the following INFO 17:03:09,216 Compacted 4 sstables to [/var/lib/cassandra/data/studata/datapoints/studata