Re: problem in create column family

Not sure about that, what version of Cassandra are you using? Maybe someone else here knows how to solve this.. 2012/3/27 puneet loya > ya had created with UTF8Type before.. It gave the same error. > > On executing help assume command it is giving 'utf8' as a type. > > so can i use comparator='u

Re: problem in create column family

ya had created with UTF8Type before.. It gave the same error. On executing help assume command it is giving 'utf8' as a type. so can i use comparator='utf8' or not?? Please reply On Mon, Mar 26, 2012 at 9:17 PM, R. Verlangen wrote: > You should use the full type names, e.g. > > create column

RE: Exceptions related to thrift transport

No the clients are fixed However sometimes the queries can be huge like this. To summarize I will have the following in my TODO list to rectify this: Try reducing the batch commit size. Thanks, Dushyant From: Ben Coverston [mailto:ben.covers...@datastax.com] Sent: Thursday, March 22, 2012 1:32 A

Re: unbalanced ring

This morning I have nodetool ring -h localhost Address DC RackStatus State LoadOwns Token 113427455640312821154458202477256070485 10.34.158.33us-east 1c Up Normal 5.78 MB 33.33% 0 10.38.175.131 us-east 1c Up No

Re: How to store a list of values?

On Tue, Mar 27, 2012 at 1:47 AM, R. Verlangen wrote: > " but any schema change will break it " > > How do you mean? You don't have to specify the columns in Cassandra so it > should work perfect. Except for the "skill~" is preserverd for your list. > In case skill~ is decided to change to skill

Re: Error in FAQ?

I updated the FAQ to the best of my ability: http://wiki.apache.org/cassandra/FAQ#modify_cf_config On Mon, Mar 26, 2012 at 12:25 AM, R. Verlangen wrote: > If you want to modify a column family, just open the command line > interface (cassandra-cli), connect to a node (probably: "connect > local

Re: unbalanced ring

What version are you using? Anyway try nodetool repair & compact. maki 2012/3/26 Tamar Fraenkel > Hi! > I created Amazon ring using datastax image and started filling the db. > The cluster seems un-balanced. > > nodetool ring returns: > Address DC RackStatus State Loa

Re: Fwd: information on cassandra

auto_bootstrap has been removed from cassandra.yaml and always enabled since 1.0. fyi. maki 2012/3/26 R. Verlangen : > Yes, you can add nodes to a running "cluster". It's very simple: configure > the cluster name and seed node(s) in cassandra.yaml, set auto_bootstrap to > true and start the node.

Internal error processing get_slice (NullPointerException)

Has anyone seen this particular NPE before from Cassandra? This is on 1.0.8. It seems to happen transiently on multiple nodes in my cluster, every so often, and goes away. ERROR [Thrift:45] 2012-03-26 19:59:12,024 Cassandra.java (line 3041) Internal error processing get_slice java.lang.NullPoin

Re: multi region EC2

On 3/26/2012 2:15 PM, aaron morton wrote: - can i migrate the replication strategy one node at a time or do i need to shut to the whole cluster to do this? Just use the NTS from the start. but what if i already have a bunch (8g per node) data that i need and i don't have a way to re-create it.

Re: cassandra 1.08 on java7 and win7

create keyspace via cassandra cli fails https://issues.apache.org/jira/browse/CASSANDRA-4085 On Mon, Mar 26, 2012 at 2:44 PM, Sasha Dolgy wrote: > best to open an issue: https://issues.apache.org/jira/browse/CASSANDRA > > > On Mon, Mar 26, 2012 at 11:35 PM, Frank Hsueh wrote: > >> err ... s

The cassandra gem on rubygems.org needs to be updated

If you're not a maintainer of the cassandra gem on rubygems.org, you can stop reading. And if you are ... I'm just bringing this up to your attention: https://github.com/twitter/cassandra/issues/142 Thanks! -- Ilya

Re: cassandra 1.08 on java7 and win7

best to open an issue: https://issues.apache.org/jira/browse/CASSANDRA On Mon, Mar 26, 2012 at 11:35 PM, Frank Hsueh wrote: > err ... same thing happens with Java 1.6 > > > > On Mon, Mar 26, 2012 at 2:35 PM, Frank Hsueh wrote: > >> I'm using the latest of Java 1.6 from Oracle. >> >> >> >> On

Re: cassandra 1.08 on java7 and win7

err ... same thing happens with Java 1.6 On Mon, Mar 26, 2012 at 2:35 PM, Frank Hsueh wrote: > I'm using the latest of Java 1.6 from Oracle. > > > > On Mon, Mar 26, 2012 at 2:29 PM, R. Verlangen wrote: > >> Ben Coverston wrote earlier today: " Use a version of the Java 6 >> runtime, Cassandr

Re: cassandra 1.08 on java7 and win7

I'm using the latest of Java 1.6 from Oracle. On Mon, Mar 26, 2012 at 2:29 PM, R. Verlangen wrote: > Ben Coverston wrote earlier today: " Use a version of the Java 6 runtime, > Cassandra hasn't been tested at all with the Java 7 runtime" > > So I think that might be a good way to start. > > 20

Re: cassandra 1.08 on java7 and win7

interesting. that behaviour _does_ happen in 1.0.8, but doesn't in 1.0.6 on windows 7 with Java 7. looks to be a problem with the CLI and not the actual Cassandra service. just tried it now. -sd On Mon, Mar 26, 2012 at 11:29 PM, R. Verlangen wrote: > Ben Coverston wrote earlier today: " Use

Re: cassandra 1.08 on java7 and win7

Ben Coverston wrote earlier today: " Use a version of the Java 6 runtime, Cassandra hasn't been tested at all with the Java 7 runtime" So I think that might be a good way to start. 2012/3/26 Frank Hsueh > I think I have cassandra the server started > > In another window: > > > cassandra-cl

cassandra 1.08 on java7 and win7

I think I have cassandra the server started In another window: > cassandra-cli.bat -h localhost -p 9160 Starting Cassandra Client Connected to: "Test Cluster" on localhost/9160 Welcome to Cassandra CLI version 1.0.8 Type 'help;' or '?' for help. Type 'quit;' or 'exit;' to quit. [default@unk

Schema advice/help

I need to store activities by each user, on 5 items types. I always want to read last 10 activities on each item type, by a user (ie, total activities to read at a time =50). I am wanting to store these activities in a single row for each user so that they can be retrieved in single row query, sin

Re: multi region EC2

> (rep factor 3, simple) if this means you are using the SimpleStrategy I would recommend using the NetworkTopologyStrategy. > - what is the min and recommended number of nodes to use in multiple region > cluster. we only have a single app server right now. It depends on how exciting you want

Re: what other ports than 7199 need to be open for nodetool to work?

I have documented some of the things you can do to make the random port nature of JMX happy. http://www.jointhegrid.com/highperfcassandra/?p=140 Other options are setting up mx4j or using jmxterm, or setting up a sock proxy and tell jconsole to use your proxy. Also there is the xwindows over vnc

Re: Performance overhead when using start and end columns

@Aaron: Very interesting article! Mentioned it on my Dutch blog. 2012/3/26 Mohit Anchlia > Thanks! > > > On Mon, Mar 26, 2012 at 10:53 AM, aaron morton wrote: > >> See the test's in the article. >> >> The code I used for profiling is also available. >> >> Cheers >> >>- >> Aar

Re: How to store a list of values?

" but any schema change will break it " How do you mean? You don't have to specify the columns in Cassandra so it should work perfect. Except for the "skill~" is preserverd for your list. 2012/3/26 samal > > Save the skills in a single column in json format. Job done. >> > Good if it have fix

Re: what other ports than 7199 need to be open for nodetool to work?

Thanks Nick -- I didn't know about this ticket. Good to know. Yes, nodetool doesn't do anything special - but I still wish I could use nodetool to examine other nodes, instead of having to ssh to other nodes first and then nodetool each one (i am lazy :-). -- Y. On Mon, Mar 26, 2012 at 3:50 PM,

Re: what other ports than 7199 need to be open for nodetool to work?

You are correct about the second random dynamic port. There is a ticket open to fix that as well as some other jmx issues: https://issues.apache.org/jira/browse/CASSANDRA-2967 Regarding nodetool, it doesn't do anything special. Nodetool is often used to connect to 'localhost' which generally does

what other ports than 7199 need to be open for nodetool to work?

Hi, We opened port 7199 on a cassandra node, but were unable to get a nodetool to talk to it remotely unless we turn off the firewall entirely. So what other ports should be opened for this -- online posts all indicate that JMX uses a random dynamic port, which would be difficult to create a fire

copy data for dev

all, is there a easy way to take a 4 node snapshot and restore it on my single node dev cluster? thanks, deno

multi region EC2

all, we just about ready to push our app live and just have some cassandra tuning left. i've been currently running a 4 node (rep factor 3, simple) in EC2 using the datastax AMIs (thanks datastax). so after reading through a bunch of docs i have a few questions. - what is the min and reco

Re: CQL Reversed and Comparator reversed=true

Thank you Aaron! On Mon, Mar 26, 2012 at 10:44 PM, aaron morton wrote: > create column family Comments > with comparator = 'CompositeType(UTF8Type(reversed=True), UTF8Type)' > and key_validation_class = 'UTF8Type' > and default_validation_class = 'UTF8Type'; > > Looks ok. > > SELECT F

Re: Performance overhead when using start and end columns

Thanks! On Mon, Mar 26, 2012 at 10:53 AM, aaron morton wrote: > See the test's in the article. > > The code I used for profiling is also available. > > Cheers > >- > Aaron Morton > Freelance Developer > @aaronmorton > http://www.thelastpickle.com > > On 27/03/2012, at 6:21 A

Server side scripting support in Cassandra - go Python !

Howdy, Some Polyglot Persistence(NoSQL) products started support server side scripting, similar to RDBMS store procedure. E.g. Redis Lua scripting. I wish it is Python when Cassandra has the server side scripting feature. FYI, http://antirez.com/post/250 http://nosql.mypopescu.com/post/1994927

Re: How to store a list of values?

> Save the skills in a single column in json format. Job done. > Good if it have fixed set of skills, then any add or delete changes need handle in app. ->read column first->reformat JOSN->update column (2 thrift calls). skill~Java: null, skill~Cassandra: null This is also good option, but any

Re: Performance overhead when using start and end columns

Hi Aaron, Thanks for the benchmark. The matrix is valuable. Thanks, Charlie (@mujiang) 一个 木匠 === Data Architect Developer http://mujiang.blogspot.com On Mon, Mar 26, 2012 at 10:53 AM, aaron morton wrote: > See the test's in the article. > > The code I used for profiling is also available.

Re: Adding Long type rows to a CF containing Integer(32) type row keys, without overlapping ?

Only if you reuse a row key. Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 27/03/2012, at 6:38 AM, Ertio Lew wrote: > I need to use the range beyond the integer32 type range, so I am using Long > to write those keys. I am afraid if th

Re: Adding Long type rows to a CF containing Integer(32) type row keys, without overlapping ?

Only if you reuse a row key. Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 27/03/2012, at 6:38 AM, Ertio Lew wrote: > I need to use the range beyond the integer32 type range, so I am using Long > to write those keys. I am afraid if th

Re: Performance overhead when using start and end columns

See the test's in the article. The code I used for profiling is also available. Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 27/03/2012, at 6:21 AM, Mohit Anchlia wrote: > Thanks but if I do have to specify start and end columns then

Re: One or Two clusters?

Use one cluster. Use lots-o-machines. The read and write paths do not directly interfere with each other like they do in a RDBMS. Compaction created by writes can suck up disk IO, but this is throttled so in practice it is not such a big problem. Excessive GC created by reads or compaction may

Re: Estimation of memtable size are wrong

> Yes i noticed that. Its not too often, about 1 times per week. The assumption would be that the workload stabilises over time. > INFO [MemoryMeter:1] 2012-03-23 00:00:18,407 Memtable.java (line 186) > CFS(Keyspace='whois', ColumnFamily='ipbans') liveRatio is 64.0 (just-counted > was 16.3546327

Re: Adding Long type rows to a CF containing Integer(32) type row keys, without overlapping ?

I need to use the range beyond the integer32 type range, so I am using Long to write those keys. I am afraid if this might lead to collisions with the previously stored integer keys in the same CF even if I leave out the int32 type range. On Mon, Mar 26, 2012 at 10:51 PM, aaron morton wrote: >

Re: Sample Data

>> > I wish to test certain things in Cassandra so can someone help me with >> > sample database or sample database data generator which can help me >> > flood Cassandra nodes with large amount of data. I would recommend YCSB: https://github.com/brianfrankcooper/YCSB/wiki/ Thanks, Tom

Re: Sample Data

The 'stress' tool that you can find in a source checkout of cassandra sounds like what you're looking for. It's designed to write data to (or read data from) a cluster as fast as possible, and has plenty of options for tweaking the type of data it inserts. You can read more about it here: http://

Re: cqlsh gets confused by tombstone

Thanks for the bug report. A - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 26/03/2012, at 6:08 PM, Radim Kolar wrote: > Dne 26.3.2012 3:39, aaron morton napsal(a): >> Can you please reproduce the fault using the --debug cqlsh command option >> a

Re: Regarding nodetool tpstats

Cheers :) - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 26/03/2012, at 1:55 PM, Watanabe Maki wrote: >> - InternalResponseStage > > Handles response to non client initiated messages, including bootstrap, > schema check, etc. > > maki > > > O

Re: smart client proxy for cassandra

I've heard of people using HA Proxy http://haproxy.1wt.eu/ with php as a connection pool. Note that detecting failure in Cassandra can only be done as part of a request. So HA Proxy cannot understand if a node is actually functional, only that it allows a socket to be opened. There is some w

Re: How to store a list of values?

Save the skills in a single column in json format. Job done. On Mar 26, 2012 7:04 PM, "Ben McCann" wrote: > True. But I don't need the skills to be searchable, so I'd rather embed > them in the user than add another top-level CF. I was thinking of doing > something along the lines of adding a

Re: Adding Long type rows to a CF containing Integer(32) type row keys, without overlapping ?

> without them overlapping/disturbing each other (assuming that keys lie in > above domains) ? Not sure what you mean by overlapping. 42 as a int and 42 as a long are the same key. Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 25/03/201

Re: Performance overhead when using start and end columns

Thanks but if I do have to specify start and end columns then how much overhead roughly would that translate to since reading metadata should be constant overall? On Mon, Mar 26, 2012 at 10:18 AM, aaron morton wrote: > Some information on query plans > http://thelastpickle.com/2011/07/04/Cassandr

Re: Performance overhead when using start and end columns

Some information on query plans http://thelastpickle.com/2011/07/04/Cassandra-Query-Plans/ Tl;Dr; Select columns with no start, in the natural Comparator order. Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 25/03/2012, at 2:25 PM, Mohi

Re: Counters and replication factor

Can you describe the situations where counter updates are lost or go backwards ? Do you ever get TimedOutExceptions when performing counter updates ? Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 24/03/2012, at 6:34 PM, Radim Kolar wrot

Re: CQL Reversed and Comparator reversed=true

> create column family Comments > with comparator = 'CompositeType(UTF8Type(reversed=True), UTF8Type)' > and key_validation_class = 'UTF8Type' > and default_validation_class = 'UTF8Type'; Looks ok. > SELECT FIRST 100 REVERSED 'z'..'0' from Comments where key = 'xyz'; try SELECT FIRST

Re: How to store a list of values?

You can prefix the skills with something (you will "fake" the composite columns), e.g. john { name : John, phone : 1234567890 skill~Java: null, skill~Cassandra: null } And then retreive the columns with start = "skill~" 2012/3/26 Ben McCann > True. But I don't need the skills to be search

Re: How to store a list of values?

True. But I don't need the skills to be searchable, so I'd rather embed them in the user than add another top-level CF. I was thinking of doing something along the lines of adding a skills super column to the User table: skills: { 'java': null, 'c++': null, 'cobol': null } However, I'm st

Re: How to store a list of values?

In this case you only neem the columns for values. You don't need the column-values to hold multiple columns (the super-column principle). So a normal CF would work. 2012/3/26 Ben McCann > Thanks for the reply Samal. I did not realize that you could store a > column with null value. Do you kno

Re: How to store a list of values?

On Mon, Mar 26, 2012 at 9:20 PM, Ben McCann wrote: > Thanks for the reply Samal. > > I did not realize that you could store a column with null value. > values can be null or any value like [default@node] set hus['test']['wowq']='\{de\'.de\;\}\+\^anything'; Value inserted. Elapsed time: 4 m

Re: How to store a list of values?

plus it is fully compatible with CQL. SELECT * FROM UserSkill WHERE KEY='ben'; On Mon, Mar 26, 2012 at 9:13 PM, samal wrote: > I would take simple approach. create one other CF "UserSkill" with row > key same as profile_cf key, > In user_skill cf will add skill as column name and value null. Co

Re: How to store a list of values?

Thanks for the reply Samal. I did not realize that you could store a column with null value. Do you know if this solution would work with composite columns? It seems super columns are being phased out in favor of composites, but I do not understand composites very well yet. I'm trying to figure

Re: problem in create column family

You should use the full type names, e.g. create column family MyColumnFamily with comparator=UTF8Type; 2012/3/26 puneet loya > It is giving errors like " Unable to find abstract-type class > 'org.apache.cassandra.db.marshal.utf8' " > > and java.lang.RuntimeException: > org.apache.cassandra.db.m

Re: How to store a list of values?

I would take simple approach. create one other CF "UserSkill" with row key same as profile_cf key, In user_skill cf will add skill as column name and value null. Columns can be added or removed. UserProfile={ '*ben*'={ blah :blah blah :blah blah :blah } } UserSkill={ '*ben*'={

problem in create column family

It is giving errors like " Unable to find abstract-type class 'org.apache.cassandra.db.marshal.utf8' " and java.lang.RuntimeException: org.apache.cassandra.db.marshal.MarshalException: cannot parse 'catalogueId' as hex bytes where catalogueId is a column that has utf8 as its data type. they may b

Re: unbalanced ring

How can I fix this? add more data. 1.5M is not enough to get reliable reports

One or Two clusters?

Hi, Could someone please help me understand the benefits of having a single large cluster vs. having two smaller clusters separated by the pattern of use? One, MOSTLY WRITE cluster could incrementally accumulate large amounts of data throughout the day. The daily increment would be processed, s

unbalanced ring

Hi! I created Amazon ring using datastax image and started filling the db. The cluster seems un-balanced. nodetool ring returns: Address DC RackStatus State LoadOwns Token 113427455640312821154458202477256070485 10.34.158.33us-east 1c

Re: Fwd: information on cassandra

Yes, you can add nodes to a running "cluster". It's very simple: configure the cluster name and seed node(s) in cassandra.yaml, set auto_bootstrap to true and start the node. 2012/3/26 puneet loya > 5n.. consider i m starting on a single node. can I add nodes later?? plz > reply :) > > > On Sun,

Re: Fwd: information on cassandra

5n.. consider i m starting on a single node. can I add nodes later?? plz reply :) On Sun, Mar 25, 2012 at 7:41 PM, Ertio Lew wrote: > I guess 2 node cluster with RF=2 might also be a starting point. Isn't it > ? Are there any issues with this ? > > On Sun, Mar 25, 2012 at 12:20 AM, samal wrote:

RE: Sample Data

Thanks for the prompt response. I am looking at a solution which can generate scripts of statements which I can run or tweak to run in linux environment. -Original Message- From: Benoit Perroud [mailto:ben...@noisette.ch] Sent: Monday, March 26, 2012 4:14 PM To: user@cassandra.apache.org

Re: single row key continues to grow, should I be concerned?

Hi, Jim, it seems we share a very similar use case with highly variable rates in the timeseries data sources we archive. When I first started I was preocupied about this very big difference in row lengths. I was using a schema similar to the one Aaron mentioned: for each data source I had a row wi

Re: Estimation of memtable size are wrong

Dne 26.3.2012 0:36, aaron morton napsal(a): 1. its not possible to run them more often? There should be some limit - run live/serialized calculation at least once per hour. They took just few seconds. The live ratio is updated every time the operation count (since startup) for the CF doubles.

Re: Cassandra - crash with “free() invalid pointer”

I have row cache - it's about 20GB big in this case. The problem can be reproduced with our load test - we are using 20 reader threads on single Cassandra node. I will retest it with Java 6 - still it looks to me like JNA problem and JDK in this case should not matter, but we will see. On Thu, M

Re: Cassandra - crash with “free() invalid pointer”

thanks - I will try it On Thu, Mar 22, 2012 at 10:15 PM, Ben Coverston wrote: > Use a version of the Java 6 runtime, Cassandra hasn't been tested at all > with the Java 7 runtime. > > > On Thu, Mar 22, 2012 at 1:27 PM, Benoit Perroud wrote: > >> Sounds like a race condition in the off heap cachin

Re: Error in FAQ?

If you want to modify a column family, just open the command line interface (cassandra-cli), connect to a node (probably: "connect localhost/9160;"). When you have to create your first keyspace type: "create keyspace MyKeyspace;" For modifying an existing keyspace type: "use MyKeyspace;" If you

How to store a list of values?

I have a profile column family and want to store a list of skills in each profile. In BigTable I could store a Protocol Bufferwith a repeated field, but I'm not sure how this is typically accomplished in Cassandra. One option would b