Re: unbalanced ring
This morning I have nodetool ring -h localhost Address DC RackStatus State LoadOwns Token 113427455640312821154458202477256070485 10.34.158.33us-east 1c Up Normal 5.78 MB 33.33% 0 10.38.175.131 us-east 1c Up Normal 7.23 MB 33.33% 56713727820156410577229101238628035242 10.116.83.10us-east 1c Up Normal 5.02 MB 33.33% 113427455640312821154458202477256070485 Version is 1.0.8. *Tamar Fraenkel * Senior Software Engineer, TOK Media [image: Inline image 1] ta...@tok-media.com Tel: +972 2 6409736 Mob: +972 54 8356490 Fax: +972 2 5612956 On Tue, Mar 27, 2012 at 4:05 AM, Maki Watanabe watanabe.m...@gmail.comwrote: What version are you using? Anyway try nodetool repair compact. maki 2012/3/26 Tamar Fraenkel ta...@tok-media.com Hi! I created Amazon ring using datastax image and started filling the db. The cluster seems un-balanced. nodetool ring returns: Address DC RackStatus State Load OwnsToken 113427455640312821154458202477256070485 10.34.158.33us-east 1c Up Normal 514.29 KB 33.33% 0 10.38.175.131 us-east 1c Up Normal 1.5 MB 33.33% 56713727820156410577229101238628035242 10.116.83.10us-east 1c Up Normal 1.5 MB 33.33% 113427455640312821154458202477256070485 [default@tok] describe; Keyspace: tok: Replication Strategy: org.apache.cassandra.locator.SimpleStrategy Durable Writes: true Options: [replication_factor:2] [default@tok] describe cluster; Cluster Information: Snitch: org.apache.cassandra.locator.Ec2Snitch Partitioner: org.apache.cassandra.dht.RandomPartitioner Schema versions: 4687d620-7664-11e1--1bcb936807ff: [10.38.175.131, 10.34.158.33, 10.116.83.10] Any idea what is the cause? I am running similar code on local ring and it is balanced. How can I fix this? Thanks, *Tamar Fraenkel * Senior Software Engineer, TOK Media [image: Inline image 1] ta...@tok-media.com Tel: +972 2 6409736 Mob: +972 54 8356490 Fax: +972 2 5612956 tokLogo.pngtokLogo.png
RE: Exceptions related to thrift transport
No the clients are fixed However sometimes the queries can be huge like this. To summarize I will have the following in my TODO list to rectify this: Try reducing the batch commit size. Please add some more checks here Thanks, Dushyant From: Ben Coverston [mailto:ben.covers...@datastax.com] Sent: Thursday, March 22, 2012 1:32 AM To: user@cassandra.apache.org Subject: Re: Exceptions related to thrift transport With the crazy message size, the version exception, and the frequency, is there a service that is connecting to the thrift port on occasion and sending garbage (port scan or something else of that nature). Can you rule that out? On Wed, Mar 21, 2012 at 11:15 AM, aaron morton aa...@thelastpickle.commailto:aa...@thelastpickle.com wrote: 1. org.apache.thrift.TException: Message length exceeded: 134218240 thrift_mas_message_length_in_mb https://github.com/apache/cassandra/blob/cassandra-1.0/conf/cassandra.yaml#L243 (134218240 is 128MB, which is a lot of data( 2. org.apache.thrift.protocol.TProtocolException: Missing version in readMessageBegin, old client? What version of hector are you using ? Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 22/03/2012, at 12:02 AM, Tiwari, Dushyant wrote: Hi Cassandra Users, A couple of questions on the server side exceptions that I see sometimes - 1. org.apache.thrift.TException: Message length exceeded: 134218240 * How to configure message length? 2. org.apache.thrift.protocol.TProtocolException: Missing version in readMessageBegin, old client? - How to rectify this exception? Some related client side Exceptions are - 1. org.apache.thrift.transport.TTransportException: java.net.SocketException: Broken pipe 2. me.prettyprint.hector.api.exceptions.HectorTransportException: org.apache.thrift.transport.TTransportException Caused by: org.apache.thrift.transport.TTransportException: null at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132) Using Hector as client. The queries are writes to CF with indexes. The frequency of these exceptions are very low. Thanks, Dushyant NOTICE: Morgan Stanley is not acting as a municipal advisor and the opinions or views contained herein are not intended to be, and do not constitute, advice within the meaning of Section 975 of the Dodd-Frank Wall Street Reform and Consumer Protection Act. If you have received this communication in error, please destroy all electronic and paper copies and notify the sender immediately. Mistransmission is not intended to waive confidentiality or privilege. Morgan Stanley reserves the right, to the extent permitted under applicable law, to monitor electronic communications. This message is subject to terms available at the following link: http://www.morganstanley.com/disclaimers. If you cannot access these links, please notify us by reply message and we will send the contents to you. By messaging with Morgan Stanley you consent to the foregoing. -- Ben Coverston DataStax -- The Apache Cassandra Company -- NOTICE: Morgan Stanley is not acting as a municipal advisor and the opinions or views contained herein are not intended to be, and do not constitute, advice within the meaning of Section 975 of the Dodd-Frank Wall Street Reform and Consumer Protection Act. If you have received this communication in error, please destroy all electronic and paper copies and notify the sender immediately. Mistransmission is not intended to waive confidentiality or privilege. Morgan Stanley reserves the right, to the extent permitted under applicable law, to monitor electronic communications. This message is subject to terms available at the following link: http://www.morganstanley.com/disclaimers. If you cannot access these links, please notify us by reply message and we will send the contents to you. By messaging with Morgan Stanley you consent to the foregoing.
Re: problem in create column family
ya had created with UTF8Type before.. It gave the same error. On executing help assume command it is giving 'utf8' as a type. so can i use comparator='utf8' or not?? Please reply On Mon, Mar 26, 2012 at 9:17 PM, R. Verlangen ro...@us2.nl wrote: You should use the full type names, e.g. create column family MyColumnFamily with comparator=UTF8Type; 2012/3/26 puneet loya puneetl...@gmail.com It is giving errors like Unable to find abstract-type class 'org.apache.cassandra.db.marshal.utf8' and java.lang.RuntimeException: org.apache.cassandra.db.marshal.MarshalException: cannot parse 'catalogueId' as hex bytes where catalogueId is a column that has utf8 as its data type. they may be just synactical errors.. Please suggest if u can help me out on dis?? -- With kind regards, Robin Verlangen www.robinverlangen.nl
Re: problem in create column family
Not sure about that, what version of Cassandra are you using? Maybe someone else here knows how to solve this.. 2012/3/27 puneet loya puneetl...@gmail.com ya had created with UTF8Type before.. It gave the same error. On executing help assume command it is giving 'utf8' as a type. so can i use comparator='utf8' or not?? Please reply On Mon, Mar 26, 2012 at 9:17 PM, R. Verlangen ro...@us2.nl wrote: You should use the full type names, e.g. create column family MyColumnFamily with comparator=UTF8Type; 2012/3/26 puneet loya puneetl...@gmail.com It is giving errors like Unable to find abstract-type class 'org.apache.cassandra.db.marshal.utf8' and java.lang.RuntimeException: org.apache.cassandra.db.marshal.MarshalException: cannot parse 'catalogueId' as hex bytes where catalogueId is a column that has utf8 as its data type. they may be just synactical errors.. Please suggest if u can help me out on dis?? -- With kind regards, Robin Verlangen www.robinverlangen.nl -- With kind regards, Robin Verlangen www.robinverlangen.nl
Re: How to store a list of values?
That's true, but it does not sound like a real problem to me.. Maybe someone else can shed some light upon this. 2012/3/27 samal samalgo...@gmail.com On Tue, Mar 27, 2012 at 1:47 AM, R. Verlangen ro...@us2.nl wrote: but any schema change will break it How do you mean? You don't have to specify the columns in Cassandra so it should work perfect. Except for the skill~ is preserverd for your list. In case skill~ is decided to change to skill:: , it need to be handle at app level. Or otherwise had t update in all row, read it first, modify it, insert new version and delete old version. -- With kind regards, Robin Verlangen www.robinverlangen.nl
Re: Fwd: information on cassandra
Thank you Maki, wasn't aware of that. 2012/3/27 Maki Watanabe watanabe.m...@gmail.com auto_bootstrap has been removed from cassandra.yaml and always enabled since 1.0. fyi. maki 2012/3/26 R. Verlangen ro...@us2.nl: Yes, you can add nodes to a running cluster. It's very simple: configure the cluster name and seed node(s) in cassandra.yaml, set auto_bootstrap to true and start the node. 2012/3/26 puneet loya puneetl...@gmail.com 5n.. consider i m starting on a single node. can I add nodes later?? plz reply :) On Sun, Mar 25, 2012 at 7:41 PM, Ertio Lew ertio...@gmail.com wrote: I guess 2 node cluster with RF=2 might also be a starting point. Isn't it ? Are there any issues with this ? On Sun, Mar 25, 2012 at 12:20 AM, samal samalgo...@gmail.com wrote: Cassandra has distributed architecture. So 1 node does not fit into it. although it can used but you loose its benefits , ok if you are just playing around, use vm to learn how cluster communicate, handle request. To get full tolerance, redundancy and consistency minimum 3 node is required. Imp read here: http://wiki.apache.org/cassandra/ http://www.datastax.com/docs/1.0/index http://thelastpickle.com/ http://www.acunu.com/blogs/all/ On Sat, Mar 24, 2012 at 11:37 PM, Garvita Mehta garvita.me...@tcs.com wrote: its not advisable to use cassandra on single node, as its basic definition says if a node fails, data still remains in the system, atleast 3 nodes must be there while setting up a cassandra cluster. Garvita Mehta CEG - Open Source Technology Group Tata Consultancy Services Ph:- +91 22 67324756 Mailto: garvita.me...@tcs.com Website: http://www.tcs.com Experience certainty. IT Services Business Solutions Outsourcing -puneet loya wrote: - To: user@cassandra.apache.org From: puneet loya puneetl...@gmail.com Date: 03/24/2012 06:36PM Subject: Fwd: information on cassandra hi, I m puneet, an engineering student. I would like to know that, is cassandra useful considering we just have a single node(rather a single system) having all the information. I m looking for decent response time for the database. can you please respond? Thank you , Regards, Puneet Loya =-=-= Notice: The information contained in this e-mail message and/or attachments to it may contain confidential or privileged information. If you are not the intended recipient, any dissemination, use, review, distribution, printing or copying of the information contained in this e-mail message and/or attachments to it are strictly prohibited. If you have received this communication in error, please notify us by reply e-mail or telephone and immediately and permanently delete the message and any attachments. Thank you -- With kind regards, Robin Verlangen www.robinverlangen.nl -- With kind regards, Robin Verlangen www.robinverlangen.nl
Re: How to store a list of values?
YEAH! agree, it only matter for time bucket data. On Tue, Mar 27, 2012 at 12:31 PM, R. Verlangen ro...@us2.nl wrote: That's true, but it does not sound like a real problem to me.. Maybe someone else can shed some light upon this. 2012/3/27 samal samalgo...@gmail.com On Tue, Mar 27, 2012 at 1:47 AM, R. Verlangen ro...@us2.nl wrote: but any schema change will break it How do you mean? You don't have to specify the columns in Cassandra so it should work perfect. Except for the skill~ is preserverd for your list. In case skill~ is decided to change to skill:: , it need to be handle at app level. Or otherwise had t update in all row, read it first, modify it, insert new version and delete old version. -- With kind regards, Robin Verlangen www.robinverlangen.nl
Re: unbalanced ring
Thanks, I will wait and see as data accumulates. Thanks, *Tamar Fraenkel * Senior Software Engineer, TOK Media [image: Inline image 1] ta...@tok-media.com Tel: +972 2 6409736 Mob: +972 54 8356490 Fax: +972 2 5612956 On Tue, Mar 27, 2012 at 9:00 AM, R. Verlangen ro...@us2.nl wrote: Cassandra is built to store tons and tons of data. In my opinion roughly ~ 6MB per node is not enough data to allow it to become a fully balanced cluster. 2012/3/27 Tamar Fraenkel ta...@tok-media.com This morning I have nodetool ring -h localhost Address DC RackStatus State Load OwnsToken 113427455640312821154458202477256070485 10.34.158.33us-east 1c Up Normal 5.78 MB 33.33% 0 10.38.175.131 us-east 1c Up Normal 7.23 MB 33.33% 56713727820156410577229101238628035242 10.116.83.10us-east 1c Up Normal 5.02 MB 33.33% 113427455640312821154458202477256070485 Version is 1.0.8. *Tamar Fraenkel * Senior Software Engineer, TOK Media [image: Inline image 1] ta...@tok-media.com Tel: +972 2 6409736 Mob: +972 54 8356490 Fax: +972 2 5612956 On Tue, Mar 27, 2012 at 4:05 AM, Maki Watanabe watanabe.m...@gmail.comwrote: What version are you using? Anyway try nodetool repair compact. maki 2012/3/26 Tamar Fraenkel ta...@tok-media.com Hi! I created Amazon ring using datastax image and started filling the db. The cluster seems un-balanced. nodetool ring returns: Address DC RackStatus State Load OwnsToken 113427455640312821154458202477256070485 10.34.158.33us-east 1c Up Normal 514.29 KB 33.33% 0 10.38.175.131 us-east 1c Up Normal 1.5 MB 33.33% 56713727820156410577229101238628035242 10.116.83.10us-east 1c Up Normal 1.5 MB 33.33% 113427455640312821154458202477256070485 [default@tok] describe; Keyspace: tok: Replication Strategy: org.apache.cassandra.locator.SimpleStrategy Durable Writes: true Options: [replication_factor:2] [default@tok] describe cluster; Cluster Information: Snitch: org.apache.cassandra.locator.Ec2Snitch Partitioner: org.apache.cassandra.dht.RandomPartitioner Schema versions: 4687d620-7664-11e1--1bcb936807ff: [10.38.175.131, 10.34.158.33, 10.116.83.10] Any idea what is the cause? I am running similar code on local ring and it is balanced. How can I fix this? Thanks, *Tamar Fraenkel * Senior Software Engineer, TOK Media [image: Inline image 1] ta...@tok-media.com Tel: +972 2 6409736 Mob: +972 54 8356490 Fax: +972 2 5612956 -- With kind regards, Robin Verlangen www.robinverlangen.nl tokLogo.pngtokLogo.png
Re: problem in create column family
I m using cassandra 1.0.8.. Please reply On Tue, Mar 27, 2012 at 12:28 PM, R. Verlangen ro...@us2.nl wrote: Not sure about that, what version of Cassandra are you using? Maybe someone else here knows how to solve this.. 2012/3/27 puneet loya puneetl...@gmail.com ya had created with UTF8Type before.. It gave the same error. On executing help assume command it is giving 'utf8' as a type. so can i use comparator='utf8' or not?? Please reply On Mon, Mar 26, 2012 at 9:17 PM, R. Verlangen ro...@us2.nl wrote: You should use the full type names, e.g. create column family MyColumnFamily with comparator=UTF8Type; 2012/3/26 puneet loya puneetl...@gmail.com It is giving errors like Unable to find abstract-type class 'org.apache.cassandra.db.marshal.utf8' and java.lang.RuntimeException: org.apache.cassandra.db.marshal.MarshalException: cannot parse 'catalogueId' as hex bytes where catalogueId is a column that has utf8 as its data type. they may be just synactical errors.. Please suggest if u can help me out on dis?? -- With kind regards, Robin Verlangen www.robinverlangen.nl -- With kind regards, Robin Verlangen www.robinverlangen.nl
Re: Schema advice/help
without the ability to do disjoint column slices, i would probably use 5 different rows. userId:itemType - activityId then it's a multiget slice of 10 items from each of your 5 rows. On 26/03/2012 22:16, Ertio Lew wrote: I need to store activities by each user, on 5 items types. I always want to read last 10 activities on each item type, by a user (ie, total activities to read at a time =50). I am wanting to store these activities in a single row for each user so that they can be retrieved in single row query, since I want to read all the last 10 activities on each item.. I am thinking of creating composite names appending itemtype : activityId(activityId is just timestamp value) but then, I don't see about how to read the last 10 activities from all itemtypes. Any ideas about schema to do this better way ?
Re: problem in create column family
why don't you show us the command you're actually trying to run? On 27/03/2012 08:52, puneet loya wrote: I m using cassandra 1.0.8.. Please reply On Tue, Mar 27, 2012 at 12:28 PM, R. Verlangen ro...@us2.nl mailto:ro...@us2.nl wrote: Not sure about that, what version of Cassandra are you using? Maybe someone else here knows how to solve this.. 2012/3/27 puneet loya puneetl...@gmail.com mailto:puneetl...@gmail.com ya had created with UTF8Type before.. It gave the same error. On executing help assume command it is giving 'utf8' as a type. so can i use comparator='utf8' or not?? Please reply On Mon, Mar 26, 2012 at 9:17 PM, R. Verlangen ro...@us2.nl mailto:ro...@us2.nl wrote: You should use the full type names, e.g. create column family MyColumnFamily with comparator=UTF8Type; 2012/3/26 puneet loya puneetl...@gmail.com mailto:puneetl...@gmail.com It is giving errors like Unable to find abstract-type class 'org.apache.cassandra.db.marshal.utf8' and java.lang.RuntimeException: org.apache.cassandra.db.marshal.MarshalException: cannot parse 'catalogueId' as hex bytes where catalogueId is a column that has utf8 as its data type. they may be just synactical errors.. Please suggest if u can help me out on dis?? -- With kind regards, Robin Verlangen www.robinverlangen.nl http://www.robinverlangen.nl -- With kind regards, Robin Verlangen www.robinverlangen.nl http://www.robinverlangen.nl
Re: Schema advice/help
multiget would require Order Preserving Partitioner, and this can lead to unbalanced ring and hot spots. Maybe you can use secondary index on itemtype - is must have small cardinality: http://pkghosh.wordpress.com/2011/03/02/cassandra-secondary-index-patterns/ On Tue, Mar 27, 2012 at 10:10 AM, Guy Incognito dnd1...@gmail.com wrote: without the ability to do disjoint column slices, i would probably use 5 different rows. userId:itemType - activityId then it's a multiget slice of 10 items from each of your 5 rows. On 26/03/2012 22:16, Ertio Lew wrote: I need to store activities by each user, on 5 items types. I always want to read last 10 activities on each item type, by a user (ie, total activities to read at a time =50). I am wanting to store these activities in a single row for each user so that they can be retrieved in single row query, since I want to read all the last 10 activities on each item.. I am thinking of creating composite names appending itemtype : activityId(activityId is just timestamp value) but then, I don't see about how to read the last 10 activities from all itemtypes. Any ideas about schema to do this better way ?
Re: Schema advice/help
You can just get a slice range with as start userId: and no end. 2012/3/27 Maciej Miklas mac.mik...@googlemail.com multiget would require Order Preserving Partitioner, and this can lead to unbalanced ring and hot spots. Maybe you can use secondary index on itemtype - is must have small cardinality: http://pkghosh.wordpress.com/2011/03/02/cassandra-secondary-index-patterns/ On Tue, Mar 27, 2012 at 10:10 AM, Guy Incognito dnd1...@gmail.com wrote: without the ability to do disjoint column slices, i would probably use 5 different rows. userId:itemType - activityId then it's a multiget slice of 10 items from each of your 5 rows. On 26/03/2012 22:16, Ertio Lew wrote: I need to store activities by each user, on 5 items types. I always want to read last 10 activities on each item type, by a user (ie, total activities to read at a time =50). I am wanting to store these activities in a single row for each user so that they can be retrieved in single row query, since I want to read all the last 10 activities on each item.. I am thinking of creating composite names appending itemtype : activityId(activityId is just timestamp value) but then, I don't see about how to read the last 10 activities from all itemtypes. Any ideas about schema to do this better way ? -- With kind regards, Robin Verlangen www.robinverlangen.nl
Re: tombstones problem with 1.0.8
Any pointers on what I should be looking for in our application that would be stopping the deletion of tombstones? Thanks, Ross On 26 March 2012 16:27, Viktor Jevdokimov viktor.jevdoki...@adform.comwrote: Upon read from S1 S6 rows are merged, T3 timestamp wins. T1 will be deleted upon S1 compaction with S6 or manual cleanup. We're running major compactions nightly, a lot of inserts per day with TTL, some with deletes from app - no problems with tombstones. Best regards/ Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com Phone: +370 5 212 3063 Fax: +370 5 261 0453 J. Jasinskio 16C, LT-01112 Vilnius, Lithuania Disclaimer: The information contained in this message and attachments is intended solely for the attention and use of the named addressee and may be confidential. If you are not the intended recipient, you are reminded that the information remains the property of the sender. You must not use, disclose, distribute, copy, print or rely on this e-mail. If you have received this message in error, please contact the sender immediately and irrevocably delete this message and any copies.-Original Message- From: Radim Kolar [mailto:h...@filez.com] Sent: Sunday, March 25, 2012 13:20 To: user@cassandra.apache.org Subject: Re: tombstones problem with 1.0.8 Scenario 4 T1 write column T2 Flush memtable to S1 T3 del row T4 flush memtable to S5 T5 tomstone S5 expires T6 S5 is compacted but not with S1 Result?
Re: tombstones problem with 1.0.8
Dne 27.3.2012 11:13, Ross Black napsal(a): Any pointers on what I should be looking for in our application that would be stopping the deletion of tombstones? do not delete already deleted rows. On read cassandra returns deleted rows as empty in range slices.
Re: Schema advice/help
@R. Verlangen: You are suggesting to keep a single row for all activities read all the columns from the row then filter, right!? If done that way (instead of keeping it in 5 rows) then I would need to retrieve 100s-200s of columns from single row rather than just 50 columns if I keep in 5 rows.. Which of these two would be better ? More columns from single row OR less columns from multiple rows ? On Tue, Mar 27, 2012 at 2:27 PM, R. Verlangen ro...@us2.nl wrote: You can just get a slice range with as start userId: and no end. 2012/3/27 Maciej Miklas mac.mik...@googlemail.com multiget would require Order Preserving Partitioner, and this can lead to unbalanced ring and hot spots. Maybe you can use secondary index on itemtype - is must have small cardinality: http://pkghosh.wordpress.com/2011/03/02/cassandra-secondary-index-patterns/ On Tue, Mar 27, 2012 at 10:10 AM, Guy Incognito dnd1...@gmail.comwrote: without the ability to do disjoint column slices, i would probably use 5 different rows. userId:itemType - activityId then it's a multiget slice of 10 items from each of your 5 rows. On 26/03/2012 22:16, Ertio Lew wrote: I need to store activities by each user, on 5 items types. I always want to read last 10 activities on each item type, by a user (ie, total activities to read at a time =50). I am wanting to store these activities in a single row for each user so that they can be retrieved in single row query, since I want to read all the last 10 activities on each item.. I am thinking of creating composite names appending itemtype : activityId(activityId is just timestamp value) but then, I don't see about how to read the last 10 activities from all itemtypes. Any ideas about schema to do this better way ? -- With kind regards, Robin Verlangen www.robinverlangen.nl
[BETA RELEASE] Apache Cassandra 1.1.0-beta2 released
The Cassandra team is pleased to announce the release of the second beta for the future Apache Cassandra 1.1. Note that this is beta software and as such is *not* ready for production use. The goal of this release is to give a preview of what will become Cassandra 1.1 and to get wider testing before the final release. All help in testing this release would be therefore greatly appreciated and please report any problem you may encounter[3,4]. Have a look at the change log[1] and the release notes[2] to see where Cassandra 1.1 differs from the previous series. Apache Cassandra 1.1.0-beta2[5] is available as usual from the cassandra website (http://cassandra.apache.org/download/) and a debian package is available using the 11x branch (see http://wiki.apache.org/cassandra/DebianPackaging). Thank you for your help in testing and have fun with it. [1]: http://goo.gl/nX7UL (CHANGES.txt) [2]: http://goo.gl/TB9ro (NEWS.txt) [3]: https://issues.apache.org/jira/browse/CASSANDRA [4]: user@cassandra.apache.org [5]: http://git-wip-us.apache.org/repos/asf?p=cassandra.git;a=shortlog;h=refs/tags/cassandra-1.1.0-beta2
Re: [BETA RELEASE] Apache Cassandra 1.1.0-beta2 released
Hi All, Thanks a lot for the release. I just upgraded my 1.1-beta1 to 1.1-beta2, and I get the following error : INFO 10:56:17,089 Opening /app/cassandra/data/data/system/LocationInfo/system-LocationInfo-hc-18 (74 bytes) INFO 10:56:17,092 Opening /app/cassandra/data/data/system/LocationInfo/system-LocationInfo-hc-17 (486 bytes) ERROR 10:56:17,306 Exception encountered during startup java.lang.NullPointerException at org.apache.cassandra.utils.ByteBufferUtil.string(ByteBufferUtil.java:163) at org.apache.cassandra.utils.ByteBufferUtil.string(ByteBufferUtil.java:120) at org.apache.cassandra.cql.jdbc.JdbcUTF8.getString(JdbcUTF8.java:77) at org.apache.cassandra.cql.jdbc.JdbcUTF8.compose(JdbcUTF8.java:97) at org.apache.cassandra.db.marshal.UTF8Type.compose(UTF8Type.java:35) at org.apache.cassandra.cql3.UntypedResultSet$Row.getString(UntypedResultSet.java:87) at org.apache.cassandra.config.CFMetaData.fromSchemaNoColumns(CFMetaData.java:1008) at org.apache.cassandra.config.CFMetaData.fromSchema(CFMetaData.java:1053) at org.apache.cassandra.config.KSMetaData.deserializeColumnFamilies(KSMetaData.java:261) at org.apache.cassandra.config.KSMetaData.fromSchema(KSMetaData.java:242) at org.apache.cassandra.db.DefsTable.loadFromTable(DefsTable.java:158) at org.apache.cassandra.config.DatabaseDescriptor.loadSchemas(DatabaseDescriptor.java:514) at org.apache.cassandra.service.AbstractCassandraDaemon.setup(AbstractCassandraDaemon.java:182) at org.apache.cassandra.service.AbstractCassandraDaemon.activate(AbstractCassandraDaemon.java:353) at org.apache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:106) Thanks for your support, Benoit. Le 27 mars 2012 11:55, Sylvain Lebresne sylv...@datastax.com a écrit : The Cassandra team is pleased to announce the release of the second beta for the future Apache Cassandra 1.1. Note that this is beta software and as such is *not* ready for production use. The goal of this release is to give a preview of what will become Cassandra 1.1 and to get wider testing before the final release. All help in testing this release would be therefore greatly appreciated and please report any problem you may encounter[3,4]. Have a look at the change log[1] and the release notes[2] to see where Cassandra 1.1 differs from the previous series. Apache Cassandra 1.1.0-beta2[5] is available as usual from the cassandra website (http://cassandra.apache.org/download/) and a debian package is available using the 11x branch (see http://wiki.apache.org/cassandra/DebianPackaging). Thank you for your help in testing and have fun with it. [1]: http://goo.gl/nX7UL (CHANGES.txt) [2]: http://goo.gl/TB9ro (NEWS.txt) [3]: https://issues.apache.org/jira/browse/CASSANDRA [4]: user@cassandra.apache.org [5]: http://git-wip-us.apache.org/repos/asf?p=cassandra.git;a=shortlog;h=refs/tags/cassandra-1.1.0-beta2 -- sent from my Nokia 3210
Re: problem in create column family
create column family student
with column_type = 'AsciiType'
and column_metadata =
[{
column_name : name,
validation_class : 'AsciiType
}];
On Tue, Mar 27, 2012 at 1:48 PM, Guy Incognito dnd1...@gmail.com wrote:
why don't you show us the command you're actually trying to run?
On 27/03/2012 08:52, puneet loya wrote:
I m using cassandra 1.0.8..
Please reply
On Tue, Mar 27, 2012 at 12:28 PM, R. Verlangen ro...@us2.nl wrote:
Not sure about that, what version of Cassandra are you using? Maybe
someone else here knows how to solve this..
2012/3/27 puneet loya puneetl...@gmail.com
ya had created with UTF8Type before.. It gave the same error.
On executing help assume command it is giving 'utf8' as a type.
so can i use comparator='utf8' or not??
Please reply
On Mon, Mar 26, 2012 at 9:17 PM, R. Verlangen ro...@us2.nl wrote:
You should use the full type names, e.g.
create column family MyColumnFamily with comparator=UTF8Type;
2012/3/26 puneet loya puneetl...@gmail.com
It is giving errors like Unable to find abstract-type class
'org.apache.cassandra.db.marshal.utf8'
and java.lang.RuntimeException:
org.apache.cassandra.db.marshal.MarshalException: cannot parse
'catalogueId' as hex bytes
where catalogueId is a column that has utf8 as its data type. they
may be just synactical errors..
Please suggest if u can help me out on dis??
--
With kind regards,
Robin Verlangen
www.robinverlangen.nl
--
With kind regards,
Robin Verlangen
www.robinverlangen.nl
counter column family
Can u give an example of create column family with counter column in it. Please reply Regards, Puneet Loya
Re: cassandra 1.08 on java7 and win7
create keyspace DEMO
with placement_strategy =
'org.apache.cassandra.locator.NetworkTopologyStrategy'
and strategy_options=[{datacenter1:1}];
try it n check if it executes
On Tue, Mar 27, 2012 at 3:35 AM, Frank Hsueh frank.hs...@gmail.com wrote:
create keyspace via cassandra cli fails
https://issues.apache.org/jira/browse/CASSANDRA-4085
On Mon, Mar 26, 2012 at 2:44 PM, Sasha Dolgy sdo...@gmail.com wrote:
best to open an issue: https://issues.apache.org/jira/browse/CASSANDRA
On Mon, Mar 26, 2012 at 11:35 PM, Frank Hsueh frank.hs...@gmail.comwrote:
err ... same thing happens with Java 1.6
On Mon, Mar 26, 2012 at 2:35 PM, Frank Hsueh frank.hs...@gmail.comwrote:
I'm using the latest of Java 1.6 from Oracle.
On Mon, Mar 26, 2012 at 2:29 PM, R. Verlangen ro...@us2.nl wrote:
Ben Coverston wrote earlier today: Use a version of the Java 6
runtime, Cassandra hasn't been tested at all with the Java 7 runtime
So I think that might be a good way to start.
2012/3/26 Frank Hsueh frank.hs...@gmail.com
I think I have cassandra the server started
In another window:
cassandra-cli.bat -h localhost -p 9160
Starting Cassandra Client
Connected to: Test Cluster on localhost/9160
Welcome to Cassandra CLI version 1.0.8
Type 'help;' or '?' for help.
Type 'quit;' or 'exit;' to quit.
[default@unknown] create keyspace DEMO;
log4j:WARN No appenders could be found for logger
(org.apache.cassandra.config.DatabaseDescriptor).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfigfor
more info.
Cannot locate cassandra.yaml
Fatal configuration error; unable to start server. See log for
stacktrace.
C:\Workspace\cassandra\apache-cassandra-1.0.8\bin
anybody seen this before ?
--
Frank Hsueh | frank.hs...@gmail.com
--
With kind regards,
Robin Verlangen
www.robinverlangen.nl
--
Frank Hsueh | frank.hs...@gmail.com
--
Frank Hsueh | frank.hs...@gmail.com
--
Sasha Dolgy
sasha.do...@gmail.com
--
Frank Hsueh | frank.hs...@gmail.com
Re: counter column family
*create column family MyCounterColumnFamily with default_validation_class=CounterColumnType and key_validation_class=UTF8Type and comparator=UTF8Type;* There you go! Keys must be utf8, as well as the column names. Of course you can change those validators. Cheers! 2012/3/27 puneet loya puneetl...@gmail.com Can u give an example of create column family with counter column in it. Please reply Regards, Puneet Loya -- With kind regards, Robin Verlangen www.robinverlangen.nl
create column family
create column family users
(uuid PRIMARY KEY
firstname text,
lastname text,
email text,
address text,
zip int,
state text);
Is dis above statement correct?
I m getting an error Syntax error at position 27: missing EOF at '('
Do reply
Can u suggest the most stable version of cassandra??
Re: counter column family
thanxx a ton :) :) the counter column family works synonymous as 'auto increment' in other databases rite? I mean we have a column of type integer which increments with every insert. Am i goin the rite way?? please reply :) On Tue, Mar 27, 2012 at 5:50 PM, R. Verlangen ro...@us2.nl wrote: *create column family MyCounterColumnFamily with default_validation_class=CounterColumnType and key_validation_class=UTF8Type and comparator=UTF8Type;* There you go! Keys must be utf8, as well as the column names. Of course you can change those validators. Cheers! 2012/3/27 puneet loya puneetl...@gmail.com Can u give an example of create column family with counter column in it. Please reply Regards, Puneet Loya -- With kind regards, Robin Verlangen www.robinverlangen.nl
Re: [BETA RELEASE] Apache Cassandra 1.1.0-beta2 released
Actually, there was a few changes to the on-disk format of schema between beta1 and beta2 so upgrade is not supported between those two beta versions. Sorry for any inconvenience. -- Sylvain On Tue, Mar 27, 2012 at 12:57 PM, Benoit Perroud ben...@noisette.ch wrote: Hi All, Thanks a lot for the release. I just upgraded my 1.1-beta1 to 1.1-beta2, and I get the following error : INFO 10:56:17,089 Opening /app/cassandra/data/data/system/LocationInfo/system-LocationInfo-hc-18 (74 bytes) INFO 10:56:17,092 Opening /app/cassandra/data/data/system/LocationInfo/system-LocationInfo-hc-17 (486 bytes) ERROR 10:56:17,306 Exception encountered during startup java.lang.NullPointerException at org.apache.cassandra.utils.ByteBufferUtil.string(ByteBufferUtil.java:163) at org.apache.cassandra.utils.ByteBufferUtil.string(ByteBufferUtil.java:120) at org.apache.cassandra.cql.jdbc.JdbcUTF8.getString(JdbcUTF8.java:77) at org.apache.cassandra.cql.jdbc.JdbcUTF8.compose(JdbcUTF8.java:97) at org.apache.cassandra.db.marshal.UTF8Type.compose(UTF8Type.java:35) at org.apache.cassandra.cql3.UntypedResultSet$Row.getString(UntypedResultSet.java:87) at org.apache.cassandra.config.CFMetaData.fromSchemaNoColumns(CFMetaData.java:1008) at org.apache.cassandra.config.CFMetaData.fromSchema(CFMetaData.java:1053) at org.apache.cassandra.config.KSMetaData.deserializeColumnFamilies(KSMetaData.java:261) at org.apache.cassandra.config.KSMetaData.fromSchema(KSMetaData.java:242) at org.apache.cassandra.db.DefsTable.loadFromTable(DefsTable.java:158) at org.apache.cassandra.config.DatabaseDescriptor.loadSchemas(DatabaseDescriptor.java:514) at org.apache.cassandra.service.AbstractCassandraDaemon.setup(AbstractCassandraDaemon.java:182) at org.apache.cassandra.service.AbstractCassandraDaemon.activate(AbstractCassandraDaemon.java:353) at org.apache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:106) Thanks for your support, Benoit. Le 27 mars 2012 11:55, Sylvain Lebresne sylv...@datastax.com a écrit : The Cassandra team is pleased to announce the release of the second beta for the future Apache Cassandra 1.1. Note that this is beta software and as such is *not* ready for production use. The goal of this release is to give a preview of what will become Cassandra 1.1 and to get wider testing before the final release. All help in testing this release would be therefore greatly appreciated and please report any problem you may encounter[3,4]. Have a look at the change log[1] and the release notes[2] to see where Cassandra 1.1 differs from the previous series. Apache Cassandra 1.1.0-beta2[5] is available as usual from the cassandra website (http://cassandra.apache.org/download/) and a debian package is available using the 11x branch (see http://wiki.apache.org/cassandra/DebianPackaging). Thank you for your help in testing and have fun with it. [1]: http://goo.gl/nX7UL (CHANGES.txt) [2]: http://goo.gl/TB9ro (NEWS.txt) [3]: https://issues.apache.org/jira/browse/CASSANDRA [4]: user@cassandra.apache.org [5]: http://git-wip-us.apache.org/repos/asf?p=cassandra.git;a=shortlog;h=refs/tags/cassandra-1.1.0-beta2 -- sent from my Nokia 3210
Re: create column family
how to use cql??
Rite now i m running dis file cassandra-cli.bat
i connect localhost/9160;
den i went into use pun; //its a keyspace
using the create statement
create COLUMNFAMILY users
(KY uuid PRIMARY KEY*,*
firstname text,
lastname text,
email text,
address text,
zip int,
state text);**
it is gining error??
how to write in cql??
do we have to shift to some other environment.. for using cql
On Tue, Mar 27, 2012 at 5:58 PM, Rishabh Agrawal
rishabh.agra...@impetus.co.in wrote:
If you are using cql then following statement is more apt:
create COLUMNFAMILY users
(KY uuid PRIMARY KEY*,*
firstname text,
lastname text,
email text,
address text,
zip int,
state text);**
*From:* puneet loya [mailto:puneetl...@gmail.com]
*Sent:* Tuesday, March 27, 2012 5:54 PM
*To:* user@cassandra.apache.org
*Subject:* create column family
create column family users
(uuid PRIMARY KEY
firstname text,
lastname text,
email text,
address text,
zip int,
state text);
Is dis above statement correct?
I m getting an error Syntax error at position 27: missing EOF at '('
Do reply
Can u suggest the most stable version of cassandra??
--
Impetus to sponsor and exhibit at Structure Data 2012, NY; Mar 21-22. Know
more about our Big Data quick-start program at the event.
New Impetus webcast ‘Cloud-enabled Performance Testing vis-à-vis
On-premise’ available at http://bit.ly/z6zT4L.
NOTE: This message may contain information that is confidential,
proprietary, privileged or otherwise protected by law. The message is
intended solely for the named addressee. If received in error, please
destroy and notify the sender. Any use of this email is prohibited when
received in error. Impetus does not represent, warrant and/or guarantee,
that the integrity of this communication has been maintained nor that the
communication is free of errors, virus, interception or interference.
import
I want to import files from excel to cassandra? Is it possible?? Any tool that can help?? Whats the best way?? Plz reply :)
Re: counter column family
You should use a connection pool without retries to prevent a single increment of +1 have a result of e.g. +3. 2012/3/27 Rishabh Agrawal rishabh.agra...@impetus.co.in You can even define how much increment you want. But let me just warn you, as far my knowledge, it has consistency issues. *From:* puneet loya [mailto:puneetl...@gmail.com] *Sent:* Tuesday, March 27, 2012 5:59 PM *To:* user@cassandra.apache.org *Subject:* Re: counter column family thanxx a ton :) :) the counter column family works synonymous as 'auto increment' in other databases rite? I mean we have a column of type integer which increments with every insert. Am i goin the rite way?? please reply :) On Tue, Mar 27, 2012 at 5:50 PM, R. Verlangen ro...@us2.nl wrote: *create column family MyCounterColumnFamily with default_validation_class=CounterColumnType and key_validation_class=UTF8Type and comparator=UTF8Type;* There you go! Keys must be utf8, as well as the column names. Of course you can change those validators. Cheers! 2012/3/27 puneet loya puneetl...@gmail.com Can u give an example of create column family with counter column in it. Please reply Regards, Puneet Loya -- With kind regards, Robin Verlangen www.robinverlangen.nl -- Impetus to sponsor and exhibit at Structure Data 2012, NY; Mar 21-22. Know more about our Big Data quick-start program at the event. New Impetus webcast ‘Cloud-enabled Performance Testing vis-à-vis On-premise’ available at http://bit.ly/z6zT4L. NOTE: This message may contain information that is confidential, proprietary, privileged or otherwise protected by law. The message is intended solely for the named addressee. If received in error, please destroy and notify the sender. Any use of this email is prohibited when received in error. Impetus does not represent, warrant and/or guarantee, that the integrity of this communication has been maintained nor that the communication is free of errors, virus, interception or interference. -- With kind regards, Robin Verlangen www.robinverlangen.nl
Re: counter column family
wen i m using a counter column.. i m nt able to add columns of other type
to the column family.. is it so or it is just synactical error??
[default@CMDCv99] create column family status
... with comparator = AsciiType
... and column_metadata =
... [{
... column_name : Test,
... validation_class : IntegerType,
... index_type : 0,
... index_name : IdxName},
... {
... column_name : 'other name',
... validation_class : CounterColumnType
... }];
Cannot add a counter column (other name) in a non counter column family
On Tue, Mar 27, 2012 at 6:55 PM, R. Verlangen ro...@us2.nl wrote:
You should use a connection pool without retries to prevent a single
increment of +1 have a result of e.g. +3.
2012/3/27 Rishabh Agrawal rishabh.agra...@impetus.co.in
You can even define how much increment you want. But let me just warn
you, as far my knowledge, it has consistency issues.
*From:* puneet loya [mailto:puneetl...@gmail.com]
*Sent:* Tuesday, March 27, 2012 5:59 PM
*To:* user@cassandra.apache.org
*Subject:* Re: counter column family
thanxx a ton :) :)
the counter column family works synonymous as 'auto increment' in other
databases rite?
I mean we have a column of type integer which increments with every
insert.
Am i goin the rite way??
please reply :)
On Tue, Mar 27, 2012 at 5:50 PM, R. Verlangen ro...@us2.nl wrote:
*create column family MyCounterColumnFamily with
default_validation_class=CounterColumnType and
key_validation_class=UTF8Type and comparator=UTF8Type;*
There you go! Keys must be utf8, as well as the column names. Of course
you can change those validators.
Cheers!
2012/3/27 puneet loya puneetl...@gmail.com
Can u give an example of create column family with counter column in it.
Please reply
Regards,
Puneet Loya
--
With kind regards,
Robin Verlangen
www.robinverlangen.nl
--
Impetus to sponsor and exhibit at Structure Data 2012, NY; Mar 21-22.
Know more about our Big Data quick-start program at the event.
New Impetus webcast ‘Cloud-enabled Performance Testing vis-à-vis
On-premise’ available at http://bit.ly/z6zT4L.
NOTE: This message may contain information that is confidential,
proprietary, privileged or otherwise protected by law. The message is
intended solely for the named addressee. If received in error, please
destroy and notify the sender. Any use of this email is prohibited when
received in error. Impetus does not represent, warrant and/or guarantee,
that the integrity of this communication has been maintained nor that the
communication is free of errors, virus, interception or interference.
--
With kind regards,
Robin Verlangen
www.robinverlangen.nl
Re: [BETA RELEASE] Apache Cassandra 1.1.0-beta2 released
Thanks for the quick feedback. I will drop the schema then. Benoit. Le 27 mars 2012 14:50, Sylvain Lebresne sylv...@datastax.com a écrit : Actually, there was a few changes to the on-disk format of schema between beta1 and beta2 so upgrade is not supported between those two beta versions. Sorry for any inconvenience. -- Sylvain On Tue, Mar 27, 2012 at 12:57 PM, Benoit Perroud ben...@noisette.ch wrote: Hi All, Thanks a lot for the release. I just upgraded my 1.1-beta1 to 1.1-beta2, and I get the following error : INFO 10:56:17,089 Opening /app/cassandra/data/data/system/LocationInfo/system-LocationInfo-hc-18 (74 bytes) INFO 10:56:17,092 Opening /app/cassandra/data/data/system/LocationInfo/system-LocationInfo-hc-17 (486 bytes) ERROR 10:56:17,306 Exception encountered during startup java.lang.NullPointerException at org.apache.cassandra.utils.ByteBufferUtil.string(ByteBufferUtil.java:163) at org.apache.cassandra.utils.ByteBufferUtil.string(ByteBufferUtil.java:120) at org.apache.cassandra.cql.jdbc.JdbcUTF8.getString(JdbcUTF8.java:77) at org.apache.cassandra.cql.jdbc.JdbcUTF8.compose(JdbcUTF8.java:97) at org.apache.cassandra.db.marshal.UTF8Type.compose(UTF8Type.java:35) at org.apache.cassandra.cql3.UntypedResultSet$Row.getString(UntypedResultSet.java:87) at org.apache.cassandra.config.CFMetaData.fromSchemaNoColumns(CFMetaData.java:1008) at org.apache.cassandra.config.CFMetaData.fromSchema(CFMetaData.java:1053) at org.apache.cassandra.config.KSMetaData.deserializeColumnFamilies(KSMetaData.java:261) at org.apache.cassandra.config.KSMetaData.fromSchema(KSMetaData.java:242) at org.apache.cassandra.db.DefsTable.loadFromTable(DefsTable.java:158) at org.apache.cassandra.config.DatabaseDescriptor.loadSchemas(DatabaseDescriptor.java:514) at org.apache.cassandra.service.AbstractCassandraDaemon.setup(AbstractCassandraDaemon.java:182) at org.apache.cassandra.service.AbstractCassandraDaemon.activate(AbstractCassandraDaemon.java:353) at org.apache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:106) Thanks for your support, Benoit. Le 27 mars 2012 11:55, Sylvain Lebresne sylv...@datastax.com a écrit : The Cassandra team is pleased to announce the release of the second beta for the future Apache Cassandra 1.1. Note that this is beta software and as such is *not* ready for production use. The goal of this release is to give a preview of what will become Cassandra 1.1 and to get wider testing before the final release. All help in testing this release would be therefore greatly appreciated and please report any problem you may encounter[3,4]. Have a look at the change log[1] and the release notes[2] to see where Cassandra 1.1 differs from the previous series. Apache Cassandra 1.1.0-beta2[5] is available as usual from the cassandra website (http://cassandra.apache.org/download/) and a debian package is available using the 11x branch (see http://wiki.apache.org/cassandra/DebianPackaging). Thank you for your help in testing and have fun with it. [1]: http://goo.gl/nX7UL (CHANGES.txt) [2]: http://goo.gl/TB9ro (NEWS.txt) [3]: https://issues.apache.org/jira/browse/CASSANDRA [4]: user@cassandra.apache.org [5]: http://git-wip-us.apache.org/repos/asf?p=cassandra.git;a=shortlog;h=refs/tags/cassandra-1.1.0-beta2 -- sent from my Nokia 3210 -- sent from my Nokia 3210
Re: Cannot start cassandra node anymore
Hi Carlo, Can you post steps to reproduce over on https://issues.apache.org/jira/browse/CASSANDRA-3819 ? We have tried and failed to cause this problem. On Thu, Jan 26, 2012 at 6:24 AM, Carlo Pires carlopi...@gmail.com wrote: I found out this is related to schema change. Happens *every time* I create drop and new CF with composite types. As workaround I: * never stop all nodes together To stop a node: * repair and compact a node before stopping it * stop and start it again * if it started fine good if not, remove all data and restart the node (and wait...) 2012/1/25 aaron morton aa...@thelastpickle.com There is someone wrong with the way a composite type value was serialized. The length of a part on disk is not right. As a work around remove the log file, restart and then repair the node. How it got like that is another question. What was the schema change ? Cheers -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of DataStax, the source for professional Cassandra support http://www.datastax.com
Re: counter column family
Counter columns are special, they must be in a column family to themselves.
On 03/27/2012 09:32 AM, puneet loya wrote:
wen i m using a counter column.. i m nt able to add columns of other
type to the column family.. is it so or it is just synactical error??
[default@CMDCv99] create column family status
... with comparator = AsciiType
... and column_metadata =
... [{
... column_name : Test,
... validation_class : IntegerType,
... index_type : 0,
... index_name : IdxName},
... {
... column_name : 'other name',
... validation_class : CounterColumnType
... }];
Cannot add a counter column (other name) in a non counter column family
On Tue, Mar 27, 2012 at 6:55 PM, R. Verlangen ro...@us2.nl
mailto:ro...@us2.nl wrote:
You should use a connection pool without retries to prevent a
single increment of +1 have a result of e.g. +3.
2012/3/27 Rishabh Agrawal rishabh.agra...@impetus.co.in
mailto:rishabh.agra...@impetus.co.in
You can even define how much increment you want. But let me
just warn you, as far my knowledge, it has consistency issues.
*From:*puneet loya [mailto:puneetl...@gmail.com
mailto:puneetl...@gmail.com]
*Sent:* Tuesday, March 27, 2012 5:59 PM
*To:* user@cassandra.apache.org mailto:user@cassandra.apache.org
*Subject:* Re: counter column family
thanxx a ton :) :)
the counter column family works synonymous as 'auto increment'
in other databases rite?
I mean we have a column of type integer which increments with
every insert.
Am i goin the rite way??
please reply :)
On Tue, Mar 27, 2012 at 5:50 PM, R. Verlangen ro...@us2.nl
mailto:ro...@us2.nl wrote:
*create column family MyCounterColumnFamily with
default_validation_class=CounterColumnType and
key_validation_class=UTF8Type and comparator=UTF8Type;*
There you go! Keys must be utf8, as well as the column names.
Of course you can change those validators.
Cheers!
2012/3/27 puneet loya puneetl...@gmail.com
mailto:puneetl...@gmail.com
Can u give an example of create column family with counter
column in it.
Please reply
Regards,
Puneet Loya
--
With kind regards,
Robin Verlangen
www.robinverlangen.nl http://www.robinverlangen.nl
Impetus to sponsor and exhibit at Structure Data 2012, NY; Mar
21-22. Know more about our Big Data quick-start program at the
event.
New Impetus webcast ‘Cloud-enabled Performance Testing
vis-à-vis On-premise’ available at http://bit.ly/z6zT4L.
NOTE: This message may contain information that is
confidential, proprietary, privileged or otherwise protected
by law. The message is intended solely for the named
addressee. If received in error, please destroy and notify the
sender. Any use of this email is prohibited when received in
error. Impetus does not represent, warrant and/or guarantee,
that the integrity of this communication has been maintained
nor that the communication is free of errors, virus,
interception or interference.
--
With kind regards,
Robin Verlangen
www.robinverlangen.nl http://www.robinverlangen.nl
Re: counter column family
now i want to have a field incrementing with every row insertion. how do i
do it in cassandra??
On Tue, Mar 27, 2012 at 7:34 PM, Dave Brosius dbros...@mebigfatguy.comwrote:
Counter columns are special, they must be in a column family to
themselves.
On 03/27/2012 09:32 AM, puneet loya wrote:
wen i m using a counter column.. i m nt able to add columns of other type
to the column family.. is it so or it is just synactical error??
[default@CMDCv99] create column family status
... with comparator = AsciiType
... and column_metadata =
... [{
... column_name : Test,
... validation_class : IntegerType,
... index_type : 0,
... index_name : IdxName},
... {
... column_name : 'other name',
... validation_class : CounterColumnType
... }];
Cannot add a counter column (other name) in a non counter column family
On Tue, Mar 27, 2012 at 6:55 PM, R. Verlangen ro...@us2.nl wrote:
You should use a connection pool without retries to prevent a single
increment of +1 have a result of e.g. +3.
2012/3/27 Rishabh Agrawal rishabh.agra...@impetus.co.in
You can even define how much increment you want. But let me just warn
you, as far my knowledge, it has consistency issues.
*From:* puneet loya [mailto:puneetl...@gmail.com]
*Sent:* Tuesday, March 27, 2012 5:59 PM
*To:* user@cassandra.apache.org
*Subject:* Re: counter column family
thanxx a ton :) :)
the counter column family works synonymous as 'auto increment' in other
databases rite?
I mean we have a column of type integer which increments with every
insert.
Am i goin the rite way??
please reply :)
On Tue, Mar 27, 2012 at 5:50 PM, R. Verlangen ro...@us2.nl wrote:
*create column family MyCounterColumnFamily with
default_validation_class=CounterColumnType and
key_validation_class=UTF8Type and comparator=UTF8Type;*
There you go! Keys must be utf8, as well as the column names. Of course
you can change those validators.
Cheers!
2012/3/27 puneet loya puneetl...@gmail.com
Can u give an example of create column family with counter column in it.
Please reply
Regards,
Puneet Loya
--
With kind regards,
Robin Verlangen
www.robinverlangen.nl
--
Impetus to sponsor and exhibit at Structure Data 2012, NY; Mar 21-22.
Know more about our Big Data quick-start program at the event.
New Impetus webcast ‘Cloud-enabled Performance Testing vis-à-vis
On-premise’ available at http://bit.ly/z6zT4L.
NOTE: This message may contain information that is confidential,
proprietary, privileged or otherwise protected by law. The message is
intended solely for the named addressee. If received in error, please
destroy and notify the sender. Any use of this email is prohibited when
received in error. Impetus does not represent, warrant and/or guarantee,
that the integrity of this communication has been maintained nor that the
communication is free of errors, virus, interception or interference.
--
With kind regards,
Robin Verlangen
www.robinverlangen.nl
cqlsh
How do i use the cqlsh comand line utility?? I m using cassandra 1.0.8.. Does cqlsh command line utility comes with the download of cassandra 1.0.8 or we have to do it separately. Suggest a way to go further plz reply :)
Re: Schema advice/help
multiget does not require OPP. On 27/03/2012 09:51, Maciej Miklas wrote: multiget would require Order Preserving Partitioner, and this can lead to unbalanced ring and hot spots. Maybe you can use secondary index on itemtype - is must have small cardinality: http://pkghosh.wordpress.com/2011/03/02/cassandra-secondary-index-patterns/ On Tue, Mar 27, 2012 at 10:10 AM, Guy Incognito dnd1...@gmail.com mailto:dnd1...@gmail.com wrote: without the ability to do disjoint column slices, i would probably use 5 different rows. userId:itemType - activityId then it's a multiget slice of 10 items from each of your 5 rows. On 26/03/2012 22:16, Ertio Lew wrote: I need to store activities by each user, on 5 items types. I always want to read last 10 activities on each item type, by a user (ie, total activities to read at a time =50). I am wanting to store these activities in a single row for each user so that they can be retrieved in single row query, since I want to read all the last 10 activities on each item.. I am thinking of creating composite names appending itemtype : activityId(activityId is just timestamp value) but then, I don't see about how to read the last 10 activities from all itemtypes. Any ideas about schema to do this better way ?
Re: import
You can write your own script to parse the excel file (export as csv) and import it with batch inserts. Should be pretty easy if you have experience with those techniques. 2012/3/27 puneet loya puneetl...@gmail.com I want to import files from excel to cassandra? Is it possible?? Any tool that can help?? Whats the best way?? Plz reply :) -- With kind regards, Robin Verlangen www.robinverlangen.nl
Re: nodetool ring runs very slow
Haven't received any reply. Resend... Feng Qu From: Feng Qu mail...@gmail.com To: Cassandra User Group user@cassandra.apache.org Sent: Wednesday, February 22, 2012 1:49 PM Subject: nodetool ring runs very slow We noticed that nodetool ring sometimes returns in 17-20 sec while it normally runs in less than a sec. There were some compaction running when it happened. Did compaction cause nodetool slowness? Anything else I should check? time nodetool -h hostname ring real 0m17.595s user 0m0.339s sys 0m0.054s Feng Qu
Re: nodetool ring runs very slow
Hi Jonathan, similar problem happens again and there is only one GC running at that time per system.log. This is one node of a 6-node 0.8.6 ring. Heap size on this host is 16GB. [fengqu@slcdbx1035 cassandra]$ date; time cnt ring Tue Mar 27 09:24:20 GMT+7 2012 Address DC Rack Status State Load Owns Token 141784319550391026443072753096570088106 10.89.74.60 slc rack0 Up Normal 343.97 GB 16.67% 0 10.2.128.55 phx rack0 Up Normal 485.48 GB 16.67% 28356863910078205288614550619314017621 10.89.74.67 slc rack0 Up Normal 252.82 GB 16.67% 56713727820156410577229101238628035242 10.2.128.56 phx rack0 Up Normal 258.49 GB 16.67% 85070591730234615865843651857942052864 10.89.74.62 slc rack0 Up Normal 251.02 GB 16.67% 113427455640312821154458202477256070485 10.2.128.57 phx rack0 Up Normal 451.97 GB 16.67% 141784319550391026443072753096570088106 real 0m25.999s user 0m0.309s sys 0m0.048s WARN [ScheduledTasks:1] 2012-03-27 09:22:39,499 GCInspector.java (line 143) Heap is 0.8716646568744459 full. You may need to reduce memtable and/or cache sizes. Cassandra will now flush up to the two largest memtables to free up memory. Adjust flush_largest_memtables_at threshold in cassandra.yaml if you don't want Cassandra to do this automatically INFO [ScheduledTasks:1] 2012-03-27 09:23:21,637 GCInspector.java (line 122) GC for ConcurrentMarkSweep: 1383 ms for 2 collections, 14756794512 used; max is 16928210944 WARN [ScheduledTasks:1] 2012-03-27 09:23:21,637 GCInspector.java (line 143) Heap is 0.8717279434204102 full. You may need to reduce memtable and/or cache sizes. Cassandra will now flush up to the two largest memtables to free up memory. Adjust flush_largest_memtables_at threshold in cassandra.yaml if you don't want Cassandra to do this automatically INFO [ScheduledTasks:1] 2012-03-27 09:24:04,844 GCInspector.java (line 122) GC for ConcurrentMarkSweep: 3090 ms for 2 collections, 14782314472 used; max is 16928210944 WARN [ScheduledTasks:1] 2012-03-27 09:24:04,851 GCInspector.java (line 143) Heap is 0.8732354837083013 full. You may need to reduce memtable and/or cache sizes. Cassandra will now flush up to the two largest memtables to free up memory. Adjust flush_largest_memtables_at threshold in cassandra.yaml if you don't want Cassandra to do this automatically INFO [ScheduledTasks:1] 2012-03-27 09:24:46,610 GCInspector.java (line 122) GC for ConcurrentMarkSweep: 3057 ms for 2 collections, 14757982328 used; max is 16928210944 WARN [ScheduledTasks:1] 2012-03-27 09:24:46,616 GCInspector.java (line 143) Heap is 0.871798111260587 full. You may need to reduce memtable and/or cache sizes. Cassandra will now flush up to the two largest memtables to free up memory. Adjust flush_largest_memtables_at threshold in cassandra.yaml if you don't want Cassandra to do this automatically INFO [ScheduledTasks:1] 2012-03-27 09:25:36,371 GCInspector.java (line 122) GC for ConcurrentMarkSweep: 7430 ms for 2 collections, 14719911032 used; max is 16928210944 WARN [ScheduledTasks:1] 2012-03-27 09:25:36,377 GCInspector.java (line 143) Heap is 0.8695491260532345 full. You may need to reduce memtable and/or cache sizes. Cassandra will now flush up to the two largest memtables to free up memory. Adjust flush_largest_memtables_at threshold in cassandra.yaml if you don't want Cassandra to do this automatically Feng Qu From: Jonathan Ellis jbel...@gmail.com To: user user@cassandra.apache.org Cc: Feng Qu mail...@gmail.com Sent: Friday, February 24, 2012 2:29 PM Subject: Re: nodetool ring runs very slow Read the server log and look for GCInspector output. On Fri, Feb 24, 2012 at 11:02 AM, Feng Qu mail...@gmail.com wrote: Hi Jonathan, how to check out whether it's in GC storming? This server crashed few time due to Java heap out of memory. We use 8GB heap on a server with 96GB ram. This is first node in a 6-node ring and it has opscenter community running on it. Feng Qu From: Jonathan Ellis jbel...@gmail.com To: user@cassandra.apache.org; Feng Qu mail...@gmail.com Sent: Thursday, February 23, 2012 1:19 PM Subject: Re: nodetool ring runs very slow The only time I've seen nodetool be that slow is when it was talking to a machine that was either swapping or deep into (JVM) GC storming. On Wed, Feb 22, 2012 at 3:49 PM, Feng Qu mail...@gmail.com wrote: We noticed that nodetool ring sometimes returns in 17-20 sec while it normally runs in less than a sec. There were some compaction running when it
Advice on architecture
Hello. I'm developing a system that will require me to store large (=4MB) columns in Cassandra. Right now I'm storing 1 column per row, in a single CF. The machines I have at my disposal are 32GB RAM machines with 10 SATA drives each. I would prefer to have a larger number of smaller nodes, but this is what I have to work with. Some issues that I have are: RAID0 Vs separate data dirs, and SizeTiered compaction Vs Leveled compaction. I will have approximately 2 times more writes than reads. RAID0 would help me use more efficiently the total disk space available at each node, but tests have shown that under write load it behaves much worse than using separate data dirs, one per disk. I used a 3-node cluster, and the node with RAID0 kept getting behind the other two nodes which had separate data dirs. The problem with separate data dirs is that it seems to be difficult for Cassandra to use the space efficiently due to the compactions. I first tried the new Leveled compactions scheme, which seemed promising since it would create small files that could be scattered by the data dirs, but the IO necessary for this compaction scheme is enormous under write load. It was constantly working and it affected the write throughput because it slowed the flushing of memtables. I then tried tiered compaction and it performed better, but as it tends to create large SSTables they cannot be split across the multiple data dirs. What I'm thinking of doing now is using multiple data dirs, with tiered compaction, and dividing the input data in several (64) different CFs. This way smaller SSTables will be created and these can be split across the multiple data dirs. This will allow me to better use the available capacity and I will not need as much free space for compactions than I would if the SSTables were larger. Am I missing something here? Is this the best way to deal with this (abnormal) use case? Thanks and best regards, André Cruz smime.p7s Description: S/MIME cryptographic signature
Re: How to store a list of values?
I was given one other suggestion (which may have been suggested earlier in
this thread, but is clearer to me with an example). The suggestion was to
use composite columns and have the first part of the key name be skill
and the second part be the specific skill and then store a null value. I
hope I understood this suggestion correctly.
user: {
'name': 'ben',
'title': 'software engineer',
'company': 'google',
'location': 'orange county',
'skill:java': '',
'skill:html': '',
'skill:javascript': ''
}
On Tue, Mar 27, 2012 at 12:04 AM, samal samalgo...@gmail.com wrote:
YEAH! agree, it only matter for time bucket data.
On Tue, Mar 27, 2012 at 12:31 PM, R. Verlangen ro...@us2.nl wrote:
That's true, but it does not sound like a real problem to me.. Maybe
someone else can shed some light upon this.
2012/3/27 samal samalgo...@gmail.com
On Tue, Mar 27, 2012 at 1:47 AM, R. Verlangen ro...@us2.nl wrote:
but any schema change will break it
How do you mean? You don't have to specify the columns in Cassandra so
it should work perfect. Except for the skill~ is preserverd for your
list.
In case skill~ is decided to change to skill:: , it need to be handle
at app level. Or otherwise had t update in all row, read it first, modify
it, insert new version and delete old version.
--
With kind regards,
Robin Verlangen
www.robinverlangen.nl
Re: copy data for dev
If you have the disck space you can just copy all the data files from the snapshot onto the dev node, renaming any with conflicting names. Then bring up the dev node and it should see the data. you can then compact to merge and drop all the duplicate data. You can also use the sstable loader tool to send the snapshot files to the dev node. -Jeremiah On Mar 26, 2012, at 2:13 PM, Deno Vichas wrote: all, is there a easy way to take a 4 node snapshot and restore it on my single node dev cluster? thanks, deno
Re: tombstones problem with 1.0.8
(Radim: I'm assuming you mean do not delete already deleted columns as Ross doesn't delete his rows.) Just to be clear about Ross' situation: he continually inserts columns and later deletes columns from the same set of rows. As long as he *doesn't* *keep deleting already-deleted columns* (which refreshes the tombstone on them), the deleted columns *should* get cleaned up, right? (Even though the row itself continually gets new columns inserted and other columns deleted?) Thanks, John On Tue, Mar 27, 2012 at 2:21 AM, Radim Kolar h...@filez.com wrote: Dne 27.3.2012 11:13, Ross Black napsal(a): Any pointers on what I should be looking for in our application that would be stopping the deletion of tombstones? do not delete already deleted rows. On read cassandra returns deleted rows as empty in range slices.
Re: cqlsh
You can find it in the bin directory of the binary distribution. maki 2012/3/27 puneet loya puneetl...@gmail.com: How do i use the cqlsh comand line utility?? I m using cassandra 1.0.8.. Does cqlsh command line utility comes with the download of cassandra 1.0.8 or we have to do it separately. Suggest a way to go further plz reply :)
Re: cqlsh
i know cqlsh is in the bin directory .. how to run it on Windows? it is not a batch file that can be run directly? Should we use python to execute it?? plz show a way :) Reply On Wed, Mar 28, 2012 at 8:34 AM, Maki Watanabe watanabe.m...@gmail.comwrote: You can find it in the bin directory of the binary distribution. maki 2012/3/27 puneet loya puneetl...@gmail.com: How do i use the cqlsh comand line utility?? I m using cassandra 1.0.8.. Does cqlsh command line utility comes with the download of cassandra 1.0.8 or we have to do it separately. Suggest a way to go further plz reply :)
Re: cqlsh
cqlsh is a python script. You need python, and cql driver for python. maki 2012/3/28 puneet loya puneetl...@gmail.com: i know cqlsh is in the bin directory .. how to run it on Windows? it is not a batch file that can be run directly? Should we use python to execute it?? plz show a way :) Reply On Wed, Mar 28, 2012 at 8:34 AM, Maki Watanabe watanabe.m...@gmail.com wrote: You can find it in the bin directory of the binary distribution. maki 2012/3/27 puneet loya puneetl...@gmail.com: How do i use the cqlsh comand line utility?? I m using cassandra 1.0.8.. Does cqlsh command line utility comes with the download of cassandra 1.0.8 or we have to do it separately. Suggest a way to go further plz reply :)
Re: cqlsh
If you are running on windows the msi installer for datastax community edition will install everything you need and add appropriate entries to your start menu for running the cql shell or the normal cli shell. You can get the installer here: http://www.datastax.com/download/community That might make things a bit easier for you. On Tue, Mar 27, 2012 at 11:46 PM, Maki Watanabe watanabe.m...@gmail.com wrote: cqlsh is a python script. You need python, and cql driver for python. maki 2012/3/28 puneet loya puneetl...@gmail.com: i know cqlsh is in the bin directory .. how to run it on Windows? it is not a batch file that can be run directly? Should we use python to execute it?? plz show a way :) Reply On Wed, Mar 28, 2012 at 8:34 AM, Maki Watanabe watanabe.m...@gmail.com wrote: You can find it in the bin directory of the binary distribution. maki 2012/3/27 puneet loya puneetl...@gmail.com: How do i use the cqlsh comand line utility?? I m using cassandra 1.0.8.. Does cqlsh command line utility comes with the download of cassandra 1.0.8 or we have to do it separately. Suggest a way to go further plz reply :)
