Re: Cassandra with SAN

2013-02-21 Thread Michael Kjellman
No, this is a really really bad idea and C* was not designed for this, in fact, it was designed so you don't need to have a large expensive SAN. Don't be tempted by the shiny expensive SAN. :) If money is no object instead throw SSD's in your nodes and run 10G between racks From: Kanwar

Re: Cassandra with SAN

2013-02-21 Thread Michael Kjellman
would be the drawbacks :) From: Michael Kjellman [mailto:mkjell...@barracuda.com] Sent: 21 February 2013 17:12 To: user@cassandra.apache.orgmailto:user@cassandra.apache.org Subject: Re: Cassandra with SAN No, this is a really really bad idea and C* was not designed for this, in fact

Re: perlcassa throws TApplicationException=HASH(0x2323600)

2013-02-22 Thread Michael Kjellman
Yes, this is a thrift error returned by C*. You can use Data::Dumper to grab what's in that hash ref to see if there are more clues. Throw your object in an eval{} block and then print Dumper($@) If you file a bug on github I can work with you there more so we don't bother everyone on the

Re: is there a way to drain node(and prevent reads) and upgrade sstables offline?

2013-02-22 Thread Michael Kjellman
Couldn't you just disable thrift and leave gossip active? On 2/22/13 9:01 AM, Hiller, Dean dean.hil...@nrel.gov wrote: We would like to take a node out of the ring and upgradesstables while it is not doing any writes nor reads with the ring. Is this possible? I am thinking from the

Re: operations progress on DBA operations?

2013-02-22 Thread Michael Kjellman
Just to add though- compactionstats on an upgradesstables will only show the currently running sstable being upgraded. Overall progress on a upgradesstables isn't exposed anywhere yet but you can figure out how much there is to go thru the log lines. From: aaron morton

Re: Incompatible Gossip 1.1.6 to 1.2.1 Upgrade?

2013-02-23 Thread Michael Kjellman
This was a bug with 1.2.0 but resolved in 1.2.1. Did you take a capture of nodetool gossipinfo and nodetool ring by chance? On Feb 23, 2013, at 12:26 AM, Arya Goudarzi gouda...@gmail.com wrote: Hi C* users, I just upgrade a 12 node test cluster from 1.1.6 to 1.2.1. What I noticed from

Re: 1.2.2 as primary storage?

2013-02-25 Thread Michael Kjellman
How big will each mutation be roughly? 1MB, 5MB, 16MB? On 2/25/13 3:32 PM, Chris Dean ctd...@sokitomi.com wrote: I've been away from Cassandra for a while and wondered what the consensus is on using 1.2.2 as a primary data store? Our app has a typical OLTP workload but we have high availability

Re: 1.2.2 as primary storage?

2013-02-25 Thread Michael Kjellman
an issue with network in your DC Netflix actually has support for chunking binary blobs in Astyanax. I'd say you'll be fine if you plan to have 1MB mutations and only 1-2TB of total load across your cluster. On 2/25/13 3:37 PM, Chris Dean ctd...@sokitomi.com wrote: Michael Kjellman mkjell

Re: is upgradesstables required for 1.1.4 to 1.2.2? (I don't think it is)

2013-02-27 Thread Michael Kjellman
Yes, it's required between majors. Which your upgrade would be. On 2/27/13 10:54 AM, Hiller, Dean dean.hil...@nrel.gov wrote: My script to upgrade our first node in QA is thus (basically, snapshot, drain, stop, then switch over then start)Š #!/bin/bash export NODE=$1 export VERSION=1.1.4

Re: is upgradesstables required for 1.1.4 to 1.2.2? (I don't think it is)

2013-02-28 Thread Michael Kjellman
before I rejoin the ring? Quote from Aaron... In pre 1.2 add these jvm startup params -Dcassandra.join_ring=false -Dcassandra.start_rpc=false Thanks, Dean On 2/27/13 12:00 PM, Michael Kjellman mkjell...@barracuda.com wrote: Yes, it's required between majors. Which your upgrade

Re: nodetool compactionstats doesn't work for repair status?

2013-02-28 Thread Michael Kjellman
There is no overall repair progress currently. You can use some awk/grep hackery to try and figure it out from the logs. (This works best for a cleanup, less so for a repair because ranges are skipped and merkel trees take a long time to compare/generate/validate) Remember, things might be

Re: nodetool compactionstats doesn't work for repair status?

2013-02-28 Thread Michael Kjellman
this. https://github.com/apache/cassandra/blob/trunk/CHANGES.txt https://issues.apache.org/jira/browse/CASSANDRA-4767 Alain 2013/2/28 Michael Kjellman mkjell...@barracuda.commailto:mkjell...@barracuda.com There is no overall repair progress currently. You can use some awk/grep

Re: can we wipe CF data dir and run repair(is this safe?)

2013-02-28 Thread Michael Kjellman
Is your goal to rebuild a cf from scratch? On Feb 28, 2013, at 11:24 AM, Hiller, Dean dean.hil...@nrel.gov wrote: Title says it all. Anyone know? Thanks, Dean Copy, by Barracuda, helps you store, protect, and share all your amazing things. Start today: www.copy.com.

Re: upgrade 1.1.4 to 1.2.2 around 120x performance loss(one node only)

2013-03-01 Thread Michael Kjellman
No. I've actually found performance is better. Sounds like a timeout somewhere. On Mar 1, 2013, at 10:18 AM, Hiller, Dean dean.hil...@nrel.gov wrote: I setup a QA system copying our production system which was accidentally SimpleSnitch I found out but we are only in one datacenter right now

Re: Column Slice Query performance after deletions

2013-03-02 Thread Michael Kjellman
When is the last time you did a cleanup on the cf? On Mar 2, 2013, at 9:48 AM, Víctor Hugo Oliveira Molinar vhmoli...@gmail.com wrote: Hello guys. I'm investigating the reasons of performance degradation for my case scenario which follows: - I do have a column family which is filled of

Re: Column Slice Query performance after deletions

2013-03-02 Thread Michael Kjellman
are started(when are only few deleted columns), the performance looks pretty well. Unfortunately it is degraded along the day. On Sat, Mar 2, 2013 at 2:54 PM, Michael Kjellman mkjell...@barracuda.commailto:mkjell...@barracuda.com wrote: When is the last time you did a cleanup on the cf? On Mar 2

Re: Column Slice Query performance after deletions

2013-03-02 Thread Michael Kjellman
lower the min_compaction_threshold for this column family. Right? What does realy mean this threeshold value? Guys, thanks for the help so far. On Sat, Mar 2, 2013 at 3:42 PM, Michael Kjellman mkjell...@barracuda.commailto:mkjell...@barracuda.com wrote: What is your gc_grace set to? Sounds like

Re: no backwards compatibility for thrift in 1.2.2? (we get utter failure)

2013-03-03 Thread Michael Kjellman
Dean, I think if you look back through previous mailing list items you'll find answers to this already but to summarize: Tables created prior to 1.2 will continue to work after upgrade. New tables created are not exposed by the Thrift API. It is up to client developers to upgrade the client to

Re: Storage question

2013-03-04 Thread Michael Kjellman
The best way would be to chunk your binary blobs into 1/2MB chunks. You could store Key (md5 of entire blob) = part1, part2, part3 etc BytesType Validation Then if you want the entire image just grab the key (md5)..obviously you'll need a index somewhere with a filename = md5 Best, Michael

Re: hinted handoff disabling trade-offs

2013-03-04 Thread Michael Kjellman
Repair is slow. On Mar 4, 2013, at 8:07 PM, Matt Kap matvey1...@gmail.com wrote: I am looking to get a second opinion about disabling hinted-handoffs. I have an application that can tolerate a fair amount of inconsistency (advertising domain), and so I'm weighting the pros and cons of hinted

Re: hinted handoff disabling trade-offs

2013-03-04 Thread Michael Kjellman
memory usage? Thanks. -Wei Sent from my Samsung smartphone on ATT Original message Subject: Re: hinted handoff disabling trade-offs From: Michael Kjellman mkjell...@barracuda.commailto:mkjell...@barracuda.com To: user@cassandra.apache.orgmailto:user@cassandra.apache.org user

Re: USING CONSISTENCY WHILE SELECT

2013-05-29 Thread Michael Kjellman
Consistency is no longer query level but now session level in 1.2.0+. Change the consistency first. Then issue your select/update/insert query. Cheers, Michael On May 29, 2013, at 7:06 AM, Chandana Tummala chandana.tumm...@wipro.com wrote: Hi Team, I am using datastax cassandra

<    1   2