Re: USING CONSISTENCY WHILE SELECT

2013-05-29 Thread Michael Kjellman
Consistency is no longer query level but now session level in 1.2.0+. Change the consistency first. Then issue your select/update/insert query. Cheers, Michael On May 29, 2013, at 7:06 AM, Chandana Tummala chandana.tumm...@wipro.com wrote: Hi Team, I am using datastax cassandra

Re: Storage question

2013-03-04 Thread Michael Kjellman
The best way would be to chunk your binary blobs into 1/2MB chunks. You could store Key (md5 of entire blob) = part1, part2, part3 etc BytesType Validation Then if you want the entire image just grab the key (md5)..obviously you'll need a index somewhere with a filename = md5 Best, Michael

Re: hinted handoff disabling trade-offs

2013-03-04 Thread Michael Kjellman
Repair is slow. On Mar 4, 2013, at 8:07 PM, Matt Kap matvey1...@gmail.com wrote: I am looking to get a second opinion about disabling hinted-handoffs. I have an application that can tolerate a fair amount of inconsistency (advertising domain), and so I'm weighting the pros and cons of hinted

Re: hinted handoff disabling trade-offs

2013-03-04 Thread Michael Kjellman
memory usage? Thanks. -Wei Sent from my Samsung smartphone on ATT Original message Subject: Re: hinted handoff disabling trade-offs From: Michael Kjellman mkjell...@barracuda.commailto:mkjell...@barracuda.com To: user@cassandra.apache.orgmailto:user@cassandra.apache.org user

Re: no backwards compatibility for thrift in 1.2.2? (we get utter failure)

2013-03-03 Thread Michael Kjellman
Dean, I think if you look back through previous mailing list items you'll find answers to this already but to summarize: Tables created prior to 1.2 will continue to work after upgrade. New tables created are not exposed by the Thrift API. It is up to client developers to upgrade the client to

Re: Column Slice Query performance after deletions

2013-03-02 Thread Michael Kjellman
When is the last time you did a cleanup on the cf? On Mar 2, 2013, at 9:48 AM, Víctor Hugo Oliveira Molinar vhmoli...@gmail.com wrote: Hello guys. I'm investigating the reasons of performance degradation for my case scenario which follows: - I do have a column family which is filled of

Re: Column Slice Query performance after deletions

2013-03-02 Thread Michael Kjellman
are started(when are only few deleted columns), the performance looks pretty well. Unfortunately it is degraded along the day. On Sat, Mar 2, 2013 at 2:54 PM, Michael Kjellman mkjell...@barracuda.commailto:mkjell...@barracuda.com wrote: When is the last time you did a cleanup on the cf? On Mar 2

Re: Column Slice Query performance after deletions

2013-03-02 Thread Michael Kjellman
lower the min_compaction_threshold for this column family. Right? What does realy mean this threeshold value? Guys, thanks for the help so far. On Sat, Mar 2, 2013 at 3:42 PM, Michael Kjellman mkjell...@barracuda.commailto:mkjell...@barracuda.com wrote: What is your gc_grace set to? Sounds like

Re: upgrade 1.1.4 to 1.2.2 around 120x performance loss(one node only)

2013-03-01 Thread Michael Kjellman
No. I've actually found performance is better. Sounds like a timeout somewhere. On Mar 1, 2013, at 10:18 AM, Hiller, Dean dean.hil...@nrel.gov wrote: I setup a QA system copying our production system which was accidentally SimpleSnitch I found out but we are only in one datacenter right now

Re: is upgradesstables required for 1.1.4 to 1.2.2? (I don't think it is)

2013-02-28 Thread Michael Kjellman
before I rejoin the ring? Quote from Aaron... In pre 1.2 add these jvm startup params -Dcassandra.join_ring=false -Dcassandra.start_rpc=false Thanks, Dean On 2/27/13 12:00 PM, Michael Kjellman mkjell...@barracuda.com wrote: Yes, it's required between majors. Which your upgrade

Re: nodetool compactionstats doesn't work for repair status?

2013-02-28 Thread Michael Kjellman
There is no overall repair progress currently. You can use some awk/grep hackery to try and figure it out from the logs. (This works best for a cleanup, less so for a repair because ranges are skipped and merkel trees take a long time to compare/generate/validate) Remember, things might be

Re: nodetool compactionstats doesn't work for repair status?

2013-02-28 Thread Michael Kjellman
this. https://github.com/apache/cassandra/blob/trunk/CHANGES.txt https://issues.apache.org/jira/browse/CASSANDRA-4767 Alain 2013/2/28 Michael Kjellman mkjell...@barracuda.commailto:mkjell...@barracuda.com There is no overall repair progress currently. You can use some awk/grep

Re: can we wipe CF data dir and run repair(is this safe?)

2013-02-28 Thread Michael Kjellman
Is your goal to rebuild a cf from scratch? On Feb 28, 2013, at 11:24 AM, Hiller, Dean dean.hil...@nrel.gov wrote: Title says it all. Anyone know? Thanks, Dean Copy, by Barracuda, helps you store, protect, and share all your amazing things. Start today: www.copy.com.

Re: is upgradesstables required for 1.1.4 to 1.2.2? (I don't think it is)

2013-02-27 Thread Michael Kjellman
Yes, it's required between majors. Which your upgrade would be. On 2/27/13 10:54 AM, Hiller, Dean dean.hil...@nrel.gov wrote: My script to upgrade our first node in QA is thus (basically, snapshot, drain, stop, then switch over then start)Š #!/bin/bash export NODE=$1 export VERSION=1.1.4

Re: 1.2.2 as primary storage?

2013-02-25 Thread Michael Kjellman
How big will each mutation be roughly? 1MB, 5MB, 16MB? On 2/25/13 3:32 PM, Chris Dean ctd...@sokitomi.com wrote: I've been away from Cassandra for a while and wondered what the consensus is on using 1.2.2 as a primary data store? Our app has a typical OLTP workload but we have high availability

Re: 1.2.2 as primary storage?

2013-02-25 Thread Michael Kjellman
an issue with network in your DC Netflix actually has support for chunking binary blobs in Astyanax. I'd say you'll be fine if you plan to have 1MB mutations and only 1-2TB of total load across your cluster. On 2/25/13 3:37 PM, Chris Dean ctd...@sokitomi.com wrote: Michael Kjellman mkjell

Re: Incompatible Gossip 1.1.6 to 1.2.1 Upgrade?

2013-02-23 Thread Michael Kjellman
This was a bug with 1.2.0 but resolved in 1.2.1. Did you take a capture of nodetool gossipinfo and nodetool ring by chance? On Feb 23, 2013, at 12:26 AM, Arya Goudarzi gouda...@gmail.com wrote: Hi C* users, I just upgrade a 12 node test cluster from 1.1.6 to 1.2.1. What I noticed from

Re: perlcassa throws TApplicationException=HASH(0x2323600)

2013-02-22 Thread Michael Kjellman
Yes, this is a thrift error returned by C*. You can use Data::Dumper to grab what's in that hash ref to see if there are more clues. Throw your object in an eval{} block and then print Dumper($@) If you file a bug on github I can work with you there more so we don't bother everyone on the

Re: is there a way to drain node(and prevent reads) and upgrade sstables offline?

2013-02-22 Thread Michael Kjellman
Couldn't you just disable thrift and leave gossip active? On 2/22/13 9:01 AM, Hiller, Dean dean.hil...@nrel.gov wrote: We would like to take a node out of the ring and upgradesstables while it is not doing any writes nor reads with the ring. Is this possible? I am thinking from the

Re: operations progress on DBA operations?

2013-02-22 Thread Michael Kjellman
Just to add though- compactionstats on an upgradesstables will only show the currently running sstable being upgraded. Overall progress on a upgradesstables isn't exposed anywhere yet but you can figure out how much there is to go thru the log lines. From: aaron morton

Re: Cassandra with SAN

2013-02-21 Thread Michael Kjellman
No, this is a really really bad idea and C* was not designed for this, in fact, it was designed so you don't need to have a large expensive SAN. Don't be tempted by the shiny expensive SAN. :) If money is no object instead throw SSD's in your nodes and run 10G between racks From: Kanwar

Re: Cassandra with SAN

2013-02-21 Thread Michael Kjellman
would be the drawbacks :) From: Michael Kjellman [mailto:mkjell...@barracuda.com] Sent: 21 February 2013 17:12 To: user@cassandra.apache.orgmailto:user@cassandra.apache.org Subject: Re: Cassandra with SAN No, this is a really really bad idea and C* was not designed for this, in fact

Re: benchmark

2013-02-20 Thread Michael Kjellman
http://www.miraclelinux.com/jp/online-service/labs/pdf/zabbix-write-performance is a recent one that comes to mind But that was just write performance.. If you are really doing a case study you might want to do it yourself, in which case you can use the stress tool distributed with Cassandra

Re: Long running nodetool repair

2013-02-19 Thread Michael Kjellman
This is very normal (unfortunately). Are you doing a repair –pr or a straight up repair? Does nodetool netstats show anything? I frequently see repair hang in 1.2.1, and I haven't been able to figure out why yet though. Feel free to take a stack dump with jstack on the node doing the repair

Re: Cassandra backup

2013-02-18 Thread Michael Kjellman
There is this: http://www.datastax.com/dev/blog/whats-new-in-cassandra-1-1-flexible-data-file-placement But you'll need to design your data model around the fact that this is only as granular as 1 column family Best, michael From: Kanwar Sangha kan...@mavenir.commailto:kan...@mavenir.com

Re: unsubscribe

2013-02-17 Thread Michael Kjellman
Please see the Mailing Lists section of the home page. http://cassandra.apache.org user-unsubscr...@cassandra.apache.org From: James Wong jwong...@gmail.commailto:jwong...@gmail.com Reply-To: user@cassandra.apache.orgmailto:user@cassandra.apache.org

Re: Is C* common nickname for Cassandra?

2013-02-17 Thread Michael Kjellman
Why do you feel that link is unprofessional? Just wondering. I actually quite like the abbreviation personally. On Feb 17, 2013, at 1:37 PM, Boris Solovyov boris.solov...@gmail.commailto:boris.solov...@gmail.com wrote: Thanks. I don't know if anyone cares my opinion, but as a newcomer to the

Re: Cassandra 1.20 with Cloudera Hadoop (CDH4) Compatibility Issue

2013-02-15 Thread Michael Kjellman
That bug is kinda wrong though. 1.0.x is current for like a year now and C* works great with it :) On Feb 15, 2013, at 7:38 PM, Dave Brosius dbros...@mebigfatguy.commailto:dbros...@mebigfatguy.com wrote: see https://issues.apache.org/jira/browse/CASSANDRA-5201 On 02/15/2013 10:05 PM, Yang

Re: Cassandra 1.20 with Cloudera Hadoop (CDH4) Compatibility Issue

2013-02-15 Thread Michael Kjellman
Sorry. I meant to say even though there *wasnt* a major change between 1.0.x and 0.22. The big change was 0.20 to 0.22. Sorry for the confusion. On Feb 15, 2013, at 9:53 PM, Michael Kjellman mkjell...@barracuda.commailto:mkjell...@barracuda.com wrote: There were pretty big changes in Hadoop

Re: multiget_slice using CQL3

2013-02-14 Thread Michael Kjellman
I'm confused what you are looking to do. CQL3 syntax (SELECT * FROM keyspace.cf WHERE user = 'cooldude') has nothing to do with thrift client calls (such as multiget_slice) What is your goal here? Best, michael On 2/14/13 5:57 PM, Drew Kutcharian d...@venarc.com wrote: Hi Guys, What's the

Re: UNSUBSCRIBE

2013-02-08 Thread Michael Kjellman
Sigh. Google please On Feb 8, 2013, at 11:00 AM, Rudy Jahchan r...@carbonfive.com wrote: -- Rudy Jahchan

Re: How to change the tokens?

2013-02-08 Thread Michael Kjellman
You need to move the node to the new token you would like. Take care to only do one move operation at a time in the ring and also do a repair –pr and cleanup after the move operation. See nodetool move for more information Best, michael From: S C as...@outlook.commailto:as...@outlook.com

Re: How to change the tokens?

2013-02-08 Thread Michael Kjellman
Not sure why you would need to do that...And regardless you will need to move the data to change the tokens. On Feb 8, 2013, at 7:01 PM, S C as...@outlook.commailto:as...@outlook.com wrote: I have a scenario where I have to swap the tokens of the two nodes in a three node cluster. Thanks, SC

Re: Netflix/Astynax Client for Cassandra

2013-02-06 Thread Michael Kjellman
It's a really great library and definitely recommended by me and many who are reading this. And if you are just starting out on 1.2.1 with C* you might also want to evaluate https://github.com/datastax/java-driver and the new binary protocol. Best, michael From: Cassa L

Re: Why do Datastax docs recommend Java 6?

2013-02-05 Thread Michael Kjellman
There have been tons of threads/convos on this. In the early days of Java 7 it was pretty unstable and there was pretty much no convincing reason to use Java 7 over Java 6. Now that Java 7 has stabilized and Java 6 is EOL it's a reasonable decision to use Java 7 and we do it in production with

Re: Inserting via thrift interface to column family created with Compound Key via cql3

2013-01-30 Thread Michael Kjellman
Are you using execute_cql3_query() ? On Jan 30, 2013, at 7:31 AM, Oleksandr Petrov oleksandr.pet...@gmail.com wrote: Hi, I'm creating a table via cql3 query like: CREATE TABLE posts ( userid text, blog_name text, entry_title text, posted_at text, PRIMARY KEY (userid,

Re: Inserting via thrift interface to column family created with Compound Key via cql3

2013-01-30 Thread Michael Kjellman
, Michael Kjellman mkjell...@barracuda.commailto:mkjell...@barracuda.com wrote: Are you using execute_cql3_query() ? On Jan 30, 2013, at 7:31 AM, Oleksandr Petrov oleksandr.pet...@gmail.commailto:oleksandr.pet...@gmail.com wrote: Hi, I'm creating a table via cql3 query like: CREATE TABLE posts

Re: Inserting via thrift interface to column family created with Compound Key via cql3

2013-01-30 Thread Michael Kjellman
* allows to query everything that is greater than 3foo.getBytes(), but * not 3foo.getBytes() itself. */ Or am I missing the fact that you are inserting with cql3 as well? From: Michael Kjellman mkjell...@barracuda.commailto:mkjell...@barracuda.com Reply-To: user@cassandra.apache.orgmailto:user

Re: ConfigHelper.setThriftContact() undefined in cassandra v1.2

2013-01-29 Thread Michael Kjellman
Pretty sure you are looking for something like: // thrift input job settings ConfigHelper.setInputRpcPort(job.getConfiguration(), 9160); ConfigHelper.setInputInitialAddress(job.getConfiguration(), 127.0.0.1); ConfigHelper.setInputPartitioner(job.getConfiguration(), RandomPartitioner); // thrift

Re: How Cassandra guarantees the replicas if any node is down?

2013-01-29 Thread Michael Kjellman
Do get started look at: HintedHandoff: http://wiki.apache.org/cassandra/HintedHandoff Operations: http://wiki.apache.org/cassandra/Operations (specifically repair and repair –pr operations) There should be a ton of information on this you can easily Google. Best, Michael From: dong.yajun

Re: Is there any way to fetch all data efficiently from a column family?

2013-01-29 Thread Michael Kjellman
How often do you need to do this? How many rows in your column families? If it's not a frequent operation you can just page the data n number of rows at a time using nothing special but C* and a driver. Or another option is you can write a map/reduce job if you need an entire cf to be an input

Re: Is there any way to fetch all data efficiently from a column family?

2013-01-29 Thread Michael Kjellman
is to purge the bombstones, another option is using the map/reduce job to do the purging things without major compactions. Best Rick. On Wed, Jan 30, 2013 at 1:15 PM, Michael Kjellman mkjell...@barracuda.commailto:mkjell...@barracuda.com wrote: How often do you need to do this? How many rows

Re: Is there any way to fetch all data efficiently from a column family?

2013-01-29 Thread Michael Kjellman
from Datastax: http://www.datastax.com/docs/1.1/cluster_architecture/hadoop_integration From: Michael Kjellman mkjell...@barracuda.commailto:mkjell...@barracuda.com Reply-To: user@cassandra.apache.orgmailto:user@cassandra.apache.org user@cassandra.apache.orgmailto:user@cassandra.apache.org Date

Re: Issue when deleting Cassandra rowKeys.

2013-01-26 Thread Michael Kjellman
What is your gc_grace set to? Are your findings before or after this time after the deletion? From: Kasun Weranga kas...@wso2.commailto:kas...@wso2.com Reply-To: user@cassandra.apache.orgmailto:user@cassandra.apache.org user@cassandra.apache.orgmailto:user@cassandra.apache.org Date: Saturday,

Re: Unavaliable Exception

2013-01-25 Thread Michael Kjellman
More nodes! On Jan 25, 2013, at 7:21 AM, Alain RODRIGUEZ arodr...@gmail.commailto:arodr...@gmail.com wrote: fwiw, I have a mixed ubuntu 11.10 / 12.04 6 node cluster (AWS m1.xlarge). The load average is always between 0 and 5 for 11.10 nodes while 12.04 nodes shows all the time a load between

Re: Cassandra source code explained

2013-01-22 Thread Michael Kjellman
http://wiki.apache.org/cassandra/ArchitectureInternals From: Radek Gruchalski radek.gruchal...@portico.iomailto:radek.gruchal...@portico.io Reply-To: user@cassandra.apache.orgmailto:user@cassandra.apache.org user@cassandra.apache.orgmailto:user@cassandra.apache.org Date: Tuesday, January 22,

Re: BulkOutputFormat

2013-01-17 Thread Michael Kjellman
https://issues.apache.org/jira/browse/CASSANDRA-4813 Fixed in 1.2.0 Best, michael From: chandra Varahala hadoopandcassan...@gmail.commailto:hadoopandcassan...@gmail.com Reply-To: user@cassandra.apache.orgmailto:user@cassandra.apache.org

Re: BulkOutputFormat

2013-01-17 Thread Michael Kjellman
chandra On Thu, Jan 17, 2013 at 1:50 PM, Michael Kjellman mkjell...@barracuda.commailto:mkjell...@barracuda.com wrote: https://issues.apache.org/jira/browse/CASSANDRA-4813 Fixed in 1.2.0 Best, michael From: chandra Varahala hadoopandcassan...@gmail.commailto:hadoopandcassan...@gmail.com Reply

Re: Cassandra 1.1.2 - 1.1.8 upgrade

2013-01-16 Thread Michael Kjellman
upgradesstables is safe, but it is essentially compaction (because sstables are immutable it rewrites the sstable in the new format) so you'll want to do it when traffic is low to avoid IO issues. upgradesstables always needs to be done between majors. While 1.1.2 - 1.1.8 is not a major, due

Re: unsubscribe

2013-01-16 Thread Michael Kjellman
Writing to the list user@cassandra.apache.org Subscription addressuser-subscr...@cassandra.apache.org Digest subscription address user-digest-subscr...@cassandra.apache.org Unsubscription addressesuser-unsubscr...@cassandra.apache.org Getting help with the list

Re: Pig / Map Reduce on Cassandra

2013-01-16 Thread Michael Kjellman
Brisk is pretty much stagnant. I think someone forked it to work with 1.0 but not sure how that is going. You'll need to pay for DSE to get CFS (which is essentially Brisk) if you want to use any modern version of C*. Best, Michael On 1/16/13 11:17 AM, cscetbon@orange.com

Re: java exception on start

2013-01-12 Thread Michael Kjellman
https://issues.apache.org/jira/browse/CASSANDRA-4916 Fixed for 1.2.1! From: Tim Dunphy bluethu...@gmail.commailto:bluethu...@gmail.com Reply-To: user@cassandra.apache.orgmailto:user@cassandra.apache.org user@cassandra.apache.orgmailto:user@cassandra.apache.org Date: Saturday, January 12, 2013

Re: Murmur3Partitioner cassandra 1.2

2013-01-11 Thread Michael Kjellman
There is no migration path from RandomPartitioner to Murmur3 On Jan 11, 2013, at 11:12 AM, Tim Dunphy bluethu...@gmail.commailto:bluethu...@gmail.com wrote: Hello, Will I have to recreate my schema in order to use the Murmur3Partitioner ? Thanks Tim -- GPG me!! gpg --keyserver

Re: Starting Cassandra

2013-01-10 Thread Michael Kjellman
I've seen this with OpenJDK 7. Grab Java 7 u10 from Oracle and you should be good to go. From: Alain RODRIGUEZ arodr...@gmail.commailto:arodr...@gmail.com Reply-To: user@cassandra.apache.orgmailto:user@cassandra.apache.org user@cassandra.apache.orgmailto:user@cassandra.apache.org Date:

Re: inconsistent hadoop/cassandra results

2013-01-10 Thread Michael Kjellman
I found that overall Hadoop input/output from Cassandra could use a little more QA and input from the community. (Especially with large datasets). There were some serious BOF bugs in 1.1 that have been resolved in 1.2. (Yay!) But, the problems in 1.1 weren't immediately apparent. Testing in my

Re: Date Index?

2013-01-09 Thread Michael Kjellman
ElasticSearch is a nice option for ordered lists. In 2.0 triggers would fit updates to elastic search much easier as right now it's in your application logic to detect changes and update. On Jan 9, 2013, at 7:55 AM, stephen.m.thomp...@wellsfargo.commailto:stephen.m.thomp...@wellsfargo.com

Re: change cluster name retaining keypsace

2013-01-09 Thread Michael Kjellman
I think Arron meant /var/lib/cassandra (by default) Check there (unless you changed you data directories in your cassandra.yaml) On Jan 9, 2013, at 7:36 PM, Tim Dunphy bluethu...@gmail.commailto:bluethu...@gmail.com wrote: Hello, And thanks for your reply! Well so far it's just a single node.

Re: Script to load sstables from v1.0.x to v 1.1.x

2013-01-08 Thread Michael Kjellman
I thought this was to load between separate clusters not to upgrade within the same cluster. No? On Jan 8, 2013, at 11:29 AM, Rob Coli rc...@palominodb.com wrote: On Tue, Jan 8, 2013 at 8:41 AM, Todd Nine todd.n...@gmail.com wrote: I have recently been trying to restore backups from a v1.0.x

Re: help turning compaction..hours of run to get 0% compaction....

2013-01-07 Thread Michael Kjellman
Size tiered or leveled compaction? From: Brian Tarbox tar...@cabotresearch.commailto:tar...@cabotresearch.com Reply-To: user@cassandra.apache.orgmailto:user@cassandra.apache.org user@cassandra.apache.orgmailto:user@cassandra.apache.org Date: Monday, January 7, 2013 12:03 PM To:

Re: help turning compaction..hours of run to get 0% compaction....

2013-01-07 Thread Michael Kjellman
) insert once, ready many, update-never. Brian On Mon, Jan 7, 2013 at 3:13 PM, Michael Kjellman mkjell...@barracuda.commailto:mkjell...@barracuda.com wrote: Size tiered or leveled compaction? From: Brian Tarbox tar...@cabotresearch.commailto:tar...@cabotresearch.com Reply-To: user

Re: help turning compaction..hours of run to get 0% compaction....

2013-01-07 Thread Michael Kjellman
in detail. Thanks. Brain On Mon, Jan 7, 2013 at 4:13 PM, Michael Kjellman mkjell...@barracuda.commailto:mkjell...@barracuda.com wrote: http://www.datastax.com/dev/blog/when-to-use-leveled-compaction If you perform at least twice as many reads as you do writes, leveled compaction may actually save

Re: Cassandra 1.2 compatible Python bindings

2013-01-06 Thread Michael Kjellman
I know one outstanding issue is that CQL3 created column families won't be listed as CQL3 column families aren't exposed by the old thrift calls. I know work is in progress to fix this... On Jan 6, 2013, at 8:01 PM, aaron morton aa...@thelastpickle.commailto:aa...@thelastpickle.com wrote: I'm

Re: num_tokens - virtual nodes

2013-01-04 Thread Michael Kjellman
http://www.mail-archive.com/user@cassandra.apache.org/msg26528.html From: Alain RODRIGUEZ arodr...@gmail.commailto:arodr...@gmail.com Reply-To: user@cassandra.apache.orgmailto:user@cassandra.apache.org user@cassandra.apache.orgmailto:user@cassandra.apache.org Date: Friday, January 4, 2013 6:00

Re: Specifying initial token in 1.2 fails

2013-01-04 Thread Michael Kjellman
Murmur3 != MD5 (RandomPartitioner) From: Dwight Smith dwight.sm...@genesyslab.commailto:dwight.sm...@genesyslab.com Reply-To: user@cassandra.apache.orgmailto:user@cassandra.apache.org user@cassandra.apache.orgmailto:user@cassandra.apache.org Date: Friday, January 4, 2013 8:36 AM To:

Re: Specifying initial token in 1.2 fails

2013-01-04 Thread Michael Kjellman
token method supported? If so – how should these be generated, the token-generator seems to only apply to RandomPartitioner. Thanks again From: Michael Kjellman [mailto:mkjell...@barracuda.com] Sent: Friday, January 04, 2013 8:39 AM To: user@cassandra.apache.orgmailto:user@cassandra.apache.org

Re: Cassandra / Windows Server 2008

2013-01-04 Thread Michael Kjellman
Use linux ;) More seriously, I'm wondering if it is binding to the IPV6 address? Is that enabled on that NIC? You could try disabling IPv6 and seeing if RPC binds correctly.. From: stephen.m.thomp...@wellsfargo.commailto:stephen.m.thomp...@wellsfargo.com

Re: Error after 1.2.0 upgrade

2013-01-03 Thread Michael Kjellman
I'm having huge upgrade issues from 1.1.7 - 1.2.0 atm but in a 12 node cluster which I am slowly massaging into a good state I haven't seen this in 15+ hours of operation… This looks related to JNA? From: Alain RODRIGUEZ arodr...@gmail.commailto:arodr...@gmail.com Reply-To:

Re: Error after 1.2.0 upgrade

2013-01-03 Thread Michael Kjellman
? Does it ? The only thing logged about JNA is the following : JNA mlockall successful. What does this line *** java.lang.instrument ASSERTION FAILED ***: !errorOutstanding with message transform method call failed at ../../../src/share/instrument/JPLISAgent.c line: 806 means? 2013/1/3 Michael

Re: Fixing the schema for a Column Family

2012-12-28 Thread Michael Kjellman
I've found that if you drop a column family, the data is still there/snapshotted. If you recreate the column family as expected the data will repopulate the cf. From: Charles Lamanna char...@metricshub.commailto:char...@metricshub.com Reply-To:

Re: Cassadra API for Java

2012-12-28 Thread Michael Kjellman
This was asked as recently as one month + 1 day btw: http://grokbase.com/t/cassandra/user/12bve4d8e8/java-high-level-client if you weren't subscribed to the group to see the messages to see a longer discussion. From: Baskar Sikkayan techba...@gmail.commailto:techba...@gmail.com Reply-To:

Re: Partition maintenance

2012-12-18 Thread Michael Kjellman
You could make a column family for each period of time and then drop the column family when you want to destroy it. Before you drop it you could use the sstabletojson converter and write the json files out to tape. Might make your life difficult however if you need an input split for map

Re: Partition maintenance

2012-12-18 Thread Michael Kjellman
a secondary index for that, I would assume. From: Michael Kjellman [mailto:mkjell...@barracuda.com] Sent: Tuesday, December 18, 2012 11:15 AM To: user@cassandra.apache.orgmailto:user@cassandra.apache.org Subject: Re: Partition maintenance You could make a column family for each period of time

Re: Monitoring the number of client connections

2012-12-18 Thread Michael Kjellman
netstat + cron is your friend at this point in time On Dec 18, 2012, at 8:25 PM, aaron morton aa...@thelastpickle.commailto:aa...@thelastpickle.com wrote: AFAIK the count connections is not exposed. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton

Re: State of Cassandra and Java 7

2012-12-16 Thread Michael Kjellman
:54 AM, Sylvain Lebresne sylv...@datastax.com wrote: On Sat, Dec 15, 2012 at 7:12 PM, Michael Kjellman mkjell...@barracuda.com wrote: What issues have you ran into? Actually curious because we push 1.1.5-7 really hard and have no issues whatsoever. A related question is which which

Re: State of Cassandra and Java 7

2012-12-15 Thread Michael Kjellman
What issues have you ran into? Actually curious because we push 1.1.5-7 really hard and have no issues whatsoever. On Dec 15, 2012, at 7:51 AM, Brian Tarbox tar...@cabotresearch.commailto:tar...@cabotresearch.com wrote: We've reverted all machines back to Java 6 after running into numerous

Re: State of Cassandra and Java 7

2012-12-13 Thread Michael Kjellman
Works just fine for us. On 12/13/12 11:43 AM, Drew Kutcharian d...@venarc.com wrote: Hey Guys, With Java 6 begin EOL-ed soon (https://blogs.oracle.com/java/entry/end_of_public_updates_for), what's the status of Cassandra's Java 7 support? Anyone using it in production? Any outstanding *known*

Re: Vnode migration path

2012-12-11 Thread Michael Kjellman
ranges around to migrate to vnodes. Richard. On 11 December 2012 08:47, Michael Kjellman mkjell...@barracuda.commailto:mkjell...@barracuda.com wrote: So I'm wondering if anyone has given thought to their migration path to Vnodes. Other than having a separate cluster and migrating the data from

Re: Freeing up disk space on Cassandra 1.1.5 with Size-Tiered compaction.

2012-12-06 Thread Michael Kjellman
+1 On Dec 6, 2012, at 10:06 PM, Wei Zhu wz1...@yahoo.com wrote: I think Aaron meant 300-400GB instead of 300-400MB. Thanks. -Wei - Original Message - From: Wade L Poziombka wade.l.poziom...@intel.com To: user@cassandra.apache.org Sent: Thursday, December 6, 2012 6:53:53 AM

progress of cleanup operations

2012-11-29 Thread Michael Kjellman
I know there is very little insight currently into long running JMX operations but has anyone figured out any way clever to determine approximate progress on cleanup operations? Merci. Best, Michael 'Like' us on Facebook for exclusive content and other resources on all Barracuda Networks

Re: progress of cleanup operations

2012-11-29 Thread Michael Kjellman
operation, so you would estimate in terms of how long it would take to go through all of those. On Nov 29, 2012, at 10:37 AM, Michael Kjellman mkjell...@barracuda.com wrote: I know there is very little insight currently into long running JMX operations but has anyone figured out any way clever

Re: progress of cleanup operations

2012-11-29 Thread Michael Kjellman
that to the number of total sstables in your data dir for that cf for a rough percentage of sstables that have been processed. Thoughts? On 11/29/12 10:36 AM, Michael Kjellman mkjell...@barracuda.com wrote: compactionstats does not show the overall progress it has made on cleanup operations

Re: Java high-level client

2012-11-28 Thread Michael Kjellman
-level client +1 On Tue, Nov 27, 2012 at 10:10 AM, Michael Kjellman mkjell...@barracuda.commailto:mkjell...@barracuda.com wrote: Netflix has a great client https://github.com/Netflix/astyanax 'Like' us on Facebook for exclusive content and other resources on all Barracuda Networks

Re: Java high-level client

2012-11-28 Thread Michael Kjellman
at 2:51 PM, Michael Kjellman mkjell...@barracuda.commailto:mkjell...@barracuda.com wrote: Lots of example code, nice api, good performance as the first things that come to mind why I like Astyanax better than Hector From: Andrey Ilinykh ailin...@gmail.commailto:ailin...@gmail.com Reply-To: user

Re: Java high-level client

2012-11-27 Thread Michael Kjellman
Netflix has a great client https://github.com/Netflix/astyanax On 11/27/12 7:40 AM, Peter Lin wool...@gmail.com wrote: I use hector-client master, which is pretty stable right now. It uses the latest thrift, so you can use hector with thrift 0.9.0. That's assuming you don't mind using the

Re: for a school project

2012-11-27 Thread Michael Kjellman
*because *which *be *with Please see: http://en.wikipedia.org/wiki/Codd's_12_rules http://wiki.apache.org/cassandra/DataModel That should get you going for your school report. If you have more specific questions about terms on the wiki please feel free to ask. On 11/27/12 4:02 AM,

Re: counters + replication = awful performance?

2012-11-27 Thread Michael Kjellman
Are you writing with QUORUM consistency or ONE? On 11/27/12 9:52 AM, Sergey Olefir solf.li...@gmail.com wrote: Hi Juan, thanks for your input! In my case, however, I doubt this is the case -- clients are able to push many more updates than I need to saturate replication_factor=2 case (e.g. I'm

Re: continue seeing Finished hinted handoff of 0 rows to endpoint

2012-11-24 Thread Michael Kjellman
Some people (myself included) have seen issues when upgrading from 1.1.2 to 1.1.6 with tombstoned rows in the HintsColumnFamily Some (mysql included) have fixed this by doing a nodetool scrub system HintsColumnFamily -mike On 11/24/12 7:37 AM, Chuan-Heng Hsiao hsiao.chuanh...@gmail.com wrote:

Re: continue seeing Finished hinted handoff of 0 rows to endpoint

2012-11-24 Thread Michael Kjellman
Sorry, auto correct changed 'myself' to 'mysql'. Sorry for the confusion... On Nov 24, 2012, at 9:29 AM, Michael Kjellman mkjell...@barracuda.com wrote: Some people (myself included) have seen issues when upgrading from 1.1.2 to 1.1.6 with tombstoned rows in the HintsColumnFamily Some

Re: SchemaDisagreementException

2012-11-19 Thread Michael Kjellman
While this might not be helpful (I don't have all the thread history here), have you checked that all your servers are properly synced with NTP? From: Everton Lima peitin.inu...@gmail.commailto:peitin.inu...@gmail.com Reply-To: user@cassandra.apache.orgmailto:user@cassandra.apache.org

Re: [BETA RELEASE] Apache Cassandra 1.2.0-beta2 released

2012-11-10 Thread Michael Kjellman
Ohh lala. Any documentation yet? On Nov 10, 2012, at 6:27 PM, Edward Capriolo edlinuxg...@gmail.commailto:edlinuxg...@gmail.com wrote: just a note for all. The default partitioner is no longer randompartitioner. It is now murmur, and the token range starts in negative numbers. So you don't

Re: Replication factor and performance questions

2012-11-05 Thread Michael Kjellman
Rule of thumb is to try to keep nodes under 400GB. Compactions/Repairs/Move operations etc become a nightmare otherwise. How much data do you expect to have on each node? Also depends on caches, bloom filters etc On 11/5/12 8:57 AM, Oleg Dulin oleg.du...@gmail.com wrote: I have 4 nodes at my

Re: Single Node Cassandra Installation

2012-11-05 Thread Michael Kjellman
Should be fine if one node can deal with your read and write load. Switching from SimpleStrategy to RackAware can be a pain. That¹s a potential growth point way down the line (if you ever have your nodes on different switches). You might want to just setup your keyspace as RackAware if you intend

Re: hadoop consistency level

2012-10-18 Thread Michael Kjellman
Unless you have Brisk (however as far as I know there was one fork that got it working on 1.0 but nothing for 1.1 and is not being actively maintained by Datastax) or go with CFS (which comes with DSE) you are not guaranteed all data is on that hadoop node. You can take a look at the forks if

Re: hadoop consistency level

2012-10-18 Thread Michael Kjellman
DataStax Entreprise service... On Thu, Oct 18, 2012 at 3:00 PM, Michael Kjellman mkjell...@barracuda.com wrote: Unless you have Brisk (however as far as I know there was one fork that got it working on 1.0 but nothing for 1.1 and is not being actively maintained by Datastax) or go with CFS (which

Re: hadoop consistency level

2012-10-18 Thread Michael Kjellman
. On 10/18/12 1:15 PM, Andrey Ilinykh ailin...@gmail.com wrote: On Thu, Oct 18, 2012 at 12:00 PM, Michael Kjellman mkjell...@barracuda.com wrote: Unless you have Brisk (however as far as I know there was one fork that got it working on 1.0 but nothing for 1.1 and is not being actively maintained

Re: hadoop consistency level

2012-10-18 Thread Michael Kjellman
. If you don't specify a CL in your job config it will default to ONE (at least that's what my read of the ConfigHelper source for 1.1.6 shows) On 10/18/12 1:29 PM, Andrey Ilinykh ailin...@gmail.com wrote: On Thu, Oct 18, 2012 at 1:24 PM, Michael Kjellman mkjell...@barracuda.com wrote: Well

EOFException with BulkOutputFormat in 1.1.6

2012-10-17 Thread Michael Kjellman
I'm getting EOFExceptions with BulkOutputFormat 2012-10-17 12:23:01,182 ERROR org.apache.cassandra.concurrent.DebuggableThreadPoolExecutor: Error in ThreadPoolExecutor java.lang.RuntimeException: java.io.EOFException at org.apache.cassandra.utils.FBUtilities.unchecked(FBUtilities.java:628) at

Re: EOFException with BulkOutputFormat in 1.1.6

2012-10-17 Thread Michael Kjellman
Apologies - looks like this is already being tracked in https://issues.apache.org/jira/browse/CASSANDRA-4813 From: Michael Kjellman mkjell...@barracuda.commailto:mkjell...@barracuda.com Reply-To: user@cassandra.apache.orgmailto:user@cassandra.apache.org user@cassandra.apache.orgmailto:user

Re: Using Cassandra to store binary files?

2012-10-16 Thread Michael Kjellman
When we started with Cassandra almost 2 years ago in production originally it was for the sole purpose storing blobs in a redundant way. I ignored the warnings as my own tests showed it would be okay (and two years later it is ok). If you plan on using Cassandra later (as we now as as features

Re: what happens while node is bootstrapping?

2012-10-16 Thread Michael Kjellman
Correct. Also, there is a new feature in 1.1+ that lets you play with live traffic on new nodes before they actually join the ring http://www.datastax.com/dev/blog/whats-new-in-cassandra-1-1-live-traffic-sa mpling On 10/16/12 9:42 AM, Andrey Ilinykh ailin...@gmail.com wrote: No. The

  1   2   >