Re: cassandra and .net

2012-04-10 Thread puneet loya
is using cassandra from datastax community center software an issue for not be able to connect with .net? On Tue, Apr 10, 2012 at 11:24 AM, Maki Watanabe watanabe.m...@gmail.comwrote: Check your cassandra log. If you can't find any interesting log, set cassandra log level to DEBUG and run

Re: cassandra and .net

2012-04-10 Thread Pierre Chalamet
Another tentative : try using TFramedTransport with an instance of TSocket directly. - Pierre -Original Message- From: puneet loya puneetl...@gmail.com Date: Tue, 10 Apr 2012 11:06:22 To: user@cassandra.apache.org Reply-To: user@cassandra.apache.org Subject: Re: cassandra and .net

undo effect of CASSANDRA-3989

2012-04-10 Thread Radim Kolar
what is method for undo effect of CASSANDRA-3989 (too many unnecessary levels)? running major compact or cleanup does nothing.

Re: cassandra and .net

2012-04-10 Thread puneet loya
I checked logs of cassandra.. in the debug state.. I got this response DEBUG [ScheduledTasks:1] 2012-04-10 14:49:29,654 LoadBroadcaster.java (line 86) Disseminating load info ... DEBUG [Thrift:7] 2012-04-10 14:50:00,820 CustomTThreadPoolServer.java (line 197) Thrift transport error occurred

Re: cassandra and .net

2012-04-10 Thread puneet loya
Log is showing the following exception DEBUG [ScheduledTasks:1] 2012-04-10 14:49:29,654 LoadBroadcaster.java (line 86) Disseminating load info ... DEBUG [Thrift:7] 2012-04-10 14:50:00,820 CustomTThreadPoolServer.java (line 197) Thrift transport error occurred during processing of message.

Re: cassandra and .net

2012-04-10 Thread Henrik Schröder
In your code you are using BufferedTransport, but in the Cassandra logs you're getting errors when it tries to use FramedTransport. If I remember correctly, BufferedTransport is gone, so you should only use FramedTransport. Like this: TTransport transport = new TFramedTransport(new TSocket(host,

Re: Listen and RPC address

2012-04-10 Thread aaron morton
Schema may not be fully propagated. Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 9/04/2012, at 10:18 PM, Rishabh Agrawal wrote: Thanks, it just worked. Though I am able to load sstables but I get following error: ERROR

Re: composite columns vs super columns

2012-04-10 Thread aaron morton
Super Columns: top level column to have a list of sub column. e.g. row key: foo column: bar sub columns: baz = qux Composite columns: data types are defined by combining multiple types, instances of the type are compared by comparing each component in turn. e.g. row key: foo column:

Re: Request timeout and host marked down

2012-04-10 Thread aaron morton
Caused by: java.net.SocketTimeoutException: Read timed out at java.net.SocketInputStream.socketRead0(Native Method) at java.net.SocketInputStream.read(SocketInputStream.java:129) at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127)

Re: undo effect of CASSANDRA-3989

2012-04-10 Thread Watanabe Maki
Plz refer to the following thread: http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/cleanup-crashing-with-quot-java-util-concurrent-ExecutionException-java-lang-ArrayIndexOutOfBoundsEx-td7371682.html maki From iPhone On 2012/04/10, at 17:21, Radim Kolar h...@filez.com wrote:

Re: cassandra and .net

2012-04-10 Thread puneet loya
thankk :) :) it works :) On Tue, Apr 10, 2012 at 3:07 PM, Henrik Schröder skro...@gmail.com wrote: In your code you are using BufferedTransport, but in the Cassandra logs you're getting errors when it tries to use FramedTransport. If I remember correctly, BufferedTransport is gone, so

Re: cassandra and .net

2012-04-10 Thread Jake Luciani
You can also look at using a .net client wrapper like https://github.com/managedfusion/fluentcassandra On Tue, Apr 10, 2012 at 8:06 AM, puneet loya puneetl...@gmail.com wrote: thankk :) :) it works :) On Tue, Apr 10, 2012 at 3:07 PM, Henrik Schröder skro...@gmail.comwrote: In your

json2sstable error: Can not write to the Standard columns Super Column Family

2012-04-10 Thread Aliou SOW
Dear All, I am new to Cassandra 1.0.8, and I use the tool json2sstable for bulk insert, but I still have the error:

Repair Process Taking too long

2012-04-10 Thread Frank Ng
Hello, I am on Cassandra 1.0.7. My repair processes are taking over 30 hours to complete. Is it normal for the repair process to take this long? I wonder if it's because I am using the ext3 file system. thanks

json2sstable error: Can not write to the Standard columns Super Column Family

2012-04-10 Thread Aliou SOW
Dear All, I am new to Cassandra 1.0.8, and I use the tool json2sstable for bulk insert, but I still have the error: java.lang.RuntimeException: Can not write to the Standard columns Super Column Family. Has org.apache.cassandra.tools.SSTableImport.importSorted

Why so many SSTables?

2012-04-10 Thread Romain HARDOUIN
Hi, We are surprised by the number of files generated by Cassandra. Our cluster consists of 9 nodes and each node handles about 35 GB. We're using Cassandra 1.0.6 with LeveledCompactionStrategy. We have 30 CF. We've got roughly 45,000 files under the keyspace directory on each node: ls -l

Trouble with wrong data

2012-04-10 Thread Alain RODRIGUEZ
Hi, I'm experimenting a strange and very annoying phenomena. I had a problem with the commit log size which grew too much and full one of the hard disks in all my nodes almost at the same time (2 nodes only, RF=2, so the 2 nodes are behaving exactly in the same way) My data are mounted in an

Re: Trouble with wrong data

2012-04-10 Thread Alain RODRIGUEZ
By the way, I am using Cassandra 1.0.7, CL = ONE (R/W), RF = 2, 2 EC2 c1.medium nodes cluster Alain 2012/4/10 Alain RODRIGUEZ arodr...@gmail.com Hi, I'm experimenting a strange and very annoying phenomena. I had a problem with the commit log size which grew too much and full one of the hard

Pycassa help?

2012-04-10 Thread Mucklow, Blaine (GE Energy)
Hi all, I had a lot of success using Java+Hector, but was trying to migrate to pycassa and was having some 'simple' issues. What I am trying to do is create a column family where the following occurs: KEY- String ColumnName- LongType ColumnValue- DoubleType Basically this is time series data

Re: Repair Process Taking too long

2012-04-10 Thread Igor
Hi You can check with nodetool which part of repair process is slow - network streams or verify compactions. use nodetool netstats or compactionstats. On 04/10/2012 05:16 PM, Frank Ng wrote: Hello, I am on Cassandra 1.0.7. My repair processes are taking over 30 hours to complete. Is it

Re: Resident size growth

2012-04-10 Thread ruslan usifov
mmap doesn't depend on jna 2012/4/9 Jeremiah Jordan jeremiah.jor...@morningstar.com He says he disabled JNA. You can't mmap without JNA can you? On Apr 9, 2012, at 4:52 AM, aaron morton wrote: see http://wiki.apache.org/cassandra/FAQ#mmap Cheers - Aaron Morton

Re: Resident size growth

2012-04-10 Thread ruslan usifov
also i suggest to setup disk_access_mode: mmap_index_only 2012/4/9 Omid Aladini omidalad...@gmail.com Thanks. Yes it's due to mmappd SSTables pages that count as resident size. Jeremiah: mmap isn't through JNA, it's via java.nio.MappedByteBuffer I think. -- Omid On Mon, Apr 9, 2012 at

Re: Pycassa help?

2012-04-10 Thread Mucklow, Blaine (GE Energy)
Turns out if you read to the bottom of the tutorial you find answers. Please disregard this mail, I found my answer. :) On 4/10/12 10:41 AM, Mucklow, Blaine (GE Energy) blaine.muck...@ge.com wrote: Hi all, I had a lot of success using Java+Hector, but was trying to migrate to pycassa and was

Re: Why so many SSTables?

2012-04-10 Thread Jonathan Ellis
LCS explicitly tries to keep sstables under 5MB to minimize extra work done by compacting data that didn't really overlap across different levels. On Tue, Apr 10, 2012 at 9:24 AM, Romain HARDOUIN romain.hardo...@urssaf.fr wrote: Hi, We are surprised by the number of files generated by

Re: Repair Process Taking too long

2012-04-10 Thread Frank Ng
I think both processes are taking a while. When it starts up, netstats and compactionstats show nothing. Anyone out there successfully using ext3 and their repair processes are faster than this? On Tue, Apr 10, 2012 at 10:42 AM, Igor i...@4friends.od.ua wrote: Hi You can check with nodetool

Re: Repair Process Taking too long

2012-04-10 Thread Igor
On 04/10/2012 07:16 PM, Frank Ng wrote: Short answer - yes. But you are asking wrong question. I think both processes are taking a while. When it starts up, netstats and compactionstats show nothing. Anyone out there successfully using ext3 and their repair processes are faster than this?

Re: Repair Process Taking too long

2012-04-10 Thread Jonathan Rhone
Data size, number of nodes, RF? Are you using size-tiered compaction on any of the column families that hold a lot of your data? Do your cassandra logs say you are streaming a lot of ranges? zgrep -E (Performing streaming repair|out of sync) On Tue, Apr 10, 2012 at 9:45 AM, Igor

Re: Repair Process Taking too long

2012-04-10 Thread Igor
also - JVM heap size, and anything related to memory pressure On 04/10/2012 07:56 PM, Jonathan Rhone wrote: Data size, number of nodes, RF? Are you using size-tiered compaction on any of the column families that hold a lot of your data? Do your cassandra logs say you are streaming a lot of

Re: Repair Process Taking too long

2012-04-10 Thread Frank Ng
I have 12 nodes with approximately 1TB load per node. The RF is 3. I am considering moving to ext4. I checked the ranges and the numbers go from 1 to the 9000s . On Tue, Apr 10, 2012 at 12:56 PM, Jonathan Rhone rh...@tinyco.com wrote: Data size, number of nodes, RF? Are you using

Re: Request timeout and host marked down

2012-04-10 Thread Daning Wang
Thanks Aaron, will seek help from hector team. On Tue, Apr 10, 2012 at 3:41 AM, aaron morton aa...@thelastpickle.comwrote: Caused by: java.net.SocketTimeoutException: Read timed out at java.net.SocketInputStream.socketRead0(Native Method) at

Re: Repair Process Taking too long

2012-04-10 Thread Frank Ng
I am not using tier-sized compaction. On Tue, Apr 10, 2012 at 12:56 PM, Jonathan Rhone rh...@tinyco.com wrote: Data size, number of nodes, RF? Are you using size-tiered compaction on any of the column families that hold a lot of your data? Do your cassandra logs say you are streaming a

RE: Issue with SStable loader.

2012-04-10 Thread Rishabh Agrawal
I don't understand config for sstableloader. I thought sstableloader just takes cassandra.yaml file and does it. pleae throw some more light on same. From: aaron morton [aa...@thelastpickle.com] Sent: 10 April 2012 11:37 PM To: user@cassandra.apache.org Subject:

cassandra_jobs on twitter

2012-04-10 Thread Jeremy Hanna
some time back, I created the account cassandra_jobs on twitter. if you email the user list or better yet just cc cassandra_jobs on twitter, I'll retweet it there so that the information can get out to more people. https://twitter.com/#!/cassandra_jobs cheers, Jeremy

Re: issue with composite row key on CassandraStorage pig?

2012-04-10 Thread Janne Jalkanen
There doesn't seem to be an open JIRA ticket for it - can you please make one at https://issues.apache.org/jira/browse/CASSANDRA? That ensures that at some point someone will take a look at it and it just won't be forgotten in the endless barrage of emails... Yup, I did the composite columns

Re: Materialized Views or Index CF - data model question

2012-04-10 Thread Data Craftsman
Hi Aaron, Thanks for the quick answer, I'll build a prototype to benchmark each approach next week. Here are more questions based on your reply: a) These queries are not easily supported on standard Cassandra select * from book where price 992 order by price descending limit 30; This is a

Re: Repair Process Taking too long

2012-04-10 Thread David Leimbach
I had this happen when I had really poorly generated tokens for the ring. Cassandra seems to accept numbers that are too big. You get hot spots when you think you should be balanced and repair never ends (I think there is a 48 hour timeout). On Tuesday, April 10, 2012, Frank Ng wrote: I am

Re: Why so many SSTables?

2012-04-10 Thread Maki Watanabe
You can configure sstable size by sstable_size_in_mb parameter for LCS. The default value is 5MB. You should better to check you don't have many pending compaction tasks with nodetool tpstats and compactionstats also. If you have enough IO throughput, you can increase