write timeouts when saving a big object

2015-04-22 Thread Alexander Shutyaev
Hi all! We have a problem with cassandra. We're getting write timeouts when saving a big object. The object size is approx. 30 Mb which is big but not enormous as (if I'm not wrong) cassandra can handle up to 2Gb in theory. We tried increasing write timeout but that didn't help - 10 minutes that

Re: cassandra performance problems

2013-12-19 Thread Alexander Shutyaev
wrote: On Thu, Dec 5, 2013 at 6:33 AM, Alexander Shutyaev shuty...@gmail.comwrote: We've plugged it into our production environment as a cache in front of postgres. Everything worked fine, we even stressed it by explicitly propagating about 30G (10G/node) data from postgres to cassandra

MUTATION messages dropped

2013-12-19 Thread Alexander Shutyaev
Hi all! We've had a problem with cassandra recently. We had 2 one-minute periods when we got a lot of timeouts on the client side (the only timeouts during 9 days we are using cassandra in production). In the logs we've found corresponding messages saying something about MUTATION messages

cassandra performance problems

2013-12-05 Thread Alexander Shutyaev
Hi all, We have a 3 node cluster setup, single keyspace, about 500 tables. The hardware is 2 cores + 16 GB RAM (Cassandra chose to have 4GB). Cassandra version is 2.0.3. Our replication factor is 3, read/write consistency is QUORUM. We've plugged it into our production environment as a cache in

Re: cassandra performance problems

2013-12-05 Thread Alexander Shutyaev
Coli rc...@eventbrite.com On Thu, Dec 5, 2013 at 4:33 AM, Alexander Shutyaev shuty...@gmail.comwrote: Cassandra version is 2.0.3. ... We've plugged it into our production environment as a cache in front of postgres. https://engineering.eventbrite.com/what-version-of-cassandra-should-i-run

Re: DELETE does not delete :)

2013-10-17 Thread Alexander Shutyaev
run the select query a couple of times in a row right after deletion, do you see the data appear again? On Wed, Oct 16, 2013 at 12:12 AM, Alexander Shutyaev shuty...@gmail.comwrote: Hi all, Unfortunately, we still have a problem. I've modified my code, so that it explicitly sets

Re: DELETE does not delete :)

2013-10-15 Thread Alexander Shutyaev
ntp to see if ntpd it's already running. On Oct 7, 2013, at 12:23 AM, Alexander Shutyaev shuty...@gmail.com wrote: Hi Michał, I didn't notice your message at first.. Well this seems like a real cause candidate.. I'll add an explicit consistency level QUORUM and see if that helps. Thanks

DELETE does not delete :)

2013-10-07 Thread Alexander Shutyaev
Hi all, We have encountered the following problem with cassandra. * We use *cassandra v2.0.0* from *Datastax* community repo. * We have *3 nodes* in a cluster, all of them are seed providers. * We have a *single keyspace* with *replication factor = 3*: *CREATE KEYSPACE bof WITH replication =

Re: DELETE does not delete :)

2013-10-07 Thread Alexander Shutyaev
my two cents - before doing anything else, make sure clocks are synchronized to the millisecond. ntp will do so. Nick. On Mon, Oct 7, 2013 at 9:02 AM, Alexander Shutyaev shuty...@gmail.comwrote: Hi all, We have encountered the following problem with cassandra. * We use *cassandra

Re: DELETE does not delete :)

2013-10-07 Thread Alexander Shutyaev
Hi Michał, I didn't notice your message at first.. Well this seems like a real cause candidate.. I'll add an explicit consistency level QUORUM and see if that helps. Thanks 2013/10/7 Alexander Shutyaev shuty...@gmail.com Hi Nick, Thanks for the note! We have our cassanra instances installed

cassandra not responding, log full of gc invocations

2013-09-18 Thread Alexander Shutyaev
Hi all! We have a problem with cassandra 2.0. We have installed cassandra from datastax community respository. We haven't changed any java options from the default ones. De-facto Xmx is 1GB. Recently we have encountered a couple of cases when cassandra stopped responding and the log was showing

datastax ops center shows a lot of activity when idle

2013-09-18 Thread Alexander Shutyaev
Hi all! We have experienced a strange issue with datastax opscenter. It showed much more write requests that we should actually have. We've set everything up on an isolated node and there without any activity it showed 100+ writes per second. Is this some opscenter bug? Does it maybe count some

mysterious 'column1' in cql describe

2013-08-30 Thread Alexander Shutyaev
Hi all! We have encountered the following problem. We create our column families via hector like this: ColumnFamilyDefinition cfdef = HFactory.createColumnFamilyDefinition(* mykeyspace*, *mycf*); cfdef.setColumnType(ColumnType.*STANDARD*); cfdef.setComparatorType(ComparatorType.*UTF8TYPE*);

Re: mysterious 'column1' in cql describe

2013-08-30 Thread Alexander Shutyaev
, and why your saw what you saw). -- Sylvain On Fri, Aug 30, 2013 at 9:50 AM, Alexander Shutyaev shuty...@gmail.comwrote: Hi all! We have encountered the following problem. We create our column families via hector like this: ColumnFamilyDefinition cfdef = HFactory.createColumnFamilyDefinition

Re: CorruptSSTableException in system keyspace

2013-04-02 Thread Alexander Shutyaev
releases. https://issues.apache.org/jira/browse/CASSANDRA-5225 https://issues.apache.org/jira/browse/CASSANDRA-5365 Cheers - Aaron Morton Freelance Cassandra Consultant New Zealand @aaronmorton http://www.thelastpickle.com On 1/04/2013, at 1:45 PM, Alexander Shutyaev

CorruptSSTableException in system keyspace

2013-04-01 Thread Alexander Shutyaev
Hi all! Our app currently moves from *hibernate* to *cassandra+solr* combination (we use our own storage abstraction for this). We have a lot of junit integration tests that use database. Now we've decided to use these tests to test our *cassandra+solr* storage implementation (given that on *

Re: force gc?

2012-09-02 Thread Alexander Shutyaev
, it will run. On Fri, Aug 31, 2012 at 9:03 AM, Alexander Shutyaev shuty...@gmail.comwrote: Hi All! I have a problem with using cassandra. Our application does a lot of overwrites and deletes. If I understand correctly cassandra does not actually delete these objects until gc_grace seconds have

Re: force gc?

2012-09-02 Thread Alexander Shutyaev
Hi Peter, I don't compare it with PosgreSQL size, I just make some estimations.. This table / column family stores some xml documents with average raw size of 2Mb each and total size about 5Gb. However the space cassandra occupies on disc is 70Gb (after gc_grace was set to 0 and major compaction

Re: force gc?

2012-09-02 Thread Alexander Shutyaev
Hi Derek, I'm using size-tiered compaction. 2012/9/3 Derek Williams de...@fyrie.net On Fri, Aug 31, 2012 at 7:03 AM, Alexander Shutyaev shuty...@gmail.comwrote: Does anyone have any suggestions on how can I analyze my problem? Or maybe I'm doing something wrong and there is another way

force gc?

2012-08-31 Thread Alexander Shutyaev
Hi All! I have a problem with using cassandra. Our application does a lot of overwrites and deletes. If I understand correctly cassandra does not actually delete these objects until gc_grace seconds have passed. I tried to force gc by setting gc_grace to 0 on an existing column family and running