Re: Upgrade from 1.2.x to 2.0.x, upgradesstables has doubled the size on disk?

2017-12-30 Thread Dan Washusen
Nope, just ran out of disk space... So on 1.2.x I had 70GB used on a 200GB disk and everything was great, with 2.0.x I'm now at 99% used and getting exception while compacting about insufficient disk space. FML... Dan Washusen On Sun, Dec 31, 2017 at 6:47 AM, Dan Washusen <d...@reactive.

Re: Upgrade from 1.2.x to 2.0.x, upgradesstables has doubled the size on disk?

2017-12-30 Thread Dan Washusen
/data/dp/s_evt/dp-s_evt-jb-302,]. 9,663,696,752 bytes to 4,834,895,601 (~50% of original) in 3,899,888ms = 1.182320MB/s. 90,533 total partitions merged to 45,278. Partition merge counts were {1:23, 2:45255, } Dan Washusen On Sun, Dec 31, 2017 at 1:51 AM, Jeff Jirsa <jji...@gmail.com>

Upgrade from 1.2.x to 2.0.x, upgradesstables has doubled the size on disk?

2017-12-29 Thread Dan Washusen
Hi All, We're taking advantage of the lull in traffic to go through a production cluster upgrade from 1.2.x (latest) to 2.0.x (latest). We have three nodes with a replication factor of three. I've noticed that the 'space used' has almost doubled as a result of running 'nodetool upgradesstables'.

Re: which high level Java client

2012-06-28 Thread Dan Washusen
Pelops is a very thin wrapper over the Thrift client so that could be a good option. You could also check out a fork by the VMWare/Spring guys which adds full async support: https://github.com/andrewswan/scale7-pelops. I'm not sure on the state of it, but it seems promising... On

Re: Configuring cassandra cluster with host preferences

2012-05-14 Thread Dan Washusen
It's not possible 'out of the box' but you could implement your own org.scale7.cassandra.pelops.pool.CommonsBackedPool.INodeSelectionStrategy that chooses the desired node. -- Dan Washusen Make big files fly visit digitalpigeon.com (http://digitalpigeon.com) On Tuesday, 15 May 2012 at 3:23

Re: Cassandra Clients for Java

2011-06-17 Thread Dan Washusen
I've added some comments/questions inline... Cheers, -- Dan Washusen On Saturday, 18 June 2011 at 8:02 AM, Daniel Colchete wrote: Good day everyone! I'm getting started with a new project and I'm thinking about using Cassandra because of its distributed quality and because of its

0.7.5 Debian packages - can't upgrade?

2011-04-29 Thread Dan Washusen
Hey all, I can't seem upgrade to 0.7.5 using the Debian packages. Here's what I've done... Edited sources.list and changed unstable to 07x. deb http://www.apache.org/dist/cassandra/debian 07x main deb-src http://www.apache.org/dist/cassandra/debian 07x main Add the new key. sudo gpg

Re: 0.7.5 Debian packages - can't upgrade?

2011-04-29 Thread Dan Washusen
wrote: On Sat, 2011-04-30 at 09:34 +1000, Dan Washusen wrote: sudo aptitude update sudo aptitude safe-upgrade The upgrade shows this: Reading package lists... Done Building dependency tree Reading state information... Done Reading extended state information

Re: RE: batch_mutate failed: out of sequence response

2011-04-18 Thread Dan Washusen
connections is all cases *except* NotFoundException. Cheers, -- Dan Washusen On Friday, 8 April 2011 at 7:28 AM, Dan Washusen wrote: Pelops uses a single connection per operation from a pool that is backed by Apache Commons Pool (assuming you're using Cassandra 0.7). I'm not saying it's

Re: RE: batch_mutate failed: out of sequence response

2011-04-18 Thread Dan Washusen
connection and Cassandra throws an ApplicationException A Pelops test case for this can be found here: https://github.com/s7/scale7-pelops/blob/3fe7584a24bb4b62b01897a814ef62415bd2fe43/src/test/java/org/scale7/cassandra/pelops/MutatorIntegrationTest.java#L262 Cheers, -- Dan Washusen On Tuesday

Re: Atomicity Strategies

2011-04-08 Thread Dan Washusen
Here's a good writeup on how fightmymonster.com does it... http://ria101.wordpress.com/category/nosql-databases/locking/ -- Dan Washusen Make big files fly visit digitalpigeon.com On Saturday, 9 April 2011 at 11:53 AM, Alex Araujo wrote: On 4/8/11 5:46 PM, Drew Kutcharian wrote: I'm

Re: RE: batch_mutate failed: out of sequence response

2011-04-07 Thread Dan Washusen
? From his comment about retrying I'd assume not... -- Dan Washusen On Thursday, 7 April 2011 at 7:39 PM, Héctor Izquierdo Seliva wrote: El mié, 06-04-2011 a las 21:04 -0500, Jonathan Ellis escribió: out of sequence response is thrift's way of saying I got a response for request Y when I

Re: RE: batch_mutate failed: out of sequence response

2011-04-06 Thread Dan Washusen
on these type property of TApplicationException? Cheers, Dan On Wednesday, 6 April 2011 at 8:03 PM, Héctor Izquierdo Seliva wrote: El mié, 06-04-2011 a las 09:06 +1000, Dan Washusen escribió: Pelops raises a RuntimeException? Can you provide more info please? org.scale7

Re: RE: batch_mutate failed: out of sequence response

2011-04-05 Thread Dan Washusen
Pelops raises a RuntimeException? Can you provide more info please? -- Dan Washusen Make big files fly visit digitalpigeon.com On Tuesday, 5 April 2011 at 11:43 PM, Héctor Izquierdo Seliva wrote: El mar, 05-04-2011 a las 09:35 -0400, Dan Hendry escribió: I too have seen the out of sequence

Re: OOM during compaction with half the heap still available?

2011-03-24 Thread Dan Washusen
Ah, it would appear I forgot to do that on the hudson machine. Thanks! -- Dan Washusen On Friday, 25 March 2011 at 2:23 PM, Jonathan Ellis wrote: Have you run nodetool scrub? The data versioning problem scrub fixes can manifest itself as trying to read GB of data into memory during

Re: I: Re: Are row-keys sorted by the compareWith?

2011-03-01 Thread Dan Washusen
Pelops moved to github several months ago... https://github.com/s7/scale7-pelops/blob/master/src/main/java/org/scale7/cassandra/pelops/Selector.java#L1179 Cheers, -- Dan Washusen On Wednesday, 2 March 2011 at 3:35 AM, Matthew Dennis wrote: I'm not really familiar with pelops code, but I found

Re: I: Re: Are row-keys sorted by the compareWith?

2011-02-23 Thread Dan Washusen
Hi Matthew, As you mention the map returned from multiget_slice is not order preserving, Pelops is doing this on the client side... Cheers, Dan -- Dan Washusen Sent with Sparrow On Wednesday, 23 February 2011 at 8:38 PM, Matthew Dennis wrote: The map returned by multiget_slice (what I

Re: Are row-keys sorted by the compareWith?

2011-02-20 Thread Dan Washusen
entry are definitely in the order that Cassandra provides them, take a look at org.scale7.cassandra.pelops.Selector#toColumnList if you need more info. Cheers, Dan -- Dan Washusen Sent with Sparrow On Saturday, 19 February 2011 at 8:16 AM, cbert...@libero.it wrote: Hi all, I created a CF

Re: Another EOFException

2011-02-15 Thread Dan Washusen
I'm seeing this as well; several column families with keys_cached = 0 on 0.7.1. Debug level logs: http://pastebin.com/qvujKDth -- Dan Washusen On Wednesday, 16 February 2011 at 1:12 PM, Jonathan Ellis wrote: Created https://issues.apache.org/jira/browse/CASSANDRA-2172. On Tue, Feb 15, 2011

Re: seed node failure crash the whole cluster

2011-02-07 Thread Dan Washusen
Hi, I've added some comments and questions inline. Cheers, Dan On 8 February 2011 10:00, Jonathan Ellis jbel...@gmail.com wrote: On Mon, Feb 7, 2011 at 1:51 AM, TSANG Yiu Wing ywts...@gmail.com wrote: cassandra version: 0.7 client library: scale7-pelops / 1.0-RC1-0.7.0-SNAPSHOT

Re: Re: R: Re: Ring up but read fails ...

2011-01-23 Thread Dan Washusen
This is a known issue with the Cassandra 0.6 versions of Pelops. The issue was fixed in the 0.7 based versions a few months ago but never back-ported (Dominic, myself and the other contributors don't run 0.6)... On 24 January 2011 05:25, cbert...@libero.it cbert...@libero.it wrote: Reconnect

Re: Java cient

2011-01-19 Thread Dan Washusen
Pelops is pretty thin wrapper for the Thrift API. It's thinness has both up and down sides; on the up side it's very easy to map functionality mentioned on the Cassandra API wiki page to functionality provided by Pelops, it is also relatively simple to add features (thanks to Alois^^ for indexing

Re: Range Queries in RP on SCF in 0.7 with UUID SCs

2010-12-01 Thread Dan Washusen
Using the methods on the Bytes class would be preferable. The byte[] related methods on UuidHelper should have been deprecated with the Bytes class was introduced... e.g. new Bytes(col.getName()).toUuid() Cheers, Dan On Thu, Dec 2, 2010 at 10:26 AM, Frank LoVecchio fr...@isidorey.com wrote:

cassandra-cli multiline commands?

2010-11-23 Thread Dan Washusen
I notice CASSANDRA-1742 mentions support for commands that span multiple lines in cassandra-cli. Did it make it in? If so what's the syntax? Cheers, Dan

Re: HintedHandoff and ReplicationFactor with a downed node

2010-10-22 Thread Dan Washusen
The last time this came up on the list Jonathan Ellis said (something along the lines of) if your application can't tolerate stale data then you should read with a consistency level of QUORUM. It would be nice if there was some sort of middle ground for an application that can tolerate slightly

Re: What is the correct way of changing a partitioner?

2010-10-19 Thread Dan Washusen
http://wiki.apache.org/cassandra/DistributedDeletes From the http://wiki.apache.org/cassandra/StorageConfiguration page: Achtung! Changing this parameter requires wiping your data directories, since the partitioner can modify the !sstable on-disk format. So delete your data and commit log

Re: Running out of heap

2010-09-22 Thread Dan Washusen
http://wiki.apache.org/cassandra/FAQ#i_deleted_what_gives That help? On Wed, Sep 22, 2010 at 5:27 PM, Chris Jansen chris.jan...@cognitomobile.com wrote: Hi all, I have written a test application that does a write, read and delete on one of the sample column families that ship with

Re: Error when compile pelops

2010-09-13 Thread Dan Washusen
I just downloaded the jar file in question and it seems fine... wget -O cassandra.jar http://github.com/s7/mvnrepo/raw/master/org/apache/cassandra/cassandra/0.7.0-2010-09-12_19-23-07/cassandra-0.7.0-2010-09-12_19-23-07.jar; unzip -t cassandra.jar Which version of Maven are you using? On

Re: too many open files 0.7.0 beta1

2010-08-25 Thread Dan Washusen
Maybe you're seeing this: https://issues.apache.org/jira/browse/CASSANDRA-1416 On Thu, Aug 26, 2010 at 2:05 PM, Aaron Morton aa...@thelastpickle.comwrote: Under 0.7.0 beta1 am seeing cassandra run out of files handles... Caused by: java.io.FileNotFoundException:

Re: Upgrading to Cassanda 0.7 Thrift Erlang

2010-07-31 Thread Dan Washusen
Slightly off topic but still related (java instead of erlang). I just tried using the latest trunk build available on Hudson (2010-07-31_12-31-29) and I'm getting lock ups. The same code (without the framed transport) was working with a build form 2010-07-07_13-32-16 I'm connecting using the

Re: Upgrading to Cassanda 0.7 Thrift Erlang

2010-07-31 Thread Dan Washusen
p.s. If I set thrift_framed_transport_size_in_mb to 0 and just use TSocket instead of TFramedTransport everything works as expected... On 1 August 2010 12:16, Dan Washusen d...@reactive.org wrote: Slightly off topic but still related (java instead of erlang). I just tried using the latest

Re: Using Pelops with Cassandra 0.7.X

2010-07-13 Thread Dan Washusen
http://github.com/danwashusen/pelops/tree/cassandra-0.7.0 p.s. Pelops doesn't have any test coverage and my implicit tests (my app integration tests) don't touch anywhere near all of the Pelops API. p.s.s. I've made API breaking changes to support the new 0.7.0 API and Dominic (the original

Re: Pelops 'up and running' post question + WTF is a SuperColumn = really confused.

2010-07-02 Thread Dan Washusen
L1Tickets = { // column family userId: { // row key 42C120DF-D44A-44E4-9BDC-2B5439A5C7B4: { category: videoPhone, reportType: POOR_PICTURE, ...}, 99B60047-382A-4237-82CE-AE53A74FB747: { category: somethingElse, reportType: FOO, ...} } } On 3 July 2010 02:29, S Ahmed

Re: Pelops - a new Java client library paradigm

2010-06-12 Thread Dan Washusen
Very nice! You mention that the connections are handled internally by Pelops, does that mean that potentially a different connection is used for each operation performed? I had assumed using the same connection for several operations with ConsistencyLevel.ONE would provide a basic level of

Re: Pelops - a new Java client library paradigm

2010-06-12 Thread Dan Washusen
http://issues.apache.org/jira/browse/CASSANDRA-132 http://issues.apache.org/jira/browse/CASSANDRA-132 On Jun 12, 2010, at 5:48 PM, Dan Washusen d...@reactive.org wrote: Very nice! You mention that the connections are handled internally by Pelops, does that mean that potentially