Re: Possibility of going OOM using get_count

2011-09-23 Thread Boris Yen
On Fri, Sep 23, 2011 at 12:28 PM, aaron morton aa...@thelastpickle.comwrote: Offsets have been discussed in previously. IIRC the main concerns were either: There is no way to reliably count to start the offset, i.e. we do not lock the row In the new get_count function, cassandra does the

Build Cassandra under Windows

2011-09-23 Thread Viktor Jevdokimov
Hello, I'm trying to build Cassandra 0.8 and 1.0.0 branches with no success on Windows, getting errors: ... maven-ant-tasks-retrieve-build: [artifact:dependencies] Downloading: asm/asm/3.2/asm-3.2-sources.jar from repository central at http://repo1.maven.org/maven2 [artifact:dependencies] Unable

Re: is it possible for light-traffic CF to hold down many commit logs?

2011-09-23 Thread Sylvain Lebresne
In 1.0.0, you have: # Total space to use for commitlogs. # If space gets above this value (it will round up to the next nearest # segment multiple), Cassandra will flush every dirty CF in the oldest # segment and remove it. # commitlog_total_space_in_mb: 4096 In 0.8, you're supposed to use the

Re: is it possible for light-traffic CF to hold down many commit logs?

2011-09-23 Thread Yang
Thanks Sylvain, this is exactly what I need. On Fri, Sep 23, 2011 at 12:10 AM, Sylvain Lebresne sylv...@datastax.com wrote: In 1.0.0, you have: # Total space to use for commitlogs. # If space gets above this value (it will round up to the next nearest # segment multiple), Cassandra will

Re: MessagingService.sendOneWay sending blank bytes?

2011-09-23 Thread Jonathan Ellis
Yes. This is one of the things fixed for 1.0 in https://issues.apache.org/jira/browse/CASSANDRA-1788 On Thu, Sep 22, 2011 at 11:16 PM, Greg Hinkle greghin...@gmail.com wrote: I noticed that on the 0.8 branch the implementation of MessagingService.sendOneWay is building up a DataOutputBuffer

Re: Performance degradation observed through embedded cassandra server - pointers needed

2011-09-23 Thread Roshan Dawrani
Thanks for sharing your inputs, Edward. Some comments inline below: On Thu, Sep 22, 2011 at 7:31 PM, Edward Capriolo edlinuxg...@gmail.comwrote: 1) Should should try to dig in an determine why the truncate is slower. Look for related jira issues on truncation. I should give it a try. I

RE: Build Cassandra under Windows

2011-09-23 Thread Viktor Jevdokimov
Spolved - just used appropriate ant's targets to get jars built. Best regards/ Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com Phone: +370 5 212 3063. Fax: +370 5 261 0453 J. Jasinskio 16C, LT-01112 Vilnius, Lithuania

Re: shutdown by drain

2011-09-23 Thread Radim Kolar
Dne 10.9.2011 21:48, Chris Goffinet napsal(a): For things like rolling restarts, we do: disablethrift disablegossip (...wait for all nodes to see this node go down..) drain I discovered problem with this advice. If i do nodetool drain before killing node nodetool returns just after flush and

RE: How to enable JNA for Cassandra on Windows?

2011-09-23 Thread Viktor Jevdokimov
I found that there's no C library under Windows, and msvcrt does not provide mlockall function, so currently there's no way to use JNA under Windows. That way mmap is not a good idea? Best regards/ Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com

RE: shutdown by drain

2011-09-23 Thread Viktor Jevdokimov
More of it, Cassandra 0.8.6 still leaves all commit logs under Windows. Best regards/ Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com Phone: +370 5 212 3063 Fax: +370 5 261 0453 J. Jasinskio 16C, LT-01112 Vilnius, Lithuania Disclaimer: The information

Re: LevelDB type compaction

2011-09-23 Thread Sam Overton
On 17 September 2011 00:58, mcasandra mohitanch...@gmail.com wrote: and updates could be scattered all over before compaction? No, updates to a given row will be still be in a single sstable. Can you please explain little more? You mean that if Level 1 file contains range from 1-100

Compression in v1.0

2011-09-23 Thread David McNelis
I just read through the DataStax compression post ( http://www.datastax.com/dev/blog/whats-new-in-cassandra-1-0-compression). My question is around good use cases for enabling compression. In my scenario I have very wide rows with many thousands of columns where its essentially time-series

Re: Build Cassandra under Windows

2011-09-23 Thread Jonathan Ellis
What was the target you were using that didn't work? On Fri, Sep 23, 2011 at 5:00 AM, Viktor Jevdokimov viktor.jevdoki...@adform.com wrote: Spolved – just used appropriate ant‘s targets to get jars built. ** ** ** ** ** Best regards/ Pagarbiai ** ** *Viktor Jevdokimov*

Re: How to enable JNA for Cassandra on Windows?

2011-09-23 Thread Jonathan Ellis
mmap is supported by the JDK, jna is not required. On Fri, Sep 23, 2011 at 5:07 AM, Viktor Jevdokimov viktor.jevdoki...@adform.com wrote: I found that there‘s no C library under Windows, and msvcrt does not provide mlockall function, so currently there‘s no way to use JNA under Windows. That

Re: MessagingService.sendOneWay sending blank bytes?

2011-09-23 Thread Greg Hinkle
Is it worth a back-port or at least switch to asByteArray for 0.8.7? It's a sizable amount of wasted network traffic and the fix seems pretty safe. (It's working for me) Greg Hinkle On Sep 23, 2011, at 3:32 AM, Jonathan Ellis wrote: Yes. This is one of the things fixed for 1.0 in

Re: user Digest 23 Sep 2011 12:49:40 -0000 Issue 1371

2011-09-23 Thread David Semeria
user-digest-h...@cassandra.apache.org wrote: user Digest 23 Sep 2011 12:49:40 - Issue 1371 Topics (messages 20995 through 21004): Re: shutdown by drain 20995 by: Radim Kolar 20998 by: Viktor Jevdokimov 21001 by: Sylvain Lebresne Re: How to enable JNA for Cassandra

Re: Storing (python) objects

2011-09-23 Thread Koert Kuipers
i would advise not to use a language specific storage format, you might regret it later on if you want to add an application to your system that is written in anything else than python. i mean python is great, but it is not necessary the right tool for every job look at

Re: Storing (python) objects

2011-09-23 Thread Tristan Seligmann
On Fri, Sep 23, 2011 at 1:09 AM, Alexis Lê-Quôc a...@datadoghq.com wrote: For data accessed through a single path, I use the same trick: pickle, bz2 and insert. Note that unpickling a pickle in Python involves a) arbitrary code execution, and b) relies on your code being the same (or close

Bulk uploader issue on multi-node cluster

2011-09-23 Thread Thamizh
Hi All, I am using bulk-loading to upload data(from lab02) to multi-node cluster of 3 machines(lab02,lab03 lab04) with sigle ethernet card. I have created SSTable instance on lab02 by duplicating look back address( sudo ifconfig lo:2 127.0.0.2 netmask 255.0.0.0 up; ) 127.0.0.2 as rpc and

Re: Bulk uploader issue on multi-node cluster

2011-09-23 Thread Benoit Perroud
On the sstableloader config, make sure you have the seed set and rpc_address and rpc_port pointing to your cassandra instance (127.0.0.2) 2011/9/23 Thamizh tceg...@yahoo.co.in Hi All, I am using bulk-loading to upload data(from lab02) to multi-node cluster of 3 machines(lab02,lab03 lab04)

Re: Storing (python) objects

2011-09-23 Thread Ian Danforth
Good feedback from all. Thanks! Ian On Fri, Sep 23, 2011 at 7:48 AM, Tristan Seligmann mithra...@mithrandi.netwrote: On Fri, Sep 23, 2011 at 1:09 AM, Alexis Lê-Quôc a...@datadoghq.com wrote: For data accessed through a single path, I use the same trick: pickle, bz2 and insert. Note that

Re: MessagingService.sendOneWay sending blank bytes?

2011-09-23 Thread Jonathan Ellis
The full backport is beyond the scope of what I'm comfortable in a stable release series, but the asByteArray fix sounds reasonable to me. Can you create a ticket + patch? On Fri, Sep 23, 2011 at 8:04 AM, Greg Hinkle greghin...@gmail.com wrote: Is it worth a back-port or at least switch to

Re: [VOTE] Release Mojo's Cassandra Maven Plugin 0.8.6-1

2011-09-23 Thread Stephen Connolly
This vote has passed: +1: Me, Colin Nate 0: -1: I will proceed with the release -Stephen On 20 September 2011 15:27, Stephen Connolly stephen.alan.conno...@gmail.com wrote: Hi, I'd like to release version 0.8.6-1 of Mojo's Cassandra Maven Plugin to sync up with the recent 0.8.6 release of

Increasing thrift_framed_transport_size_in_mb

2011-09-23 Thread Sanjeev Kulkarni
Hey guys, Are there any side-effects of increasing the thrift_framed_transport_size_in_mb and thrift_max_message_length_in_mb variables from their default values to something like 100mb? Thanks!

Re: Storing (python) objects

2011-09-23 Thread Edward Capriolo
On Fri, Sep 23, 2011 at 1:41 PM, Ian Danforth idanfo...@numenta.com wrote: Good feedback from all. Thanks! Ian On Fri, Sep 23, 2011 at 7:48 AM, Tristan Seligmann mithra...@mithrandi.net wrote: On Fri, Sep 23, 2011 at 1:09 AM, Alexis Lê-Quôc a...@datadoghq.com wrote: For data accessed

ColumnFamily per Index?

2011-09-23 Thread Ron Siemens
I have a column family for my main data, and I have been using an additional column family to store indexes to the data: row per index style. I now want to be able to update a set of indexes by the field being indexed on. To access that set, I can maintain meta indexes for each field, or I

Re: ColumnFamily per Index?

2011-09-23 Thread Edward Capriolo
On Fri, Sep 23, 2011 at 5:28 PM, Ron Siemens rsiem...@greatergood.comwrote: I have a column family for my main data, and I have been using an additional column family to store indexes to the data: row per index style. I now want to be able to update a set of indexes by the field being

Re: Increasing thrift_framed_transport_size_in_mb

2011-09-23 Thread Jonathan Ellis
Really large messages are not encouraged because they will fragment your heap quickly. Other than that, no. On Fri, Sep 23, 2011 at 3:40 PM, Sanjeev Kulkarni sanj...@locomatix.com wrote: Hey guys, Are there any side-effects of increasing the thrift_framed_transport_size_in_mb and