Minor point on FailureDetector

2010-07-13 Thread Masood Mortazavi
In FailureDetector, in ArrivalWindow, in "double p(double t)", is return 1 - ( 1 - Math.pow(Math.E, exponent) ); really needed, instead of return Math.pow(Math.E, exponent) ; I believe the integral of the the Exponential Distribution from "t" to infinity leads to the latter val

Re: Minimizing the impact of compaction on latency and throughput

2010-07-13 Thread Terje Marthinussen
On Tue, Jul 13, 2010 at 10:26 PM, Jonathan Ellis wrote: > > I'm totally fine with saying "Here's a JNI library for Linux [or even > Linux version >= 2.6.X]" since that makes up 99% of our production > deployments, and leaving the remaining 1% with the status quo. > You really need to say Linux >

Re: Minimizing the impact of compaction on latency and throughput

2010-07-13 Thread Jonathan Ellis
On Tue, Jul 13, 2010 at 6:18 AM, Terje Marthinussen wrote: > Due to the need for doing data alignment in the application itself (you are > bypassing all the OS magic here), there is really nothing portable about > O_DIRECT. I'm totally fine with saying "Here's a JNI library for Linux [or even Lin

Re: Minimizing the impact of compaction on latency and throughput

2010-07-13 Thread Jonathan Ellis
On Tue, Jul 13, 2010 at 4:19 AM, Thomas Downing wrote: > On a related note:  I am running some feasibility tests looking for > high ingest rate capabilities.  While testing Cassandra the problem > I've encountered is that it runs out of file handles during compaction. This usually just means "inc

Re: Minimizing the impact of compaction on latency and throughput

2010-07-13 Thread Peter Schuller
> Due to the need for doing data alignment in the application itself (you are > bypassing all the OS magic here), there is really nothing portable about > O_DIRECT. Just have a look at open(2) on linux: [snip] > So, just within Linux you got different mechanisms for this depending on > kernel and

Re: version.properties missing in trunk?

2010-07-13 Thread Gary Dusbabek
`ant createVersionPropFile` takes care of this, as does `ant build`. Gary. On Tue, Jul 13, 2010 at 04:08, Morten Wegelbye Nissen wrote: > Hello, > > Could it be that org/apache/cassandra/config/version.properties is missing > in trunk? Or should this file be generated somewhere? > > ( FBUttilit

Re: Minimizing the impact of compaction on latency and throughput

2010-07-13 Thread Terje Marthinussen
> (2) posix_fadvise() feels more obscure and less portable than > O_DIRECT, the latter being well-understood and used by e.g. databases > for a long time. > Due to the need for doing data alignment in the application itself (you are bypassing all the OS magic here), there is really nothing portabl

Re: Minimizing the impact of compaction on latency and throughput

2010-07-13 Thread Peter Schuller
> This looks relevant: > http://chbits.blogspot.com/2010/06/lucene-and-fadvisemadvise.html (see > comments for directions to code sample) Thanks. That's helpful; I've been trying to avoid JNI in the past so wasn't familiar with the API, and the main difficulty was likely to be how to best expose t

Re: Minimizing the impact of compaction on latency and throughput

2010-07-13 Thread Thomas Downing
On a related note: I am running some feasibility tests looking for high ingest rate capabilities. While testing Cassandra the problem I've encountered is that it runs out of file handles during compaction. Until that event, there was no significant impact on throughput as I was using it (0.1 que

version.properties missing in trunk?

2010-07-13 Thread Morten Wegelbye Nissen
Hello, Could it be that org/apache/cassandra/config/version.properties is missing in trunk? Or should this file be generated somewhere? ( FBUttilities.getCassandraVersionString is not feeling very good about the absent of this file ) ./Morten