find smallest counter

2012-10-21 Thread Paul Loy
. Many thanks in advance, Paul. -- - Paul Loy p...@keteracel.com http://uk.linkedin.com/in/paulloy

Re: TimeUUID

2012-02-28 Thread Paul Loy
In a multi server env, to avoid key collisions timeuuid may be the better choice. On Monday, February 27, 2012, Tamar Fraenkel wrote: Hi! I have a column family where I use rows as time buckets. What I do is take epoc time in seconds, and round it to 1 hour (taking the result of

Re: [RELEASE] Apache Cassandra 0.8.10 released

2012-02-14 Thread Paul Loy
this delay smaller as time goes on. I do not have a specific target date for 0.8.10 rpms, but real soon :) -- Warm regards, Michael Shuler -- - Paul Loy p...@keteracel.com http://uk.linkedin.com/in/paulloy

Re: Does anybody know why Twitter stop integrate Cassandra as Twitter store?

2011-10-04 Thread Paul Loy
, but there nothing said why they made this decision? Does anybody have mo information -- - Paul Loy p...@keteracel.com http://uk.linkedin.com/in/paulloy

Re: Best indexing solution for Cassandra

2011-09-29 Thread Paul Loy
. That means the documents don't get spread out throught the cluster and search was painfully slow. We ended up rolling up our own solution and not using cassandra at all for that purpose (althought we still use it for storage). -- - Paul Loy p

Re: How can I check what the consistency level is?

2011-09-29 Thread Paul Loy
is actually being used? Anthony -- - Paul Loy p...@keteracel.com http://uk.linkedin.com/in/paulloy

Re: Updates lost

2011-09-01 Thread Paul Loy
be the column value which jives with the fact that you're saying it seems to depend on the value. (I haven't checked current nor past versions of pycassa to determine if this is plausible. Just speculating.) -- - Paul Loy p...@keteracel.com http

Re: Suggested settings for number crunching

2011-08-19 Thread Paul Loy
://www.thelastpickle.com On 19/08/2011, at 3:43 AM, Paul Loy wrote: Yeah, the data after crunching drops to just 65000 columns so one Cassandra is plenty. That will all go in memory on one box. It's only the crunching where we have lots of data and then need it arranged in a structured manner. That's why I

Suggested settings for number crunching

2011-08-18 Thread Paul Loy
I can change to increase the write throughput. Perhaps disabling all caching, etc, as I won't be able to keep it all in memory anyway and only want to query the results once. Any thoughts would be appreciated, Paul. -- - Paul Loy p...@keteracel.com

Re: Suggested settings for number crunching

2011-08-18 Thread Paul Loy
? -Jake On Thu, Aug 18, 2011 at 7:08 AM, Paul Loy ketera...@gmail.com wrote: Hi All, I have a program that crunches through around 3 billion calculations. We store the result of each of these in cassandra to later query once in order to create some vectors. Our processing is limited by Cassandra

Re: Suggested settings for number crunching

2011-08-18 Thread Paul Loy
PM, Jonathan Ellis jbel...@gmail.com wrote: Step 0: use multiple threads to insert On Thu, Aug 18, 2011 at 10:03 AM, Paul Loy ketera...@gmail.com wrote: Yeah, we're processing item similarities. So we are writing single columns at a time. Although we do batch these into 400 mutations before

Re: Suggested settings for number crunching

2011-08-18 Thread Paul Loy
, take a look at the new bulk loader in cassandra: http://www.datastax.com/dev/blog/bulk-loading -Jake On Thu, Aug 18, 2011 at 11:03 AM, Paul Loy ketera...@gmail.com wrote: Yeah, we're processing item similarities. So we are writing single columns at a time. Although we do batch these into 400

Re: RF=1

2011-08-02 Thread Paul Loy
(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:662) -- - Paul Loy p...@keteracel.com http://uk.linkedin.com/in/paulloy

Re: host clocks

2011-07-25 Thread Paul Loy
! -- - Paul Loy p...@keteracel.com http://uk.linkedin.com/in/paulloy

Re: host clocks

2011-07-25 Thread Paul Loy
://www.endruntechnologies.com/faq.htm#How_accurate_is On Mon, Jul 25, 2011 at 1:38 PM, Sooraj S soor...@sparksupport.com wrote: may be you can sync the servers with pool.ntp.org with running ntp as a service. On 25 July 2011 14:34, Paul Loy ketera...@gmail.com wrote: And I guess there's the next problem

Re: host clocks

2011-07-25 Thread Paul Loy
we don't have those guarantees on EC2. Networks can fluctuate wildly. On Mon, Jul 25, 2011 at 2:00 PM, zGreenfelder zgreenfel...@gmail.comwrote: On Mon, Jul 25, 2011 at 8:51 AM, Paul Loy ketera...@gmail.com wrote: As I understand it, this will not quarantee that they are millisecond

Re: How to scale Cassandra?

2011-07-04 Thread Paul Loy
consistencies. The typical recommendation is RF=3 and QUORUM reads/writes. ** ** Dan ** ** *From:* Paul Loy [mailto:ketera...@gmail.com] *Sent:* July-04-11 5:59 *To:* user@cassandra.apache.org *Subject:* Re: How to scale Cassandra? ** ** That's basically how I understand

Re: working with time uuid

2011-06-06 Thread Paul Loy
query or insert? Or does cassandra only inspect the bits that represent the time stamp of the UUID when performing a lookup? -- - Paul Loy p...@keteracel.com http://uk.linkedin.com/in/paulloy

Re: working with time uuid

2011-06-06 Thread Paul Loy
well, to clarify, it first checks the timestamp bytes, then the rest so it doesn;t say they're the same if they came from 2 different servers. On Mon, Jun 6, 2011 at 4:52 PM, Paul Loy ketera...@gmail.com wrote: private static int compareTimestampBytes(ByteBuffer o1, ByteBuffer o2

Re: What's the best approach to search in Cassandra

2011-06-04 Thread Paul Loy
, or plan scan and compare of every record? Thanks a bunch! Mark -- - Paul Loy p...@keteracel.com http://uk.linkedin.com/in/paulloy

Loading Keyspace from YAML in 0.8

2011-06-03 Thread Paul Loy
, -- - Paul Loy p...@keteracel.com http://uk.linkedin.com/in/paulloy

Re: Loading Keyspace from YAML in 0.8

2011-06-03 Thread Paul Loy
ugh! On Fri, Jun 3, 2011 at 5:19 PM, Edward Capriolo edlinuxg...@gmail.comwrote: On Fri, Jun 3, 2011 at 12:14 PM, Paul Loy ketera...@gmail.com wrote: We embed cassandra in our app. When we first load a cluster, we specify one node in the cluster as the seed node. This node installs

Re: Loading Keyspace from YAML in 0.8

2011-06-03 Thread Paul Loy
:* Friday, June 03, 2011 12:00 PM *To:* user@cassandra.apache.org *Subject:* Re: Loading Keyspace from YAML in 0.8 On Fri, Jun 3, 2011 at 12:35 PM, Paul Loy ketera...@gmail.com wrote: ugh! On Fri, Jun 3, 2011 at 5:19 PM, Edward Capriolo edlinuxg...@gmail.comwrote: On Fri, Jun 3, 2011

Cluster not recovering when a single node dies

2011-05-27 Thread Paul Loy
. -- - Paul Loy p...@keteracel.com http://uk.linkedin.com/in/paulloy

Re: Cluster not recovering when a single node dies

2011-05-27 Thread Paul Loy
ahh, thanks. On Fri, May 27, 2011 at 4:43 PM, Jonathan Ellis jbel...@gmail.com wrote: Quorum of 2 is 2. You need at least RF=3 for quorum to tolerate losing a node indefinitely. On Fri, May 27, 2011 at 10:37 AM, Paul Loy ketera...@gmail.com wrote: We have a 4 node cluster

Re: Cluster not recovering when a single node dies

2011-05-27 Thread Paul Loy
I guess my next question is: the data should be complete somewhere in the ring with RF = 2. Does cassandra not redistribute the replication ring without a nodetool decommission call? On Fri, May 27, 2011 at 4:45 PM, Paul Loy ketera...@gmail.com wrote: ahh, thanks. On Fri, May 27, 2011 at 4:43

Re: Cluster not recovering when a single node dies

2011-05-27 Thread Paul Loy
' not coming back this time.) On Fri, May 27, 2011 at 10:47 AM, Paul Loy ketera...@gmail.com wrote: I guess my next question is: the data should be complete somewhere in the ring with RF = 2. Does cassandra not redistribute the replication ring without a nodetool decommission call? On Fri, May

Re: Priority queue in a single row - performance falls over time

2011-05-26 Thread Paul Loy
, Hampshire, GU14 0LX http://www.qinetiq.com. -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of DataStax, the source for professional Cassandra support http://www.datastax.com -- - Paul Loy p...@keteracel.com http

Re: cassandra not reading keyspaces defined in cassandra.yaml

2011-05-09 Thread Paul Loy
Solution Architect *http://www.persistentsys.com* *http://narendrasharma.blogspot.com/* -- - Paul Loy p...@keteracel.com http://uk.linkedin.com/in/paulloy

Re: caching change between 0.7.0 and 0.7.5

2011-05-06 Thread Paul Loy
PM, Paul Loy ketera...@gmail.com wrote: Hi all, so I just updated Cassandra from 0.7.0 to 0.7.5. I embed Cassandra in my app and use StorageProxy for querying. In one of my unit tests I write a column to Cassandra and then read it out again twice in quick succession. The second time I

caching change between 0.7.0 and 0.7.5

2011-05-05 Thread Paul Loy
means we have to upgrade but I'm concerned that the changes mean our load/stress tests will not be valid so just need some info to put my mind at ease! Many thanks, Paul. -- - Paul Loy p...@keteracel.com http://uk.linkedin.com/in/paulloy