Local quorum reads

2011-11-18 Thread Anthony Ikeda
This is the setup: Cassandra 0.8.6 3 nodes Keyspace: NetworkTopologyStrategy, 1DC, RF=2 1 node goes down and we cannot read from the ring. My expectation is that LOCAL_QUORUM dictates that it will return a record once a majority (N/2 +1) of replicas reports back. 2/2 + 1 = 2 I originally

Re: Local quorum reads

2011-11-18 Thread Anthony Ikeda
No it's not just the cli tool, our app has the same issue coming back with read issues. Sent from my iPhone On 18/11/2011, at 15:04, Peter Schuller peter.schul...@infidyne.com wrote: Keyspace: NetworkTopologyStrategy, 1DC, RF=2 1 node goes down and we cannot read from the ring. My

Re: Will writes with ALL consistency eventually propagate?

2011-11-07 Thread Anthony Ikeda
Riyad, I'm also just getting to know the different settings and values myself :) I believe, and it also depends on your config, CL.ONE Should ignore the loss of a node if your RF is 5, once you increase the CL then if you lose a node the CL is not met and you will get exceptions returned.

Re: Will writes with ALL consistency eventually propagate?

2011-11-06 Thread Anthony Ikeda
It's your replication factor that determines how many nodes contain the data. So you would set the replication factor to 5 to ensure all nodes contain the data. Your consistency level is all based on when should the server return to the client after writing. When one node has written the data

Re: Programmatically allow only one out of two types of rows in a CF to enter the CACHE

2011-10-29 Thread Anthony Ikeda
By higher level data I meant the common data. For example we plan on creating an index using Solr for search but as its lucene based you can store the common data as part of a Document. It won't be indexed but is still accessible as the document will share the same id as the row key. Sent

Re: Using elasticsearch on cassandra nodes

2011-10-18 Thread Anthony Ikeda
ahead of time). What are you using as your bridge between Cassandra and ES? Are you developing a Cassandra river? -brian On Mon, Oct 17, 2011 at 5:29 PM, Anthony Ikeda anthony.ikeda@gmail.com wrote: I've already posted to the elasticsearch groups and thought it prudent to also ask

Using elasticsearch on cassandra nodes

2011-10-17 Thread Anthony Ikeda
I've already posted to the elasticsearch groups and thought it prudent to also ask here. We are looking at using elastic search to index our data that we currently store to Cassandra. I was wondering if there are any concerns running elastic search on the same nodes that we use for Cassandra? We

How can I check what the consistency level is?

2011-09-29 Thread Anthony Ikeda
We seem to be having issues with out Consistency policies. We have it configured in Spring using the following: bean id=consistencyLevelPolicy class= me.prettyprint.cassandra.model.ConfigurableConsistencyLevel property name=defaultReadConsistencyLevel value=LOCAL_QUORUM/ property

Re: How can I check what the consistency level is?

2011-09-29 Thread Anthony Ikeda
RF=3 2 DC's 3 nodes each On Thu, Sep 29, 2011 at 5:08 PM, Paul Loy ketera...@gmail.com wrote: What is your replication factor? On Thu, Sep 29, 2011 at 5:02 PM, Anthony Ikeda anthony.ikeda@gmail.com wrote: We seem to be having issues with out Consistency policies. We have

Re: How can I check what the consistency level is?

2011-09-29 Thread Anthony Ikeda
Well I did a local test by debugging our code and the policy is set to LOCAL_QUORUM. Is there something else I'm missing? More info that would help? Or should I direct this to the hector-users group? Anthony On Thu, Sep 29, 2011 at 5:13 PM, Anthony Ikeda anthony.ikeda@gmail.comwrote: RF=3

Best indexing solution for Cassandra

2011-09-28 Thread Anthony Ikeda
Well, we go live with our project very soon and we are now looking into what we will be doing for the next phase. One of the enhancements we would like to consider is an indexing platform to start building searches into our application. Right now we are just using column families to index the

Using different versions of Cassandra in production

2011-09-21 Thread Anthony Ikeda
Okay, this is leaning more towards getting Brisk into our environment and making sure we can get it all working. We plan on deploying to production Cassandra 0.8.5/6, however, Brisk only works on 0.8.1 (in the 0.8.x release) Can we have a Brisk node operating as part of the ring to still do our

Re: [RELEASE] Apache Cassandra 0.8.6 released

2011-09-20 Thread Anthony Ikeda
One question. I was told that Brisk was going to made compatible with this version of Cassandra, will we see a new Brisk release this week as well? Anthony On Tue, Sep 20, 2011 at 3:12 AM, Sylvain Lebresne sylv...@datastax.comwrote: The Cassandra team is pleased to announce the release of

Configuring the keyspace correctly - NTS

2011-09-14 Thread Anthony Ikeda
Okay, in a previous post, it was stated that I could use a NetworkTopologyStrategy in a singel data centre by setting up my keyspace with: create keyspace KeyspaceDEV with placement_strategy = 'org.apache.cassandra.locator.NetworkTopologyStrategy' and strategy_options=[{datacenter1:3}];

Re: Configuring the keyspace correctly - NTS

2011-09-14 Thread Anthony Ikeda
the SimpleSnitch or the PropertyFileSnitch. Property File Snitch has a default catch all DC, see the cassandra-topology.properties file. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 15/09/2011, at 9:43 AM, Anthony Ikeda

Re: Configuring the keyspace correctly - NTS

2011-09-14 Thread Anthony Ikeda
Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 15/09/2011, at 9:43 AM, Anthony Ikeda wrote: Okay, in a previous post, it was stated that I could use a NetworkTopologyStrategy in a singel data centre by setting up my keyspace with: create keyspace KeyspaceDEV

Re: Is sstable2json broken in 0.8.4+?

2011-09-09 Thread Anthony Ikeda
a key? column? was UTF8 but it had non-UTF8 data in it. On Fri, Sep 9, 2011 at 2:06 PM, Anthony Ikeda anthony.ikeda@gmail.com wrote: I can't seem to export an sstable. The parameter flags don't work either (using -k and -f). sstable2json /Users/X/Database/cassandra_files/data

Re: [RELEASE] Apache Cassandra 0.8.5 released

2011-09-08 Thread Anthony Ikeda
Cool, all those fixes will be going into our prod env! Congrats! Anthony On Thu, Sep 8, 2011 at 7:51 AM, Stephen Connolly stephen.alan.conno...@gmail.com wrote: can take up to 12 hours for the sync to central - Stephen --- Sent from my Android phone, so random spelling mistakes, random

Re: Anybody out there using 0.8 in production

2011-09-08 Thread Anthony Ikeda
We plan to and have been using it in Dev and QA. There are some bugs that have been fixed that we are looking forward to in 0.8.5 and probably that would be the better build for production (there is a quorum bug that we will need). Otherwise no other 0.8 issues that we are aware of. We did go

Re: UnavailableException while storing with EACH_QUORUM and RF=3

2011-09-06 Thread Anthony Ikeda
Jonathan, do you know when 0.8.5 will be released? We are looking at a production deployment soon and this fix is something that we would need. Alternatively, what is the stability of the trunk for a production deployment. Anthony On Mon, Sep 5, 2011 at 3:35 PM, Evgeniy Ryabitskiy

Re: UnavailableException while storing with EACH_QUORUM and RF=3

2011-09-06 Thread Anthony Ikeda
Thanks Jonathan, I'll consult with the team. Anthony On Tue, Sep 6, 2011 at 3:34 PM, Jonathan Ellis jbel...@gmail.com wrote: 0.8.5 is being voted on now on the dev list. I'd encourage you to test it. I do not recommend running trunk. On Tue, Sep 6, 2011 at 5:32 PM, Anthony Ikeda

Re: UnavailableException while storing with EACH_QUORUM and RF=3

2011-09-06 Thread Anthony Ikeda
Do you have a link to the downloadable? Anthony On Tue, Sep 6, 2011 at 3:38 PM, Anthony Ikeda anthony.ikeda@gmail.comwrote: Thanks Jonathan, I'll consult with the team. Anthony On Tue, Sep 6, 2011 at 3:34 PM, Jonathan Ellis jbel...@gmail.com wrote: 0.8.5 is being voted on now

Re: UnavailableException while storing with EACH_QUORUM and RF=3

2011-09-06 Thread Anthony Ikeda
PM, Anthony Ikeda anthony.ikeda@gmail.com wrote: Do you have a link to the downloadable? Anthony On Tue, Sep 6, 2011 at 3:38 PM, Anthony Ikeda anthony.ikeda@gmail.com wrote: Thanks Jonathan, I'll consult with the team. Anthony On Tue, Sep 6, 2011 at 3:34 PM, Jonathan

Re: Trying to understand QUORUM and Strategies

2011-09-02 Thread Anthony Ikeda
Okay, great I just wanted to confirm that LOCAL_QUORUM will not work with SimpleStrategy. There was somewhat of a debate amongst my devs that said it should work. Anthon On Fri, Sep 2, 2011 at 9:55 AM, Evgeniy Ryabitskiy evgeniy.ryabits...@wikimart.ru wrote: So. You have created keyspace

Re: Limiting ColumnSlice range in second composite value

2011-09-02 Thread Anthony Ikeda
. Is what I'm trying to do possible? Anthony On Fri, Sep 2, 2011 at 12:29 PM, Nate McCall n...@datastax.com wrote: Instead of empty strings, try Character.[MAX|MIN-]_VALUE. On Thu, Sep 1, 2011 at 8:27 PM, Anthony Ikeda anthony.ikeda@gmail.com wrote: My Column name is of Composite

Re: Limiting ColumnSlice range in second composite value

2011-09-02 Thread Anthony Ikeda
Okay, I reversed the composite and seem to have come up with a solution. Although the rows are sorted by the status, the statuses are sorted temporally which helps. I tell you this type of modeling really breaks the rules :) Anthony On Fri, Sep 2, 2011 at 3:54 PM, Anthony Ikeda anthony.ikeda

Re: Trying to understand QUORUM and Strategies

2011-09-01 Thread Anthony Ikeda
Thanks Evneniy, We encountered this exception with the following settings: bean id=*consistencyLevelPolicy* class=* me.prettyprint.cassandra.model.ConfigurableConsistencyLevel* property name=*defaultReadConsistencyLevel* value=*LOCAL_QUORUM* / property

Limiting ColumnSlice range in second composite value

2011-09-01 Thread Anthony Ikeda
My Column name is of Composite(TimeUUIDType, UTF8Type) and I can query across the TimeUUIDs correctly, but now I want to also range across the UTF8 component. Is this possible? UUID start = uuidForDate(new Date(1979, 1, 1)); UUID end = uuidForDate(new Date(Long.MAX_VALUE)); String startState =

Trying to understand QUORUM and Strategies

2011-08-31 Thread Anthony Ikeda
Okay, we are looking at setting up a production environment which means getting our quorum settings and strategies correct. However, we need to really understand the approach taken to get this right. So far we have been working with co-located nodes and our prod environment is going to be

Re: hw requirements

2011-08-31 Thread Anthony Ikeda
Sorry to fork this topic, but in composite indexes do you mean as strings or as Composite(). I only ask cause we have started using the Composite as rowkeys and column names to replace the use of concatenated strings mainly for lookup purposes. Anthony On Wed, Aug 31, 2011 at 10:27 AM, Maxim

Re: Querying a composite key with cassandra-cli

2011-08-30 Thread Anthony Ikeda
, Anthony Ikeda anthony.ikeda@gmail.comwrote: Yeah I figured out what happened. I inadvertently set the keys to utf8 on the column family: assume ColumnFamily keys as utf8; which broke whichever default mechanism was in place to perform the colon separated values for the Composite key. When I

Re: Querying a composite key with cassandra-cli

2011-08-30 Thread Anthony Ikeda
No problems. Anthony On Tue, Aug 30, 2011 at 9:31 AM, Jonathan Ellis jbel...@gmail.com wrote: Sounds like a bug. Can you create a ticket on https://issues.apache.org/jira/browse/CASSANDRA ? On Tue, Aug 30, 2011 at 11:28 AM, Anthony Ikeda anthony.ikeda@gmail.com wrote: One thing I

Querying a composite key with cassandra-cli

2011-08-29 Thread Anthony Ikeda
Is there currently a way to query a composite key in cassandra-cli? I was sure I used to be able to call: get ColumnFamily['comp1:comp2'] But this has recently stopped working. Anthony

Re: Trying to find the problem with a broken pipe

2011-08-08 Thread Anthony Ikeda
Tim do you know if this is the actual reason that is causing the broken pipe? I'm having a hard time convincing my team that modifying this value will fix the issue. Jonathan, do you know if there is a valid explanation on why Tim no longer has the problem based on this change? Anthony Ikeda

Trying to find the problem with a broken pipe

2011-08-02 Thread Anthony Ikeda
I'm not sure if this is a problem with Hector or with Cassandra. We seem to be seeing broken pipe issues with our connections on the client side (Exception below). A bit of googling finds possibly a problem with the amount of data we are trying to store, although I'm certain our datasets are not

Re: Trying to find the problem with a broken pipe

2011-08-02 Thread Anthony Ikeda
of Hector and Cassandra are you running?* Cassandra 0.8.1, Hector 0.8.0-1 On Tue, Aug 2, 2011 at 10:37 AM, Jim Ancona j...@anconafamily.com wrote: On Tue, Aug 2, 2011 at 4:36 PM, Anthony Ikeda anthony.ikeda@gmail.com wrote: I'm not sure if this is a problem with Hector or with Cassandra

Re: Trying to find the problem with a broken pipe

2011-08-02 Thread Anthony Ikeda
/ property name=maxIdle value=-1/ property name=maxWaitTimeWhenExhausted value=-1/ property name=cassandraThriftSocketTimeout value=0/ /bean On Tue, Aug 2, 2011 at 11:13 AM, Anthony Ikeda anthony.ikeda@gmail.comwrote: The link (which I may be misreading) is http

Re: Trying to find the problem with a broken pipe

2011-08-02 Thread Anthony Ikeda
: On Tue, Aug 2, 2011 at 6:13 PM, Anthony Ikeda anthony.ikeda@gmail.com wrote: The link (which I may be misreading) is http://groups.google.com/group/hector-users/browse_thread/thread/8d7004b6f85a0f2e I hadn't found that one, but I doubt that our issue is related to that. It's only started

Questions over the use of CQL

2011-07-27 Thread Anthony Ikeda
For our current project we have decided to use Hector as the client API, however, with the introduction of CQL I need to understand a few things. Firstly, CQL use SQL like constructs. Column names seem to be limited to the same constraints of SQL (restricted use of delimiters) and yet the

Creating comparator of (Dynamic)CompositeType with cassandra-cli

2011-07-18 Thread Anthony Ikeda
Is this possible? I'm trying to create a Column Family with a CompositeType comparator, but I keep getting an error: create column family Transactions with comparator = CompositeType(UTF8Type, UUIDType) and keys_cached=1 and rows_cached=1000; Syntax error at position 84: missing EOF at '('

Re: Creating comparator of (Dynamic)CompositeType with cassandra-cli

2011-07-18 Thread Anthony Ikeda
getting 0 results even if I use the values of beginning of time (----) and end of time (----) I want to slice only across the Time component of the Composite. Is this possible? Anthony On Mon, Jul 18, 2011 at 10:52 AM, Anthony Ikeda

Node setup - recommended hardware

2011-05-04 Thread Anthony Ikeda
I just want to ask, when setting up nodes in a Node ring is it worthwhile using a 2 partition setup? i.e. Cassandra on the Primary, data directories etc on the second partition or does it really not make a difference? Anthony

Upgrading 0.6.2 - 0.6.3

2010-06-29 Thread Anthony Ikeda
org.apache.cassandra.dht.OrderPreservingPartitioner already. Any reason it has to find a saved partitioner? Anthony Ikeda Java Analyst/Programmer Cardlink Services Limited Level 4, 3 Rider Boulevard Rhodes NSW 2138 Web: www.cardlink.com.au | Tel: + 61 2 9646 9221 | Fax: + 61 2 9646

RE: Understanding SuperColumns

2010-06-28 Thread Anthony Ikeda
So no one is able to help? From: Anthony Ikeda [mailto:anthony.ik...@cardlink.com.au] Sent: Monday, 28 June 2010 12:36 PM To: user@cassandra.apache.org Subject: Understanding SuperColumns I seem to be scratching my head about how to model Super Columns properly and how they relate to a 1

RE: Understanding SuperColumns

2010-06-28 Thread Anthony Ikeda
: Understanding SuperColumns On Sun, Jun 27, 2010 at 7:36 PM, Anthony Ikeda anthony.ik...@cardlink.com.au wrote: Say my query is: Get all Work addresses in New York and the address owner. Steps to get the data would be: If this is the query you want to run, then you probably just

Understanding SuperColumns

2010-06-27 Thread Anthony Ikeda
], address3 is abandoned) 4. Then retrieve the User details and Address details using address2 and PB12345 using a kind of union...I think. Am I over complicating this? Anthony Ikeda Java Analyst/Programmer Cardlink Services Limited Level 4, 3 Rider Boulevard Rhodes NSW 2138 Web

Best documentation for Java and Cassandra?

2010-06-17 Thread Anthony Ikeda
). Any suggestions? Anthony Ikeda Java Analyst/Programmer Cardlink Services Limited Level 4, 3 Rider Boulevard Rhodes NSW 2138 Web: www.cardlink.com.au | Tel: + 61 2 9646 9221 | Fax: + 61 2 9646 9283 ** This e

RE: Best documentation for Java and Cassandra?

2010-06-17 Thread Anthony Ikeda
the keys are the color values and the values are whatever you choose - propably keys to other ColumnFamilies that hold the relevant record data. HTH, Ezra On Jun 17, 2010, at 12:04 AM, Anthony Ikeda anthony.ik...@cardlink.com.au wrote: I’m wondering if anyone can suggest

Get all rows back from a ColumnFamily

2010-06-17 Thread Anthony Ikeda
Is there any way at all (In Java) to get all the data from a ColumnFamily? I've inserted data into Cassandra and I don't seem to have a way to browse what's in there. Anthony Ikeda Java Analyst/Programmer Cardlink Services Limited Level 4, 3 Rider Boulevard Rhodes NSW 2138 Web

RE: Best documentation for Java and Cassandra?

2010-06-17 Thread Anthony Ikeda
of trying to model your _queries_. You _must_ use the tools as intended to achieve good results. b On Thu, Jun 17, 2010 at 4:12 PM, Anthony Ikeda anthony.ik...@cardlink.com.au wrote: Okay, so that is where frameworks such as Lucene come into play. Right now we have set up Cassandra

RE: Get all rows back from a ColumnFamily

2010-06-17 Thread Anthony Ikeda
Ikeda anthony.ik...@cardlink.com.au wrote: Is there any way at all (In Java) to get all the data from a ColumnFamily? I've inserted data into Cassandra and I don't seem to have a way to browse what's in there. Anthony Ikeda Java Analyst/Programmer Cardlink Services Limited Level 4, 3 Rider

Some questions about using Cassandra

2010-06-15 Thread Anthony Ikeda
relevant. Is there any concept of Listeners such that when data is added to Cassandra we can fire off another process to do something with that data? E.g. create a copy in a secondary database for Business Intelligence reports? Send the data to an LDAP server? Anthony Ikeda Java Analyst

RE: Some questions about using Cassandra

2010-06-15 Thread Anthony Ikeda
, necessarily, but some cyclic rework may occur. If your storage layout includes temporal names, it should be straightforward. The details how exactly how would depend on your storage layout, but it is not unusual as far as requirements go. On Tue, Jun 15, 2010 at 7:49 PM, Anthony Ikeda anthony.ik

RE: Some questions about using Cassandra

2010-06-15 Thread Anthony Ikeda
Thanks Benjamin. Looking at the 'plugins' now :) -Original Message- From: Benjamin Black [mailto:b...@b3k.us] Sent: Wednesday, 16 June 2010 11:35 AM To: user@cassandra.apache.org Subject: Re: Some questions about using Cassandra On Tue, Jun 15, 2010 at 6:07 PM, Anthony Ikeda anthony.ik