Re: Lucandra Ingestion

2010-01-25 Thread ML_Seda
Jonathan Ellis-3 wrote: Are you using multiple threads? I'm adding in threading now, and getting exceptions at times regarding a broken pipe. I then added the following : synchronized (this) { indexWriter.addDocument(doc, analyzer); } Which did get rid of

Re: Lucandra Ingestion

2010-01-25 Thread ML_Seda
Sure. Thanks Jake Jon! -- View this message in context: http://n2.nabble.com/Lucandra-Ingestion-tp4415691p4457366.html Sent from the cassandra-user@incubator.apache.org mailing list archive at Nabble.com.

Re: Lucandra Ingestion

2010-01-18 Thread ML_Seda
for many keys is in available this should go much faster. https://issues.apache.org/jira/browse/CASSANDRA-336 Looks like it will be in 0.6 release. -Jake On Mon, Jan 18, 2010 at 2:29 PM, ML_Seda sonnyh...@gmail.com wrote: I'm inserting a lot of documents into Cassandra/Lucandra

Re: Lucandra Ingestion

2010-01-18 Thread ML_Seda
requires an insert so it's def slow on Lucandra's side. Once the bulk insert for many keys is in available this should go much faster. https://issues.apache.org/jira/browse/CASSANDRA-336 Looks like it will be in 0.6 release. -Jake On Mon, Jan 18, 2010 at 2:29 PM, ML_Seda sonnyh

Re: Data Model Index Text

2010-01-13 Thread ML_Seda
; is there an architecture for storage that could be considered that would work with RandomPartitioner? Ryan On Tue, Jan 12, 2010 at 12:20 PM, ML_Seda sonnyh...@gmail.com wrote: i do see the classes now, but All the way back in version .20. Is there a newer version of Lucandra. It would be nice for us

Re: Data Model Index Text

2010-01-12 Thread ML_Seda
i do see the classes now, but All the way back in version .20. Is there a newer version of Lucandra. It would be nice for us to use the lastest cassandra (trunk). -- View this message in context: http://n2.nabble.com/Data-Model-Index-Text-tp4275199p4293071.html Sent from the

Re: Data Model Index Text

2010-01-11 Thread ML_Seda
Thanks Drew. That is correct. That would be one of the queries (give me all documents in which a list of terms are present) But not only that, another query would allow users to search for words around a given word. Keying in Michael would have a list of words in all documents after the word

Re: Data Model Index Text

2010-01-11 Thread ML_Seda
there. regards Ian On Jan 9, 2010, at 9:12 AM, ML_Seda wrote: Hey, I've been reading up on the Cassandra data model a bit, and would like to get some input from this forum on different techniques for a particular problem. Assume I need to index millions of text docs (e.g. research

Re: Data Model Index Text

2010-01-11 Thread ML_Seda
Thanks Jake. I don't see import org.apache.cassandra.service.Cassandra in 0.4 which is referenced in BookmarksDemo.java. Jake Luciani wrote: currently uses the 0.4 release series. On Mon, Jan 11, 2010 at 6:21 PM, ML_Seda sonnyh...@gmail.com wrote: Is there a particular version

Data Model Index Text

2010-01-08 Thread ML_Seda
Hey, I've been reading up on the Cassandra data model a bit, and would like to get some input from this forum on different techniques for a particular problem. Assume I need to index millions of text docs (e.g. research papers), and allow the ability to query them by a given word inside or