GData

2006-04-25 Thread jason rutherglen
http://jeremy.zawodny.com/blog/archives/006687.html Here is a good blog entry with a talk on GData from someone who worked on it. The only thing I think Solr needs is faster replication, which perhaps can be done faster using a direct replication model, preferably over HTTP of the segments

Re: GData

2006-04-25 Thread Yonik Seeley
On 4/25/06, jason rutherglen [EMAIL PROTECTED] wrote: Here is a good blog entry with a talk on GData from someone who worked on it. The only thing I think Solr needs is faster replication, which perhaps can be done faster using a direct replication model, preferably over HTTP of the

Re: GData

2006-04-25 Thread jason rutherglen
Also they have created what looks like fine grained date based queries in use with the Calendar application. Perhaps having a predefined out of the box way of handling date queries using date ranges in Solr would be useful. - Original Message From: Yonik Seeley [EMAIL PROTECTED] To:

Re: GData

2006-04-25 Thread Erik Hatcher
Anyone here an old timer Apple Newton user? I've been really getting jazzed on the ideas I'm getting thanks to Solr and contemplating Ruby integration. I've been re-reading my dusty Programming for the Newton (using Windows!) book. The discussion of the Newton soup data storage mechanism

[no subject]

2006-04-25 Thread jason rutherglen
http://code.google.com/apis/gdata/protocol.html#Optimistic-concurrency The versioning is for updates only.

Re: GData

2006-04-25 Thread jason rutherglen
Ok, if Google is using the GData architecture to store the GCalendar data, assuming they are, how long do you think a write takes to show up on the GCalendar web site? I think in this case something other than rsync may be a better option. - Original Message From: Yonik Seeley [EMAIL

Re: GData

2006-04-25 Thread Ian Holsman
I noticed you guys have created a 'gdata-lucene' server in the SoC project. are you planning on doing this via SoLR? or is it something brand new? --i On 4/26/06, jason rutherglen [EMAIL PROTECTED] wrote: Ok, if Google is using the GData architecture to store the GCalendar data, assuming they

Re: GData

2006-04-25 Thread Yonik Seeley
On 4/25/06, jason rutherglen [EMAIL PROTECTED] wrote: Ok, if Google is using the GData architecture to store the GCalendar data, assuming they are, how long do you think a write takes to show up on the GCalendar web site? I think in this case something other than rsync may be a better

Re: GData

2006-04-25 Thread Doug Cutting
Ian Holsman wrote: I noticed you guys have created a 'gdata-lucene' server in the SoC project. are you planning on doing this via SoLR? or is it something brand new? We decided that doing this via Solr would probably make it more complicated. A simple, standalone GData server built just

Re: GData

2006-04-25 Thread jason rutherglen
I would be curious then how the Google architecture works given that it seems to combine search and database concepts together and the Adam Bosworth talk seems to imply a replication redundant architecture like Solr. Is a faster method of loading or updating the IndexSearcher something that

Re: GData

2006-04-25 Thread Doug Cutting
jason rutherglen wrote: Is a faster method of loading or updating the IndexSearcher something that makes sense for Lucene? Yes. Folks have developed incrementally updateable IndexSearchers before, but none is yet part of Lucene. Or just assume the Google architecture is a lot more

Re: GData

2006-04-25 Thread jason rutherglen
I tried the find this Nutch answer in the docs and mailing list, sorry that it's a bit naive. Assuming Nutch distributes the index over many machines, does it use the NutchFS as a the Directory for IndexSearcher or does not use RemoteMultiSearcher? support real-time things like calendars,

Re: GData

2006-04-25 Thread jason rutherglen
Ah ok, think I found it: org.apache.nutch.indexer.FsDirectory no? Couldn't this be used in Solr and distribute all the data rather than master/slave it? - Original Message From: Doug Cutting [EMAIL PROTECTED] To: solr-dev@lucene.apache.org Sent: Tuesday, April 25, 2006 4:10:36 PM

Re: GData

2006-04-25 Thread Doug Cutting
jason rutherglen wrote: Ah ok, think I found it: org.apache.nutch.indexer.FsDirectory no? Couldn't this be used in Solr and distribute all the data rather than master/slave it? It's possible to search a Lucene index that lives in Hadoop's DFS, but not recommended. It's very slow. It's