Re: Using Solr for indexing emails

2008-11-25 Thread Norberto Meijome
On Tue, 25 Nov 2008 03:59:31 +0200 Timo Sirainen [EMAIL PROTECTED] wrote: would it be faster to say q=user:user AND highestuid:[ * TO *] ? Now that I read again what fq really did, yes, sounds like you're right. you may want to compare them both to see which one is better... I just went

Re: Using Solr for indexing emails

2008-11-25 Thread Shalin Shekhar Mangar
On Mon, Nov 24, 2008 at 11:51 PM, Timo Sirainen [EMAIL PROTECTED] wrote: DIH seems to be about Solr pulling data into it from an external source. That's not really practical with Dovecot since there's no central repository of any kind of data, so there's no way to know what has changed since

Re: Using Solr for indexing emails

2008-11-25 Thread Timo Sirainen
On Tue, 2008-11-25 at 20:45 +0530, Shalin Shekhar Mangar wrote: On Mon, Nov 24, 2008 at 11:51 PM, Timo Sirainen [EMAIL PROTECTED] wrote: DIH seems to be about Solr pulling data into it from an external source. That's not really practical with Dovecot since there's no central repository

Re: Using Solr for indexing emails

2008-11-24 Thread Timo Sirainen
On Mon, 2008-11-24 at 14:25 +1100, Norberto Meijome wrote: The main problem is that before doing the search, I first have to check if there are any unindexed messages and then add them to Solr. This is done using a query like: - fl=uid - rows=1 - sort=uid desc -

Re: Using Solr for indexing emails

2008-11-24 Thread Norberto Meijome
On Mon, 24 Nov 2008 20:21:17 +0200 Timo Sirainen [EMAIL PROTECTED] wrote: I think I gave enough reasons above for why I don't like this solution. :) I also don't like adding new shared global state databases just for Solr. Solr should be the one shared global state database.. fair enough - it

Re: Using Solr for indexing emails

2008-11-24 Thread Timo Sirainen
On Tue, 2008-11-25 at 12:20 +1100, Norberto Meijome wrote: Store the per-mailbox highest indexed UID in a new unique field created like user/uidvalidity/mailbox. Always update it by deleting the old one first and then adding the new one. you mean delete, commit, add, commit? if you

Using Solr for indexing emails

2008-11-23 Thread Timo Sirainen
Hi, A while ago I implemented searching emails with Solr for my IMAP server (www.dovecot.org). Seems to work ok, but now I'm having a bit of trouble trying to figure out how to implement searching from multiple mailboxes efficiently. Would be great if someone had suggestions how to do things

Re: Using Solr for indexing emails

2008-11-23 Thread Norberto Meijome
On Sun, 23 Nov 2008 16:02:16 +0200 Timo Sirainen [EMAIL PROTECTED] wrote: Hi, Hi Timo, [...] The main problem is that before doing the search, I first have to check if there are any unindexed messages and then add them to Solr. This is done using a query like: - fl=uid - rows=1 -