Designing a multilingual index

2010-03-31 Thread David Vergnaud
Hi everyone! I'm about to build a search engine that will handle documents in several languages (4 for now but the number will increase in the near future). In order to index them properly and offer the best user experience, I'm automatically recognizing the language of each document in order t

Re: Designing a multilingual index

2010-04-01 Thread David Vergnaud
her systematic and it could become more part of the culture of search engines... paul Le 31-mars-10 à 18:20, David Vergnaud a écrit : > The second method I've thought of is to have all languages in the same index > and use different analyzers on fields that require analysis. In orde

Re: Designing a multilingual index

2010-04-01 Thread David Vergnaud
Hi, thx for sharing your experience with us. I'm happy to see that both methods I've thought of are apparently sensible ;-) However, it might be due to my lack of experience in that domain, but some of your arguments in favor of a multi-index solution seem to me to be also compatible with a si