Someone posted an Arabic analyzer about 1 year ago, however, I don't think the licensing was very friendly and we no longer use it.
We have a cross language system that works w/ Arabic (among other languages). We have written several stemmers based on the literature that perform pretty well and were not too difficult to implement (but are not available as open source at this point). Light stemming seems to work much better in IR applications then aggressive stemmers due to the problems with roots discussed earlier. -Grant ---------------------------------------------------------------------- Grant Ingersoll Sr. Software Engineer Center for Natural Language Processing Syracuse University School of Information Studies http://www.cnlp.org >>> [EMAIL PROTECTED] 10/7/2004 8:45:42 AM >>> Dawid Weiss wrote: > >> nothing to do with each other furthermore, Arabic uses phonetic >> indicators on each letter called diacritics that change the way you >> pronounce the word which in turn changes the words meaning so two word >> spelled exactly the same way with different diacritics will mean two >> separate things, > > > Just to point out the fact: most slavic languages also use diacritic > marks (above, like 'acute', or 'dot' marks, or below, like the Polish > 'ogonek' mark). Some people argue that they can be stripped off the text > upon indexing and that the queries usually disambiguate the context of > the word. Hmm. This brings up a question: the algorithmic stemmer package from Egothor works quite well for Polish (http://www.getopt.org/stempel), wouldn't it work well for Arabic, too? I lack the necessary expertise to evaluate results (knowing only two or three arabic words ;-) ), but I can certainly help someone to get started with testing... -- Best regards, Andrzej Bialecki ------------------------------------------------- Software Architect, System Integration Specialist CEN/ISSS EC Workshop, ECIMF project chair EU FP6 E-Commerce Expert/Evaluator ------------------------------------------------- FreeBSD developer (http://www.freebsd.org) --------------------------------------------------------------------- To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED] --------------------------------------------------------------------- To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
