Re: American /British Dictionary for solr-4.10.2

2015-02-12 Thread Walter Underwood
You are looking for this sort of thing?

elevator, lift
blueberry, whortleberry, bilberry
rutabega, swede
hood, bonnet
convertible top, hood
trunk, boot
daycare, preschool, nursery, playgroup
arugula, rocket
sidewalk, pavement
sweater, jumper
kerosene, paraffin
paraffin, wax
pants, trousers
underwear, pants

I did this once, as a demonstration to ship with Ultraseek. I dug through web 
resources manually and typed up a list. Some of the terms are domain-specific. 
There are big sets of automobile and railroad terms which are different.

http://en.wikipedia.org/wiki/Comparison_of_American_and_British_English
https://www.englishclub.com/vocabulary/british-american.htm
http://resources.woodlands-junior.kent.sch.uk/customs/questions/americanbritish.html
http://www.oxforddictionaries.com/us/words/british-and-american-terms
http://www.englisch-hilfen.de/en/words/be-ae.htm
http://www.englisch-hilfen.de/en/words/be-ae2.htm

This can cause confusing search results, because there are domain-specific 
terms that mean different things in the two dialects: hood, pants, paraffin, 
swede, rocket, etc. One of our customers made rocket propulsion systems. They 
were confused that “rocket fuel” suggested “arugula”.

Walter Underwood
wun...@wunderwood.org
http://observer.wunderwood.org/  (my blog)


On Feb 12, 2015, at 12:19 AM, Markus Jelsma  wrote:

> There are no dictionaries that sum up all possible conjugations, using a 
> heuristics based normalizer would be more appropriate. There are nevertheless 
> some good sources to start:
> 
> Contains lots of useful spelling issues, incl. 
> british/american/canadian/australian
> http://grammarist.com/spelling
> 
> Very useful
> http://en.wikipedia.org/wiki/American_and_British_English_spelling_differences#Acronyms_and_abbreviations
> 
> A handy list
> http://www.avko.org/free/reference/british-vs-american-spelling.html
> 
> There are some more lists but it seems the other one's tab is no longer open!
> Good luck
> 
> -Original message-
>> From:dinesh naik 
>> Sent: Thursday 12th February 2015 7:17
>> To: solr-user@lucene.apache.org
>> Subject: American /British Dictionary for solr-4.10.2
>> 
>> Hi,
>> 
>> What are the dictionaries available for Solr 4.10.2?
>> We are looking for a dictionary to support American/British English synonym.
>> 
>> 
>> -- 
>> Best Regards,
>> Dinesh Naik
>> 



RE: American /British Dictionary for solr-4.10.2

2015-02-12 Thread Markus Jelsma
There are no dictionaries that sum up all possible conjugations, using a 
heuristics based normalizer would be more appropriate. There are nevertheless 
some good sources to start:

Contains lots of useful spelling issues, incl. 
british/american/canadian/australian
http://grammarist.com/spelling

Very useful
http://en.wikipedia.org/wiki/American_and_British_English_spelling_differences#Acronyms_and_abbreviations

A handy list
http://www.avko.org/free/reference/british-vs-american-spelling.html

There are some more lists but it seems the other one's tab is no longer open!
Good luck

-Original message-
> From:dinesh naik 
> Sent: Thursday 12th February 2015 7:17
> To: solr-user@lucene.apache.org
> Subject: American /British Dictionary for solr-4.10.2
> 
> Hi,
> 
> What are the dictionaries available for Solr 4.10.2?
> We are looking for a dictionary to support American/British English synonym.
> 
> 
> -- 
> Best Regards,
> Dinesh Naik
>