W dniu 2014-09-15 o 09:33, Daniel Naber pisze:
> On 2014-09-14 08:29, R.J. Baars wrote:
>
>> Currently it isn't:
>>
>> <S> <S> test—test[</S>,]
>>
>> Maybe this applies to more languages, but certainly to Dutch. Would
>> anyone
>> please change this in the (Dutch) Tokenizer?
>
> I tried adding that character (em dash) for all languages and all tests
> still work. Any objections to adding it directly to WordTokenizer so
> that it affects all languages?

I think it should be added universally.

Best,
Marcin

------------------------------------------------------------------------------
Want excitement?
Manually upgrade your production database.
When you want reliability, choose Perforce
Perforce version control. Predictably reliable.
http://pubads.g.doubleclick.net/gampad/clk?id=157508191&iu=/4140/ostg.clktrk
_______________________________________________
Languagetool-devel mailing list
Languagetool-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/languagetool-devel

Reply via email to