Another good reference is this one: http://unicode.org/reports/tr29/
Since the latest Lucene uses this for the basis of its text segmentation, it's worth getting familiar with it. On Fri, Mar 30, 2012 at 10:09 AM, Robert Muir <[email protected]> wrote: > On Fri, Mar 30, 2012 at 1:03 PM, Denis Brodeur <[email protected]> wrote: >> Thanks Robert. That makes sense. Do you have a link handy where I can >> find this information? i.e. word boundary/punctuation for any unicode >> character set? >> > > yeah, usually i use > http://unicode.org/cldr/utility/list-unicodeset.jsp?a=[\u0f10-\u0f19]&g= > > you can then click on a character and see all of its properties easily. > > (site seems to have some issues today) > > -- > lucidimagination.com > > --------------------------------------------------------------------- > To unsubscribe, e-mail: [email protected] > For additional commands, e-mail: [email protected] > --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
