[ +mpvl ] On Wed, Apr 15, 2020 at 2:30 PM Matt Sherman <mwsher...@gmail.com> wrote: > > Hi, I am working on a tokenizer based on Unicode text segmentation (UAX 29). > I am wondering if there would be an interest in adding range tables for word > break categories to the x/text or unicode packages. It appears they could be > code-gen’d alongside the rest of the range tables. > > Pardon if this is already being done and I have missed it. I see some mention > of those categories (e.g. ALetter) in other places. > > My code is here. Thanks. > > -- > You received this message because you are subscribed to the Google Groups > "golang-nuts" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to golang-nuts+unsubscr...@googlegroups.com. > To view this discussion on the web visit > https://groups.google.com/d/msgid/golang-nuts/2a058556-da51-46d0-a41b-28e323541332%40googlegroups.com.
-- You received this message because you are subscribed to the Google Groups "golang-nuts" group. To unsubscribe from this group and stop receiving emails from it, send an email to golang-nuts+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/golang-nuts/CAOyqgcXiKgZTi4RdgB2ZZAC1cKJ3A1dVsweDULCM2gf8g1SUEw%40mail.gmail.com.