Re: [pcre-dev] Support for invalid UTF-8 strings?

2018-04-13 Thread Ze'ev Atlas via Pcre-dev
If you want to hide the gory details from the user then you may provide two methods with similar signatures.  One would handle known valid utf-8 strings and the other would handle suspected strings.  The first one would go straight to PCRE2 and the other would do the suggested verification and

Re: [pcre-dev] Support for invalid UTF-8 strings?

2018-04-13 Thread Milan Bouchet-Valat
Hi, Thanks for the detailed reply, that's very useful. To be honest, I won't work on implementing this myself, but it's important to know what's possible to implement when designing APIs. I think it would be OK for Julia to check whether a string is valid UTF-8 beforehand (as PCRE currently does),

Re: [pcre-dev] Support for invalid UTF-8 strings?

2018-04-13 Thread ph10
On Thu, 12 Apr 2018, Milan Bouchet-Valat wrote: > I'm writing on behalf of the Julia programming language [1] developers > in order to get some information regarding the handling of invalid UTF- > 8 string when PCRE2_UTF and PCRE2_NO_UTF_CHECK flags are set. Milan, I understand what you are