Re: [pcre-dev] Support for invalid UTF-8 strings?

2018-04-14 Thread Zoltán Herczeg
ink -> mailto:nalimi...@club.fr) > Dátum: 2018 április 13 17:23:04 Tárgy: Re: [pcre-dev] Support for invalid UTF-8 strings? Címzett: pcre-dev@exim.org (Link -> mailto:pcre-dev@exim.org)   Hi, Thanks for the detailed reply, that's very useful. To be honest, I won't work on implementing this myself, but it

Re: [pcre-dev] Support for invalid UTF-8 strings?

2018-04-13 Thread Ze'ev Atlas via Pcre-dev
If you want to hide the gory details from the user then you may provide two methods with similar signatures.  One would handle known valid utf-8 strings and the other would handle suspected strings.  The first one would go straight to PCRE2 and the other would do the suggested verification and

Re: [pcre-dev] Support for invalid UTF-8 strings?

2018-04-13 Thread Milan Bouchet-Valat
Hi, Thanks for the detailed reply, that's very useful. To be honest, I won't work on implementing this myself, but it's important to know what's possible to implement when designing APIs. I think it would be OK for Julia to check whether a string is valid UTF-8 beforehand (as PCRE currently does),

Re: [pcre-dev] Support for invalid UTF-8 strings?

2018-04-13 Thread ph10
On Thu, 12 Apr 2018, Milan Bouchet-Valat wrote: > I'm writing on behalf of the Julia programming language [1] developers > in order to get some information regarding the handling of invalid UTF- > 8 string when PCRE2_UTF and PCRE2_NO_UTF_CHECK flags are set. Milan, I understand what you are

[pcre-dev] Support for invalid UTF-8 strings?

2018-04-12 Thread Milan Bouchet-Valat
Dear PCRE developers, I'm writing on behalf of the Julia programming language [1] developers in order to get some information regarding the handling of invalid UTF- 8 string when PCRE2_UTF and PCRE2_NO_UTF_CHECK flags are set. For the context, Julia has taken the stance that strings are stored in