Re: [elixir-core:11550] Re: [Proposal] U+FFFD Substitution of Maximal Subparts

2023-10-07 Thread José Valim
Hi Cameron, If the goal is to include this handling for UTF-16 and UTF-32, I suggest proposing this to Erlang/OTP as new functions in the "unicode" module. Otherwise, Elixir only has facilities to deal with UTF-8. You could propose such a feature in their issues tracker. Also note that "rolling

[elixir-core:11550] Re: [Proposal] U+FFFD Substitution of Maximal Subparts

2023-10-06 Thread Kip
Your implementation is definitely fast and memory efficient so I retract my implementation comments. Now that I've run the benchmarking script and tested out a few different approaches leveraging the std lib I understand better why you've taken the approach you have. Nice work. On Saturday,