Bodo Graumann <m...@bodograumann.de> added the comment:

Unfortunately this is not quite finished yet.

First of all, the change is bigger than what is documented: “Changed in version 
3.9: Hyphens and spaces are converted to underscore.“

In reality, now
| Normalization works as follows: all non-alphanumeric
| characters except the dot used for Python package names are
| collapsed and replaced with a single underscore, e.g. '  -;#'
| becomes '_'. Leading and trailing underscores are removed.”
Cf. 
[encodings/__init__.py](https://github.com/python/cpython/blob/bb3e0c240bc60fe08d332ff5955d54197f79751c/Lib/encodings/__init__.py#L47-L50)

Secondly, this change breaks lots of iconv codecs with the python-iconv 
binding. E.g. `ASCII//TRANSLIT` is now normalized to `ascii_translit`, which 
iconv does not understand. Codec names which use hyphens also break and iinm 
not all of them have aliases in iconv without hyphens.
Cf. [python-iconv #4](https://github.com/bodograumann/python-iconv/issues/4)

The codecs api feels extremely well-fitting for integrating iconv in python and 
any alternative I can think of seems unsatisfactory.
Please advise.

----------
nosy: +bodograumann

_______________________________________
Python tracker <rep...@bugs.python.org>
<https://bugs.python.org/issue37751>
_______________________________________
_______________________________________________
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

Reply via email to