Bug#968486: FTBFS turkish folder in Debian 10 buster in www-master: locale or UTF-8 or wml or perl issue
Hi, Laura Arjona Reina wrote: > As per https://www.debian.org/devel/website/translating, it seems that > this variable is only needed for correctly sort stuff in the > corresponding language, so, for now (until we find the fix), I have > removed the ""-D CUR_LOCALE=tr_TR.UTF-8" line in /turkish/.wmlrc so the > build at least starts. This has been made in commit > 2bf084fcb1cae633a6e5b8f044003bdea7e87c4a With that change, the build completes fine here ATM ! Holger -- Holger Wansing PGP-Fingerprint: 496A C6E8 1442 4B34 8508 3529 59F1 87CA 156E B076
Bug#968486: FTBFS turkish folder in Debian 10 buster in www-master: locale or UTF-8 or wml or perl issue
Hi, Laura Arjona Reina wrote (16 Aug 2020 15:52:46 +0200): > Thanks for trying! > What happens if you install locales-all package? (if not installed in > your system). Laura Arjona Reina wrote (16 Aug 2020 16:21:49 +0200): > Maybe the fix is installing libunicode-utf8-perl package? Both of the above are already installed here. Holger -- Holger Wansing PGP-Fingerprint: 496A C6E8 1442 4B34 8508 3529 59F1 87CA 156E B076
Bug#968486: FTBFS turkish folder in Debian 10 buster in www-master: locale or UTF-8 or wml or perl issue
Hi all, Thanks Holger for trying. I guess it must be another package. As per https://www.debian.org/devel/website/translating, it seems that this variable is only needed for correctly sort stuff in the corresponding language, so, for now (until we find the fix), I have removed the ""-D CUR_LOCALE=tr_TR.UTF-8" line in /turkish/.wmlrc so the build at least starts. This has been made in commit 2bf084fcb1cae633a6e5b8f044003bdea7e87c4a Note that in former message I quoted perl documentation that mentions that the Turkic locales are correctly handled in Perl 5.30, but we have 5.28.1 in buster. I have checked 5.28.1 documentation and the relevant paragraphs are: "Locale '%s' contains (at least) the following characters which have unexpected meanings: %s The Perl program will use the expected meanings (W locale) You are using the named UTF-8 locale. UTF-8 locales are expected to have very particular behavior, which most do. This message arises when perl found some departures from the expectations, and is notifying you that the expected behavior overrides these differences. In some cases the differences are caused by the locale definition being defective, but the most common causes of this warning are when there are ambiguities and conflicts in following the Standard, and the locale has chosen an approach that differs from Perl's. One of these is because that, contrary to the claims, Unicode is not completely locale insensitive. Turkish and some related languages have two types of "I" characters. One is dotted in both upper- and lowercase, and the other is dotless in both cases. Unicode allows a locale to use either the Turkish rules, or the rules used in all other instances, where there is only one type of "I" , which is dotless in the uppercase, and dotted in the lower. The perl core does not (yet) handle the Turkish case, and this message warns you of that. Instead, the Unicode::Casing module allows you to mostly implement the Turkish casing rules." Maybe the fix is installing libunicode-utf8-perl package? Kind regards, -- Laura Arjona Reina https://wiki.debian.org/LauraArjona
Bug#968486: FTBFS turkish folder in Debian 10 buster in www-master: locale or UTF-8 or wml or perl issue
Hi, Laura Arjona Reina wrote: > Can anybody reproduce the issue (just go to the "turkish" folder and do > "make", and get the error), and see if installing some of these packages > (libperlio-utf8-strict-perl or libunicode-utf8-perl or libutf8-all-perl) > the turkish folder builds fine? I got the error too, when starting, so my laptop (on Buster) looks like a valid case :-) But installing all those three packages does not fix the issue :-(( Holger -- Holger Wansing PGP-Fingerprint: 496A C6E8 1442 4B34 8508 3529 59F1 87CA 156E B076
Bug#968486: FTBFS turkish folder in Debian 10 buster in www-master: locale or UTF-8 or wml or perl issue
Package: www.debian.org User www.debian@packages.debian.org Usertag: scripts Severity: normal X-Debbugs-CC: debian-l10n-turk...@lists.debian.org , debian-i...@lists.debian.org Hi all In bug #924365, we discovered that the "tr_TR" locale in .wmlrc file was wrong and causing FTBFS issues in the turkish folder in buster machines, so we changed to "tr_TR.UTF-8" and our local tests were building fine. However, now that www-master migrated to Debian 10 buster, we're facing FTBFS issues anyway in the turkish folder: wml -q -D CUR_YEAR=2020 -o UNDEFuTR:index.tr.html@g+w index.wml ePerl:Error: Perl runtime error (interpreter rc=0) Contents of STDERR channel: - Locale 'tr_TR.UTF-8' contains (at least) the following characters which have unexpected meanings: I i The Perl program will use the expected meanings; codeset=UTF-8 -- ** WML:Break: Error in Pass 3 (rc=1). Died at /usr/share/wml/TheWML/Frontends/Wml/Runner.pm line 403. Since I cannot reproduce the issue in my local machine, I guess there is some missing package that we should install in www-master. However, I cannot tell which one is it. The Perl documentation says: "Starting in Perl v5.30, Perl detects Turkic locales by their behaviour, and seamlessly handles both types; previously only the non-Turkic one was supported. The name of the locale is ignored, if your system has a tr_TR.UTF-8 locale and it doesn't behave like a Turkic locale, perl will treat it like a non-Turkic locale." I have done "dpkg -l | grep locale" both in my machine and www-master and compared the results and didn't find much difference. I have done "dpkg -l | grep urkish" and neither (but I have task-turkish, task-turkish-desktop and task-turkish-kde-desktop installed) I have done dpkg -l | grep UTF and here I think maybe it's the package we need: (www-master) dpkg -l | grep UTF ii libutf8proc2:amd642.3.0-1 amd64C library for processing UTF-8 Unicode data (shared library) ii uni2ascii 4.18-3 amd64UTF-8 to 7-bit ASCII and vice versa converter (local machine) dpkg -l | grep UTF ii libperlio-utf8-strict-perl0.007-2+b1 amd64fast and correct UTF-8 Perl IO module ii libunicode-utf8-perl 0.62-1 amd64encoding and decoding of UTF-8 encoding form ii libutf8-all-perl 0.024-1 all Perl pragma to turn on UTF-8 everywhere ii libutf8proc2:amd642.3.0-1 amd64C library for processing UTF-8 Unicode data (shared library) Can anybody reproduce the issue (just go to the "turkish" folder and do "make", and get the error), and see if installing some of these packages (libperlio-utf8-strict-perl or libunicode-utf8-perl or libutf8-all-perl) the turkish folder builds fine? Thanks! -- -- Laura Arjona Reina https://wiki.debian.org/LauraArjona
