Bug#924365: www.debian.org: FTBFS in buster: turkish vs. tr_TR locale

2019-04-07 Thread Laura Arjona Reina 
Hello Ömer

To avoid such errors you need to make the english folder first, I think

make -j1 -C english STRICT_ERROR_CHECKS=1 USE_SAMPLE_FILES=1

and then

make -j1 -C turkish STRICT_ERROR_CHECKS=1 USE_SAMPLE_FILES=1

I cannot reproduce the error in Stretch, the error happens only in Buster.

Kind regards,


El 7/4/19 a las 6:26, Omer Ozarslan escribió:
> Hello Laura,
> 
> I'm not sure if I missed some steps, but I couldn't reproduce this
> issue. Yet, I hit another one:
> 
> [snipped]
> 
> root@a179023d59e0:/webwml# make -j1 -C turkish STRICT_ERROR_CHECKS=1
> USE_SAMPLE_FILES=1
> make: Entering directory '/webwml/turkish'
> make -C po install
> make[1]: Entering directory '/webwml/turkish/po'
> make[1]: Leaving directory '/webwml/turkish/po'
> make -C CD
> make[1]: Entering directory '/webwml/turkish/CD'
> make -C http-ftp
> make[2]: Entering directory '/webwml/turkish/CD/http-ftp'
> make[2]: *** No rule to make target
> '../../../english/CD/http-ftp/cdimage_mirrors.list', needed by
> 'index.tr.html'.  Stop.
> make[2]: Leaving directory '/webwml/turkish/CD/http-ftp'
> make[1]: *** [../../Makefile.common:79: http-ftp] Error 2
> make[1]: Leaving directory '/webwml/turkish/CD'
> make: *** [../Makefile.common:79: CD] Error 2
> make: Leaving directory '/webwml/turkish'
> 
> Here is the verbose part I snipped for convenience:
> 
> root@a179023d59e0:/# cd webwml
> root@a179023d59e0:/webwml# cat /var/log/apt/history.log | grep Commandline
> Commandline: apt-get install -y build-essential vim gettext make perl
> wml git wget libxml-rss-perl
> root@a179023d59e0:/webwml# git reset --hard
> HEAD is now at c28ce7bbd78 (fr) DSA 4223-4225, initial translation
> root@a179023d59e0:/webwml# make -j1 -C turkish STRICT_ERROR_CHECKS=1
> USE_SAMPLE_FILES=1
> make: Entering directory '/webwml/turkish'
> make -C po install
> make[1]: Entering directory '/webwml/turkish/po'
> msgmerge -q templates.tr.po ../../english/po/templates.pot | \
>     msgfmt --statistics -o templates.mo -
> 91 translated messages, 16 fuzzy translations, 12 untranslated messages.
> 'templates.mo' -> '../../locale/tr/LC_MESSAGES/templates.mo'
> msgmerge -q bugs.tr.po ../../english/po/bugs.pot | \
>     msgfmt --statistics -o bugs.mo -
> 34 translated messages.
> 'bugs.mo' -> '../../locale/tr/LC_MESSAGES/bugs.mo'
> msgmerge -q blends.tr.po ../../english/po/blends.pot | \
>     msgfmt --statistics -o blends.mo -
> 0 translated messages, 18 untranslated messages.
> 'blends.mo' -> '../../locale/tr/LC_MESSAGES/blends.mo'
> msgmerge -q cdimage.tr.po ../../english/po/cdimage.pot | \
>     msgfmt --statistics -o cdimage.mo -
> 26 translated messages.
> 'cdimage.mo' -> '../../locale/tr/LC_MESSAGES/cdimage.mo'
> msgmerge -q consultants.tr.po ../../english/po/consultants.pot | \
>     msgfmt --statistics -o consultants.mo -
> 15 translated messages.
> 'consultants.mo' -> '../../locale/tr/LC_MESSAGES/consultants.mo'
> msgmerge -q countries.tr.po ../../english/po/countries.pot | \
>     msgfmt --statistics -o countries.mo -
> 104 translated messages.
> 'countries.mo' -> '../../locale/tr/LC_MESSAGES/countries.mo'
> msgmerge -q date.tr.po ../../english/po/date.pot | \
>     msgfmt --statistics -o date.mo -
> 38 translated messages.
> 'date.mo' -> '../../locale/tr/LC_MESSAGES/date.mo'
> msgmerge -q distrib.tr.po ../../english/po/distrib.pot | \
>     msgfmt --statistics -o distrib.mo -
> 46 translated messages.
> 'distrib.mo' -> '../../locale/tr/LC_MESSAGES/distrib.mo'
> msgmerge -q doc.tr.po ../../english/po/doc.pot | \
>     msgfmt --statistics -o doc.mo -
> 16 translated messages, 2 fuzzy translations, 14 untranslated messages.
> 'doc.mo' -> '../../locale/tr/LC_MESSAGES/doc.mo'
> msgmerge -q l10n.tr.po ../../english/po/l10n.pot | \
>     msgfmt --statistics -o l10n.mo -
> 21 translated messages.
> 'l10n.mo' -> '../../locale/tr/LC_MESSAGES/l10n.mo'
> msgmerge -q langs.tr.po ../../english/po/langs.pot | \
>     msgfmt --statistics -o langs.mo -
> 86 translated messages.
> 'langs.mo' -> '../../locale/tr/LC_MESSAGES/langs.mo'
> msgmerge -q legal.tr.po ../../english/po/legal.pot | \
>     msgfmt --statistics -o legal.mo -
> 25 translated messages.
> 'legal.mo' -> '../../locale/tr/LC_MESSAGES/legal.mo'
> msgmerge -q mailinglists.tr.po ../../english/po/mailinglists.pot | \
>     msgfmt --statistics -o mailinglists.mo -
> 20 translated messages.
> 'mailinglists.mo' -> '../../locale/tr/LC_MESSAGES/mailinglists.mo'
> msgmerge -q newsevents.tr.po ../../english/po/newsevents.pot | \
>     msgfmt --statistics -o newsevents.mo -
> 24 translated messages, 7 fuzzy translations, 37 untranslated messages.
> 'newsevents.mo' -> '../../locale/tr/LC_MESSAGES/newsevents.mo'
> msgmerge -q organization.tr.po ../../english/po/organization.pot | \
>     msgfmt --statistics -o organization.mo -
> 49 translated messages, 17 fuzzy translations, 22 untranslated messages.
>

Bug#924365: www.debian.org: FTBFS in buster: turkish vs. tr_TR locale

2019-04-06 Thread Omer Ozarslan 
Hello Laura,

I'm not sure if I missed some steps, but I couldn't reproduce this issue.
Yet, I hit another one:

[snipped]

root@a179023d59e0:/webwml# make -j1 -C turkish STRICT_ERROR_CHECKS=1
USE_SAMPLE_FILES=1
make: Entering directory '/webwml/turkish'
make -C po install
make[1]: Entering directory '/webwml/turkish/po'
make[1]: Leaving directory '/webwml/turkish/po'
make -C CD
make[1]: Entering directory '/webwml/turkish/CD'
make -C http-ftp
make[2]: Entering directory '/webwml/turkish/CD/http-ftp'
make[2]: *** No rule to make target
'../../../english/CD/http-ftp/cdimage_mirrors.list', needed by
'index.tr.html'.  Stop.
make[2]: Leaving directory '/webwml/turkish/CD/http-ftp'
make[1]: *** [../../Makefile.common:79: http-ftp] Error 2
make[1]: Leaving directory '/webwml/turkish/CD'
make: *** [../Makefile.common:79: CD] Error 2
make: Leaving directory '/webwml/turkish'

Here is the verbose part I snipped for convenience:

root@a179023d59e0:/# cd webwml
root@a179023d59e0:/webwml# cat /var/log/apt/history.log | grep Commandline
Commandline: apt-get install -y build-essential vim gettext make perl wml
git wget libxml-rss-perl
root@a179023d59e0:/webwml# git reset --hard
HEAD is now at c28ce7bbd78 (fr) DSA 4223-4225, initial translation
root@a179023d59e0:/webwml# make -j1 -C turkish STRICT_ERROR_CHECKS=1
USE_SAMPLE_FILES=1
make: Entering directory '/webwml/turkish'
make -C po install
make[1]: Entering directory '/webwml/turkish/po'
msgmerge -q templates.tr.po ../../english/po/templates.pot | \
msgfmt --statistics -o templates.mo -
91 translated messages, 16 fuzzy translations, 12 untranslated messages.
'templates.mo' -> '../../locale/tr/LC_MESSAGES/templates.mo'
msgmerge -q bugs.tr.po ../../english/po/bugs.pot | \
msgfmt --statistics -o bugs.mo -
34 translated messages.
'bugs.mo' -> '../../locale/tr/LC_MESSAGES/bugs.mo'
msgmerge -q blends.tr.po ../../english/po/blends.pot | \
msgfmt --statistics -o blends.mo -
0 translated messages, 18 untranslated messages.
'blends.mo' -> '../../locale/tr/LC_MESSAGES/blends.mo'
msgmerge -q cdimage.tr.po ../../english/po/cdimage.pot | \
msgfmt --statistics -o cdimage.mo -
26 translated messages.
'cdimage.mo' -> '../../locale/tr/LC_MESSAGES/cdimage.mo'
msgmerge -q consultants.tr.po ../../english/po/consultants.pot | \
msgfmt --statistics -o consultants.mo -
15 translated messages.
'consultants.mo' -> '../../locale/tr/LC_MESSAGES/consultants.mo'
msgmerge -q countries.tr.po ../../english/po/countries.pot | \
msgfmt --statistics -o countries.mo -
104 translated messages.
'countries.mo' -> '../../locale/tr/LC_MESSAGES/countries.mo'
msgmerge -q date.tr.po ../../english/po/date.pot | \
msgfmt --statistics -o date.mo -
38 translated messages.
'date.mo' -> '../../locale/tr/LC_MESSAGES/date.mo'
msgmerge -q distrib.tr.po ../../english/po/distrib.pot | \
msgfmt --statistics -o distrib.mo -
46 translated messages.
'distrib.mo' -> '../../locale/tr/LC_MESSAGES/distrib.mo'
msgmerge -q doc.tr.po ../../english/po/doc.pot | \
msgfmt --statistics -o doc.mo -
16 translated messages, 2 fuzzy translations, 14 untranslated messages.
'doc.mo' -> '../../locale/tr/LC_MESSAGES/doc.mo'
msgmerge -q l10n.tr.po ../../english/po/l10n.pot | \
msgfmt --statistics -o l10n.mo -
21 translated messages.
'l10n.mo' -> '../../locale/tr/LC_MESSAGES/l10n.mo'
msgmerge -q langs.tr.po ../../english/po/langs.pot | \
msgfmt --statistics -o langs.mo -
86 translated messages.
'langs.mo' -> '../../locale/tr/LC_MESSAGES/langs.mo'
msgmerge -q legal.tr.po ../../english/po/legal.pot | \
msgfmt --statistics -o legal.mo -
25 translated messages.
'legal.mo' -> '../../locale/tr/LC_MESSAGES/legal.mo'
msgmerge -q mailinglists.tr.po ../../english/po/mailinglists.pot | \
msgfmt --statistics -o mailinglists.mo -
20 translated messages.
'mailinglists.mo' -> '../../locale/tr/LC_MESSAGES/mailinglists.mo'
msgmerge -q newsevents.tr.po ../../english/po/newsevents.pot | \
msgfmt --statistics -o newsevents.mo -
24 translated messages, 7 fuzzy translations, 37 untranslated messages.
'newsevents.mo' -> '../../locale/tr/LC_MESSAGES/newsevents.mo'
msgmerge -q organization.tr.po ../../english/po/organization.pot | \
msgfmt --statistics -o organization.mo -
49 translated messages, 17 fuzzy translations, 22 untranslated messages.
'organization.mo' -> '../../locale/tr/LC_MESSAGES/organization.mo'
msgmerge -q partners.tr.po ../../english/po/partners.pot | \
msgfmt --statistics -o partners.mo -
0 translated messages, 62 untranslated messages.
'partners.mo' -> '../../locale/tr/LC_MESSAGES/partners.mo'
msgmerge -q ports.tr.po ../../english/po/ports.pot | \
msgfmt --statistics -o ports.mo -
26 translated messages.
'ports.mo' -> '../../locale/tr/LC_MESSAGES/ports.mo'
msgmerge -q security.tr.po ../../english/po/security.pot | \
msgfmt --statistics -o

Bug#924365: www.debian.org: FTBFS in buster: turkish vs. tr_TR locale

2019-04-06 Thread Laura Arjona Reina 
Dear Turkish Translation team,

While working on rebuilding the Debian website [1] within stretch and
buster, Cyril Brulebois detected that the Turkish subdirectory doesn't
build in buster, apparently due to possible locale issues.

[1] https://salsa.debian.org/webmaster-team/webwml

The .wmlrc file in that folder orders to build the site using the tr_TR
locale:

turkish/.wmlrc:-D CUR_LOCALE=tr_TR

But Perl complains about that:

 wml -q -D CUR_YEAR=2019 -o UNDEFuTR:index.tr.html@g+w   index.wml
 ePerl:Error: Perl runtime error (interpreter rc=0)

  Contents of STDERR channel: -
 Locale 'tr_TR' may not work well.
 The following characters (and maybe others) may not have the same
meaning as the Perl program expects:
 I i
 ; codeset=ISO-8859-9
 --
 ** WML:Break: Error in Pass 3 (rc=1).

More details on bug report #924365

https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=924365

I've done a "file" command on all the .po and .wml files in the /turkish
folder of the website and all of them seem to be UTF-8 encoded
(charset=utf-8), so I guess it's safe to change the .wmlrc file to tell
the site to build using tr_TR.UTF-8 locale.

Could you confirm?

Kind regards,
-- 
Laura Arjona Reina
https://wiki.debian.org/LauraArjona

Bug#924365: www.debian.org: FTBFS in buster: turkish vs. tr_TR locale

2019-03-11 Thread Cyril Brulebois 
Package: www.debian.org
Severity: normal
User: www.debian@packages.debian.org
Usertags: scripts

Hi,

While working on rebuilding the website within stretch and buster, I've
noticed the following.

The turkish subdirectory doesn't build in buster, apparently due to
possible locale issues:

(buster-amd64-webwml)kibi@wodi:~/debian-www/buster/webwml$ make -j1 -C 
turkish STRICT_ERROR_CHECKS=1 USE_SAMPLE_FILES=1
make: Entering directory '/home/kibi/debian-www/buster/webwml/turkish'
make -C po install
make[1]: Entering directory '/home/kibi/debian-www/buster/webwml/turkish/po'
make[1]: Leaving directory '/home/kibi/debian-www/buster/webwml/turkish/po'
wml -q -D CUR_YEAR=2019 -o UNDEFuTR:index.tr.html@g+w   index.wml
ePerl:Error: Perl runtime error (interpreter rc=0)

 Contents of STDERR channel: -
Locale 'tr_TR' may not work well.
The following characters (and maybe others) may not have the same meaning 
as the Perl program expects:
I i
; codeset=ISO-8859-9
--
** WML:Break: Error in Pass 3 (rc=1).
Died at /usr/share/wml/TheWML/Frontends/Wml/Runner.pm line 403.

TheWML::Frontends::Wml::Runner::_run_pass(TheWML::Frontends::Wml::Runner=HASH(0x55db148af458),
 3, SCALAR(0x55db14e351b8), SCALAR(0x55db14e35188), SCALAR(0x55db14e351a0)) 
called at /usr/share/wml/TheWML/Frontends/Wml/Runner.pm line 441

TheWML::Frontends::Wml::Runner::_passes_loop(TheWML::Frontends::Wml::Runner=HASH(0x55db148af458))
 called at /usr/share/wml/TheWML/Frontends/Wml/Runner.pm line 726

TheWML::Frontends::Wml::Runner::_output_and_cleanup(TheWML::Frontends::Wml::Runner=HASH(0x55db148af458))
 called at /usr/share/wml/TheWML/Frontends/Wml/Runner.pm line 930

TheWML::Frontends::Wml::Runner::run_with_ARGV(TheWML::Frontends::Wml::Runner=HASH(0x55db148af458),
 HASH(0x55db14908ff8)) called at /usr/bin/wml line 47
make: *** [/home/kibi/debian-www/buster/webwml/english/Makefile:43: 
index.tr.html] Error 2
make: Leaving directory '/home/kibi/debian-www/buster/webwml/turkish'


Many languages are using UTF-8 locales, exceptions are the following ones:

$ git grep CUR_LOCALE -- */.wmlrc|grep -v UTF-8$|grep -v utf8$
armenian/.wmlrc:-D CUR_LOCALE=hy_AM
bulgarian/.wmlrc:-D CUR_LOCALE=bg_BG
dutch/.wmlrc:-D CUR_LOCALE=nl_NL
hungarian/.wmlrc:-D CUR_LOCALE=hu_HU
lithuanian/.wmlrc:-D CUR_LOCALE=lt_LT
persian/.wmlrc:-D CUR_LOCALE=fa_IR
romanian/.wmlrc:-D CUR_LOCALE=ro_RO
slovak/.wmlrc:-D CUR_LOCALE=sk_SK
slovene/.wmlrc:-D CUR_LOCALE=sl_SI
turkish/.wmlrc:-D CUR_LOCALE=tr_TR

I suppose contacting translators and checking with them whether ISO-8859-9
is the right encoding to use in our source files, and whether there might
be some issues with Perl, would be a starting point?


Cheers,
-- 
Cyril Brulebois (k...@debian.org)
D-I release manager -- Release team member -- Freelance Consultant