Bug#796170: lintian: [new check] warn on non-UTF8 text files

2015-08-22 Thread Jakub Wilk
* Adam Borowski kilob...@angband.pl, 2015-08-22, 18:04: iconv should be good for plain text files in /usr/share/doc; but if applied blindly to code, or HTML documents or similar, it can cause more harm than good. Blindly can break when the code in question deals with obsolete encodings, but

Bug#796170: lintian: [new check] warn on non-UTF8 text files

2015-08-22 Thread Adam Borowski
On Thu, Aug 20, 2015 at 09:58:25AM +0200, Niels Thykier wrote: On 2015-08-19 23:43, Adam Borowski wrote: Thanks for the suggestion and the prototype patch. I think it is an interesting proposal and I think we could try it as an experimental check to see if it is a feasible check. I did some

Bug#796170: lintian: [new check] warn on non-UTF8 text files

2015-08-20 Thread Russ Allbery
Adam Borowski kilob...@angband.pl writes: Here's an experimental tag, a step towards elimination of mojibake system-wide. It checks all text files in *bin/, /usr/share/doc/ and those that look like a script file. Text is defined as not having any bytes in the 0..31 range other than tabs,

Bug#796170: lintian: [new check] warn on non-UTF8 text files

2015-08-20 Thread Niels Thykier
On 2015-08-19 23:43, Adam Borowski wrote: Package: lintian Version: 2.5.36.1 Severity: wishlist Tags: patch Hi, Thanks for the suggestion and the prototype patch. I think it is an interesting proposal and I think we could try it as an experimental check to see if it is a feasible check.

Bug#796170: lintian: [new check] warn on non-UTF8 text files

2015-08-20 Thread Jakub Wilk
Hi Adam! Here are some comments from a grumpy Lintian contributor: * Adam Borowski kilob...@angband.pl, 2015-08-19, 23:43: +Tag: text-file-uses-obsolete-encoding We have already a few tags named *-uses-obsolete-national-encoding, so it would be nice if this tag used the same scheme. Also,

Bug#796170: lintian: [new check] warn on non-UTF8 text files

2015-08-19 Thread Adam Borowski
Package: lintian Version: 2.5.36.1 Severity: wishlist Tags: patch Here's an experimental tag, a step towards elimination of mojibake system-wide. It checks all text files in *bin/, /usr/share/doc/ and those that look like a script file. Text is defined as not having any bytes in the 0..31