[Reproducible-builds] Bug#801855: ongl: test strings depend on default character encoding of the build system

2015-10-15 Thread Jérémy Bobbio 
Source: ognl
Version: 2.7.3-6
Severity: minor
User: reproducible-builds@lists.alioth.debian.org
Usertags: locale

Hi!

It seems that depending on the build system default character encoding,
the non-ASCII characters in org/ognl/test/QuotingTest.java might get
mistranslated.

This also prevents ongl from building reproducibly when one locale is
ISO-8859-15 and the other is UTF-8. See:
https://reproducible.debian.net/dbd/unstable/amd64/ognl_2.7.3-6.debbindiff.html
(also supplied as attachment)

-- 
Lunar.''`. 
lu...@debian.org: :Ⓐ  :  # apt-get install anarchism
`. `'` 
  `-   


ognl_2.7.3-6.debbindiff.html.xz
Description: Binary data


signature.asc
Description: Digital signature
___
Reproducible-builds mailing list
Reproducible-builds@lists.alioth.debian.org
http://lists.alioth.debian.org/cgi-bin/mailman/listinfo/reproducible-builds

[Reproducible-builds] Notes on OpenWRT Reproducibility

2015-10-15 Thread bnewbold 


Hi there! This is a long rambling email, sorry.

I ran across the OpenWRT reproducible build page[0] and diffoscope outputs 
this morning and thought they were super rad. I spent a bit of time to see 
if I could push things forward. Presumably this will mostly involve 
interaction with the OpenWRT developers, but I wanted to check in here 
first for feedback and to share what I learned.


1. There's a statement that diffoscope "cannot detect .bin files as 
squashfs". I don't think that's accurate, I could rename .squashfs files 
to .bin and diffoscope found the magic and worked fine. I think the issue 
is the huge number of hardware-specific ".bin" and ".img" formats OpenWRT 
generates[1]. Many of these are in uImage format (detectable by magic), 
others are just {kernel, bootloader, fs} at fixed offsets. For the former 
it would be great if diffoscope could pick up on the format in any way. I 
found a random script[2] that tries to extract uImage binaries into the 
original files, but it would be a good start to just present the metadata 
and offsets.


2. A few small changes to reproducible_openwrt.sh would be helpful. I 
would enable .tar.gz rootfs output for all targets 
(CONFIG_TARGET_ROOTFS_TARGZ=y) and grab some extra "image" files. In 
addition to .bin and .squashfs, {*.img, *.ext4, *.rootfs.tar.gz, *.img.gz, 
*.ubi, *.ubifs, *.itb} are full image suffixes. {*-uImage, *-zImage, 
*-vmlinuz, *.dtb, *.elf} are suffixes of kernel files which are sometimes 
distributed separately.

Also, perhaps add CONFIG_CLEAN_IPKG=y (see below).
Also, perhaps an ARM build target; A20-OLinuXino-Lime? Something with 
device tree, otherwise doesn't really matter.
I can submit a patch for the above if that would help, but I wouldn't have 
an easy way to test it.


In particular, being able to compare the rootfs images and kernel 
images separately might be sufficient instead of trying to untangle all 
the many random combined binary image formats.


3. I was sort of surprised to see linux-latest passing reproducibility in 
Debian on armhf. Was anything special necessary for this, eg changes to 
mkimage to generate uImage without a timestamp? Any advice or HOWTO out 
there on reproducible kernel builds? I see Ben Hutchings's kbuild patch 
for SOURCE_DATE_EPOCH support; is that sufficient?


4. busybox uses kconfig (or something very similar), which generates a 
AUTOCONF_TIMESTAMP macro in a header file (passed through as a "banner" 
variable capturing build time). I assumed this had to do with autotools at 
first, but it seems to be an old kconfig thing. I don't know how many 
other projects use these tools, but it might be worth making an 
identifier. I worked around the problem by checking for SOURCE_DATE_EPOCH 
in the Makefile and overriding the macro, but it might be cleaner to check 
in kconfig itself and generate an appropriate macro variable instead, as a 
reusable pattern.


5. diffoscope has squashfs support, but is there actually a way to 
generate squashfs files reproducibly? Perhaps there is a way to strip the 
metadata after the fact?


6. The opkg package manger leaves a log of .ipkg installs which end up on 
the disk and include a (UNIX) Installed-Time field. This situation is very 
similar to /var/cache with Debian. The CONFIG_CLEAN_IPKG=y flag is 
sufficient to just delete this log file, or opkg could add an argument to 
override the time, or a sed script could "fix" all the timestamps. A 
question for the OpenWRT developers.



I haven't gotten to any complete reproducible image files yet; I've got 
some patches with partial progress here: 
https://github.com/bnewbold/openwrt-repro/compare/master...repro


These are mostly just passing an existing TIMESTAMP variable (from version 
control) through to tar, having gzip not make timestamps, sorting a text 
file, etc.


The next things to tackle would be kernel images and a few more packages 
that capture timestamps. Also, with squashfs (vs tar), device files like 
/dev/console are problematic because they can't be "touched" to change 
mtime for mksquashfs.


Thanks for not only pushing through so much progress within Debian but 
also setting up this example infrastructure for OpenWRT, BSDs, etc. 
Inspiring!


--bryan

[0]: https://reproducible.debian.net/openwrt/openwrt.html
[1]: http://wiki.openwrt.org/doc/howto/obtain.firmware.generate
[2]: http://buffalo.nas-central.org/wiki/How_to_Extract_an_uImage

___
Reproducible-builds mailing list
Reproducible-builds@lists.alioth.debian.org
http://lists.alioth.debian.org/cgi-bin/mailman/listinfo/reproducible-builds

Re: [Reproducible-builds] Notes on OpenWRT Reproducibility

2015-10-15 Thread Jérémy Bobbio 
bnewb...@robocracy.org:
> 1. There's a statement that diffoscope "cannot detect .bin files as
> squashfs". I don't think that's accurate, I could rename .squashfs files to
> .bin and diffoscope found the magic and worked fine.

diffoscope currently recognizes Squashfs images using file(1). The
extension should not matter.

> I think the issue is the huge number of hardware-specific ".bin" and
> ".img" formats OpenWRT generates[1]. Many of these are in uImage
> format (detectable by magic), others are just {kernel, bootloader, fs}
> at fixed offsets. For the former it would be great if diffoscope could
> pick up on the format in any way. I found a random script[2] that
> tries to extract uImage binaries into the original files, but it would
> be a good start to just present the metadata and offsets.

The easiest way is probably to add a new “container-style” type of file
in diffoscope. If you don't feel comfortable doing it yourself by
looking at the existing code I can probably do it, but I would welcome
good pointers and test data. Feel free to open a new wishlist bug for
this.

> 3. I was sort of surprised to see linux-latest passing reproducibility in
> Debian on armhf. Was anything special necessary for this, eg changes to
> mkimage to generate uImage without a timestamp? Any advice or HOWTO out
> there on reproducible kernel builds? I see Ben Hutchings's kbuild patch for
> SOURCE_DATE_EPOCH support; is that sufficient?

linux-latest is just a meta package to instal the latest kernel version.
The source package for the kernel is called “linux”. It has not been
tested on armhf yet:
https://reproducible.debian.net/rb-pkg/unstable/armhf/linux.html

> 5. diffoscope has squashfs support, but is there actually a way to generate
> squashfs files reproducibly? Perhaps there is a way to strip the metadata
> after the fact?

It's most probable that changes in mksquashfs itself will be required.

Thanks for your work! :)

-- 
Lunar.''`. 
lu...@debian.org: :Ⓐ  :  # apt-get install anarchism
`. `'` 
  `-   


signature.asc
Description: Digital signature
___
Reproducible-builds mailing list
Reproducible-builds@lists.alioth.debian.org
http://lists.alioth.debian.org/cgi-bin/mailman/listinfo/reproducible-builds

[Reproducible-builds] diffoscope_37_amd64.changes ACCEPTED into unstable

2015-10-15 Thread Debian FTP Masters 


Accepted:

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256

Format: 1.8
Date: Thu, 15 Oct 2015 16:45:55 +0200
Source: diffoscope
Binary: diffoscope debbindiff
Architecture: source all
Version: 37
Distribution: unstable
Urgency: low
Maintainer: Reproducible builds folks 

Changed-By: Jérémy Bobbio 
Description:
 debbindiff - transitional package
 diffoscope - in-depth comparison of files, archives, and directories
Closes: 788364 799863 799901 800359 801333 801766
Changes:
 diffoscope (37) unstable; urgency=low
 .
   * Switch to incremental interface for TLSH. That means we won't load
 800 MiB or more in memory to compute the fuzzy hash.
   * Add support for CBFS images (Closes: #788364)
   * Add support for .dsc files (Closes: #800359)
   * Fix handling of malformed md5sums file. (Closes: #799901)
   * Fix placeholder encoding issue when trimming stderr.
 (Closes: #799863)
   * Read text report as UTF-8 encoded in test_text_option_with_file.
 (Closes: #801766)
   * Read Haskell interfaces in binary mode (Closes: #801333)
   * Read md5sums file using UTF-8.
   * Add a test for --max-diff-block-lines.
   * Handle closing stdin for Command implementing feed_stdin.
   * Handle subprocess errors with no output when comparing with a command.
   * Use name and not path when doing binary comparisons.
   * Add a test for --list-tools.
   * Fix main exception handling.
   * Use text file comparison for .dsc and .changes when the referenced files
 are missing.
   * Do skip squashfs test if there's no user with uid 1000.
   * Use super() instead of the old cumbersome form.
Checksums-Sha1:
 436adb3763d0cd1a647dee0b3752b356b2cceb20 1979 diffoscope_37.dsc
 7a99da70f15ffb9c3a1067cd3886eef78fc20bbc 207296 diffoscope_37.tar.xz
 c1e8feffecb6e58a2ef7a72c427da3a5415270a7 10130 debbindiff_37_all.deb
 a549ffc3416b8b0babb82a0db8ccaeaa3a35e634 43140 diffoscope_37_all.deb
Checksums-Sha256:
 1ef275ac33685737eaa0f668a84d17d31a1293564f9814d0a40fb25153f5fe89 1979 
diffoscope_37.dsc
 3238633f091976d1cd06c2c8f682a2978efa8961f2bdac4452eb755eb59efe1d 207296 
diffoscope_37.tar.xz
 872e85ebd7482c26458a2d73263aa33d29304ac4ec093fb0c74c637f36a5b5b3 10130 
debbindiff_37_all.deb
 093e8c23fbec5ab18b599f1ab85c65add7f8f38eb821e53b24c997a164c8b892 43140 
diffoscope_37_all.deb
Files:
 918e78ca52f459e791e40087071194f3 1979 devel optional diffoscope_37.dsc
 0fe1c4d5aaa11015bb22d511b84d461c 207296 devel optional diffoscope_37.tar.xz
 60e570a8843ec605be040a80c5cd7dbc 10130 oldlibs extra debbindiff_37_all.deb
 1d671c48169eeeca09859b9927d10d80 43140 devel optional diffoscope_37_all.deb

-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.12 (GNU/Linux)

iQIcBAEBCAAGBQJWH83WAAoJEEAsIlA9Nuk2MrYP/00Ht+KSFk0Spx7wOGT6c1G7
76ZO9SNYiH++CNGQ9ptwl8ve6pHGie+nZz4SHtgJRZTeB4AILI4h+gDhQ/ovPiGy
NqtdJhYXuz4jpXY78Id4M08IOgaxhBFPKOa82GCRmllKrejCwP8r4235UiWvsbgS
bhDTV42K6K6bsen4B3L3SqN5HzzeVK7NAghJGzNsi93fRsllb3AH2NO0Ofrn8IEK
HcruegukbadIBq2Q+i7avyrp5a2hFJBkgDMaq7q5stz5sNN5ikrNqlHU08E2l/c1
U2XQLK6LVhYa0u/nPK3OvjHdeEjCREHajGeEgQC2eCRcZmjqu/JJhf3RIsyjdJ1N
H/GHB0axi8+Jb7TOozHSowBRVFyBvcHDuj6sg/vJVMznL+OPZPwurbULQk1e6RDW
86iI3h2LnDyxvgR+efU9/nrqZR5pqtBNyBzOeliYfXLD+C+SANCbwx4jdPsSQh3q
PPWUr1Pj8Uxjp/33ssimi4cqleDn+NQa3/beLjhLQo6nEBMTAn4IFS0mNIC9gIOV
fW35ajGn1XDvTenhL6II3T19+rbgaTzFXYqUmUJFPmJi2AV2VEzRRdYA3cBMl4C2
g3tFst4ldQylmJBIEVdSaApH9lVAvu2YmOSxcrIhvhNFUNrR0sdQA3hRWwtkCKkn
72aEucO6symBBC2mf8uZ
=ZZzb
-END PGP SIGNATURE-


Thank you for your contribution to Debian.

___
Reproducible-builds mailing list
Reproducible-builds@lists.alioth.debian.org
http://lists.alioth.debian.org/cgi-bin/mailman/listinfo/reproducible-builds

[Reproducible-builds] Processing of diffoscope_37_amd64.changes

2015-10-15 Thread Debian FTP Masters 
diffoscope_37_amd64.changes uploaded successfully to localhost
along with the files:
  diffoscope_37.dsc
  diffoscope_37.tar.xz
  debbindiff_37_all.deb
  diffoscope_37_all.deb

Greetings,

Your Debian queue daemon (running on host franck.debian.org)

___
Reproducible-builds mailing list
Reproducible-builds@lists.alioth.debian.org
http://lists.alioth.debian.org/cgi-bin/mailman/listinfo/reproducible-builds

[Reproducible-builds] Processing of diffoscope_37_amd64.changes

2015-10-15 Thread Debian FTP Masters 
diffoscope_37_amd64.changes uploaded successfully to ftp-master.debian.org
along with the files:
  diffoscope_37.dsc
  diffoscope_37.tar.xz
  debbindiff_37_all.deb
  diffoscope_37_all.deb

Greetings,

Your Debian queue daemon (running on host coccia.debian.org)

___
Reproducible-builds mailing list
Reproducible-builds@lists.alioth.debian.org
http://lists.alioth.debian.org/cgi-bin/mailman/listinfo/reproducible-builds

[Reproducible-builds] Bug#799863: marked as done (diffoscope: exception in thread: TypeError: 'str' does not support the buffer interface)

2015-10-15 Thread Debian Bug Tracking System 
Your message dated Thu, 15 Oct 2015 16:19:02 +
with message-id 
and subject line Bug#799863: fixed in diffoscope 37
has caused the Debian Bug report #799863,
regarding diffoscope: exception in thread: TypeError: 'str' does not support 
the buffer interface
to be marked as done.

This means that you claim that the problem has been dealt with.
If this is not the case it is now your responsibility to reopen the
Bug report if necessary, and/or fix the problem forthwith.

(NB: If you are a system administrator and have no idea what this
message is talking about, this may indicate a serious mail system
misconfiguration somewhere. Please contact ow...@bugs.debian.org
immediately.)


-- 
799863: http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=799863
Debian Bug Tracking System
Contact ow...@bugs.debian.org with problems
--- Begin Message ---
package: diffoscope
version: 36
User: reproducible-builds@lists.alioth.debian.org
Usertags: infrastructure
X-Debbugs-Cc: reproducible-builds@lists.alioth.debian.org

Hi,

https://jenkins.debian.net/job/reproducible_builder_armhf_3/1619/console
shows the following symptoms:

+ timeout 30m schroot --directory /srv/reproducible-results/tmp.7Xt3pglBMQ -c 
source:jenkins-reproducible-unstable-diffoscope -- sh -c 'export 
TMPDIR=/srv/reproducible-results/tmp.7Xt3pglBMQ/dbd-tmp-QlfMX18 ; 
diffoscope  --html 
/srv/reproducible-results/tmp.7Xt3pglBMQ/gamera_3.4.2+svn1437-1.debbindiff.html 
 --text /srv/reproducible-
results/tmp.7Xt3pglBMQ/gamera_3.4.2+svn1437-1.debbindiff.txt

/srv/reproducible-results/tmp.7Xt3pglBMQ/b1/gamera_3.4.2+svn1437-1_armhf.changes

/srv/reproducible-results/tmp.7Xt3pglBMQ/b2/gamera_3.4.2+svn1437-1_armhf.changes'
+ RESULT=1
+ false
+ set +x
Exception in thread Thread-123:
Traceback (most recent call last):
  File "/usr/lib/python3.4/threading.py", line 920, in _bootstrap_inner
self.run()
  File "/usr/lib/python3.4/threading.py", line 868, in run
self._target(*self._args, **self._kwargs)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/utils.py", line 
114, in _read_stderr
self._stderr.write('[ %d lines ignored ]\n' % (self._stderr_line_count - 
Command.MAX_STDERR_LINES))
TypeError: 'str' does not support the buffer interface

Exception in thread Thread-124:
Traceback (most recent call last):
  File "/usr/lib/python3.4/threading.py", line 920, in _bootstrap_inner
self.run()
  File "/usr/lib/python3.4/threading.py", line 868, in run
self._target(*self._args, **self._kwargs)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/utils.py", line 
114, in _read_stderr
self._stderr.write('[ %d lines ignored ]\n' % (self._stderr_line_count - 
Command.MAX_STDERR_LINES))
TypeError: 'str' does not support the buffer interface

Exception in thread Thread-139:
Traceback (most recent call last):
  File "/usr/lib/python3.4/threading.py", line 920, in _bootstrap_inner
self.run()
  File "/usr/lib/python3.4/threading.py", line 868, in run
self._target(*self._args, **self._kwargs)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/utils.py", line 
114, in _read_stderr
self._stderr.write('[ %d lines ignored ]\n' % (self._stderr_line_count - 
Command.MAX_STDERR_LINES))
TypeError: 'str' does not support the buffer interface

Exception in thread Thread-138:
Traceback (most recent call last):
  File "/usr/lib/python3.4/threading.py", line 920, in _bootstrap_inner
self.run()
  File "/usr/lib/python3.4/threading.py", line 868, in run
self._target(*self._args, **self._kwargs)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/utils.py", line 
114, in _read_stderr
self._stderr.write('[ %d lines ignored ]\n' % (self._stderr_line_count - 
Command.MAX_STDERR_LINES))
TypeError: 'str' does not support the buffer interface

Exception in thread Thread-168:
Traceback (most recent call last):
  File "/usr/lib/python3.4/threading.py", line 920, in _bootstrap_inner
self.run()
  File "/usr/lib/python3.4/threading.py", line 868, in run
self._target(*self._args, **self._kwargs)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/utils.py", line 
114, in _read_stderr
self._stderr.write('[ %d lines ignored ]\n' % (self._stderr_line_count - 
Command.MAX_STDERR_LINES))
TypeError: 'str' does not support the buffer interface

Exception in thread Thread-169:
Traceback (most recent call last):
  File "/usr/lib/python3.4/threading.py", line 920, in _bootstrap_inner
self.run()
  File "/usr/lib/python3.4/threading.py", line 868, in run
self._target(*self._args, **self._kwargs)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/utils.py", line 
114, in _read_stderr
self._stderr.write('[ %d lines ignored ]\n' % (self._stderr_line_count - 
Command.MAX_STDERR_LINES))
TypeError: 'str' does not support the buffer interface

Exception

[Reproducible-builds] Bug#800359: marked as done (diffoscope: diffing two .dsc should diff the full sources)

2015-10-15 Thread Debian Bug Tracking System 
Your message dated Thu, 15 Oct 2015 16:19:02 +
with message-id 
and subject line Bug#800359: fixed in diffoscope 37
has caused the Debian Bug report #800359,
regarding diffoscope: diffing two .dsc should diff the full sources
to be marked as done.

This means that you claim that the problem has been dealt with.
If this is not the case it is now your responsibility to reopen the
Bug report if necessary, and/or fix the problem forthwith.

(NB: If you are a system administrator and have no idea what this
message is talking about, this may indicate a serious mail system
misconfiguration somewhere. Please contact ow...@bugs.debian.org
immediately.)


-- 
800359: http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=800359
Debian Bug Tracking System
Contact ow...@bugs.debian.org with problems
--- Begin Message ---
Package: diffoscope
Version: 36
Severity: wishlist

Hi there.

I tend to use diffoscope to check the differences between two uploads
because I like it's output much more than a plain debdiff.
So, I'd like to compare the source, and I feed diffoscope with the 2
.dsc; it shows me only the diff of the .dsc files iteself, which is
quite uselss.

I'd prefer diffosocpe to behave the same why it does with .changes and
diff all the files listed in the Files: field of the .dscs.


-- System Information:
Debian Release: stretch/sid
  APT prefers unstable
  APT policy: (500, 'unstable'), (1, 'experimental')
Architecture: amd64 (x86_64)
Foreign Architectures: i386, arm64, armhf

Kernel: Linux 4.2.0-1-amd64 (SMP w/4 CPU cores)
Locale: LANG=en_US.UTF-8, LC_CTYPE=en_US.UTF-8 (charmap=UTF-8)
Shell: /bin/sh linked to /bin/dash
Init: systemd (via /run/systemd/system)

Versions of packages diffoscope depends on:
ii  python3   3.4.3-6
ii  python3-debian0.1.27
ii  python3-libarchive-c  2.1-3
ii  python3-magic 1:5.25-2
ii  python3-rpm   4.12.0.1+dfsg1-3
ii  python3-tlsh  3.2.1+20150727-2
pn  python3:any   

Versions of packages diffoscope recommends:
ii  acl   2.2.52-2
ii  binutils-multiarch2.25.1-3
ii  bzip2 1.0.6-8
ii  cpio  2.11+dfsg-4.1
ii  default-jdk [java-sdk]2:1.7-52
ii  fontforge-extras  0.3-4
ii  genisoimage   9:1.1.11-3
ii  gettext   0.19.6-1
ii  ghc   7.8.4-9
ii  gnupg 1.4.19-5
ii  mono-utils3.2.8+dfsg-10
ii  openjdk-7-jdk [java-sdk]  7u85-2.6.1-3
ii  pdftk 2.02-3
ii  poppler-utils 0.26.5-4
ii  rpm2cpio  4.12.0.1+dfsg1-3
ii  sng   1.0.6-2
ii  sqlite3   3.8.11.1-1
ii  squashfs-tools1:4.3-2
ii  unzip 6.0-18
ii  vim-common2:7.4.826-1
ii  xz-utils  5.1.1alpha+20120614-2.1

diffoscope suggests no packages.

-- no debconf information

-- 
regards,
Mattia Rizzolo

GPG Key: 66AE 2B4A FCCF 3F52 DA18  4D18 4B04 3FCD B944 4540  .''`.
more about me:  http://mapreri.org  : :'  :
Launchpad user: https://launchpad.net/~mapreri  `. `'`
Debian QA page: https://qa.debian.org/developer.php?login=mattia  `-


signature.asc
Description: PGP signature
--- End Message ---
--- Begin Message ---
Source: diffoscope
Source-Version: 37

We believe that the bug you reported is fixed in the latest version of
diffoscope, which is due to be installed in the Debian FTP archive.

A summary of the changes between this version and the previous one is
attached.

Thank you for reporting the bug, which will now be closed.  If you
have further comments please address them to 800...@bugs.debian.org,
and the maintainer will reopen the bug report if appropriate.

Debian distribution maintenance software
pp.
Jérémy Bobbio  (supplier of updated diffoscope package)

(This message was generated automatically at their request; if you
believe that there is a problem with it please contact the archive
administrators by mailing ftpmas...@ftp-master.debian.org)


-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256

Format: 1.8
Date: Thu, 15 Oct 2015 16:45:55 +0200
Source: diffoscope
Binary: diffoscope debbindiff
Architecture: source all
Version: 37
Distribution: unstable
Urgency: low
Maintainer: Reproducible builds folks 

Changed-By: Jérémy Bobbio 
Description:
 debbindiff - transitional package
 diffoscope - in-depth comparison of files, archives, and directories
Closes: 788364 799863 799901 800359 801333 801766
Changes:
 diffoscope (37) unstable; urgency=low
 .
   * Switch to incremental interface for TLSH. That means we won't load
 800 MiB or more in memory to compute the fuzzy hash.
   * Add support for CBFS images (Closes: #788364)
   * Add support for .dsc files (Closes: #800359)
   * Fix handling of malformed

[Reproducible-builds] Bug#799901: marked as done ([diffoscope] TypeError: 'differences' must contains Difference objects')

2015-10-15 Thread Debian Bug Tracking System 
Your message dated Thu, 15 Oct 2015 16:19:02 +
with message-id 
and subject line Bug#799901: fixed in diffoscope 37
has caused the Debian Bug report #799901,
regarding [diffoscope] TypeError: 'differences' must contains Difference 
objects'
to be marked as done.

This means that you claim that the problem has been dealt with.
If this is not the case it is now your responsibility to reopen the
Bug report if necessary, and/or fix the problem forthwith.

(NB: If you are a system administrator and have no idea what this
message is talking about, this may indicate a serious mail system
misconfiguration somewhere. Please contact ow...@bugs.debian.org
immediately.)


-- 
799901: http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=799901
Debian Bug Tracking System
Contact ow...@bugs.debian.org with problems
--- Begin Message ---
Package: diffoscope
Version: 36

Seen on rb.d.n (publican/4.3.2-1 on unstable/amd64):


Wed Sep 23 18:58:19 UTC 2015 - diffoscope 36 will be used to compare the two 
builds:
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/diffoscope/__main__.py", line 137, in 
main
sys.exit(run_diffoscope(parsed_args))
  File "/usr/lib/python3/dist-packages/diffoscope/__main__.py", line 114, in 
run_diffoscope
parsed_args.file1, parsed_args.file2)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/__init__.py", 
line 81, in compare_root_paths
return compare_files(file1, file2)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/__init__.py", 
line 98, in compare_files
return file1.compare(file2, source)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/binary.py", line 
78, in wrapper
return original_method(self, other, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/binary.py", line 
176, in compare
difference = self._compare_using_details(other, source)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/binary.py", line 
149, in _compare_using_details
details = [d for d in self.compare_details(other, source) if d is not None]
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/binary.py", line 
78, in wrapper
return original_method(self, other, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/debian.py", line 
143, in compare_details
differences.extend(my_container.compare(other_container))
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/utils.py", line 
199, in compare
return list(starmap(diffoscope.comparators.compare_commented_files, 
self.comparisons(other)))
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/__init__.py", 
line 101, in compare_commented_files
difference = compare_files(file1, file2, source=source)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/__init__.py", 
line 98, in compare_files
return file1.compare(file2, source)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/binary.py", line 
78, in wrapper
return original_method(self, other, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/binary.py", line 
176, in compare
difference = self._compare_using_details(other, source)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/binary.py", line 
149, in _compare_using_details
details = [d for d in self.compare_details(other, source) if d is not None]
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/binary.py", line 
78, in wrapper
return original_method(self, other, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/deb.py", line 84, 
in compare_details
differences.extend(my_container.compare(other_container))
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/utils.py", line 
199, in compare
return list(starmap(diffoscope.comparators.compare_commented_files, 
self.comparisons(other)))
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/__init__.py", 
line 101, in compare_commented_files
difference = compare_files(file1, file2, source=source)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/__init__.py", 
line 98, in compare_files
return file1.compare(file2, source)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/binary.py", line 
78, in wrapper
return original_method(self, other, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/binary.py", line 
176, in compare
difference = self._compare_using_details(other, source)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/binary.py", line 
149, in _compare_using_details
details = [d for d in self.compare_details(other, source) if d is not None]
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/binary.py", line 
78, in wrapper
return original_method(self, other, *args, **kwargs)
  File

[Reproducible-builds] Bug#801766: marked as done (diffoscope: UnicodeDecodeError in test_text_option_with_file)

2015-10-15 Thread Debian Bug Tracking System 
Your message dated Thu, 15 Oct 2015 16:19:02 +
with message-id 
and subject line Bug#801766: fixed in diffoscope 37
has caused the Debian Bug report #801766,
regarding diffoscope: UnicodeDecodeError in test_text_option_with_file
to be marked as done.

This means that you claim that the problem has been dealt with.
If this is not the case it is now your responsibility to reopen the
Bug report if necessary, and/or fix the problem forthwith.

(NB: If you are a system administrator and have no idea what this
message is talking about, this may indicate a serious mail system
misconfiguration somewhere. Please contact ow...@bugs.debian.org
immediately.)


-- 
801766: http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=801766
Debian Bug Tracking System
Contact ow...@bugs.debian.org with problems
--- Begin Message ---
Package: diffoscope
Version: 36

seen in rb.d.n:
in experimental, haskell-authenticate-oauth/1.5.1.1-4:

Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/diffoscope/__main__.py", line 137, in 
main
sys.exit(run_diffoscope(parsed_args))
  File "/usr/lib/python3/dist-packages/diffoscope/__main__.py", line 114, in 
run_diffoscope
parsed_args.file1, parsed_args.file2)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/__init__.py", 
line 81, in compare_root_paths
return compare_files(file1, file2)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/__init__.py", 
line 98, in compare_files
return file1.compare(file2, source)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/binary.py", line 
78, in wrapper
return original_method(self, other, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/binary.py", line 
176, in compare
difference = self._compare_using_details(other, source)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/binary.py", line 
149, in _compare_using_details
details = [d for d in self.compare_details(other, source) if d is not None]
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/binary.py", line 
78, in wrapper
return original_method(self, other, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/debian.py", line 
143, in compare_details
differences.extend(my_container.compare(other_container))
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/utils.py", line 
199, in compare
return list(starmap(diffoscope.comparators.compare_commented_files, 
self.comparisons(other)))
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/__init__.py", 
line 101, in compare_commented_files
difference = compare_files(file1, file2, source=source)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/__init__.py", 
line 98, in compare_files
return file1.compare(file2, source)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/binary.py", line 
78, in wrapper
return original_method(self, other, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/binary.py", line 
176, in compare
difference = self._compare_using_details(other, source)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/binary.py", line 
149, in _compare_using_details
details = [d for d in self.compare_details(other, source) if d is not None]
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/binary.py", line 
78, in wrapper
return original_method(self, other, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/deb.py", line 84, 
in compare_details
differences.extend(my_container.compare(other_container))
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/utils.py", line 
199, in compare
return list(starmap(diffoscope.comparators.compare_commented_files, 
self.comparisons(other)))
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/__init__.py", 
line 101, in compare_commented_files
difference = compare_files(file1, file2, source=source)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/__init__.py", 
line 98, in compare_files
return file1.compare(file2, source)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/binary.py", line 
78, in wrapper
return original_method(self, other, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/binary.py", line 
176, in compare
difference = self._compare_using_details(other, source)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/binary.py", line 
149, in _compare_using_details
details = [d for d in self.compare_details(other, source) if d is not None]
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/binary.py", line 
78, in wrapper
return original_method(self, other, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/xz.py", line 69, 
in compare_details
return

[Reproducible-builds] Bug#801885: autoconf2.13: Package contains /usr/share/man/man1/ChangeLog.1.gz if built under certain locales

2015-10-15 Thread Santiago Vila 
Package: autoconf2.13
Version: 2.13-66
Severity: wishlist
X-Debbugs-Cc: reproducible-builds@lists.alioth.debian.org
User: reproducible-builds@lists.alioth.debian.org
Usertags: locale
Tags: patch

Hi.

While working on the “reproducible builds” effort [1], we have noticed
that this package could not be built reproducibly.

 [1] https://wiki.debian.org/ReproducibleBuilds

The problem is in this line from debian/rules:

cp [a-z]*.1 $M

Under LANG=fr_FR.UTF-8 and several other common locales, and also
because debian/rules has "SHELL=/bin/bash", this includes ChangeLog.1,
which has the funny effect of including a changelog as if it were a
manpage, as shown in diffoscope output:

 [...]
 drwxr-xr-x root/root 0 2015-09-06 18:48:51 ./usr/share/man/
 drwxr-xr-x root/root 0 2015-09-06 18:48:51 ./usr/share/man/man1/
+-rw-r--r-- root/root 20044 2015-09-06 18:48:51 
./usr/share/man/man1/ChangeLog.1.gz
 -rw-r--r-- root/root  1321 2015-09-06 18:48:51 
./usr/share/man/man1/autoconf2.13.1.gz
 -rw-r--r-- root/root  1896 2015-09-06 18:48:51 
./usr/share/man/man1/autoheader2.13.1.gz
 [...]

Patch attached.

[ Note: We usually submit most bugs as wishlist, but I'm not sure
  about this one. What would happen if somebody ever has to make a NMU
  for this package and does not have LANG=C in the environment? ].

Thanks.
--- a/debian/rules
+++ b/debian/rules
@@ -42,7 +42,7 @@
dh_installchangelogs
dh_installdocs
install -d $M
-   cp [a-z]*.1 $M
+   LC_ALL=C cp [a-z]*.1 $M
for d in auto{{re,}conf,scan,update,header} ifnames; do \
mv $D/usr/share/man/man1/$${d}{,2.13}.1;\
done
___
Reproducible-builds mailing list
Reproducible-builds@lists.alioth.debian.org
http://lists.alioth.debian.org/cgi-bin/mailman/listinfo/reproducible-builds

[Reproducible-builds] Bug#801333: marked as done (diffoscope: UnicodeDecodeError with haskell-authenticate-oauth/1.5.1.1-4)

2015-10-15 Thread Debian Bug Tracking System 
Your message dated Thu, 15 Oct 2015 16:19:02 +
with message-id 
and subject line Bug#801333: fixed in diffoscope 37
has caused the Debian Bug report #801333,
regarding diffoscope: UnicodeDecodeError with 
haskell-authenticate-oauth/1.5.1.1-4
to be marked as done.

This means that you claim that the problem has been dealt with.
If this is not the case it is now your responsibility to reopen the
Bug report if necessary, and/or fix the problem forthwith.

(NB: If you are a system administrator and have no idea what this
message is talking about, this may indicate a serious mail system
misconfiguration somewhere. Please contact ow...@bugs.debian.org
immediately.)


-- 
801333: http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=801333
Debian Bug Tracking System
Contact ow...@bugs.debian.org with problems
--- Begin Message ---
Package: diffoscope
Version: 36

seen in rb.d.n:
in experimental, haskell-authenticate-oauth/1.5.1.1-4:

Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/diffoscope/__main__.py", line 137, in 
main
sys.exit(run_diffoscope(parsed_args))
  File "/usr/lib/python3/dist-packages/diffoscope/__main__.py", line 114, in 
run_diffoscope
parsed_args.file1, parsed_args.file2)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/__init__.py", 
line 81, in compare_root_paths
return compare_files(file1, file2)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/__init__.py", 
line 98, in compare_files
return file1.compare(file2, source)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/binary.py", line 
78, in wrapper
return original_method(self, other, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/binary.py", line 
176, in compare
difference = self._compare_using_details(other, source)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/binary.py", line 
149, in _compare_using_details
details = [d for d in self.compare_details(other, source) if d is not None]
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/binary.py", line 
78, in wrapper
return original_method(self, other, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/debian.py", line 
143, in compare_details
differences.extend(my_container.compare(other_container))
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/utils.py", line 
199, in compare
return list(starmap(diffoscope.comparators.compare_commented_files, 
self.comparisons(other)))
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/__init__.py", 
line 101, in compare_commented_files
difference = compare_files(file1, file2, source=source)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/__init__.py", 
line 98, in compare_files
return file1.compare(file2, source)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/binary.py", line 
78, in wrapper
return original_method(self, other, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/binary.py", line 
176, in compare
difference = self._compare_using_details(other, source)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/binary.py", line 
149, in _compare_using_details
details = [d for d in self.compare_details(other, source) if d is not None]
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/binary.py", line 
78, in wrapper
return original_method(self, other, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/deb.py", line 84, 
in compare_details
differences.extend(my_container.compare(other_container))
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/utils.py", line 
199, in compare
return list(starmap(diffoscope.comparators.compare_commented_files, 
self.comparisons(other)))
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/__init__.py", 
line 101, in compare_commented_files
difference = compare_files(file1, file2, source=source)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/__init__.py", 
line 98, in compare_files
return file1.compare(file2, source)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/binary.py", line 
78, in wrapper
return original_method(self, other, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/binary.py", line 
176, in compare
difference = self._compare_using_details(other, source)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/binary.py", line 
149, in _compare_using_details
details = [d for d in self.compare_details(other, source) if d is not None]
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/binary.py", line 
78, in wrapper
return original_method(self, other, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/xz.py", line 69, 
in compare_details
return

Re: [Reproducible-builds] Bug#801885: autoconf2.13: Package contains /usr/share/man/man1/ChangeLog.1.gz if built under certain locales

2015-10-15 Thread Santiago Vila 
Ooops! Sorry, didn't test it well enough.

This seems to work:

 export LC_ALL=C && cp [a-z]*.1 $M

Thanks to Jakub for spotting the error.
(Please keep the Cc: if you can).

Thanks.

___
Reproducible-builds mailing list
Reproducible-builds@lists.alioth.debian.org
http://lists.alioth.debian.org/cgi-bin/mailman/listinfo/reproducible-builds