Bug#1069329: diffoscope: XZ: compare metadata before comparing compressed data

2024-04-19 Thread Paul Wise
Package: diffoscope Severity: wishlist X-Debbugs-Cc: Sam James When comparing two XZ compressed files that decompress to identical data, please compare the metadata before comparing compressed data. The xz --list option can be used for this, from the manual page: Print information about

Bug#1022210: diffoscope: highlight whitespace-only differences in text data

2022-10-21 Thread Paul Wise
Package: diffoscope Version: 224 Severity: wishlist It would be nice if diffoscope could help highlight that text data differ only in the whitespace or if they differ in the text too. The proposal would be that by default diffoscope would use wdiff (or similar) to compare all line based text

Bug#1022209: diffoscope: highlight text-only differences in HTML files

2022-10-21 Thread Paul Wise
Package: diffoscope Version: 224 Severity: wishlist It would be nice if diffoscope could help highlight that HTML files differ in the text output or if they differ only in the non-text HTML bytes like the page title, the stylesheet etc. The proposal would be that by default diffoscope would

Bug#1022146: diffoscope: detect ordering-only differences in XML files

2022-10-20 Thread Paul Wise
Package: diffoscope Version: 224 Severity: wishlist It would be nice if diffoscope could detect that XML files are only different because of ordering differences, currently it cannot: $ head -vn-0 *.xml ==> bar.xml <== ==> foo.xml <==

Bug#1022145: diffoscope: detect ordering-only differences in text files

2022-10-20 Thread Paul Wise
Package: diffoscope Version: 224 Severity: wishlist It would be nice if diffoscope could detect that text files are only different because of ordering differences, currently it cannot: $ (echo foo ; echo bar) > foo $ (echo bar ; echo foo) > bar $ diffoscope foo bar --- foo +++

Re: hope help reproducible-build to support Debian riscv64 arch

2022-06-09 Thread Paul Wise
On Thu, 2022-06-09 at 13:25 +0200, Mattia Rizzolo wrote: > Oh, interesting.  TIL. The docs are relatively new, at one point we had a few folks who had never contributed to Debian show up wanting to convert their company's internal port of Debian for their company's CPU arch into an official

Re: hope help reproducible-build to support Debian riscv64 arch

2022-06-09 Thread Paul Wise
On Thu, 2022-06-09 at 11:00 +0100, Chris Lamb wrote: > For some unknown reason, I thought that riscv64 *was* an official > Debian architecture, and the tone of my previous emails should be > read with that (incorrect) assumption in mind. riscv64 is in the process of becoming an official port and

Re: hope help reproducible-build to support Debian riscv64 arch

2022-05-26 Thread Paul Wise
On Thu, 2022-05-26 at 14:00 +0100, Chris Lamb wrote: > What I was trying to say is that we would need enough riscv64 > computing power to build all of Debian in good time... where "good > time" is loosely defined as being able to keep up with the current > architectures. Here are the statistics

Re: Including build metadata in packages

2022-02-16 Thread Paul Wise
Simon McVittie wrote: > Relatedly, I would like to be able to capture some information about > builds even if (perhaps especially if) the build fails. That is a good point that I hadn't considered. > so that failing builds can also produce artifacts, to help the > maintainer and/or porters to

Re: Including build metadata in packages

2022-02-14 Thread Paul Wise
On Sun, 2022-02-13 at 14:13 -0800, Vagrant Cascadian wrote: > * Split build metadata into a separate file or archive > > Some of the debian-installer packages generate tarballs that are not > .deb files and are included in the .changes files when uploading to > the archive; making a similar

Re: Embedded buildpath via rpath using cmake

2022-02-03 Thread Paul Wise
Vagrant Cascadian wrote: > Over the last several months, I and others have found quite a few > packages that embed build paths via rpath when building with cmake. This seems like the sort of thing that will be an ongoing problem, so if it is detectable statically then a lintian warning might be

Bug#1002002: diffoscope: note order-only changes in .dsc fields

2021-12-19 Thread Paul Wise
Package: diffoscope Version: 197 Severity: wishlist I recently sponsored memtest86+ and used diffoscope to compare the Debian source packages before uploading. The debian/ directory had been subject to wrap-and-sort, which also affects the Architecture field. The architecture list hadn't been

Bug#999438: diffoscope: issues with XML files not named *.xml

2021-11-10 Thread Paul Wise
Package: diffoscope Version: 190 Severity: normal There are two issues with XML files not named *.xml: They don't get reformatted before comparison, resulting in a diff of the plain text, instead of a diff of the reformatted XML. When comparing them with XML files named *.xml, a comparison of

Bug#989626: diffoscope: when comparing fonts with .ttx files, convert the font to .ttx first

2021-06-08 Thread Paul Wise
Package: diffoscope Version: 177 Severity: wishlist diffoscope currently prints a hex dump when comparing a TTF font with a .ttx XML dump of a TTF font. If it used ttx (from fonttools) to convert that TTF font to .ttx instead, then the comparison would become an XML diff, which diffoscope treats

Bug#988488: diffoscope: allow comparing directories with container formats (tar/ZIP/ISO etc)

2021-05-13 Thread Paul Wise
Package: diffoscope Version: 174 Severity: wishlist When comparing directories and files that are essentially directories serialised into a file (such as tar, ZIP, ISO etc), currently diffoscope just says one is a file while one is a directory. $ rm -rf ./* ; mkdir foo ; echo foo > foo/bar ;

Re: partial snapshot mirror amd64/bullseye/bookworm

2021-03-05 Thread Paul Wise
On Fri, Mar 5, 2021 at 8:26 AM Frédéric Pierret wrote: > Is it possible to have an exported version somewhere for starting working on > the mirroring? To not bothering you currently, just a one shot export until > we are sure that would be absolutely necessary to have this daily export. Please

Re: partial snapshot mirror amd64/bullseye/bookworm

2021-03-04 Thread Paul Wise
On Thu, Mar 4, 2021 at 8:57 AM Frédéric Pierret wrote: > Following discussion on #debian-reproducible, would this be feasible from the > snapshot team to allow something like a daily export of the database on a > public exposed server? Looking on the database server, the raw PostgreSQL tables

Re: partial snapshot mirror amd64/bullseye/bookworm

2021-03-02 Thread Paul Wise
On Tue, 2021-03-02 at 10:58 +0100, Lucas Nussbaum wrote: > - queries the snapshot DB to identify the files and hashes for each > source package > - fetches and analyses Sources files to identify (source,version) of > interest, and thus hashes to transfer You can probably replace this with

Re: partial snapshot mirror amd64/bullseye/bookworm

2021-03-01 Thread Paul Wise
On Mon, Mar 1, 2021 at 5:25 PM Holger Levsen wrote: > > How would the mirroring work? > > to be discussed, but my raw idea would be to use rsync with excluding the > years > before 2015 or 2017. or can't this work? 8-) That won't work, since the filesystem storing the data is hash (SHA1) based,

Re: reproducible builds Debian usertags?

2020-12-06 Thread Paul Wise
On Sun, 2020-12-06 at 11:51 +0100, Mattia Rizzolo wrote: > Note that the formal explenation for those usertags is at > https://reproducible-builds.org/contribute/#how-to-report-bugs-in-debian > and https://wiki.debian.org/ReproducibleBuilds/UserCategory (though > I'm not sure anymore if they are

reproducible builds Debian usertags?

2020-12-06 Thread Paul Wise
Hi all, [Please CC me on any replies you would like me to read] As part of my efforts to do some QA on Debian usertags, I noticed a few typos and other issues with the reproducible builds Debian usertags, which I fixed using a script and the attached commands to the bts bot.

Bug#964365: diffoscope: comparing squashfs filesystems: Could not open foo.squashfs, because No such file or directory

2020-07-05 Thread Paul Wise
Package: diffoscope Version: 150 Severity: normal When comparing squashfs filesystems I get an error saying the first filesystem could not be found, even though I created it just before. $ mkdir foo bar $ touch foo/foo bar/foo $ chronic mksquashfs foo foo.squashfs $ chronic mksquashfs bar

Re: Storing build logs outside of .deb packages

2020-06-01 Thread Paul Wise
On Mon, 2020-06-01 at 20:53 +0200, Mattia Rizzolo wrote: > But so, do you think the first step lies in pbuilder/sbuild to decide an > interface for the package maintainers to use, or for the buildd managers > (wanna-build/buildd and launchpad) to decide on an interface that > sbuild needs to

Re: Storing build logs outside of .deb packages

2020-06-01 Thread Paul Wise
On Mon, 2020-06-01 at 11:12 +0200, Mattia Rizzolo wrote: > I know this has been linked in multiple places, but I'll link it > again: > https://bugs.launchpad.net/launchpad/+bug/1845159 > there has also been a relevant thread in debian-devel a few months > back, spawned off the debian/.build

Re: binutils-dev: included log files introduce reproducibility issues

2020-05-17 Thread Paul Wise
On Sun, 2020-05-17 at 13:12 +0200, Matthias Klose wrote: > Any idea which package this should be filed for? I think this is going to require a bunch of different changes in various places including dpkg-dev, debhelper, reprepro, dak, launchpad and any other apt repos that have an incoming

Bug#960814: diffoscope: comparing an unsigned and a signed buildinfo file gives a hex diff

2020-05-16 Thread Paul Wise
Package: diffoscope Version: 144 Severity: minor When I compare the attached files (one unsigned buildinfo file, one signed buildinfo file) I get a hex diff. When I strip away the signature, the comparison is a text diff as normal. The optimal comparison would be to compare the missing container

Re: binutils-dev: included log files introduce reproducibility issues

2020-05-16 Thread Paul Wise
On Sat, 2020-05-16 at 22:58 +, Chris Lamb wrote: > My gut feeling is that this is the avenue we want to explore. Having a > separate mechanism to capture this build-specific metadata would be an > elegant solution and, as you imply, having the logs would have QA > advantages as well as permit

Re: binutils-dev: included log files introduce reproducibility issues

2020-05-15 Thread Paul Wise
On Mon, 24 Feb 2020 14:09:23 -0800 Vagrant Cascadian wrote: > Exploring avenues to put files like this into some separate artifact for > things that are not reproducible might be one avenue There is already the BYHAND (and automatic BYHAND) mechanisms for files that get installed outside of

Bug#908992: diffoscope: side-by-side diff for terminal output

2018-11-26 Thread Paul Wise
On Mon, 2018-11-26 at 16:58 -0500, Chris Lamb wrote: > I think this could be made to work. > As a demo, I just knocked together: > ... which resulted in the attached. Looks good. > One difficulty however will be in passing in a sane value of `cols` to > ConsoleDiff; not because it's difficult

Bug#908994: diffoscope: extract information from OpenPGP keys and signatures

2018-09-17 Thread Paul Wise
Package: diffoscope Version: 101 Severity: wishlist When comparing OpenPGP keys or signatures (binary and ASCII-armoured), either as raw files or embedded in other formats (like .dsc files), it would be nice to compare the internal data of those keys and sigs. There are some different ways to

Bug#903535: bls: warn about -mtune=native in build logs

2018-07-10 Thread Paul Wise
Package: qa.debian.org Severity: wishlist User: qa.debian@packages.debian.org Usertags: bls X-Debbugs-CC: reproducible-bui...@lists.alioth.debian.org, brl...@debian.org Control: user reproducible-bui...@lists.alioth.debian.org Control: usertags -1 + infrastructure Control: clone -1 -2 Control:

Bug#901758: diffoscope: leaves progress bar on terminal after completion

2018-07-07 Thread Paul Wise
On Sat, 2018-07-07 at 11:26 +0100, Chris Lamb wrote: > Thanks, applied. Attached a couple more patches. -- bye, pabs https://wiki.debian.org/PaulWise From 2c95bd3ec8e17c54fc2f8a1c4a1735d17df7ab55 Mon Sep 17 00:00:00 2001 From: Paul Wise Date: Sat, 7 Jul 2018 16:31:24 +0800 Subject: [PATC

Bug#901758: diffoscope: leaves progress bar on terminal after completion

2018-07-07 Thread Paul Wise
there. I was thinking diffoscope &> output shell redirection. > In that case, please could you provide a merge request? I'm not interested in touching gitlab, patches attached. -- bye, pabs https://wiki.debian.org/PaulWise From 9fa755c81033148cc1a5a49bc4d2fe865ec6e0c8 Mon Sep 17 00:00:00 2

Bug#901758: diffoscope: leaves progress bar on terminal after completion

2018-07-06 Thread Paul Wise
On Fri, 06 Jul 2018 18:50:44 +0100 Chris Lamb wrote: > https://salsa.debian.org/reproducible-builds/diffoscope/commit/68c8263a430aca779b0c44fd31e729ae9bd59e0b.patch > +# Clear the progress bar after completion (#901758) I don't think mentioning the bug in the comment is useful

Bug#901982: diffoscope: crash comparing ext4 filesystems: AttributeError: 'FsImageContainer' object has no attribute 'g'

2018-06-20 Thread Paul Wise
Package: diffoscope Version: 96 Severity: normal Usertags: crash diffoscope crashes when comparing ext4 filesystems: $ truncate -s 1M foo.ext4.initial $ /sbin/mkfs.ext4 foo.ext4.initial mke2fs 1.44.2 (14-May-2018) Filesystem too small for a journal Discarding device blocks: done

Bug#901758: diffoscope: leaves progress bar on terminal after completion

2018-06-17 Thread Paul Wise
Package: diffoscope Version: 95 Severity: minor diffoscope leaves a giant progress bar on the terminal after it completes. It would be nice if the progress bar could disappear after it has served its purpose. In case the progress bar code you use doesn't support this, I've included code below

Bug#901757: diffoscope: ZIP files: compare comments with zipnote or zipdetails output

2018-06-17 Thread Paul Wise
Package: diffoscope Version: 95 Severity: wishlist It would be nice if comparing ZIP files with diffoscope could compare the comments embedded in the CDFH and EOCD structures: https://en.wikipedia.org/wiki/Zip_(file_format)#Central_directory_file_header This can be done using both zipnote or

Bug#896934: diffoscope: decode monitor EDID data to text

2018-05-01 Thread Paul Wise
On Thu, 2018-04-26 at 09:08 +0200, Mattia Rizzolo wrote: > * add a test EDID data is almost always proprietary so I'm not sure how to do that. > * expand that TODO item, I can't understand what it is about diffoscope does not compare the output of the commands when one of them returns an

Bug#896934: diffoscope: decode monitor EDID data to text

2018-04-25 Thread Paul Wise
jquery 3.2.1-1 -- no debconf information -- bye, pabs https://wiki.debian.org/PaulWise From 526a76729430897b4d5115f8b7d85efd26b094af Mon Sep 17 00:00:00 2001 From: Paul Wise <p...@debian.org> Date: Mon, 23 Apr 2018 13:54:35 +0800 Subject: [PATCH] Add support for comparing monitor EDID infor