Bug#843711: biber: FTBFS (failing tests)

2016-11-09 Thread Niko Tyni
On Thu, Nov 10, 2016 at 12:41:39AM +0900, Norbert Preining wrote:
> > But that'd be just bandaid IMO and a real fix would either revert the
> > relevant Unicode::Collate change if it's a bug, or adapt biber to work
> 
> If one could find out what the relevant change is. It is rather unfortunate
> that the two version of the same things don't produce the same :-(

% perl -MUnicode::Collate -le 'print $Unicode::Collate::VERSION, " ", 
Unicode::Collate->new->viewSortKey("Foo")'

gives this output with the versions available on jessie and sid:

1.04 [1680 176D 176D | 0020 0020 0020 | 0008 0002 0002 |    |]

1.07 [1680 176D 176D | 0020 0020 0020 | 0008 0002 0002 |    |]

1.14 [19A9 1AA1 1AA1 | 0020 0020 0020 | 0008 0002 0002 |    |]

1.17 [1C60 1D58 1D58 | 0020 0020 0020 | 0008 0002 0002 |    |]

So the U::C sort key generation has changed (again), and the biber test
suite hardcodes md5sums of the old sort keys.

Given 
https://github.com/plk/biber/commit/9bebd3ef0cb57b5ca4f15885d0cbfecc4939a835
I suspect biber just needs to adapt again.
-- 
Niko Tyni   nt...@debian.org



Bug#843711: biber: FTBFS (failing tests)

2016-11-09 Thread Norbert Preining
Hi everyone,

thanks for digging into this.

> > > Seems to be a change in libunicode-collate-perl 1.17. Removing the
> > > separate package (so it falls back to using the modules shipped in the
> > > Perl core packages at version 1.14) makes the tests work again.

Interstingly, a former version of perl's libunicode-collate-perl did not
allow to successfully build biber, so I added this dep. Now it is the
other way round.

> What just might work is dropping the versioned
> dependencies on libunicode-collate-perl from biber (as per

I will do that.

> and build (and possibly runtime?) conflicting on libunicode-collate-perl:
> >= 1.17~ or something like that.

And that.

> But that'd be just bandaid IMO and a real fix would either revert the
> relevant Unicode::Collate change if it's a bug, or adapt biber to work

If one could find out what the relevant change is. It is rather unfortunate
that the two version of the same things don't produce the same :-(

All the best

Norbert

--
PREINING Norbert + TeX Live & Debian Developer + http://www.preining.info
GPG: 0x860CDC13fp: F7D8 A928 26E3 16A1 9FA0  ACF0 6CAC A448 860C DC13



Bug#843711: biber: FTBFS (failing tests)

2016-11-09 Thread Niko Tyni
On Wed, Nov 09, 2016 at 01:52:12PM +0100, Santiago Vila wrote:
> On Wed, Nov 09, 2016 at 02:46:24PM +0200, Niko Tyni wrote:
> > On Wed, Nov 09, 2016 at 09:10:57AM +0900, Norbert Preining wrote:
> >
> > > It seems something in the locale handline has changed.
> > > 
> > > Anyway, I hope to get an answer from upstream or perl group soon.
> > 
> > Seems to be a change in libunicode-collate-perl 1.17. Removing the
> > separate package (so it falls back to using the modules shipped in the
> > Perl core packages at version 1.14) makes the tests work again.
> 
> So the fix would be to "Build-Conflicts: libunicode-collate-perl"?

No, I don't think that is going to work. The perl-modules-5.24 package
Provides: libunicode-collate-perl so I'd expect such a conflict to make
the package unbuildable.

What just might work is dropping the versioned
dependencies on libunicode-collate-perl from biber (as per
https://lintian.debian.org/tags/versioned-dependency-satisfied-by-perl.html)
and build (and possibly runtime?) conflicting on libunicode-collate-perl:
>= 1.17~ or something like that.

But that'd be just bandaid IMO and a real fix would either revert the
relevant Unicode::Collate change if it's a bug, or adapt biber to work
with newer Unicode::Collate versions if it's a feature.
-- 
Niko Tyni   nt...@debian.org



Bug#843711: biber: FTBFS (failing tests)

2016-11-09 Thread Santiago Vila
On Wed, Nov 09, 2016 at 02:46:24PM +0200, Niko Tyni wrote:
> On Wed, Nov 09, 2016 at 09:10:57AM +0900, Norbert Preining wrote:
>
> > It seems something in the locale handline has changed.
> > 
> > Anyway, I hope to get an answer from upstream or perl group soon.
> 
> Seems to be a change in libunicode-collate-perl 1.17. Removing the
> separate package (so it falls back to using the modules shipped in the
> Perl core packages at version 1.14) makes the tests work again.

So the fix would be to "Build-Conflicts: libunicode-collate-perl"?

Thanks.



Bug#843711: biber: FTBFS (failing tests)

2016-11-09 Thread Niko Tyni
On Wed, Nov 09, 2016 at 09:10:57AM +0900, Norbert Preining wrote:
> forwarded 843711 https://github.com/plk/biber/issues/149
> thanks
> 
> Hi Santiago,
> 
> the actual errors are:
> # -  \\field{sortinithash}{0aa614ace9f3a40ef5a67e7f7a184048}
> # +  \\field{sortinithash}{8343b463aacf48517c044b4d2c9c45ed}
> 
> all of them.
> 
> That means that some perl update broke biber building as it
> did built when I uploaded it.
> 
> I have contacted upstream concerning this change, and include
> the perl group in case they have an idea.
> 
> What happens is that first a "sortinitcollator" is computed by:
>   Unicode::Collate::Locale->new(locale => 
> $sortlist->get_sortscheme->{locale}, level => 1)
> and then the sortkey is collated and hashed
>   md5_hex($self->{sortinitcollator}->viewSortKey($sinit));
> 
> It seems something in the locale handline has changed.
> 
> Anyway, I hope to get an answer from upstream or perl group soon.

Seems to be a change in libunicode-collate-perl 1.17. Removing the
separate package (so it falls back to using the modules shipped in the
Perl core packages at version 1.14) makes the tests work again.
-- 
Niko Tyni   nt...@debian.org



Bug#843711: biber: FTBFS (failing tests)

2016-11-08 Thread Norbert Preining
forwarded 843711 https://github.com/plk/biber/issues/149
thanks

Hi Santiago,

the actual errors are:
# -  \\field{sortinithash}{0aa614ace9f3a40ef5a67e7f7a184048}
# +  \\field{sortinithash}{8343b463aacf48517c044b4d2c9c45ed}

all of them.

That means that some perl update broke biber building as it
did built when I uploaded it.

I have contacted upstream concerning this change, and include
the perl group in case they have an idea.

What happens is that first a "sortinitcollator" is computed by:
Unicode::Collate::Locale->new(locale => 
$sortlist->get_sortscheme->{locale}, level => 1)
and then the sortkey is collated and hashed
md5_hex($self->{sortinitcollator}->viewSortKey($sinit));

It seems something in the locale handline has changed.

Anyway, I hope to get an answer from upstream or perl group soon.

Thanks

Norbert

--
PREINING Norbert + TeX Live & Debian Developer + http://www.preining.info
GPG: 0x860CDC13fp: F7D8 A928 26E3 16A1 9FA0  ACF0 6CAC A448 860C DC13



Bug#843711: biber: FTBFS (failing tests)

2016-11-08 Thread Santiago Vila
Package: src:biber
Version: 2.6-1
Severity: serious

Dear maintainer:

I tried to build this package in stretch with "dpkg-buildpackage -A"
(which is what the "Arch: all" autobuilder would do to build it)
but it failed:


[...]
 debian/rules build-indep
dh build-indep --with tex
   dh_testdir -i
   dh_update_autotools_config -i
   dh_auto_configure -i
perl -I. Build.PL --installdirs vendor --config "optimize=-g -O2 
-fdebug-prefix-map=/<>=. -fstack-protector-strong -Wformat 
-Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2" --config 
"ld=x86_64-linux-gnu-gcc -g -O2 -fdebug-prefix-map=/<>=. 
-fstack-protector-strong -Wformat -Werror=format-security -Wl,-z,relro"
Checking prerequisites...
  requires:
!  Encode::EUCJPASCII is not installed
!  Lingua::Translit is not installed
!  Mozilla::CA is not installed

ERRORS/WARNINGS FOUND IN PREREQUISITES.  You may wish to install the versions

[... snipped ...]

  Non-zero exit status: 24
t/dateformats.t  (Wstat: 4096 Tests: 41 Failed: 16)
  Failed tests:  20-22, 24, 26, 28, 31, 33-41
  Non-zero exit status: 16
t/encoding.t (Wstat: 2304 Tests: 10 Failed: 9)
  Failed tests:  1-8, 10
  Non-zero exit status: 9
t/names.t(Wstat: 8192 Tests: 72 Failed: 32)
  Failed tests:  32-57, 59-60, 65-68
  Non-zero exit status: 32
t/options.t  (Wstat: 768 Tests: 9 Failed: 3)
  Failed tests:  7-9
  Non-zero exit status: 3
t/related-entries.t  (Wstat: 768 Tests: 13 Failed: 3)
  Failed tests:  1-2, 10
  Non-zero exit status: 3
t/set-dynamic.t  (Wstat: 1536 Tests: 7 Failed: 6)
  Failed tests:  2-7
  Non-zero exit status: 6
t/set-legacy.t   (Wstat: 256 Tests: 3 Failed: 1)
  Failed test:  1
  Non-zero exit status: 1
t/set-static.t   (Wstat: 768 Tests: 5 Failed: 3)
  Failed tests:  1-2, 5
  Non-zero exit status: 3
t/skips.t(Wstat: 2048 Tests: 15 Failed: 8)
  Failed tests:  7, 9-15
  Non-zero exit status: 8
t/sort-complex.t (Wstat: 1280 Tests: 9 Failed: 5)
  Failed tests:  2-6
  Non-zero exit status: 5
t/sortlists.t(Wstat: 512 Tests: 15 Failed: 2)
  Failed tests:  13-14
  Non-zero exit status: 2
t/xdata.t(Wstat: 512 Tests: 5 Failed: 2)
  Failed tests:  1-2
  Non-zero exit status: 2
Files=42, Tests=1046, 40 wallclock secs ( 0.25 usr  0.08 sys + 36.73 cusr  2.18 
csys = 39.24 CPU)
Result: FAIL
Failed 16/42 test programs. 130/1046 subtests failed.
dh_auto_test: perl Build test --verbose 1 test_files=t/annotations.t 
t/basic-misc.t t/bcfvalidation.t t/biblatexml.t t/bibtex-aliases.t 
t/bibtex-output.t t/configfile.t t/crossrefs.t t/dateformats.t 
t/dm-constraints.t t/encoding.t t/extratitle.t t/extratitleyear.t t/extrayear.t 
t/full-bbl.t t/full-bblxml.t t/full-bibtex.t t/full-dot.t t/labelalpha.t 
t/labelname.t t/names.t t/names_x.t t/options.t t/related-entries.t 
t/sections-complex.t t/sections.t t/set-dynamic.t t/set-legacy.t t/set-static.t 
t/skips.t t/sort-case.t t/sort-complex.t t/sort-order.t t/sort-uc.t t/sorting.t 
t/sortlists.t t/tool-bltxml-inout.t t/tool-bltxml.t t/tool.t t/uniqueness.t 
t/utils.t t/xdata.t returned exit code 2
debian/rules:17: recipe for target 'override_dh_auto_test' failed
make[1]: *** [override_dh_auto_test] Error 2
make[1]: Leaving directory '/<>'
debian/rules:9: recipe for target 'build-indep' failed
make: *** [build-indep] Error 2
dpkg-buildpackage: error: debian/rules build-indep gave error exit status 2


The above is just the last part of the build log.
For a full build log please see:

https://tests.reproducible-builds.org/debian/rbuild/unstable/amd64/biber_2.6-1.rbuild.log

Note: Even if this package is Arch:all, please consider uploading in
source-only form, so that we get official build logs available here:

https://buildd.debian.org/status/package.php?p=biber

Thanks.