Bug#840482: diffoscope: error at startup: AttributeError: undefined symbol: archive_errno

[Chris Lamb]

Hi Mihai,

> I've updated diffoscope to version 70 and I don't see the error anymore.

Great stuff. Closing this bug :)


Regards,

-- 
  ,''`.
 : :'  : Chris Lamb
 `. `'`  la...@debian.org / chris-lamb.co.uk
   `-

Bug#840482: diffoscope: error at startup: AttributeError: undefined symbol: archive_errno

[Mihai - Catalin Stefan]

Hi,

I've updated diffoscope to version 70 and I don't see the error anymore.
$ pip install --upgrade diffoscope
Collecting diffoscope
  Downloading diffoscope-70.tar.gz (452kB)
100% || 460kB 265kB/s
Requirement already up-to-date: python-magic in
/usr/local/lib/python3.4/dist-packages (from diffoscope)
Collecting libarchive-c (from diffoscope)
  Downloading libarchive_c-2.7-py2.py3-none-any.whl
Installing collected packages: libarchive-c, diffoscope
  Found existing installation: libarchive-c 2.5
Uninstalling libarchive-c-2.5:
  Successfully uninstalled libarchive-c-2.5
  Found existing installation: diffoscope 61
Uninstalling diffoscope-61:
  Successfully uninstalled diffoscope-61
  Running setup.py install for diffoscope ... done
Successfully installed diffoscope-70 libarchive-c-2.7

$ diffoscope
usage: diffoscope [--debug] [--debugger] [--status-fd FD] [--progress]
  [--no-progress] [--text OUTPUT_FILE] [--text-color WHEN]
  [--output-empty] [--html OUTPUT_FILE]
  [--html-dir OUTPUT_DIR] [--css URL] [--jquery URL]
  [--markdown OUTPUT_FILE] [--restructured-text OUTPUT_FILE]
  [--profile OUTPUT_FILE] [--no-default-limits]
  [--max-report-size BYTES] [--max-report-child-size BYTES]
  [--max-diff-block-lines LINES]
  [--max-diff-block-lines-parent LINES]
  [--max-diff-block-lines-saved LINES] [--new-file]
  [--fuzzy-threshold FUZZY_THRESHOLD]
  [--max-diff-input-lines LINES] [--help] [--version]
  [--list-tools [DISTRO]]
  path1 path2
diffoscope: error: the following arguments are required: path1, path2

Regards,
Mihai

On Tue, Feb 7, 2017 at 3:01 AM, Chris Lamb  wrote:

> Mihai - Catalin Stefan wrote:
>
> > > AttributeError: /usr/bin/python3: undefined symbol: archive_errno
>
> Are you still seeing this with recent versions? If so, I wonder if this
> is related to conflicts between the pip and package-installed versions
> of libarchive-c.
>
>
> Regards,
>
> --
>   ,''`.
>  : :'  : Chris Lamb
>  `. `'`  la...@debian.org / chris-lamb.co.uk
>`-
>

Bug#840482: diffoscope: error at startup: AttributeError: undefined symbol: archive_errno

[Chris Lamb]

Mihai - Catalin Stefan wrote:

> > AttributeError: /usr/bin/python3: undefined symbol: archive_errno

Are you still seeing this with recent versions? If so, I wonder if this
is related to conflicts between the pip and package-installed versions
of libarchive-c.


Regards,

-- 
  ,''`.
 : :'  : Chris Lamb
 `. `'`  la...@debian.org / chris-lamb.co.uk
   `-

Bug#840482: [diffoscope] error at startup

[Brett Smith]

On Sun, 23 Oct 2016 23:14:25 + Mattia Rizzolo  wrote:
> The python package of python-libarchive-c is espressing a fixed
> dependency on libarchive13 for this; do python package have any way of
> expressing such dependency? Or the only improvements that could be done
> here is python-libarchive-c¹ to ward that part offerring a nicer error
> message?

Python packages can only express dependencies on other Python packages. 
Right now libarchive's setup.py has a bit of code to try to check that
the C library is available at all; maybe that could be extended to check
the version too.  But the dependency can't be expressed in any
machine-readable way unfortunately.

-- 
Brett Smith

Bug#840482: [diffoscope] error at startup

[Mattia Rizzolo]

On Wed, Oct 12, 2016 at 12:25:14AM +, Daniel Shahaf wrote:
> I get the same on a pristine sid sbuild chroot (slightly outdated) with:
> 
> # apt-get install --no-install-recommends python3-pip
> # apt-get install --no-install-recommends python3-setuptools
> # pip3 install libarchive-c
> # python3 -c 'import libarchive; print(42)'
> Traceback (most recent call last):
>   File "", line 1, in 
>   File "/usr/local/lib/python3.5/dist-packages/libarchive/__init__.py", line 
> 1, in 
> from .entry import ArchiveEntry
>   File "/usr/local/lib/python3.5/dist-packages/libarchive/entry.py", line 6, 
> in 
> from . import ffi
>   File "/usr/local/lib/python3.5/dist-packages/libarchive/ffi.py", line 97, 
> in 
> errno = ffi('errno', [c_archive_p], c_int)
>   File "/usr/local/lib/python3.5/dist-packages/libarchive/ffi.py", line 84, 
> in ffi
> f = getattr(libarchive, 'archive_'+name)
>   File "/usr/lib/python3.5/ctypes/__init__.py", line 360, in __getattr__
> func = self.__getitem__(name)
>   File "/usr/lib/python3.5/ctypes/__init__.py", line 365, in __getitem__
> func = self._FuncPtr((name_or_ordinal, self))
> AttributeError: python3: undefined symbol: archive_errno
> 
> Note, that's without involving diffoscope at all.

indeed.
The python package of python-libarchive-c is espressing a fixed
dependency on libarchive13 for this; do python package have any way of
expressing such dependency?  Or the only improvements that could be done
here is python-libarchive-c¹ to ward that part offerring a nicer error
message?

¹ as in upstream https://github.com/Changaco/python-libarchive-c

-- 
regards,
Mattia Rizzolo

GPG Key: 66AE 2B4A FCCF 3F52 DA18  4D18 4B04 3FCD B944 4540  .''`.
more about me:  https://mapreri.org : :'  :
Launchpad user: https://launchpad.net/~mapreri  `. `'`
Debian QA page: https://qa.debian.org/developer.php?login=mattia  `-


signature.asc
Description: PGP signature

Bug#840482: [diffoscope] error at startup

[Daniel Shahaf]

Mattia Rizzolo wrote on Tue, Oct 11, 2016 at 23:53:07 +:
> On Mon, Oct 10, 2016 at 02:34:04PM +0100, Mihai - Catalin Stefan wrote:
> > AttributeError: /usr/bin/python3: undefined symbol: archive_errno

I get the same on a pristine sid sbuild chroot (slightly outdated) with:

# apt-get install --no-install-recommends python3-pip
# apt-get install --no-install-recommends python3-setuptools
# pip3 install libarchive-c
# python3 -c 'import libarchive; print(42)'
Traceback (most recent call last):
  File "", line 1, in 
  File "/usr/local/lib/python3.5/dist-packages/libarchive/__init__.py", line 1, 
in 
from .entry import ArchiveEntry
  File "/usr/local/lib/python3.5/dist-packages/libarchive/entry.py", line 6, in 

from . import ffi
  File "/usr/local/lib/python3.5/dist-packages/libarchive/ffi.py", line 97, in 

errno = ffi('errno', [c_archive_p], c_int)
  File "/usr/local/lib/python3.5/dist-packages/libarchive/ffi.py", line 84, in 
ffi
f = getattr(libarchive, 'archive_'+name)
  File "/usr/lib/python3.5/ctypes/__init__.py", line 360, in __getattr__
func = self.__getitem__(name)
  File "/usr/lib/python3.5/ctypes/__init__.py", line 365, in __getitem__
func = self._FuncPtr((name_or_ordinal, self))
AttributeError: python3: undefined symbol: archive_errno

Note, that's without involving diffoscope at all.

Cheers,

Daniel

P.S. I also did 'apt-get install tmux; LC_ALL=C.UTF-8 tmux' in there.
(I don't expect it was relevant, but just in case..)

Bug#840482: [diffoscope] error at startup

[Mattia Rizzolo]

package: diffoscope
version: 61
control: submitter -1 Mihai - Catalin Stefan 

[ original report at diffosc...@lists.reproducible-builds.org ]

On Mon, Oct 10, 2016 at 02:34:04PM +0100, Mihai - Catalin Stefan wrote:
> I'm trying to use diffoscope on Ubuntu 14.04.04 headless, installed via
> pip, and I have the following error:
> $ diffoscope
> Traceback (most recent call last):
>   File "/usr/local/bin/diffoscope", line 9, in 
> load_entry_point('diffoscope==61', 'console_scripts', 'diffoscope')()
>   File "/usr/lib/python3/dist-packages/pkg_resources.py", line 351, in
> load_entry_point
> return get_distribution(dist).load_entry_point(group, name)
>   File "/usr/lib/python3/dist-packages/pkg_resources.py", line 2363, in
> load_entry_point
> return ep.load()
>   File "/usr/lib/python3/dist-packages/pkg_resources.py", line 2088, in load
> entry = __import__(self.module_name, globals(),globals(), ['__name__'])
>   File "/usr/local/lib/python3.4/dist-packages/diffoscope/main.py", line
> 31, in 
> import diffoscope.comparators
>   File
> "/usr/local/lib/python3.4/dist-packages/diffoscope/comparators/__init__.py",
> line 193, in 
> FILE_CLASSES = import_comparators(COMPARATORS)
>   File
> "/usr/local/lib/python3.4/dist-packages/diffoscope/comparators/__init__.py",
> line 99, in import_comparators
> 'diffoscope.comparators.{}'.format(package)
>   File "/usr/lib/python3.4/importlib/__init__.py", line 109, in
> import_module
> return _bootstrap._gcd_import(name[level:], package, level)
>   File
> "/usr/local/lib/python3.4/dist-packages/diffoscope/comparators/deb.py",
> line 24, in 
> from diffoscope.comparators.tar import TarContainer
>   File
> "/usr/local/lib/python3.4/dist-packages/diffoscope/comparators/tar.py",
> line 24, in 
> from diffoscope.comparators.libarchive import LibarchiveContainer, \
>   File
> "/usr/local/lib/python3.4/dist-packages/diffoscope/comparators/libarchive.py",
> line 24, in 
> import libarchive
>   File "/usr/local/lib/python3.4/dist-packages/libarchive/__init__.py",
> line 1, in 
> from .entry import ArchiveEntry
>   File "/usr/local/lib/python3.4/dist-packages/libarchive/entry.py", line
> 6, in 
> from . import ffi
>   File "/usr/local/lib/python3.4/dist-packages/libarchive/ffi.py", line 97,
> in 
> errno = ffi('errno', [c_archive_p], c_int)
>   File "/usr/local/lib/python3.4/dist-packages/libarchive/ffi.py", line 84,
> in ffi
> f = getattr(libarchive, 'archive_'+name)
>   File "/usr/lib/python3.4/ctypes/__init__.py", line 364, in __getattr__
> func = self.__getitem__(name)
>   File "/usr/lib/python3.4/ctypes/__init__.py", line 369, in __getitem__
> func = self._FuncPtr((name_or_ordinal, self))
> AttributeError: /usr/bin/python3: undefined symbol: archive_errno
> 
> On a Ubuntu 14.04.5 non-headless diffoscope is working without problems.

I managed to reproduce the issue also on a minimal debian unstable (in a
chroot, attached the log)

> Do I need to install some other packages or diffoscope isn't supported,
> yet, on a headless machine ?

doesn't really make sense that "isn't supported" :) we run it on
jenkins.debian.net, that's definitely headless.
probably some dependency is not specified, maybe some dependency that is
usually pulled in by some other package.

Filing a bug to the Debian BTS for easier tracking with this email

> Thank you and best regards,
> Mihai Stefan

thank you for reporting!

-- 
regards,
Mattia Rizzolo

GPG Key: 66AE 2B4A FCCF 3F52 DA18  4D18 4B04 3FCD B944 4540  .''`.
more about me:  https://mapreri.org : :'  :
Launchpad user: https://launchpad.net/~mapreri  `. `'`
Debian QA page: https://qa.debian.org/developer.php?login=mattia  `-
mattia@chase ~ % pbuilder l
[sudo] password for mattia: 
D: cmdline: login 
I: Building the build Environment
I: extracting base tarball [/home/mattia/pbuilder/unstable-amd64-base.tgz]
I: copying local configuration
I: mounting /proc filesystem
I: mounting /sys filesystem
I: mounting /run/shm filesystem
I: mounting /dev/pts filesystem
I: Mounting /home/mattia/pbuilder/cache/ccache
I: Mounting /home/mattia/pbuilder/repository
I: Mounting /srv/mirror/debian
I: policy-rc.d already exists
I: using eatmydata during job
D: no hooks of type H found -- ignoring
I: entering the shell
I: File extracted to: /home/mattia/pbuilder/build/5859
D: no hooks of type F found -- ignoring
root@chase:/# apt install python3-pip
Reading package lists... Done
Building dependency tree   
Reading state information... Done
The following additional packages will be installed:
  ca-certificates dh-python libexpat1 libmpdec2 libpython3-stdlib 
libpython3.5-minimal libpython3.5-stdlib libreadline6 libsqlite3-0 libssl1.0.2 
mime-support openssl
  python-pip-whl python3 python3-minimal python3.5 python3.5-minimal 
readline-common
Suggested packages:
  python3-doc python3-tk python3-venv