Bug#993291: apt upgrade crashes with "Assertion `I->Items->Owner->Status != pkgAcquire::Item::StatIdle' failed" when not all mirrors are reachable

2021-09-10 Thread Julian Andres Klode
On Mon, Sep 06, 2021 at 09:48:52AM +0200, Sven Bartscher wrote:
> On Sat, 4 Sep 2021 17:31:34 +0200 Marc Haber
>  wrote:
> > On Wed, Sep 01, 2021 at 10:44:03AM +0200, Marc Haber wrote:
> > > I can confirm the same issue here:
> > 
> > Looks like a transient issue here, today's apt update just went through.
> > I cannot reproduce the issue any more.
> 
> 
> For me, the problem came back. As I mentioned earlier, some upgrades went
> through smoothly for me. But a few days ago, upgrades started failing again.
> But I have absolutely no clue, what is causing this difference in behavior.
> 
> My mirror in question (mirror.home.weltraumschlangen.de) is also an
> apt-cacher-ng with split DNS. If you're in the correct network segment, the
> DNS returns a reachable IP address, otherwise it just returns NXDOMAIN.

This only happens on retries due to network failures, so in apt 2.2,
the download would have failed anyway. It happens because APT tried
to retry an item that failed before and that it then delayed the retry
off, and _somehow_ the retry did not succeed.

2.3.9 lessens the severity of the issue, by turning the assert into
a warning, but it might lead to the process hanging. It should give
us the ability to see what happens, hopefully.

-- 
debian developer - deb.li/jak | jak-linux.org - free software dev
ubuntu core developer  i speak de, en


signature.asc
Description: PGP signature


Bug#993291: apt upgrade crashes with "Assertion `I->Items->Owner->Status != pkgAcquire::Item::StatIdle' failed" when not all mirrors are reachable

2021-09-06 Thread Marc Haber
On Mon, Sep 06, 2021 at 09:48:52AM +0200, Sven Bartscher wrote:
> My mirror in question (mirror.home.weltraumschlangen.de) is also an
> apt-cacher-ng with split DNS. If you're in the correct network segment, the
> DNS returns a reachable IP address, otherwise it just returns NXDOMAIN.

My hostname returns a CNAME to an official mirror if you're
somewhere[tm], and an A/ for an apt-cacher-ng if you're in my home
network.

The machine where I have seen the issue hasn't been outside the home
network in years. It's a notebook, but one I use exclusively for
testing.

Greetings
Marc

-- 
-
Marc Haber | "I don't trust Computers. They | Mailadresse im Header
Leimen, Germany|  lose things."Winona Ryder | Fon: *49 6224 1600402
Nordisch by Nature |  How to make an American Quilt | Fax: *49 6224 1600421



Bug#993291: apt upgrade crashes with "Assertion `I->Items->Owner->Status != pkgAcquire::Item::StatIdle' failed" when not all mirrors are reachable

2021-09-06 Thread Sven Bartscher
On Sat, 4 Sep 2021 17:31:34 +0200 Marc Haber 
 wrote:

On Wed, Sep 01, 2021 at 10:44:03AM +0200, Marc Haber wrote:
> I can confirm the same issue here:

Looks like a transient issue here, today's apt update just went through.
I cannot reproduce the issue any more.



For me, the problem came back. As I mentioned earlier, some upgrades 
went through smoothly for me. But a few days ago, upgrades started 
failing again. But I have absolutely no clue, what is causing this 
difference in behavior.


My mirror in question (mirror.home.weltraumschlangen.de) is also an 
apt-cacher-ng with split DNS. If you're in the correct network segment, 
the DNS returns a reachable IP address, otherwise it just returns NXDOMAIN.


Regards
Sven



OpenPGP_signature
Description: OpenPGP digital signature


Bug#993291: apt upgrade crashes with "Assertion `I->Items->Owner->Status != pkgAcquire::Item::StatIdle' failed" when not all mirrors are reachable

2021-09-04 Thread Marc Haber
On Wed, Sep 01, 2021 at 10:44:03AM +0200, Marc Haber wrote:
> I can confirm the same issue here:

Looks like a transient issue here, today's apt update just went through.
I cannot reproduce the issue any more.

Greetings
Marc



Bug#993291: apt upgrade crashes with "Assertion `I->Items->Owner->Status != pkgAcquire::Item::StatIdle' failed" when not all mirrors are reachable

2021-09-01 Thread Marc Haber
Package: apt
Version: 2.3.8
Followup-For: Bug #993291

I can confirm the same issue here:

Ign:84 http://debian.debian.zugschlus.de/debian experimental/main Translation-en
22% [Working]apt: ../apt-pkg/acquire.cc:742: pkgAcquire::RunResult 
pkgAcquire::Run(int): Assertion `I->Items->Owner->Status != 
pkgAcquire::Item::StatIdle' failed.
Aborted
(exit code 134)

The mirror in question is an apt-cacher-ng and it is reachable (split
DNS, so don't get confused by the name being a CNAME in global DNS).

Ths system I am seeing this on is a test system running sid, it was
updated a week before the bullseye release, and then partly upgraded a
week after the bullseye release. All this was successful. The apt update
following this partly completed upgrade fails now. I either get the
"Asstion failed" message, or apt simply stalls:

Ign:33 http://debian.debian.zugschlus.de/debian experimental/main all Contents 
(deb) T-2021-09-01-0801.19-F-2021-08-23-1401.28.pdiff
44% [Working]

I am prepared to let this system sit in this state until the weekend, so
if you want more debug information, please get back to me in the next
two days.

Greetings
Marc


-- Package-specific info:

-- apt-config dump --

APT "";
APT::Architecture "amd64";
APT::Build-Essential "";
APT::Build-Essential:: "build-essential";
APT::Install-Recommends "false";
APT::Install-Suggests "false";
APT::Sandbox "";
APT::Sandbox::User "_apt";
APT::NeverAutoRemove "";
APT::NeverAutoRemove:: "^firmware-linux.*";
APT::NeverAutoRemove:: "^linux-firmware$";
APT::NeverAutoRemove:: "^linux-image-[a-z0-9]*$";
APT::NeverAutoRemove:: "^linux-image-[a-z0-9]*-[a-z0-9]*$";
APT::VersionedKernelPackages "";
APT::VersionedKernelPackages:: "linux-.*";
APT::VersionedKernelPackages:: "kfreebsd-.*";
APT::VersionedKernelPackages:: "gnumach-.*";
APT::VersionedKernelPackages:: ".*-modules";
APT::VersionedKernelPackages:: ".*-kernel";
APT::Never-MarkAuto-Sections "";
APT::Never-MarkAuto-Sections:: "metapackages";
APT::Never-MarkAuto-Sections:: "contrib/metapackages";
APT::Never-MarkAuto-Sections:: "non-free/metapackages";
APT::Never-MarkAuto-Sections:: "restricted/metapackages";
APT::Never-MarkAuto-Sections:: "universe/metapackages";
APT::Never-MarkAuto-Sections:: "multiverse/metapackages";
APT::Move-Autobit-Sections "";
APT::Move-Autobit-Sections:: "oldlibs";
APT::Move-Autobit-Sections:: "contrib/oldlibs";
APT::Move-Autobit-Sections:: "non-free/oldlibs";
APT::Move-Autobit-Sections:: "restricted/oldlibs";
APT::Move-Autobit-Sections:: "universe/oldlibs";
APT::Move-Autobit-Sections:: "multiverse/oldlibs";
APT::LastInstalledKernel "5.10.0-8-amd64";
APT::Update "";
APT::Update::Post-Invoke-Success "";
APT::Update::Post-Invoke-Success:: "test -x /usr/bin/apt-show-versions || exit 
0 ; apt-show-versions -i";
APT::Architectures "";
APT::Architectures:: "amd64";
APT::Architectures:: "i386";
APT::Compressor "";
APT::Compressor::. "";
APT::Compressor::.::Name ".";
APT::Compressor::.::Extension "";
APT::Compressor::.::Binary "";
APT::Compressor::.::Cost "0";
APT::Compressor::zstd "";
APT::Compressor::zstd::Name "zstd";
APT::Compressor::zstd::Extension ".zst";
APT::Compressor::zstd::Binary "false";
APT::Compressor::zstd::Cost "60";
APT::Compressor::lz4 "";
APT::Compressor::lz4::Name "lz4";
APT::Compressor::lz4::Extension ".lz4";
APT::Compressor::lz4::Binary "false";
APT::Compressor::lz4::Cost "50";
APT::Compressor::gzip "";
APT::Compressor::gzip::Name "gzip";
APT::Compressor::gzip::Extension ".gz";
APT::Compressor::gzip::Binary "gzip";
APT::Compressor::gzip::Cost "100";
APT::Compressor::gzip::CompressArg "";
APT::Compressor::gzip::CompressArg:: "-6n";
APT::Compressor::gzip::UncompressArg "";
APT::Compressor::gzip::UncompressArg:: "-d";
APT::Compressor::xz "";
APT::Compressor::xz::Name "xz";
APT::Compressor::xz::Extension ".xz";
APT::Compressor::xz::Binary "xz";
APT::Compressor::xz::Cost "200";
APT::Compressor::xz::CompressArg "";
APT::Compressor::xz::CompressArg:: "-6";
APT::Compressor::xz::UncompressArg "";
APT::Compressor::xz::UncompressArg:: "-d";
APT::Compressor::bzip2 "";
APT::Compressor::bzip2::Name "bzip2";
APT::Compressor::bzip2::Extension ".bz2";
APT::Compressor::bzip2::Binary "bzip2";
APT::Compressor::bzip2::Cost "300";
APT::Compressor::bzip2::CompressArg "";
APT::Compressor::bzip2::CompressArg:: "-6";
APT::Compressor::bzip2::UncompressArg "";
APT::Compressor::bzip2::UncompressArg:: "-d";
APT::Compressor::lzma "";
APT::Compressor::lzma::Name "lzma";
APT::Compressor::lzma::Extension ".lzma";
APT::Compressor::lzma::Binary "xz";
APT::Compressor::lzma::Cost "400";
APT::Compressor::lzma::CompressArg "";
APT::Compressor::lzma::CompressArg:: "--format=lzma";
APT::Compressor::lzma::CompressArg:: "-6";
APT::Compressor::lzma::UncompressArg "";
APT::Compressor::lzma::UncompressArg:: "--format=lzma";
APT::Compressor::lzma::UncompressArg:: "-d";
Dir "/";
Dir::State "var/lib/apt";
Dir::State::lists "lists/";
Dir::State::cdroms "cdroms.list";
Dir::State::extended_states "extended_states";

Bug#993291: apt upgrade crashes with "Assertion `I->Items->Owner->Status != pkgAcquire::Item::StatIdle' failed" when not all mirrors are reachable

2021-08-31 Thread Sven Bartscher

Hi,

On Mon, 30 Aug 2021 11:36:49 +0200 Sven Bartscher 
 wrote:

APT seems to have trouble downloading packages, when not all configured
repositories are reachable. Attached is the result of running

sudo LC_ALL=C apt-get upgrade 2>&1 | tee apt.log

As you can see, at first apt-get (rightly) shows a lot of Ign lines for 
mirror.home.weltraumschlangen.de, as that mirror is not reachable at the 
moment. Then it crashes with a failed assertion at the end.


I completed the updates from yesterday using aptitude, which doesn't 
seem to be affected by this bug. Updates from today went through 
smoothly as expected, with the same mirror not reachable. So I'm not 
sure how to reproduce this.


Fell free to close this bug if you can't reproduce it either.

Regards
Sven



OpenPGP_signature
Description: OpenPGP digital signature


Bug#993291: apt upgrade crashes with "Assertion `I->Items->Owner->Status != pkgAcquire::Item::StatIdle' failed" when not all mirrors are reachable

2021-08-30 Thread Sven Bartscher

Package: apt
Version: 2.3.8
Severity: normal

Hi,

APT seems to have trouble downloading packages, when not all configured
repositories are reachable. Attached is the result of running

sudo LC_ALL=C apt-get upgrade 2>&1 | tee apt.log

As you can see, at first apt-get (rightly) shows a lot of Ign lines for 
mirror.home.weltraumschlangen.de, as that mirror is not reachable at the 
moment. Then it crashes with a failed assertion at the end.


It is my understanding, that apt should deal with unreachable mirrors 
gracefully and download packages from one of the available mirrors 
instead. I also never had this problems before with this setup before 
(including unreachable mirror), so I think this is a regression in apt 
2.3.8.


When I move my device to a network location where all configured mirros 
are available, the crash doesn't occur and I can successfully complete 
the upgrade.


Using apt or apt-get doesn't seem to make a difference.

Regards
Sven

-- Package-specific info:

-- apt-config dump --

APT "";
APT::Architecture "amd64";
APT::Build-Essential "";
APT::Build-Essential:: "build-essential";
APT::Install-Recommends "1";
APT::Install-Suggests "0";
APT::Sandbox "";
APT::Sandbox::User "_apt";
APT::Authentication "";
APT::Authentication::TrustCDROM "true";
APT::NeverAutoRemove "";
APT::NeverAutoRemove:: "^firmware-linux.*";
APT::NeverAutoRemove:: "^linux-firmware$";
APT::NeverAutoRemove:: "^linux-image-[a-z0-9]*$";
APT::NeverAutoRemove:: "^linux-image-[a-z0-9]*-[a-z0-9]*$";
APT::NeverAutoRemove:: "^postgresql.*-13";
APT::VersionedKernelPackages "";
APT::VersionedKernelPackages:: "linux-.*";
APT::VersionedKernelPackages:: "kfreebsd-.*";
APT::VersionedKernelPackages:: "gnumach-.*";
APT::VersionedKernelPackages:: ".*-modules";
APT::VersionedKernelPackages:: ".*-kernel";
APT::Never-MarkAuto-Sections "";
APT::Never-MarkAuto-Sections:: "metapackages";
APT::Never-MarkAuto-Sections:: "contrib/metapackages";
APT::Never-MarkAuto-Sections:: "non-free/metapackages";
APT::Never-MarkAuto-Sections:: "restricted/metapackages";
APT::Never-MarkAuto-Sections:: "universe/metapackages";
APT::Never-MarkAuto-Sections:: "multiverse/metapackages";
APT::Move-Autobit-Sections "";
APT::Move-Autobit-Sections:: "oldlibs";
APT::Move-Autobit-Sections:: "contrib/oldlibs";
APT::Move-Autobit-Sections:: "non-free/oldlibs";
APT::Move-Autobit-Sections:: "restricted/oldlibs";
APT::Move-Autobit-Sections:: "universe/oldlibs";
APT::Move-Autobit-Sections:: "multiverse/oldlibs";
APT::LastInstalledKernel "5.10.0-8-amd64";
APT::Architectures "";
APT::Architectures:: "amd64";
APT::Compressor "";
APT::Compressor::. "";
APT::Compressor::.::Name ".";
APT::Compressor::.::Extension "";
APT::Compressor::.::Binary "";
APT::Compressor::.::Cost "0";
APT::Compressor::zstd "";
APT::Compressor::zstd::Name "zstd";
APT::Compressor::zstd::Extension ".zst";
APT::Compressor::zstd::Binary "zstd";
APT::Compressor::zstd::Cost "60";
APT::Compressor::zstd::CompressArg "";
APT::Compressor::zstd::CompressArg:: "-19";
APT::Compressor::zstd::UncompressArg "";
APT::Compressor::zstd::UncompressArg:: "-d";
APT::Compressor::lz4 "";
APT::Compressor::lz4::Name "lz4";
APT::Compressor::lz4::Extension ".lz4";
APT::Compressor::lz4::Binary "lz4";
APT::Compressor::lz4::Cost "50";
APT::Compressor::lz4::CompressArg "";
APT::Compressor::lz4::CompressArg:: "-1";
APT::Compressor::lz4::UncompressArg "";
APT::Compressor::lz4::UncompressArg:: "-d";
APT::Compressor::gzip "";
APT::Compressor::gzip::Name "gzip";
APT::Compressor::gzip::Extension ".gz";
APT::Compressor::gzip::Binary "gzip";
APT::Compressor::gzip::Cost "100";
APT::Compressor::gzip::CompressArg "";
APT::Compressor::gzip::CompressArg:: "-6n";
APT::Compressor::gzip::UncompressArg "";
APT::Compressor::gzip::UncompressArg:: "-d";
APT::Compressor::xz "";
APT::Compressor::xz::Name "xz";
APT::Compressor::xz::Extension ".xz";
APT::Compressor::xz::Binary "xz";
APT::Compressor::xz::Cost "200";
APT::Compressor::xz::CompressArg "";
APT::Compressor::xz::CompressArg:: "-6";
APT::Compressor::xz::UncompressArg "";
APT::Compressor::xz::UncompressArg:: "-d";
APT::Compressor::bzip2 "";
APT::Compressor::bzip2::Name "bzip2";
APT::Compressor::bzip2::Extension ".bz2";
APT::Compressor::bzip2::Binary "bzip2";
APT::Compressor::bzip2::Cost "300";
APT::Compressor::bzip2::CompressArg "";
APT::Compressor::bzip2::CompressArg:: "-6";
APT::Compressor::bzip2::UncompressArg "";
APT::Compressor::bzip2::UncompressArg:: "-d";
APT::Compressor::lzma "";
APT::Compressor::lzma::Name "lzma";
APT::Compressor::lzma::Extension ".lzma";
APT::Compressor::lzma::Binary "xz";
APT::Compressor::lzma::Cost "400";
APT::Compressor::lzma::CompressArg "";
APT::Compressor::lzma::CompressArg:: "--format=lzma";
APT::Compressor::lzma::CompressArg:: "-6";
APT::Compressor::lzma::UncompressArg "";
APT::Compressor::lzma::UncompressArg:: "--format=lzma";
APT::Compressor::lzma::UncompressArg:: "-d";
Dir "/";
Dir::State "var/lib/apt";
Dir::State::lists "lists/";
Dir::State::cdroms "cdroms.list";