Bug#576649: [apt]: Very slow apt-get update

2010-04-11 Thread Jens Seidel
On Wed, Apr 07, 2010 at 02:16:50AM +0200, Jens Seidel wrote:
 On Tue, Apr 06, 2010 at 07:20:51PM +0200, David Kalnischkies wrote:
  2010/4/6 Jens Seidel jenssei...@users.sf.net:
   Calling apt-get update on my OpenMoko phone (armel, 128MB RAM, sd card)
   takes forever:

I found the problem. It was not swap specific and the update took only a
long time if called from inside a chroot from the SHR distribution. The
problem was the mount option sync which was used by the udev automounter
from /etc/udev/scripts/mount.sh.

Is there anything the apt developers can improve? I'm not sure. Maybe a
optimization for this case would be good (reducing disk access) or checking
the mount options and outputting a warning?

At least the bogus download rate I mentioned earlier should be fixed until
this bug gets closed.

Jens



-- 
To UNSUBSCRIBE, email to debian-bugs-dist-requ...@lists.debian.org
with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org



Bug#576649: [apt]: Very slow apt-get update

2010-04-06 Thread Jens Seidel
Package: apt
Version: 0.7.25.3

Calling apt-get update on my OpenMoko phone (armel, 128MB RAM, sd card)
takes forever:

Ign http://pkg-fso.alioth.debian.org unstable/main Sources
Ign http://pkg-fso.alioth.debian.org unstable/main Packages
Ign http://pkg-fso.alioth.debian.org unstable/main Sources
Hit http://pkg-fso.alioth.debian.org unstable/main Packages
Hit http://pkg-fso.alioth.debian.org unstable/main Sources
Hit http://ftp2.de.debian.org unstable Release.gpg
Hit http://ftp2.de.debian.org experimental Release.gpg
Hit http://ftp2.de.debian.org unstable Release
Hit http://ftp2.de.debian.org experimental Release
Hit http://ftp2.de.debian.org unstable/main Packages
Get:1 http://ftp2.de.debian.org unstable/main Sources [3852kB]
Get:2 http://ftp2.de.debian.org experimental/main Packages [209kB]
Get:3 http://ftp2.de.debian.org experimental/main Sources [108kB]
Fetched 3B in 2h 39min 45s (0B/s)

The next time (a few days later) I got:

Fetched 10.8MB in 1h 52min 43s (1,598B/s)
Reading package lists... Done

The device is not the fastest but the CPU was idle all the time (2-3% used
by bzip2) and I also doubt that IO (which is a bottleneck) is sooo slow. At
least it should not need more than 2 hours to download 3B (this values is
very very likely wrong).

The internet connection should be limited by 200-300kB/s.

Any idea how to speed it up? I deactivated already downloading package file
diffs.

Jens



-- 
To UNSUBSCRIBE, email to debian-bugs-dist-requ...@lists.debian.org
with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org



Bug#576649: [apt]: Very slow apt-get update

2010-04-06 Thread David Kalnischkies
Hi Jens Seidel,

2010/4/6 Jens Seidel jenssei...@users.sf.net:
 Calling apt-get update on my OpenMoko phone (armel, 128MB RAM, sd card)
 takes forever:
[snip]
 The device is not the fastest but the CPU was idle all the time (2-3% used
 by bzip2) and I also doubt that IO (which is a bottleneck) is sooo slow. At
 least it should not need more than 2 hours to download 3B (this values is
 very very likely wrong).

mhh. I have one myself and never had such problems.
(gta2v5 unfixed - no special tricks, mostly plain install.sh debian)

Into the blue: Do you have a swap file?
Which software powers your brick?
Is your mircosd card okay?

My neo hardly needs 20 minutes for an update and i have pdiffs
enabled… e.g. in my recent run in which ~ 15 pdiffs were applied:
 Es wurden 2.325kB in 6Min 59s geholt (5.545B/s)

IO is really the bottleneck (you can see this in every rred run - they stuck
quite a bit at 0 and at the end) loading and saving 30 MB in the
sid Packages case is a bit to much to be done immediately but it should
really be (much) faster than an hour…


Best regards,

David Kalnischkies



--
To UNSUBSCRIBE, email to debian-bugs-dist-requ...@lists.debian.org
with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org



Bug#576649: [apt]: Very slow apt-get update

2010-04-06 Thread Jens Seidel
Hi David,

On Tue, Apr 06, 2010 at 07:20:51PM +0200, David Kalnischkies wrote:
 2010/4/6 Jens Seidel jenssei...@users.sf.net:
  Calling apt-get update on my OpenMoko phone (armel, 128MB RAM, sd card)
  takes forever:
 
 Into the blue: Do you have a swap file?

Yep, I have two swap files in Debian: 256M + 128M.

Mhm, now I think I remember I performed the slow updates in the chroot once
I booted SHR-U where I do not use a swap (as the large sd card is not always
inserted). But does it matter? If the free RAM is not sufficient the kernel
would start killing processes which I didn't observed.

 Which software powers your brick?

Current Debian unstable + experimental +  http://pkg-fso.alioth.debian.org.
Kernel 2.6.29-20100118.gita15608f2.

 Is your mircosd card okay?

I think so, the filesystem is OK (fsck.ext3 -f /dev/mmcblk0p2 succeeds).
 
 My neo hardly needs 20 minutes for an update and i have pdiffs
 enabled… e.g. in my recent run in which ~ 15 pdiffs were applied:
  Es wurden 2.325kB in 6Min 59s geholt (5.545B/s)

As far as I remember using pdiffs is not recommended on the freerunner. I
read this in the openmoko wiki and experienced the same in the past (months
ago).

# cat /etc/apt/apt.conf
Acquire::PDiffs false;

Now I updated from Debian again (with enabled swap) with much better results:

Es wurden 12,3MB in 2Min 25s geholt (84,6kB/s)

Will keep en eye on it and test later without swap ...

Jens



-- 
To UNSUBSCRIBE, email to debian-bugs-dist-requ...@lists.debian.org
with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org