Package: jigdo-file Version: 0.7.3-3 Severity: wishlist Dear all,
we run jigdo to build the DVD and CD images for Debian (on ftp2.de.debian.org). During this process many files, worth several hundret GBytes, are read to build the images. As far as I can see, Linux puts these files into the cache to speed up following reads to these files. However, in the case of jigdo it is quite clear that most of these files will most likely not be read again in the near future. Thus, filling the cache with this data is not really useful. By using fadvise (see [1]) the memory could be used to cache other files, for example these (heavily) downloaded via some HTTPd or FTPd. Of course, even with fadvise enabled in jigdo some file both used by jigdo and, e.g., a HTTPd the cache would still contain that file. The current behaviour really hurts performance on our server (serving as ftp2.de.d.o among others, 60 GByte RAM, 10 GBit/sec connectivity), which is why we already use fadvise for our rsync processes (pulling data from other mirrors). 1: http://insights.oetiker.ch/linux/fadvise.html Thanks, Carsten -- System Information: Debian Release: 6.0.6 APT prefers stable-updates APT policy: (500, 'stable-updates'), (500, 'stable') Architecture: amd64 (x86_64) Kernel: Linux 2.6.32-5-amd64 (SMP w/16 CPU cores) Locale: LANG=en_US.UTF-8, LC_CTYPE=en_US.UTF-8 (charmap=UTF-8) Shell: /bin/sh linked to /bin/dash Versions of packages jigdo-file depends on: ii libbz2-1.0 1.0.5-6+squeeze1 high-quality block-sorting file co ii libc6 2.11.3-4 Embedded GNU C Library: Shared lib ii libdb4.8 4.8.30-2 Berkeley v4.8 Database Libraries [ ii libgcc1 1:4.4.5-8 GCC support library ii libstdc++6 4.4.5-8 The GNU Standard C++ Library v3 ii wget 1.12-2.1 retrieves files from the web ii zlib1g 1:1.2.3.4.dfsg-3 compression library - runtime jigdo-file recommends no packages. jigdo-file suggests no packages. -- no debconf information -- To UNSUBSCRIBE, email to [email protected] with a subject of "unsubscribe". Trouble? Contact [email protected]
