Package: beagle
Version: 0.3.3-2
Followup-For: Bug #466357

I concur, and there is a common case that can knock your
computer to your knees.

Suppose you have a program that intermittently adds to a large log file.
Add one line to it: this causes beagled and beagled-helper to process the
entire file.    Repeat.   It's not unusual for beagle to take several
seconds to process a file.

I do scientific computing, and it's not unusual to have a computation
running for days and producing gigabytes of log.    Alternatively, it's
not unusual to be storing intermediate results in dozens (or even hundreds)
of files.    Each time a log file gets touched, beagle looks at it!

I've seen situations where beagled and beagled-helper can eat up 
half of my CPU, while accomplishing absolutely no good at all.  (Because
it'll simply re-index the log file in a few more seconds...)

So, this is a good reason for running the beagle analysis at low priority
and with as much ionice as possible.    Also, it would be a smart idea
to put a limit on how often beagle will re-index a file.

I would suggest something like this:

interval = 5.0 + 15*sqrt(file size/1 megabyte)
Don't index if the file has already been indexed within the last $interval
seconds.



Also, my post-doc who is somewhat enthusiastic did an analysis of a
large collection of speech data.   Her analysis produced a collection
of 60,000 files containing tens of gigabytes of data.   Beagle went
ape, of course.    It slowed the machine down dramatically, because
beagle was well behind, and so it kept bringing old data back
from disk into RAM.     This caused a fair bit of disk thrashing.

(And, if anyone says "Get more RAM" or "Get a faster machine", I'll
take that as an offer to buy me one...)

-- System Information:
Debian Release: lenny/sid
  APT prefers testing
  APT policy: (500, 'testing')
Architecture: i386 (i686)

Kernel: Linux 2.6.22-3-686 (SMP w/1 CPU core)
Locale: LANG=en_GB, LC_CTYPE=en_GB (charmap=ISO-8859-1)
Shell: /bin/sh linked to /bin/bash

Versions of packages beagle depends on:
ii  adduser                3.105             add and remove users and groups
ii  bash                   3.1dfsg-9         The GNU Bourne Again SHell
ii  dbus                   1.1.2-1           simple interprocess messaging syst
ii  libatk1.0-0            1.20.0-1          The ATK accessibility toolkit
ii  libavahi1.0-cil        0.6.19-2          CLI bindings for Avahi
ii  libc6                  2.7-6             GNU C Library: Shared libraries
ii  libcairo2              1.4.14-1          The Cairo 2D vector graphics libra
ii  libexif12              0.6.16-2.1        library to parse EXIF files
ii  libexpat1              1.95.8-4          XML parsing C library - runtime li
ii  libfreetype6           2.3.5-1+b1        FreeType 2 font engine, shared lib
ii  libgalago1.0-cil       0.5.0-2.1         CLI bindings for libgalago
ii  libgconf2.0-cil        2.16.0-10         CLI binding for GConf 2.16
ii  libglade2.0-cil        2.10.2-5          CLI binding for the Glade librarie
ii  libglib2.0-0           2.14.6-1          The GLib library of C routines
ii  libglib2.0-cil         2.10.2-5          CLI binding for the GLib utility l
ii  libgmime2.2-cil        2.2.17-1          CLI binding for the MIME library
ii  libgnome-desktop-2     2.20.3-1          Utility library for loading .deskt
ii  libgnome-vfs2.0-cil    2.16.0-10         CLI binding for GnomeVFS 2.16
ii  libgnome2.0-cil        2.16.0-10         CLI binding for GNOME 2.16
ii  libgnomevfs2-0         1:2.20.1-1        GNOME Virtual File System (runtime
ii  libgsf-1-114           1.14.7-2          Structured File Library - runtime 
ii  libgsf0.0-cil          0.8-1             CLI bindings for libgsf
ii  libgtk2.0-0            2.12.5-2          The GTK+ graphical user interface 
ii  libgtk2.0-cil          2.10.2-5          CLI binding for the GTK+ toolkit 2
ii  libice6                2:1.0.4-1         X11 Inter-Client Exchange library
ii  libjpeg62              6b-14             The Independent JPEG Group's JPEG 
ii  libmono-corlib2.0-cil  1.2.6+dfsg-6      Mono core library (2.0)
ii  libmono-sharpzip2.84-c 1.2.6+dfsg-6      Mono SharpZipLib library
ii  libmono-sqlite2.0-cil  1.2.6+dfsg-6      Mono Sqlite library
ii  libmono-system-data2.0 1.2.6+dfsg-6      Mono System.Data Library
ii  libmono-system-web2.0- 1.2.6+dfsg-6      Mono System.Web Library
ii  libmono-system2.0-cil  1.2.6+dfsg-6      Mono System libraries (2.0)
ii  libmono0               1.2.6+dfsg-6      libraries for the Mono JIT
ii  libmono2.0-cil         1.2.6+dfsg-6      Mono libraries (2.0)
ii  libndesk-dbus-glib1.0- 0.4.1-1           CLI implementation of D-Bus (GLib 
ii  libndesk-dbus1.0-cil   0.6.0-1           CLI implementation of D-Bus
ii  libpango1.0-0          1.18.4-1          Layout and rendering of internatio
ii  libpng12-0             1.2.15~beta5-3    PNG library - runtime
ii  librsvg2-2             2.20.0-1          SAX-based renderer library for SVG
ii  libsm6                 2:1.0.3-1+b1      X11 Session Management library
ii  libtaglib2.0-cil       2.0.3.0-1         CLI library for accessing audio an
ii  libwmf0.2-7            0.2.8.4-6         Windows metafile conversion librar
ii  libwv-1.2-3            1.2.4-2           Library for accessing Microsoft Wo
ii  libx11-6               2:1.0.3-7         X11 client-side library
ii  libxml2                2.6.31.dfsg-1     GNOME XML library
ii  libxss1                1:1.1.2-1         X11 Screen Saver extension library
ii  mono-runtime           1.2.6+dfsg-6      Mono runtime
ii  xdg-utils              1.0.2-3           desktop integration utilities from
ii  zlib1g                 1:1.2.3.3.dfsg-11 compression library - runtime

Versions of packages beagle recommends:
ii  mono-gmcs                   1.2.6+dfsg-6 Mono C# 2.0 and C# 3.0 compiler fo
ii  util-linux [schedutils]     2.13.1-1     Miscellaneous system utilities
ii  xpdf-utils [poppler-utils]  3.02-1.3     Portable Document Format (PDF) sui

-- no debconf information



-- 
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]

Reply via email to