Bug#502065: Disproportionate use of RAM on big GPX files

2019-10-22 Thread Dan Fandrich 
I looked into the RAM usage with large .gpx files and the problem is libxml2.
A test file with 840K points (115.0 MiB file size) used 848.6 MiB of heap in
libxml2 and only 45 MiB of heap for everything else (on i686; all figures
exclude allocation overhead). gpscorrelate's internal requirements are 48 bytes
per point, which is 38.5 MiB . Even if gpscorrelate reduced its use in half, it
would result in only a 2% reduction in peak usage. I'm not sure there's
anything that can be done about that beyond switching to a different XML
parser.

You can also use the new feature to load multiple gpx files. By splitting
the XML file into multiple pieces memory usage is reduced because the libxml2
memory structures are freed once each file has loaded.

Bug#502065: Disproportionate use of RAM on big GPX files

2008-10-13 Thread Enrico Zini 
Package: gpscorrelate
Version: 1.5.6-1+b2
Severity: normal

Hello,

I am back from a 2 weeks vacation and I'm trying to gpscorrelate the
photos.  I have a 77MB uncompressed GPX file, and even when trying to
correlate a few photos, gpscorrelate eats all the available ram on my
laptop.

I was assuming that the task of gpscorrelate would be simple enough not
to require inordinate resources even for such a big GPX file, but it
turned out that I was wrong.  Now I'll try to split the GPX data into
smaller chunks and kludge things into place one way or another.

Ciao,

Enrico

-- System Information:
Debian Release: lenny/sid
  APT prefers testing
  APT policy: (500, 'testing')
Architecture: amd64 (x86_64)

Kernel: Linux 2.6.26-1-amd64 (SMP w/2 CPU cores)
Locale: LANG=en_GB.UTF-8, LC_CTYPE=en_GB.UTF-8 (charmap=UTF-8)
Shell: /bin/sh linked to /bin/bash

Versions of packages gpscorrelate depends on:
ii  libc6  2.7-13GNU C Library: Shared libraries
ii  libexiv2-4 0.17.1-1  EXIF/IPTC metadata manipulation li
ii  libgcc11:4.3.2-1 GCC support library
ii  libstdc++6 4.3.2-1   The GNU Standard C++ Library v3
ii  libxml22.6.32.dfsg-4 GNOME XML library

gpscorrelate recommends no packages.

gpscorrelate suggests no packages.

-- no debconf information



-- 
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of unsubscribe. Trouble? Contact [EMAIL PROTECTED]