https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=37020

--- Comment #50 from Thomas Klausner <[email protected]> ---
Here is a authorities MARC file with 42k records:
https://data.dnb.de/GNDlfdMarc21xml/2515gndmrc.xml.gz

Here's the command I use to import it into koha-testing-docker (via `ktd
--shell` and fresh db):

misc/migration_tools/bulkmarcimport.pl -m MARCXML -v -a --file 2515gndmrc.xml

After starting it, get the pid of the process, eg via `ps xa | grep bulkmarc`
(in the container or on the node, does not matter)

The watch the memory usage, eg via `htop -p $PID` or

while ps -p $PID --no-headers --format "etime pid %cpu %mem rss"; do     sleep
1 ; done


I see hardly any growth in RAM usage (htop reports 217M RES; the `while ps`
bash thingy reports 222340 (which is basically the same)


And here's the result without the patches applied:

RAM usages goes up to 1620MB (so 1.6GB) or 1648108, which is what it takes to
store the data in the array (and which is fixed by this patch) and then
continues to slowly grow.


So:

a) the patches definitely work (at least for auths...)
and
b) there are other mem leaks.

I will now try to download your big file btw.xml and see how it works on my
laptop.

-- 
You are receiving this mail because:
You are watching all bug changes.
_______________________________________________
Koha-bugs mailing list
[email protected]
https://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/

Reply via email to