#490: bibupload and large files
-------------------------+-----------------
Reporter: tbrooks | Owner:
Type: enhancement | Status: new
Priority: minor | Milestone:
Component: BibUpload | Version:
Keywords: |
-------------------------+-----------------
Uploading large files to bibupload presents a couple of problems which
would be nice to fix:
1) bibupload large_file.xml
where large file is ~10^5 recs can kill the server by eating swap space.
bibupload could look at the xml file and chunk it before processing to
prevent this type of occurrence.
2) bibupload small_file_??.xml
(i.e. breaking the large_file into several small ones and sending them in)
will fail because bibupload will only take the first file (failing
silently, I believe!)
bibupload should take all files given to it, and loop over them at a high
level - i.e. running sequentially, not stitching it together as one file
which would break the swapspace.
--
Ticket URL: <http://invenio-software.org/ticket/490>
Invenio <http://invenio-software.org>
