#300: oai_repository_updater should be optimized WRT speed
-------------------------+--------------------------------------------------
Reporter: skaplun | Owner:
Type: enhancement | Status: new
Priority: major | Milestone:
Component: BibHarvest | Version:
Keywords: speed |
-------------------------+--------------------------------------------------
Currently oai_repository_updater is checking every time *all* the records
belonging to a set, in order to see if they need to be updated WRT OAIID
and OAI set. This can be very slow for big collection (e.g. ~100000
records).
Only records added/modified/deleted since the previous time
oai_repository_updater was run, need to be updated. (currently, if the set
definition is using some indexed field, also the BibIndex timestamps
should be considered).
--
Ticket URL: <http://invenio-software.org/ticket/300>
Invenio <http://invenio-software.org>
