#426: OAI Repository to be more flexible WRT metadata formats
--------------------------+------------------------------
Reporter: skaplun | Owner: skaplun
Type: enhancement | Status: closed
Priority: major | Milestone: v1.0
Component: BibHarvest | Version:
Resolution: fixed | Keywords: OpenAIRE formats
--------------------------+------------------------------
Changes (by Samuele Kaplun <samuele.kaplun@…>):
* status: in_merge => closed
* resolution: => fixed
Comment:
In [ee9a940e254681f7b7f215374ee11426440ac3d5]:
{{{
#!CommitTicketReference repository=""
revision="ee9a940e254681f7b7f215374ee11426440ac3d5"
BibHarvest: reimplementation of OAI repository
* New CFG_OAI_PREVIOUS_SET_FIELD parameter in invenio.conf to
store which set_spec a record was member of in the past
(suitable to discover when records are moving outside of
a set).
* CFG_OAI_DELETED_POLICY is now set by default to 'persistent'
since the support for OAI-PMH deleted policy is now fully
implemented. (closes #778)
* CFG_OAI_SAMPLE_IDENTIFIER now correctly set to a sensible default.
* Simplified CFG_OAI_IDENTIFY_DESCRIPTION configuration by
generating the OAI-PMH verb=Identify response in a more
automatic way.
* CFG_OAI_SLEEP is now set by default to 2, since the performance of
the OAI-PMH handler has improved in several directions.
* New CFG_OAI_METADATA_FORMATS parameter to be able to configure
which OAI-PMH metadataPrefixes are understood, and by integrating
OAI-PMH record representation to BibFormat.
OAI MARCXML is now generated via XOAIMARC.bfo output_format
which by defaults uses OAI_MARC.bft format_template. (closes #426)
* New CFG_OAI_FRIENDS to support OAI-PMH guidelines for friend
repositories.
See: <http://www.openarchives.org/OAI/2.0/guidelines-friends.htm>
* New CFG_OAI_PROVENANCE_* parameters to support exporting provenance
information for record harvested by other repositories. Updated
default demo *2marcxml.xsl stylesheet used when harvesting.
(remove partially broken usage of 909CO field for provenance
information). (closes #122)
* When CFG_SITE_DEVEL is set to True, automatically validates
OAI-PMH responses against provided OAI-PMH.xsd schema, in order
to assert their correctness.
* Greatly improved speed of oai_repository_server code, partially
refactored to improve kwalitee. Improved error handling,
resumptionToken manipulation, buffering, caching, completeness
of responses...
* Greatly improved speed of oai_repository_updater code, fully
rewriting the main task, by using intbitset and by considering
all and only the records that really need to be updated.
(closes #300)
* BibUpload to support an alterd flag (as configured by
CFG_OAI_PROVENANCE_ALTERED_SUBFIELD) and used by the above
mentioned new feauture CFG_OAI_PROVENANCE_*.
* New handy tools in htmlutils to generate HTML or XML in a
Pythonic way.
* New get_all_field_values function in search_engine to
quickly obtain all existing values for a certain field.
* As side modification, removed everywhere HitSet aliases to
intbitset.
* Records with no OAI IDs are not exported. Records with more than
one OAI ID, are exported, but only the first OAI ID found is
used, and an alert is raised to the admin.
}}}
--
Ticket URL: </ticket/426#comment:4>
Invenio <http://invenio-software.org>
