Dear Ian, Invenio needs both: - a relational database: only mysql and postgresql are officially supported, sqlite is only for testing. - a place to store the files: the deployments I am aware of use either a local filesystem or EOS (using the provided XRootD driver). However it might be possible to create an S3 driver for Invenio as it uses PyFilesystem. Googling S3 and PyFilesystem returns this library: https://github.com/PyFilesystem/s3fs. I don’t know if it is stable, I would recommend to contact the author first.
It is not possible to replace the database with S3. An object store does not have the same properties as a database. Invenio also requires other services as described in the documentation: https://invenio.readthedocs.io/en/latest/deploymentguide/services.html (HAProxy and NGINX are optional). Best regards, -- Nicolas Harraudeau CERN IT engineer for EUDAT B2SHARE On 13 November 2017 at 12:15:44, - - ([email protected]) wrote: Hmm. I now realise what I really want to do is to have Invenio access a database with data stored in an S3 object store, as opposed to the standard database backend of MySQL. Does this sound feasible? Thanks, Ian Johnson. From: - - Posted: 11/11/2017 11:33 Subject: Any experience connecting Invenio to cloud storage with S3? Hi, I’m looking to connect Invenio to an object storage system (Ceph), which has an S3 interface. Does anyone have experience using S3 for Invenio storage back-end? Thanks, Ian Johnson MBCS Data Services Group Scientific Computing Department Rutherford Appleton Laboratory
