On Fri, Sep 11, 2020 at 10:37:41AM +1000, [email protected] wrote:
[...]
> I have scale on my mind at lot these days. Would it be possible to run 
> multiple REST API nodes and multiple UI nodes? How much of the existing 
> DSpace system is going to be retained? I imagine a lot of the OAI-PMH code, 
> handle server, and such will remain untouched?

I haven't tried, but I think it may be possible.

The UI only communicates with the REST service.  Multiple back-end
instances should use the Servlet container's usual clustering features
to share UI <-> REST session state.  Maybe someone else can comment on
session management across multiple front-end instances.  But I would
guess that this is not the first place you'll see capacity issues.

The back end uses several data stores:

o  the database.  The DBMS is responsible for coordinating concurrent
   access and should do it well.  The DSpace business logic layer is
   careful to handle concurrent database access, since it may be
   driven by concurrent request threads.

o  the assetstore(s).  Multiple back-ends would need a shared
   filesystem.

o  Solr.  Unless you are using administrator tools (e.g. during
   upgrade), I think that all four cores simply accumulate records and
   answer search queries.

o  If you are offering RDF, the triplestore.  I don't know whether
   there are concurrency issues here.

o  Each instance would have its own separate logs.

The DBMS and Solr each have their own scale-out features, if needed.

The Handle resolver communicates with DSpace solely through the
database, so it should have no issues related to scaling out the
DSpace back-end.

DSpace 7 will expect you to install Solr separately, which means that
you can put it on a different host.  If you are concerned about
scaling, you probably should do that.

Here we already run (distinct, not scaled-out) DSpace 5 and 6 instances
with a single DBMS on a separate host.  This works well.

-- 
Mark H. Wood
Lead Technology Analyst

University Library
Indiana University - Purdue University Indianapolis
755 W. Michigan Street
Indianapolis, IN 46202
317-274-0749
www.ulib.iupui.edu

-- 
All messages to this mailing list should adhere to the DuraSpace Code of 
Conduct: https://duraspace.org/about/policies/code-of-conduct/
--- 
You received this message because you are subscribed to the Google Groups 
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to [email protected].
To view this discussion on the web visit 
https://groups.google.com/d/msgid/dspace-tech/20200911144421.GB17073%40IUPUI.Edu.

Attachment: signature.asc
Description: PGP signature

Reply via email to