On Thu, Mar 18, 2021 at 03:29:43AM -0700, [email protected] wrote: > Dear DSpace Team, > > The following is error message received when running index-authority on the > server, we have increased memory for java to 24 GB and we have very huge > database as this is happening on production site, please advise as our > system engineers beleives this error might not be memory related, if this > is relating to memory how big should we increase the memory to be ably to > re-index successfully. This setup was for first time done on the server and > followed this documentation > : https://wiki.lyrasis.org/display/DSDOC5x/ORCID+Integration > Your help is appreciated with hints to get this problem resolved.
It would be helpful to know precisely what version of DSpace you are running, in order to pinpoint the failure. At about line 60 of AuthorityIndexClient in v5 the code is filling a Map with every authority value of every Item in the database. So, while I can't give you a number for the amount of memory required by this operation, it is directly proportional to the number of Items you have. That line is called out in the stack trace. This code could be made much more scalable. In essence it fills a giant list, clears the index, then goes through the list sequentially and adds each entry to the index. There's no need for the list; entries could be added to the cleared index as they are produced. This scalability issue (and perhaps another) should be fixed regardless, but I'd like to confirm that I know where the failure occurred before I write up a bug ticket. Please tell us the complete version of DSpace you're running. (Like: 5.6) 'bin/dspace version' will give you that. -- Mark H. Wood Lead Technology Analyst University Library Indiana University - Purdue University Indianapolis 755 W. Michigan Street Indianapolis, IN 46202 317-274-0749 www.ulib.iupui.edu -- All messages to this mailing list should adhere to the Code of Conduct: https://duraspace.org/about/policies/code-of-conduct/ --- You received this message because you are subscribed to the Google Groups "DSpace Community" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/dspace-community/YFN8kyb0tsqIxCTh%40IUPUI.Edu.
signature.asc
Description: PGP signature
