Hello
We experience some problems with date ranges into big cores (60Gb), that
are solved sharding.
Software as dspace-stats-collector of "lareferencia" fail working with
this cores (https://github.com/lareferencia/dspace-stats-collector)
Maybe sharding is not the best sollution, but works.
Adán
While awaiting an answer to your question, may I propose a tangential
question of my own: what do you think sharding is doing for you, and
have you seen evidence to support this? Because DSpace uses Solr's
sharding support in a very eccentric manner, and I have my doubts that
it actually buys us anything. That is why I accepted the need to
remove it in 7.0, in exchange for the option to place Solr on a
separate host if desired (since supported Solr versions must now be
installed separately anyway). The custom sharding code in DSpace
doesn't get enough information to work across hosts. If sharding is
really needed, Solr can do it much better on its own, and we could
scrap *all* of the sharding support in DSpace.
On Monday, November 6, 2023 at 12:35:55 PM UTC-5 [email protected]
wrote:
Hello DSpace fans,
Is sharding of the statistics cores with a separate core for each
individual year of statistics supported again in the most recent
version of DSpace?
The installation documentation mentions that sharding is no longer
supported in DSpace 7, but we noticed some recent commits to the
DSpace project that reference sharding and wondered if it is
available again.
In past versions of DSpace during solr index updates or
maintenance we've sometimes struggled with slow updates or running
out of memory. We have about 12 years of sharded statistics cores
in DSpace 6 and are working on a strategy for importing them into
DSpace 7, perhaps doing most of the exporting and importing on a
separate server with solr before our upgrade day. I am curious
about whether we should import all statistics into the same core
for DSpace 7, as expected, or if we should keep them separated if
it turns out that sharding is supported again.
Can someone please help to clarify which parts of sharding are now
supported, and which still do not work, and provide observations
or advice?
Thank you for the time,
Keith
--
All messages to this mailing list should adhere to the Code of
Conduct: https://www.lyrasis.org/about/Pages/Code-of-Conduct.aspx
---
You received this message because you are subscribed to the Google
Groups "DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to [email protected].
To view this discussion on the web visit
https://groups.google.com/d/msgid/dspace-tech/f2953515-e38f-4ea3-81c9-751ef4a9afc7n%40googlegroups.com
<https://groups.google.com/d/msgid/dspace-tech/f2953515-e38f-4ea3-81c9-751ef4a9afc7n%40googlegroups.com?utm_medium=email&utm_source=footer>.
--
All messages to this mailing list should adhere to the Code of Conduct:
https://www.lyrasis.org/about/Pages/Code-of-Conduct.aspx
---
You received this message because you are subscribed to the Google Groups "DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To view this discussion on the web visit
https://groups.google.com/d/msgid/dspace-tech/43bcd169-997d-4cc7-8f4c-e858215b0d10%40gmail.com.
