Hi, You may already have come across these, but we have a variety of import mechanisms for getting content into DSpace: https://wiki.lyrasis.org/display/DSDOC7x/Ingesting+Content+and+Metadata
Larger amounts of content are probably easiest to bulk upload via either of these * Simple Archive Format: https://wiki.lyrasis.org/display/DSDOC7x/Importing+and+Exporting+Items+via+Simple+Archive+Format * Archival Information Packages: https://wiki.lyrasis.org/display/DSDOC7x/Importing+and+Exporting+Content+via+Packages The format you import with may depend on which seems easier for you to get the data into. My other recommendation would be to start *small* initially, in order to get the hang of it. Choose a small subset of the content as a "test" to import and get that working. You may also want to consider importing in batches little by little (e.g. 10 batches of 30K artifacts or some similar approach). You also will want to be aware of our "Performance Tuning" hints/tips: https://wiki.lyrasis.org/display/DSDOC7x/Performance+Tuning+DSpace With any batch upload, you will require extra memory/CPU... and the larger the batch size, the more it may require (especially memory). Those are some general guidelines, but feel free to ask more specific questions or share more about your migration. I'm sure others here could share more specific tips as well based on their own bulk import experiences. Tim On Friday, September 22, 2023 at 6:32:46 AM UTC-5 [email protected] wrote: > I need to migrate a significant volume of data(~500GB and ~300k artifacts) > in dSpace from other repository. What are the recommended strategies and > tools for handling large data migrations efficiently in dSpace? Any > insights or best practices would be greatly appreciated. > > Stack overflow: > https://stackoverflow.com/questions/77147135/best-practices-for-large-data-migration-in-dspace > > -- All messages to this mailing list should adhere to the Code of Conduct: https://www.lyrasis.org/about/Pages/Code-of-Conduct.aspx --- You received this message because you are subscribed to the Google Groups "DSpace Community" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/dspace-community/337cfda9-ca0c-42c8-b08a-65f1f5052dc8n%40googlegroups.com.
