Thanks Michael for your confirmation that I didn't do anything wrong. I suspect that is the case with a big database transaction.
All the best, Jason On Tue, Jun 3, 2025 at 6:23 AM Michael Plate <[email protected]> wrote: > Hi Jason, > > Am 03.06.25 um 05:13 schrieb 'Qing Zou' via DSpace Technical Support: > > Hi all, > > > > I attempted to use AIP to ingest an entire site from version 6.4 to 9 > > (approximately 24 GB/ 5,000 handles) on two different test machines > > (both running Rocky Linux 9 and Java 17). One full ingestion took around > > 72 hours. I observed that the process at the very beginning was > > relatively quick but slowed down significantly as it progressed. I also > > increased the heap size from 512 MB to 12 GB, but this change had little > > noticeable effect on performance. > […] > > this is usual. > And congrats it did run in one attempt :) . > You can speed it up by splitting the import into multiple parts. AFAIK > this is because the ingest is done in one big database transaction and > it gets slower the more data is available for commit / rollback. > > Michael > > -- > All messages to this mailing list should adhere to the Code of Conduct: > https://www.lyrasis.org/about/Pages/Code-of-Conduct.aspx > --- > You received this message because you are subscribed to the Google Groups > "DSpace Technical Support" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To view this discussion visit > https://groups.google.com/d/msgid/dspace-tech/12fa65d2-cb18-4d55-b1ed-91b7df07a3d5%40bibliothek.uni-kassel.de > . > -- Dr. Qing (Jason) Zou, MLIS, PhD, Head, Digital Initiatives Lakehead University Library tel: (807) 343-8010 ext. 8251 email: [email protected] website: www.lakeheadu.ca -- All messages to this mailing list should adhere to the Code of Conduct: https://www.lyrasis.org/about/Pages/Code-of-Conduct.aspx --- You received this message because you are subscribed to the Google Groups "DSpace Technical Support" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion visit https://groups.google.com/d/msgid/dspace-tech/CACpaJt4KLqinEq2u_WAabF4oQHLmKWjDRdQQRop70EMsqmXWcA%40mail.gmail.com.
