> -----Original Message----- > From: Andrea Schweer [mailto:schw...@waikato.ac.nz] > Sent: Wednesday, July 27, 2011 6:38 PM > To: dspace-tech@lists.sourceforge.net > Subject: Re: [Dspace-tech] Batch metadata corrections question: does > anyone know why the limit is set to just 20 items at a time? > > Hi, > > On 28/07/11 10:19, Peter Dietz wrote: > > Doing batch changes with a large number of changes will keep your > > system busy, and the reindexing can take a while. I've noticed that > > when we set the limit to be really high, it appears that nothing will > > happen from the user's browser for 20+ minutes, so I've connected to > > the server from the command line, and noticed that the reindexing task > > was taking a long time, but still running. So you might be safe with > > setting this to a really high number (several thousand), you'll just > > have to have the patience to not disrupt it. But smaller / more > > manageable batch sizes will complete in a reasonable amount of time. > > With this set to 1000 or more, I'm guessing your more likely to run > > into Out-Of-Memory errors > > With one of 'my' repositories, when we increased the limit (to 1000 I think), > completing the changes took so long that the Apache-Tomcat connection > timed out. This meant that the user saw an error in their browser even > though the changes actually went through fine. In our case we decided to > stick with a lower limit to avoid confusion. Though 20 really does feel very > low.
There are some reports of this working with as many as 1000 items. http://dspace.2283337.n4.nabble.com/Excel-to-Dspace-td3310564.html Though it seems to be dependent on the amount of RAM available on your server. Relatedly, does anyone know how safe it is to test higher limit values? I looked at the code to determine whether these batch edits occur within a single database transaction, but I didn't see any evidence either way. Thanks, Alex Lemann ------------------------------------------------------------------------------ Got Input? Slashdot Needs You. Take our quick survey online. Come on, we don't ask for help often. Plus, you'll get a chance to win $100 to spend on ThinkGeek. http://p.sf.net/sfu/slashdot-survey _______________________________________________ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
