Hi,
I am using the dspace import tool for batch ingesting in a Postgres
database and I am facing extremely slow feedback in each record commitment.
Initially, the speed was normal but when the items tend to be around 30
thousand, the speed of each commitment is unacceptable.
Is there any known
Hi Ilias,
I am using the dspace import tool for batch ingesting in a Postgres
database and I am facing extremely slow feedback in each record commitment.
Initially, the speed was normal but when the items tend to be around 30
thousand, the speed of each commitment is unacceptable.
Is there
On 27 Jan 2009, at 10:27, Stuart Lewis wrote:
Hi Ilias,
I am using the dspace import tool for batch ingesting in a Postgres
database and I am facing extremely slow feedback in each record
commitment.
Initially, the speed was normal but when the items tend to be
around 30
thousand,
I would recommend two things;
1) batches of 200 documents (elsewhere their XML representation in
memory becomes very big)
2) make a PostgreSQL Maintenance (ANALYZE) after loading the first 200
and after loading a big part (first 10 thousand records)
Christophe
Stuart Lewis a écrit :
Hi
On Tue, 27 Jan 2009, Stuart Lewis wrote:
The following paper talks about this, and how DSpace performs when ingesting
1 million items:
Testing the Scalability of a DSpace-based Archive, Dharitri Misra, James
Seamans, George R. Thoma, National Library of Medicine, Bethesda, Maryland,
USA
Hi Simon,
Testing the Scalability of a DSpace-based Archive, Dharitri Misra,
James
Seamans, George R. Thoma, National Library of Medicine, Bethesda,
Maryland,
USA
http://www.dspace.org/images/stories/ist2008_paper_submitted1.pdf
Can I enquire as to where within the standard DSpace
Hi Tom,
The following paper talks about this, and how DSpace performs when ingesting
1 million items:
Testing the Scalability of a DSpace-based Archive, Dharitri Misra, James
Seamans, George R. Thoma, National Library of Medicine, Bethesda, Maryland,
USA
On 27 Jan 2009, at 14:14, Stuart Lewis wrote:
Hi Tom,
The following paper talks about this, and how DSpace performs when
ingesting
1 million items:
Testing the Scalability of a DSpace-based Archive, Dharitri Misra,
James
Seamans, George R. Thoma, National Library of Medicine,
Hello,
We tackled the same problem in version 1.4.2. Therefore we added extra DC
qualifiers (bibliographicCitation.issue / volume / ...) which we also uses
for a better structured input format (see http://193.190.8.15/odin/ - you
can test this out with user name and login dspace). For every
Given that the test in the paper uses neither postgres nor the DSpace
import tool, that seems unlikely.
30,000 items shouldn't pose a big problem for any mature DBMS (e.g. Postgres
/ MySQL etc). If there are problems at that scale, they are more likely to
be in other parts of the system.
We've
Can someone give me the short answer about where to put our local
customizations for DSpace 1.5.1 and exactly what procedures we need to
do to have them end up in our application?
Here is what I'm doing but it doesn't seem to be correct.
1. I have put our modules for jspui in
Hi Stan,
You can put the dspace.log and checker.log files wherever you want them.
We have ours in /export/home/dspace/log/Just make sure they are fully
qualified and don't use the ${log.dir} symbolic in the log4j files. I did
leave the symbolics in our dspace.cfg files as follows:
Hi, Sue. You need to run maven to rebuild the installation before running ant
-- just do mvn package in your {dspace-source}/dspace directory, then do your
ant build as usual. Your jsp customizations will end up in
{dspace}/webapps/jspui/. At least, that's what we've been doing; and it seem to
On Tue, Jan 27, 2009 at 10:27 AM, Stuart Lewis s...@aber.ac.uk wrote:
Hi Ilias,
I am using the dspace import tool for batch ingesting in a Postgres
database and I am facing extremely slow feedback in each record
commitment.
The following paper talks about this, and how DSpace performs
First, Thanks Claudia and Charles for your local customizations
instructions. It worked! I do suggest putting this in detail in the
doc as it's a bit fuzzy and doesn't include the mvn package step. :-)
Next, I just found this in the pom.xml file under dspace-source-.../ :
Java 1.5 is our
On Tue, Jan 27, 2009 at 8:43 PM, Thornton, Susan M. (LARC-B702)[NCI
INFORMATION SYSTEMS] susan.m.thorn...@nasa.gov wrote:
Next, I just found this in the pom.xml file under dspace-source-…/ :
*Java 1.5 is our officially endorsed build target platform.*
Is this going to be a problem for anyone
As claudia says:
if you want them in the jspui, place them into
/dspace-source/dspace/modules/jspui/src/main/webapp
/dspace-source/dspace/modules/jspui/src/main/java
Likewise, if you want something to show up in the CLI lib or across
more than one webapplication I can provide further detail
On Jan 27, 2009, at 1:03 PM, Andrew Marlow wrote:
On Tue, Jan 27, 2009 at 8:43 PM, Thornton, Susan M. (LARC-B702)[NCI
INFORMATION SYSTEMS] susan.m.thorn...@nasa.gov wrote:
Next, I just found this in the pom.xml file under dspace-source-…/ :
Java 1.5 is our officially endorsed build target
Susan,
I'm a little surprised you had to do that. Its actually the Ant
script that should have expanded that ${log.dir} in your build
process. I suspect something went wrong with your install at that
stage, maybe file permissions errors or timestamps on the
log4j.properties that was
Please keep in mind that I'm just learning 1.5, but I've also found that
I have to remove the
/dspace-source.../dspace/target/dspace-1.5.1-build.dir directory before
I run the maven and ant steps or I end up with leftover modules I may
not want.
From: Diggory
Can someone give me the short answer about where to put our local
customizations for DSpace 1.5.1 and exactly what procedures we need to
do to have them end up in our application?
This wiki page:
http://wiki.dspace.org/index.php/BuildCookbook
was intended to cover this question -- please
mvn clean package
clean will clear out your target directories.
Cheers,
Mark
On Jan 27, 2009, at 2:42 PM, Thornton, Susan M. (LARC-B702)[NCI
INFORMATION SYSTEMS] wrote:
Please keep in mind that I’m just learning 1.5, but I’ve also found
that I have to remove the
Ah!!! Wonderful! Yes, I just found that I also had to clear out the
target directories since they were really where the leftovers were
coming from:
$ find ./ -name dummy* -print
./dspace/modules/jspui/target/jspui-1.5.1/dummy-default.jsp
I tried everything I knew, even giving the entire /dspace directory 777
permissions. It doesn't make sense to me either.
Sue
From: Diggory Mark [mailto:mdigg...@gmail.com]
Sent: Tuesday, January 27, 2009 4:11 PM
To: Thornton, Susan M. (LARC-B702)[NCI
Just for clarification/understanding of what's going on, can you tell me
if object timestamps are looked at to determine whether or not to move
them to the new compiled application? For instance, I have a local
image file in /dspace-source/dspace/modules/jspui/src/main/webapp
that's already
On Thu, Jan 22, 2009 at 9:35 PM, Scott Phillips
scott.a.phill...@gmail.comwrote:
You may want to look at a Journal collection we've done.
It doesn't completely address the problem you're asking about but is in the
same sphere, and i second what Mark said, it is likely best to not use
I see signs of the handle server using
ps -wwo pid,cmd -C java |grep -Fi handle
-- Van Ly : University of Sydney Library
From: Thomas A McGee
Sent: Wed 28/01/2009 6:51 AM
To: dspace-tech@lists.sourceforge.net
Subject: [Dspace-tech] Trying to restart HANDLE server
I've seen the
also if you look at the start-handle-server script it evokes 'dsrun' (which is
a wrapper for java as Van said)
On Wed, 28 Jan 2009 10:14:38 +1100
Van Ly v...@library.usyd.edu.au wrote:
I see signs of the handle server using
ps -wwo pid,cmd -C java |grep -Fi handle
-- Van Ly :
28 matches
Mail list logo
