Re: [Dspace-tech] Problem with Statistics [SEC=UNCLASSIFIED]
UNCLASSIFIED Thankyou Stuart, Just to confirm, if what you say is happening all older stats other than what is being displayed have been lost. Regards, Hamish IMPORTANT: This email remains the property of the Australian Defence Organisation and is subject to the jurisdiction of section 70 of the Crimes Act 1914. If you have received this email in error, you are requested to contact the sender and delete the email. From: Stuart Lewis [mailto:s.le...@auckland.ac.nz] Sent: Thursday, 3 September 2009 3:21 PM To: Brett, Hamish Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Problem with Statistics [SEC=UNCLASSIFIED] Hi Brett, On 3/09/2009, at 4:34 PM, Brett, Hamish wrote: I am attempting to reconfigure our statistics. However when I run the required scripts I am not getting any stats older than 2 months ago. When I look in the .dat files in /dspace/log that have been generated they are almost except for the last 2 months empty even though a lot has occured for the last 3 years. I am pretty sure I have all the log files. I have only changed the date in the dstat.cfg file. An example of an empty dat file is below. Any advice for me I suspect what is happening is that your dspace.log.* files have rolled over their limit. In [dspace]/config/log4j.properties you can specify how many log files to keep, and how big each one can be before it rolls over. The default configuration is quite small (100 files at 1Mb each). So it sounds like you are getting through that many log files each 2 months. The problem with the stats module as it stands, is that despite creating .dat files for log files which have now rolled over and been lost, it recreates them all each time. This means you lose all the older stats. The easy short-term solution is to increase the size and/or number of log files that DSpace creates. The better solution would be for someone to look at making sure current .dat files are not overwritten by the stats system. However... the stat system is getting a complete rewrite in the upcoming 1.6 release, so a lot of people are waiting for that instead. I hope this helps, Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: 64 9 373-7599 x81928 http://www.library.auckland.ac.nz/ -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] DSpace hints - Removing Horizontal Scrollbar Initial Questions
Hi, we recently started an @mire page on facebook, on which we want to share some DSpace hints. Especially for people starting with DSpace they might be useful. Interface - Removing the Horizontal Scrollbar http://www.facebook.com/note.php?note_id=126657098767 Workflow - Removing the Initial Questions http://www.facebook.com/note.php?note_id=127204428767 Any feedback on this is welcome ! best regards, Bram Luyten @mire - http://www.atmire.com Technologielaan 9 - 3001 Heverlee - Belgium 533 2nd Street - Encinitas, CA 92024 - USA http://www.togather.eu - Before getting together, get t...@ther -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Problem with Statistics [SEC=UNCLASSIFIED]
Hi Brett, I've not double-checked the behaviour recently, but I think the old reports (.html) files stay, so you can see older stats, but newer stats only contain data from the past few months rather than back to the inception of your installation. Thanks, Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: 64 9 373-7599 x81928 http://www.library.auckland.ac.nz/ On 3/09/2009, at 6:34 PM, Brett, Hamish wrote: UNCLASSIFIED Thankyou Stuart, Just to confirm, if what you say is happening all older stats other than what is being displayed have been lost. Regards, Hamish IMPORTANT: This email remains the property of the Australian Defence Organisation and is subject to the jurisdiction of section 70 of the Crimes Act 1914. If you have received this email in error, you are requested to contact the sender and delete the email. From: Stuart Lewis [mailto:s.le...@auckland.ac.nz] Sent: Thursday, 3 September 2009 3:21 PM To: Brett, Hamish Cc: dspace-tech@lists.sourceforge.netmailto:dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Problem with Statistics [SEC=UNCLASSIFIED] Hi Brett, On 3/09/2009, at 4:34 PM, Brett, Hamish wrote: I am attempting to reconfigure our statistics. However when I run the required scripts I am not getting any stats older than 2 months ago. When I look in the .dat files in /dspace/log that have been generated they are almost except for the last 2 months empty even though a lot has occured for the last 3 years. I am pretty sure I have all the log files. I have only changed the date in the dstat.cfg file. An example of an empty dat file is below. Any advice for me I suspect what is happening is that your dspace.log.* files have rolled over their limit. In [dspace]/config/log4j.properties you can specify how many log files to keep, and how big each one can be before it rolls over. The default configuration is quite small (100 files at 1Mb each). So it sounds like you are getting through that many log files each 2 months. The problem with the stats module as it stands, is that despite creating .dat files for log files which have now rolled over and been lost, it recreates them all each time. This means you lose all the older stats. The easy short-term solution is to increase the size and/or number of log files that DSpace creates. The better solution would be for someone to look at making sure current .dat files are not overwritten by the stats system. However... the stat system is getting a complete rewrite in the upcoming 1.6 release, so a lot of people are waiting for that instead. I hope this helps, Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: 64 9 373-7599 x81928 http://www.library.auckland.ac.nz/ -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Modify My Dspace
Hi All Thanks I now changed my menu's and Surprisingly even my CSS is Changed. Regards Lewatle -Original Message- From: penning...@rhodes.edu [mailto:penning...@rhodes.edu] Sent: Wed 9/2/2009 5:40 PM To: Lewatle Phaladi Subject: RE: Modify My Dspace I think you already got a response from the DSpace list, but, basically, you need to copy the file Messages.properties from the [dspace-1.5.2-src-release]/dspace-api/target/classes directory and put it in your [tomcat-webapps]/ jspui/WEB-INF/classes directory. Then, you look through the JSP source of the jspui and find the tag that you want to edit, modify that tag in the Messages.properties file, and bounce your DSpace Java app server. You can change many, many text and links in the default jspui site using the Messages.properties file. Hope that helps. -- Stacy Pennington Rhodes College penning...@rhodes.edu (901) 843-3968 From: Lewatle Phaladi [mailto:lewatle.phal...@wits.ac.za] Sent: Wednesday, September 02, 2009 1:54 AM To: Stuart Lewis; Pennington_Stacy; dspace-tech@lists.sourceforge.net Subject: Modify My Dspace Hi Stuart and Pennington I saw your My Dspace(under Sign on to) from http://dlynx.rhodes.edu/jspui/ modified to My DLynx, I also need to change ours, can you indicate as to which file can I change mine or steps to do that. Thanks. Regards Lewatle htmlpfont face = verdana size = 0.8 color = navyThis communication is intended for the addressee only. It is confidential. If you have received this communication in error, please notify us immediately and destroy the original message. You may not copy or disseminate this communication without the permission of the University. Only authorized signatories are competent to enter into agreements on behalf of the University and recipients are thus advised that the content of this message may not be legally binding on the University and may contain the personal views and opinions of the author, which are not necessarily the views and opinions of The University of the Witwatersrand, Johannesburg. All agreements between the University and outsiders are subject to South African Law unless the University agrees in writing to the contrary./font/p/html -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] connection pool errors with Manakin 1.5.2
I've recently upgraded a 1.4.2 jsp install of DSpace to 1.5.2 Manakin, moving to a new server in the process. Everything seems to work OK but after a Google crawl or intense activity, my Manakin-based interface crashes with this sort of message (the jspui interface continues working). Here's a full java stack error. Cascade of doom triggered by Timeout waiting for idle object site: http://digilib.gmu.edu:8080/xmlui Mac OS X Server (10.5.8) Tomcat 6.0.20 DSpace 1.5.2 Postgres 8.3.7 /dspace/config/dspace.cfg shows these values: # Connection pool parameters # Maximum number of DB connections in pool db.maxconnections = 50 # Maximum time to wait before giving up if all connections in pool are busy (milliseconds) db.maxwait = 5000 # Maximum number of idle connections in pool (-1 = unlimited) db.maxidle = -1 # Determine if prepared statement should be cached. (default is true) db.statementpool = true I have plenty of memory in this server (12GB), is there a way I can increase the number of pools or whatever to at least reduce the frequency of this problem? Any help greatly appreciated (I really don't want to have to go back to the jsp interface). - Wally Wally Grotophorst Associate University Librarian Digital Programs and Systems University Libraries George Mason University Fairfax, Virginia 22030 (703) 993-9005 org.apache.cocoon.ProcessingException: Failed to process pipeline atmap:serialize type=xml - jndi:/localhost/xmlui/aspects/aspects.xmap:115:34 atmap:transform type=PageNotFound - jndi:/localhost/xmlui/aspects/aspects.xmap:114:43 atmap:generate - jndi:/localhost/xmlui/aspects/aspects.xmap:113:22 atmap:serialize type=xhtml - jndi:/localhost/xmlui/themes/Mason/sitemap.xmap:184:34 atmap:transform type=NamespaceFilter - jndi:/localhost/xmlui/themes/Mason/sitemap.xmap:181:84 atmap:transform type=NamespaceFilter - jndi:/localhost/xmlui/themes/Mason/sitemap.xmap:180:78 atmap:transform type=i18n - jndi:/localhost/xmlui/themes/Mason/sitemap.xmap:174:33 atmap:transform - jndi:/localhost/xmlui/themes/Mason/sitemap.xmap:170:40 atmap:transform type=IncludePageMeta - jndi:/localhost/xmlui/themes/Mason/sitemap.xmap:155:45 atmap:generate type=file - jndi:/localhost/xmlui/themes/Mason/sitemap.xmap:131:55 atmap:match - jndi:/localhost/xmlui/themes/Mason/sitemap.xmap:128:28 atmap:mount - jndi:/localhost/xmlui/themes/themes.xmap:63:45 atmap:match type=ThemeMatcher - jndi:/localhost/xmlui/themes/themes.xmap:62:35 atmap:mount - jndi:/localhost/xmlui/sitemap.xmap:383:73 at org.apache.cocoon.ProcessingException.throwLocated(ProcessingException.java:143) at org.apache.cocoon.components.pipeline.AbstractProcessingPipeline.handleException(AbstractProcessingPipeline.java:923) at org.apache.cocoon.components.pipeline.AbstractProcessingPipeline.setupPipeline(AbstractProcessingPipeline.java:372) at org.apache.cocoon.components.pipeline.impl.AbstractCachingProcessingPipeline.setupPipeline(AbstractCachingProcessingPipeline.java:710) at org.apache.cocoon.components.pipeline.AbstractProcessingPipeline.preparePipeline(AbstractProcessingPipeline.java:466) at org.apache.cocoon.components.pipeline.AbstractProcessingPipeline.prepareInternal(AbstractProcessingPipeline.java:480) at sun.reflect.GeneratedMethodAccessor94.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.cocoon.core.container.spring.avalon.PoolableProxyHandler.invoke(PoolableProxyHandler.java:71) at $Proxy20.prepareInternal(Unknown Source) at org.apache.cocoon.components.source.impl.SitemapSource.init(SitemapSource.java:292) at org.apache.cocoon.components.source.impl.SitemapSource.init(SitemapSource.java:148) at org.apache.cocoon.components.source.impl.SitemapSourceFactory.getSource(SitemapSourceFactory.java:62) at org.apache.cocoon.components.source.CocoonSourceResolver.resolveURI(CocoonSourceResolver.java:153) at org.apache.cocoon.components.source.CocoonSourceResolver.resolveURI(CocoonSourceResolver.java:183) at org.apache.cocoon.generation.FileGenerator.setup(FileGenerator.java:99) at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.cocoon.core.container.spring.avalon.PoolableProxyHandler.invoke(PoolableProxyHandler.java:71) at $Proxy21.setup(Unknown Source) at org.apache.cocoon.components.pipeline.AbstractProcessingPipeline.setupPipeline(AbstractProcessingPipeline.java:343) at
Re: [Dspace-tech] connection pool errors with Manakin 1.5.2
http://archie.kumc.edu/robots.txt Didn't intend to reply off-list last time. Jason On 9/3/2009 at 9:36 AM, in message 4a9fd468.5040...@gmu.edu, wally grotophorst wal...@gmu.edu wrote: Yes, I did have this problem on our old system (OSX Tiger server with DSpace running under JBOSS), but I haven't been in charge of our DSpace installation for a couple of years. Our current repository librarian just left so I'm doing it again until I can find a new one. I'll try the sitemap thing and look for the patch as well. Do you know where a battle-tested robots.txt might be found? What's the name of your server and I'll look at that one. Thanks for getting back to me so quickly. This thing is making me nuts... - Wally Wally, We had this problem after upgrading. Two things made the difference for us: 1) using a variation of the crontab script at http://wiki.dspace.org/index.php/Idle_In_Transaction_Problem#Workaround:_Kill ing_.22Idle_in_Transaction.22_processes_with_crontab (looks like you have experience with this :) and 2) editing robots.txt to block crawlers and implementing the sitemap feature in XMLUI. There is also a Cocoon patch that might help. See the thread http://www.nabble.com/AJP-Errors-td23981286.html Hopefully, Sean or Mark can say whether or not it solves the connection pool problem. Jason -- -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Adding description to batch loaded bitstream
Stuart, and everyone else: Here is what I have discovered with my test of my instance of DSpace 1.5.2: If I batch load anything into my system using: ./dsrun org.dspace.app.itemimport.ItemImport --add --eperson=g...@cornell.edu --collection=1813/ --source=/dspace/import --mapfile=mapfileTop of Form 1 The item is imported fine, but when I display the item, the description field for the bitstream does not appear...not even the title for the description field. However, after I run Filter-media, the description field appears for these batch loaded items. I don't recall this being an issue with 1.4.2. Has anyone else experienced this? Stuart Lewis wrote: Hi George, That issues was just for XMLUI. JSPUI should work fine. Have you modified much of your DSpace installation? It seems strange that it must be accepting the description OK as you see it in the edit view, but not in the normal viewing mode. Thanks, Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: 64 9 373-7599 x81928 _http://www.library.auckland.ac.nz/ _ On 2/09/09 9:12 AM, George Kozak g...@cornell.edu wrote: Stuart: No, I am using JSPUI. Is this patch specific to XMLUI or does it also apply to JSPUI? Stuart Lewis wrote: Hi George, I am having a problem with batch loading descriptions with my bitstreams. In the contents file I have file.pdf\tdescription:File description When I do the import, it works fine, but when I view the item display, the description does not appear. If I go to the Admin function and bring up the item under Edit, I see the description, but it doesn't appear on the item display. Am I doing something wrong? Are you using XMLUI? See: - http://jira.dspace.org/jira/browse/DS-156 This has been included in the upcoming 1.6 release. Thanks, Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: 64 9 373-7599 x81928 http://www.library.auckland.ac.nz/ -- *** George Kozak Digital Library Specialist Division of Library Information Technologies (DLIT), Digital Media Group 501 Olin Library Cornell University 607-255-8924 *** g...@cornell.edu -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] SWORD ingestion problem
Actually using SWORD and making my own zip with all the files and the
appropriate xml ( I supose... ), I can't make an ingestion of a 13 files
into an item ( 10 jpg and 3 pdf - 1,1Mb)
Sometimes works but if I add more files I can be sure that it won't work
and it will show me the following message :
curl -i --data-binary @modules.zip -H Content-Disposition:
filename=myDSpaceMETSItem.zip -H Content-Type: application/zip -H
X-Packaging: http://purl.org/net/sword-types/METSDSpaceSIP; -H
X-No-Op: false -H X-Verbose: true
http://user:p...@localhost:8080/sword/deposit/123456789/47
HTTP/1.1 100 Continue
HTTP/1.1 500 Internal Server Error
Server: Apache-Coyote/1.1
Content-Type: text/html;charset=utf-8
Content-Length: 1000
Date: Thu, 03 Sep 2009 16:04:53 GMT
Connection: close
htmlheadtitleApache Tomcat/6.0.18 - Error
report/titlestyle!--H1
{font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:22px;}
H2
{font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:16px;}
H3
{font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:14px;}
BODY
{font-family:Tahoma,Arial,sans-serif;color:black;background-color:white;}
B
{font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;}
P
{font-family:Tahoma,Arial,sans-serif;background:white;color:black;font-size:12px;}A
{color : black;}A.name {color : black;}HR {color :
#525D76;}--/style /headbodyh1HTTP Status 500 - /h1HR
size=1 noshade=noshadepbtype/b Status
report/ppbmessage/b u/u/ppbdescription/b uThe
server encountered an internal error () that prevented it from
fulfilling this request./u/pHR size=1
noshade=noshadeh3Apache Tomcat/6.0.18/h3/body/html
the xml file has that code (it's a simple extension of the sample file
that I found in the example package):
?xml version=1.0 encoding=utf-8 standalone=no?
mets ID=sort-mets_mets OBJID=sword-mets LABEL=DSpace SWORD Item
PROFILE=DSpace METS SIP Profile 1.0 xmlns=http://www.loc.gov/METS/;
xmlns:xlink=http://www.w3.org/1999/xlink;
xmlns:xsi=http://www.w3.org/2001/XMLSchema-instance;
xsi:schemaLocation=http://www.loc.gov/METS/
http://www.loc.gov/standards/mets/mets.xsd;
metsHdr CREATEDATE=2009-09-03T17:44:48
agent ROLE=CUSTODIAN TYPE=ORGANIZATION
nameRichard Jones/name
/agent
/metsHdr
dmdSec ID=sword-mets-dmd-1 GROUPID=sword-mets-dmd-1_group-1
mdWrap MIMETYPE=text/xml MDTYPE=OTHER OTHERMDTYPE=EPDCX
LABEL=SWAP Metadata
xmlData
epdcx:descriptionSet
xmlns:epdcx=http://purl.org/eprint/epdcx/2006-11-16/;
xmlns:xsi=http://www.w3.org/2001/XMLSchema-instance;
xmlns:schemaLocation=http://purl.org/eprint/epdcx/2006-11-16/
http://purl.org/eprint/epdcx/xsd/2006-11-16/epdcx.xsd;
epdcx:description
epdcx:resourceId=sword-mets-epdcx-1epdcx:statement
epdcx:propertyURI=http://purl.org/dc/elements/1.1/type;
epdcx:valueURI=http://purl.org/eprint/entityType/ScholarlyWork/
epdcx:statement
epdcx:propertyURI=http://purl.org/dc/elements/1.1/title;
epdcx:valueStringAttempts to detect retrotranspositionand
de novo deletion of Alus and other dispersed repeats at specific loci
in the human genome/epdcx:valueString
/epdcx:statement
epdcx:statement
epdcx:propertyURI=http://purl.org/dc/terms/abstract;
epdcx:valueStringDispersed repeat elements contribute
togenome instability by de novo insertionand unequal recombination
betweenrepeats. To study the dynamics of theseprocesses, we have
developed single DNAmolecule approaches to detect de novoinsertions at
a single locus and u-mediated deletions at two differentloci in human
genomic DNA. Validation experiments showed these approaches could
detect insertions and deletions atfrequencies below 10(-6) per
cell.However, bulk analysis of germline(sperm) and somatic DNA showed
noevidence for genuine mutant molecules,placing an upper limit of
insertionanddeletion rates of 2 x 10(-7) and 3 x10(-7),
respectively, in the individualstested. Such re-arrangements at
theseloci therefore occur at a rate lowerthan that detectable by
the mostsensitive methods currently available./epdcx:valueString
/epdcx:statement
epdcx:statement
epdcx:propertyURI=http://purl.org/dc/elements/1.1/creator;
epdcx:valueStringHollies, C.R./epdcx:valueString
/epdcx:statement
epdcx:statement
epdcx:propertyURI=http://purl.org/dc/elements/1.1/creator;
epdcx:valueStringMonckton, D.G./epdcx:valueString
/epdcx:statement
epdcx:statement
epdcx:propertyURI=http://purl.org/dc/elements/1.1/creator;
epdcx:valueStringJeffreys, A.J./epdcx:valueString
/epdcx:statement
epdcx:statement
epdcx:propertyURI=http://purl.org/dc/elements/1.1/identifier;
epdcx:valueString
epdcx:sesURI=http://purl.org/dc/terms/URI;http://www.myu.ac.uk/some/identifier/epdcx:valueString
/epdcx:statement
epdcx:statement
[Dspace-tech] help! migration causes slow loading of files
Hi All, I migrated my database, assetstore application to a new server this morning (after doing a test migration last week) All seems great until I click on a pdf (or other file) in a record. The server just sits and spins and the file never opens. I've migrated to a new linux server with twice the amount of memory, so it seems like memory shouldn't be the problem. I'm not seeing anything at all in the error logs. I'm still running Dspace 1.4.1 Does anyone have any ideas what may have happened? Thanks so much, Susan -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] SWORD ingestion problem
Hi Joan,
A common issue causing intermittent bitstream saving problems is permissions on
some parts of the asset store. If an import or media-filter has been run as a
different user (typically root) which sets wrong permissions on some
directories in the asset store.
See:
- http://wiki.dspace.org/index.php/Fix_Common_Item_Import_Errors
Thanks,
Stuart Lewis
IT Innovations Analyst and Developer
Te Tumu Herenga The University of Auckland Library
Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand
Ph: 64 9 373-7599 x81928
http://www.library.auckland.ac.nz/
On 4/09/2009, at 4:04 AM, Joan Caparros wrote:
Actually using SWORD and making my own zip with all the files and the
appropriate xml ( I supose... ), I can't make an ingestion of a 13 files into
an item ( 10 jpg and 3 pdf - 1,1Mb)
Sometimes works but if I add more files I can be sure that it won't work and it
will show me the following message :
curl -i --data-binary @modules.zip -H Content-Disposition:
filename=myDSpaceMETSItem.zip -H Content-Type: application/zip -H
X-Packaging: http://purl.org/net/sword-types/METSDSpaceSIP; -H X-No-Op:
false -H X-Verbose: true
http://user:p...@localhost:8080/sword/deposit/123456789/47
HTTP/1.1 100 Continue
HTTP/1.1 500 Internal Server Error
Server: Apache-Coyote/1.1
Content-Type: text/html;charset=utf-8
Content-Length: 1000
Date: Thu, 03 Sep 2009 16:04:53 GMT
Connection: close
htmlheadtitleApache Tomcat/6.0.18 - Error report/titlestyle!--H1
{font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:22px;}
H2
{font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:16px;}
H3
{font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:14px;}
BODY {font-family:Tahoma,Arial,sans-serif;color:black;background-color:white;}
B {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;} P
{font-family:Tahoma,Arial,sans-serif;background:white;color:black;font-size:12px;}A
{color : black;}A.name {color : black;}HR {color : #525D76;}--/style
/headbodyh1HTTP Status 500 - /h1HR size=1
noshade=noshadepbtype/b Status report/ppbmessage/b
u/u/ppbdescription/b uThe server encountered an internal error ()
that prevented it from fulfilling this request./u/pHR size=1
noshade=noshadeh3Apache Tomcat/6.0.18/h3/body/html
the xml file has that code (it's a simple extension of the sample file that I
found in the example package):
?xml version=1.0 encoding=utf-8 standalone=no?
mets ID=sort-mets_mets OBJID=sword-mets LABEL=DSpace SWORD Item
PROFILE=DSpace METS SIP Profile 1.0
xmlns=http://www.loc.gov/METS/;http://www.loc.gov/METS/
xmlns:xlink=http://www.w3.org/1999/xlink;http://www.w3.org/1999/xlink
xmlns:xsi=http://www.w3.org/2001/XMLSchema-instance;http://www.w3.org/2001/XMLSchema-instance
xsi:schemaLocation=http://www.loc.gov/METS/
http://www.loc.gov/standards/mets/mets.xsd;http://www.loc.gov/METS/http://www.loc.gov/standards/mets/mets.xsd
metsHdr CREATEDATE=2009-09-03T17:44:48
agent ROLE=CUSTODIAN TYPE=ORGANIZATION
nameRichard Jones/name
/agent
/metsHdr
dmdSec ID=sword-mets-dmd-1 GROUPID=sword-mets-dmd-1_group-1
mdWrap MIMETYPE=text/xml MDTYPE=OTHER OTHERMDTYPE=EPDCX LABEL=SWAP
Metadata
xmlData
epdcx:descriptionSet
xmlns:epdcx=http://purl.org/eprint/epdcx/2006-11-16/;http://purl.org/eprint/epdcx/2006-11-16/
xmlns:xsi=http://www.w3.org/2001/XMLSchema-instance;http://www.w3.org/2001/XMLSchema-instance
xmlns:schemaLocation=http://purl.org/eprint/epdcx/2006-11-16/
http://purl.org/eprint/epdcx/xsd/2006-11-16/epdcx.xsd;http://purl.org/eprint/epdcx/2006-11-16/http://purl.org/eprint/epdcx/xsd/2006-11-16/epdcx.xsd
epdcx:description epdcx:resourceId=sword-mets-epdcx-1epdcx:statement
epdcx:propertyURI=http://purl.org/dc/elements/1.1/type;http://purl.org/dc/elements/1.1/type
epdcx:valueURI=http://purl.org/eprint/entityType/ScholarlyWork;http://purl.org/eprint/entityType/ScholarlyWork/
epdcx:statement
epdcx:propertyURI=http://purl.org/dc/elements/1.1/title;http://purl.org/dc/elements/1.1/title
epdcx:valueStringAttempts to detect retrotranspositionand de novo
deletion of Alus and other dispersed repeats at specific loci in the human
genome/epdcx:valueString
/epdcx:statement
epdcx:statement
epdcx:propertyURI=http://purl.org/dc/terms/abstract;http://purl.org/dc/terms/abstract
epdcx:valueStringDispersed repeat elements contribute togenome
instability by de novo insertionand unequal recombination betweenrepeats. To
study the dynamics of theseprocesses, we have developed single DNAmolecule
approaches to detect de novoinsertions at a single locus and u-mediated
deletions at two differentloci in human genomic DNA. Validation experiments
showed these approaches could detect insertions and deletions atfrequencies
below 10(-6) per cell.However, bulk analysis of germline(sperm) and somatic DNA
showed noevidence for genuine mutant molecules,
Re: [Dspace-tech] help! migration causes slow loading of files
Hi all, I noticed someone else asked a similar question to mine (http://www.mail-archive.com/dspace-tech@lists.sourceforge.net/msg08681.html) recently. We're still stuck - we've tried to copy the assetstore over 2 times today to our new server to no avail. I've also tried to reindex, but that doesn't seem to affect my ability to view the files. Thanks in advance, Susan susan teague-rector wrote: Hi All, I migrated my database, assetstore application to a new server this morning (after doing a test migration last week) All seems great until I click on a pdf (or other file) in a record. The server just sits and spins and the file never opens. I've migrated to a new linux server with twice the amount of memory, so it seems like memory shouldn't be the problem. I'm not seeing anything at all in the error logs. I'm still running Dspace 1.4.1 Does anyone have any ideas what may have happened? Thanks so much, Susan -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Problem with Statistics [SEC=UNCLASSIFIED]
UNCLASSIFIED Thanks again Stuart, Problem being I overwrote those old html files trying to get it going. Oh well. Hamish IMPORTANT: This email remains the property of the Australian Defence Organisation and is subject to the jurisdiction of section 70 of the Crimes Act 1914. If you have received this email in error, you are requested to contact the sender and delete the email. From: Stuart Lewis [mailto:s.le...@auckland.ac.nz] Sent: Thursday, 3 September 2009 6:54 PM To: Brett, Hamish Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Problem with Statistics [SEC=UNCLASSIFIED] Hi Brett, I've not double-checked the behaviour recently, but I think the old reports (.html) files stay, so you can see older stats, but newer stats only contain data from the past few months rather than back to the inception of your installation. Thanks, Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: 64 9 373-7599 x81928 http://www.library.auckland.ac.nz/ On 3/09/2009, at 6:34 PM, Brett, Hamish wrote: UNCLASSIFIED Thankyou Stuart, Just to confirm, if what you say is happening all older stats other than what is being displayed have been lost. Regards, Hamish IMPORTANT: This email remains the property of the Australian Defence Organisation and is subject to the jurisdiction of section 70 of the Crimes Act 1914. If you have received this email in error, you are requested to contact the sender and delete the email. From: Stuart Lewis [mailto:s.le...@auckland.ac.nz] Sent: Thursday, 3 September 2009 3:21 PM To: Brett, Hamish Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Problem with Statistics [SEC=UNCLASSIFIED] Hi Brett, On 3/09/2009, at 4:34 PM, Brett, Hamish wrote: I am attempting to reconfigure our statistics. However when I run the required scripts I am not getting any stats older than 2 months ago. When I look in the .dat files in /dspace/log that have been generated they are almost except for the last 2 months empty even though a lot has occured for the last 3 years. I am pretty sure I have all the log files. I have only changed the date in the dstat.cfg file. An example of an empty dat file is below. Any advice for me I suspect what is happening is that your dspace.log.* files have rolled over their limit. In [dspace]/config/log4j.properties you can specify how many log files to keep, and how big each one can be before it rolls over. The default configuration is quite small (100 files at 1Mb each). So it sounds like you are getting through that many log files each 2 months. The problem with the stats module as it stands, is that despite creating .dat files for log files which have now rolled over and been lost, it recreates them all each time. This means you lose all the older stats. The easy short-term solution is to increase the size and/or number of log files that DSpace creates. The better solution would be for someone to look at making sure current .dat files are not overwritten by the stats system. However... the stat system is getting a complete rewrite in the upcoming 1.6 release, so a lot of people are waiting for that instead. I hope this helps, Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: 64 9 373-7599 x81928 http://www.library.auckland.ac.nz/ -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] help! migration causes slow loading of files
On 04/09/2009, at 6:08 AM, susan teague-rector wrote: All seems great until I click on a pdf (or other file) in a record. The server just sits and spins and the file never opens. Hi Susan, Assuming you click on a link to the pdf file in a record, what is the resulting URL? Does the new server replace the old server on the same ip-address and host name? Does the URL include a host name you expect? If it is a file system issue, you may want to find the tool to dump it's configured and running characteristics and confirm the combination is all OK. Try adding a pdf file directly to the file system to see if it will write as expected. Also check the logs for the stack of components (e.g. tomcat) and that the account permissions for the application and files are OK. You may also be able to use the mapping of the pdf file name to the assetstore's object path from details in the database and possibly look directly at that object on the file system to see if it is really there and available. Best wishes, Van Ly vly at usyd dot edu dot au -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
