[Dspace-tech] Moving Dspace Community position
Hi All I am in the process of moving position of our dspace community and I am using mirage theme, I want the communities to come first on dspace home page, currently when I open dspace url of my repository Welcome come first, Communities in DSpace comes second and Search Dspace comes last, I just want the Communities in DSpace to be on top. Your advise is appreciated. Thanks, Lewatle htmlpfont face = verdana size = 0.8 color = navyThis communication is intended for the addressee only. It is confidential. If you have received this communication in error, please notify us immediately and destroy the original message. You may not copy or disseminate this communication without the permission of the University. Only authorized signatories are competent to enter into agreements on behalf of the University and recipients are thus advised that the content of this message may not be legally binding on the University and may contain the personal views and opinions of the author, which are not necessarily the views and opinions of The University of the Witwatersrand, Johannesburg. All agreements between the University and outsiders are subject to South African Law unless the University agrees in writing to the contrary./font/p/html -- uberSVN's rich system and user administration capabilities and model configuration take the hassle out of deploying and managing Subversion and the tools developers use with it. Learn more about uberSVN and get a free download at: http://p.sf.net/sfu/wandisco-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Moving Dspace Community position
Just to add for clarity, the information from news-xmlui.xml file that appears on top of dspace home page by default I want it to appear on the bottom and on top I need to put Communities in DSpace. From: Lewatle Phaladi [mailto:lewatle.phal...@wits.ac.za] Sent: 22 August 2011 09:25 AM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Moving Dspace Community position Hi All I am in the process of moving position of our dspace community and I am using mirage theme, I want the communities to come first on dspace home page, currently when I open dspace url of my repository Welcome come first, Communities in DSpace comes second and Search Dspace comes last, I just want the Communities in DSpace to be on top. Your advise is appreciated. Thanks, Lewatle This communication is intended for the addressee only. It is confidential. If you have received this communication in error, please notify us immediately and destroy the original message. You may not copy or disseminate this communication without the permission of the University. Only authorized signatories are competent to enter into agreements on behalf of the University and recipients are thus advised that the content of this message may not be legally binding on the University and may contain the personal views and opinions of the author, which are not necessarily the views and opinions of The University of the Witwatersrand, Johannesburg. All agreements between the University and outsiders are subject to South African Law unless the University agrees in writing to the contrary. htmlpfont face = verdana size = 0.8 color = navyThis communication is intended for the addressee only. It is confidential. If you have received this communication in error, please notify us immediately and destroy the original message. You may not copy or disseminate this communication without the permission of the University. Only authorized signatories are competent to enter into agreements on behalf of the University and recipients are thus advised that the content of this message may not be legally binding on the University and may contain the personal views and opinions of the author, which are not necessarily the views and opinions of The University of the Witwatersrand, Johannesburg. All agreements between the University and outsiders are subject to South African Law unless the University agrees in writing to the contrary./font/p/html-- uberSVN's rich system and user administration capabilities and model configuration take the hassle out of deploying and managing Subversion and the tools developers use with it. Learn more about uberSVN and get a free download at: http://p.sf.net/sfu/wandisco-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] java.sql.SQLException: org.postgresql.util.PSQLException: ERROR: relation bi_5_dmap does not exist
Hi all, I try to delete items under 'Unfinished Submissions' and get the following message: java.sql.SQLException: org.postgresql.util.PSQLException: ERROR: relation bi_5_dmap does not exist. Any idea what is going on here? Thanks Ian PS. Dspace 1.6.2 with xmlui https://eric.exeter.ac.uk Ian Wellaway Senior System Support Development Officer Academic Systems Exeter IT Room 909, Laver Building University of Exeter EX4 4QE UK tel +44 1392 722852 -- uberSVN's rich system and user administration capabilities and model configuration take the hassle out of deploying and managing Subversion and the tools developers use with it. Learn more about uberSVN and get a free download at: http://p.sf.net/sfu/wandisco-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] java.sql.SQLException: org.postgresql.util.PSQLException: ERROR: relation bi_5_dmap does not exist
Hi Ian, Sounds like the browse configuration that your web app is running with is out of sync with the database and/or the dspace.cfg. I would restart your web application, and run a 'bin/dspace index-init -r' to complete recreate the browse tables. Regards, G On 22 August 2011 12:18, Wellaway, Ian i.j.wella...@exeter.ac.uk wrote: Hi all, ** ** I try to delete items under ‘Unfinished Submissions’ and get the following message: java.sql.SQLException: org.postgresql.util.PSQLException: ERROR: relation bi_5_dmap does not exist. ** ** Any idea what is going on here? ** ** Thanks ** ** Ian ** ** PS. Dspace 1.6.2 with xmlui ** ** https://eric.exeter.ac.uk ** ** ** ** ** ** Ian Wellaway Senior System Support Development Officer Academic Systems Exeter IT Room 909, Laver Building University of Exeter EX4 4QE UK tel +44 1392 722852 ** ** -- uberSVN's rich system and user administration capabilities and model configuration take the hassle out of deploying and managing Subversion and the tools developers use with it. Learn more about uberSVN and get a free download at: http://p.sf.net/sfu/wandisco-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- uberSVN's rich system and user administration capabilities and model configuration take the hassle out of deploying and managing Subversion and the tools developers use with it. Learn more about uberSVN and get a free download at: http://p.sf.net/sfu/wandisco-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Bad date problem in DSpace 1.7.1
Thanks, Mark. I will check if there is already a JIRA task or not. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: mdigg...@gmail.com [mailto:mdigg...@gmail.com] On Behalf Of Mark Diggory Sent: Friday, August 19, 2011 1:38 PM To: George S Kozak Cc: Thornton, Susan M. (LARC-B702)[LITES]; dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Bad date problem in DSpace 1.7.1 George, I would say that it could be more gracefully handled in the UI so that there are not parsing errors. But, the larger challenge is that its not a problem with the UI, the expectation is that the dates are ISO format, putting other values into that field is invalid. If anything were to be fixed, the fields should be properly typed and validated on submission / item edit / import to stop such values getting into there in the first place. I would recommend starting a JIRA task (if one does not already exist) about the topic if its something that you would like to see fixed in the future. Mark On Thu, Aug 18, 2011 at 11:48 AM, George S Kozak g...@cornell.edumailto:g...@cornell.edu wrote: Hi, Susan: I reported the same problem back in May. I was told to exported the metadata for the problem records and then reimport them after fixing them. That worked, but I never heard anyone saying that the problem was going to be fixed. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CULIT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924tel:607-255-8924 From: Thornton, Susan M. (LARC-B702)[LITES] [susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov] Sent: Thursday, August 18, 2011 12:13 PM To: dspace-tech@lists.sourceforge.netmailto:dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Bad date problem in DSpace 1.7.1 Hi, I am in the process of upgrading from DSpace 1.5.1 to 1.7.1. I am almost done and am running index-init, but I’ve just noticed a problem. With previous versions of DSpace, if a “bad” date was encountered in one of the date fields (issue date, accession date, publication date), DSpace just ignored it. Now, it seems it is unable to either display the Item page or the Browse screen if encounters one of these records. Here’s an example: One of our items has the following invalid issue and publication date that our Users have never gotten around to correcting: Washington, D.C. :1955. If I try to display the Item, the screen is blank and the following message displays in the dspace.log file: 2011-08-18 12:07:14,232 WARN org.dspace.content.DCDate @ Mangled date: Washington, D.C. :1955. ..failed all attempts to parse as date. The same message displays if I try to browse by issue date. I know the “right” thing to do is to clean up our data, but I also know we have quite a few of these old bad dates and am wondering why DSpace is now having a problem with it. Thanks, Sue Sue Walker-Thornton Software Developer/Database Administrator NASA Langley Research Center|LITES Contract SGT, Inc.|130 Research Drive Hampton, Va. 23666 Office: (757) 224-4074tel:%28757%29%20224-4074 Mobile: (757) 506-9903tel:%28757%29%20506-9903 Fax: (757) 224-4001tel:%28757%29%20224-4001 susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov -- Get a FREE DOWNLOAD! and learn more about uberSVN rich system, user administration capabilities and model configuration. Take the hassle out of deploying and managing Subversion and the tools developers use with it. http://p.sf.net/sfu/wandisco-d2d-2 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.netmailto:DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Mark R. Diggory @mire - www.atmire.comhttp://www.atmire.com/ 2888 Loker Avenue East - Suite 305 - Carlsbad - CA - 92010 Esperantolaan 4 - Heverlee 3001 - Belgium -- uberSVN's rich system and user administration capabilities and model configuration take the hassle out of deploying and managing Subversion and the tools developers use with it. Learn more about uberSVN and get a free download at: http://p.sf.net/sfu/wandisco-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Bad date problem in DSpace 1.7.1
Bram: Yes, this is exactly the problem that I am seeing and which (I think) Susan is reporting. Thanks for pointing this out to us. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: bluy...@gmail.com [mailto:bluy...@gmail.com] On Behalf Of Bram Luyten Sent: Friday, August 19, 2011 4:29 AM To: Thornton, Susan M. (LARC-B702)[LITES] Cc: George S Kozak; dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Bad date problem in DSpace 1.7.1 For what it's worth, this sounds related to this discussion here: https://jira.duraspace.org/browse/DS-815 If you have additional information I think it would be valuable if you could log it there as well. with kindest regards, Bram Luyten @mire Esperantolaan 4 - 3001 Heverlee - Belgium 2888 Loker Avenue East, Suite 305 - Carlsbad, CA 92010 - USA atmire.comhttp://atmire.com/ - Institutional Repository Solutions On Thu, Aug 18, 2011 at 10:39 PM, Thornton, Susan M. (LARC-B702)[LITES] susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov wrote: Thanks a bunch George. I heard from someone else who said they also had the same problem. Sue Sue Walker-Thornton Software Developer/Database Administrator NASA Langley Research Center|LITES Contract (757) 224-4074tel:%28757%29%20224-4074 -Original Message- From: George S Kozak [mailto:g...@cornell.edumailto:g...@cornell.edu] Sent: Thursday, August 18, 2011 2:48 PM To: Thornton, Susan M. (LARC-B702)[LITES]; dspace-tech@lists.sourceforge.netmailto:dspace-tech@lists.sourceforge.net Subject: RE: Bad date problem in DSpace 1.7.1 Hi, Susan: I reported the same problem back in May. I was told to exported the metadata for the problem records and then reimport them after fixing them. That worked, but I never heard anyone saying that the problem was going to be fixed. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CULIT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924tel:607-255-8924 From: Thornton, Susan M. (LARC-B702)[LITES] [susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov] Sent: Thursday, August 18, 2011 12:13 PM To: dspace-tech@lists.sourceforge.netmailto:dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Bad date problem in DSpace 1.7.1 Hi, I am in the process of upgrading from DSpace 1.5.1 to 1.7.1. I am almost done and am running index-init, but I've just noticed a problem. With previous versions of DSpace, if a bad date was encountered in one of the date fields (issue date, accession date, publication date), DSpace just ignored it. Now, it seems it is unable to either display the Item page or the Browse screen if encounters one of these records. Here's an example: One of our items has the following invalid issue and publication date that our Users have never gotten around to correcting: Washington, D.C. :1955. If I try to display the Item, the screen is blank and the following message displays in the dspace.log file: 2011-08-18 12:07:14,232 WARN org.dspace.content.DCDate @ Mangled date: Washington, D.C. :1955. ..failed all attempts to parse as date. The same message displays if I try to browse by issue date. I know the right thing to do is to clean up our data, but I also know we have quite a few of these old bad dates and am wondering why DSpace is now having a problem with it. Thanks, Sue Sue Walker-Thornton Software Developer/Database Administrator NASA Langley Research Center|LITES Contract SGT, Inc.|130 Research Drive Hampton, Va. 23666 Office: (757) 224-4074tel:%28757%29%20224-4074 Mobile: (757) 506-9903tel:%28757%29%20506-9903 Fax: (757) 224-4001tel:%28757%29%20224-4001 susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov -- Get a FREE DOWNLOAD! and learn more about uberSVN rich system, user administration capabilities and model configuration. Take the hassle out of deploying and managing Subversion and the tools developers use with it. http://p.sf.net/sfu/wandisco-d2d-2 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.netmailto:DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- uberSVN's rich system and user administration capabilities and model configuration take the hassle out of deploying and managing Subversion and the tools developers use with it. Learn more about uberSVN and get a free download at: http://p.sf.net/sfu/wandisco-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Adding Google search box to DSpace
I know that DSpace can be configured to be indexed for searching with Google Scholar, but has anyone attempted to put a Google Scholar search box inside a DSpace theme? Thanks, -Simon -- uberSVN's rich system and user administration capabilities and model configuration take the hassle out of deploying and managing Subversion and the tools developers use with it. Learn more about uberSVN and get a free download at: http://p.sf.net/sfu/wandisco-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Requesting Troubleshooting Suggestions - AIP Export Errors
Hi Patrick, On 8/19/2011 2:33 PM, Patrick Etienne wrote: To start, I should toss out a little system information: DSpace v. 1.7.2 Java version 1.6.0_26 PostgresSQL 8.4.7 All on the same RedHat box. Thanks! This all looks reasonable/normal. The next important detail is that I should have removed the manifestOnly option from the command as I've experienced the error with manifestOnly set to true as well as left out (defaulted to false). As a side note, this use of manifestOnly was more of an afterthought (I'd noted it's experimental nature), and I'm not certain that it actually does quite what I was looking for. My purpose is setting up instances with data so that I can fully test themes I'm building for various institutions, but I'm not really needing content files (bitstreams), just the communities, sub-communities, collections, item-pages, and /references/ to content files (having files or not doesn't really matter as much, but it'd be preferable to leave out the asset store). From the description in your email, it does sound indeed as though setting the manifestOnly option to true would be good for my use-case /as long as/ the feature was stable (which, as it has been said, it's not as of yet). But again, the manifestOnly option is not a priority (for me) at this point. OK, good to know. Yes, the manifestOnly option will not give you bitstreams (as you expected). It just includes metadata structure (communities/collections etc). However, as mentioned, it is still very experimental. I've admittedly never tried to migrate content using the manifestOnly option -- so, I'm not sure how stable the import will be. But, as the import isn't the problem right now...we can leave that for later. It sounds as though the next piece of the puzzle might be the database connection. The postgres service that I'm using for the instance(s) is on the same machine as the dspace instance(s). I think that eliminates network troubles as a potential cause (not that there couldn't be something else going on with the postgres service). Next up would be a little more detail concerning the behavior of the attempted command. The error does not happen immediately, it does run for a while before erroring out. snip After this I ended up shutting down all the tomcat instances save for the large one and also increased the db.maxconnections to 400 (just to give it a whirl). This seemed to allow the AIP export to go even longer before erroring out. Hmm..I wonder. From the reaction after increasing 'db.maxconnections', it sounds as though it could be that your DSpace is just running out of database connections (as though connections are not being closed properly). It's possible you are encountering this bug (which will be fixed in 1.8.0): https://jira.duraspace.org/browse/DS-930 The AIP Export uses the RoleCrosswalk listed in DS-930 (to export user permissions/groups into the DSPACE-ROLES schema). We realized there was a small bug in the RoleCrosswalk, where it wasn't closing its DB Connections properly. So, if you don't care whether you are moving user permissions/groups, you can turn off usage of the RoleCrosswalk by changing the following in your dspace.cfg. First, you'd want to turn off the DSPACE-ROLES schema export, by removing it from this line (also remove the comma) aip.disseminate.techMD = PREMIS, DSPACE-ROLES Second, you'd want to turn off the METSRIGHTS schema export, by removing it from this line (also remove the last comma) aip.disseminate.rightsMD = DSpaceDepositLicense:DSPACE_DEPLICENSE, \ CreativeCommonsRDF:DSPACE_CCRDF, CreativeCommonsText:DSPACE_CCTEXT, METSRIGHTS What this does is disables the export of users/groups (DSPACE-ROLES) and permissions (METSRIGHTS) in AIPs. WARNING: in most backup scenarios, you would NOT want to do this, as you cannot restore users/groups/permissions if they are not in the AIPs. However, for your purposes of moving around test content, you may not care whether users/groups/permissions are moved successfully. More info about DSPACE-ROLES and METSRIGHTS schemas can be found at: https://wiki.duraspace.org/display/DSDOC/DSpace+AIP+Format If you are encountering the DS-930 bug, disabling both DSPACE-ROLES and METSRIGHTS may actually allow the export to succeed. But, as stated, you won't have any user/groups/permissions info in your AIPs. So, when you re-import those AIPs, everything will just end up with generic default permissions (i.e. publicly accessible, but a System Administrator has rights to edit everything, etc) snip I discovered while tweaking with the database settings was that running the AIP export while tailing the log file showed that the org.postgresql.util.PSQLException popped up at least a few times for each AIP export I'd attempted to do. Is it that same PSQLException each time, with the same error message/description? Does it pop up for every item even when you bump up the
[Dspace-tech] Problem with index-init and filter-media in DSpace 1.7.1
We just went live with DSpace 1.7.1 in Production after upgrading from 1.5.1 to 1.7.1 and we’re having problems with both index-init and filter-media. Our indexes take about 5 hours to build and right at the end, both jobs fail with the following errors: request: http://oursite/solr/statistics/update?wt=javabinversion=1 2011-08-22 12:37:50,716 ERROR org.dspace.search.DSIndexer @ background merge hit exception: _u88:C181167 _u89:c1 _u8a:c20 _u8b:c20 _u8c:c20 _u8d:c18 into _u8e [optimize] [mergeDocStores] java.io.IOException: background merge hit exception: _u88:C181167 _u89:c1 _u8a:c20 _u8b:c20 _u8c:c20 _u8d:c18 into _u8e [optimize] [mergeDocStores] at org.apache.lucene.index.IndexWriter.optimize(IndexWriter.java:2908) at org.apache.lucene.index.IndexWriter.optimize(IndexWriter.java:2843) at org.apache.lucene.index.IndexWriter.optimize(IndexWriter.java:2813) at org.dspace.search.DSIndexer.optimizeIndex(DSIndexer.java:411) at org.dspace.search.DSIndexer.updateIndex(DSIndexer.java:588) at org.dspace.search.DSIndexer.updateIndex(DSIndexer.java:539) at org.dspace.app.mediafilter.MediaFilterManager.main(MediaFilterManager.java:381) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:183) Caused by: java.io.IOException: No space left on device at java.io.RandomAccessFile.writeBytes(Native Method) at java.io.RandomAccessFile.write(RandomAccessFile.java:466) at org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexOutput.flushBuffer(SimpleFSDirectory.java:192) at org.apache.lucene.store.BufferedIndexOutput.flushBuffer(BufferedIndexOutput.java:96) at org.apache.lucene.store.BufferedIndexOutput.flush(BufferedIndexOutput.java:85) at org.apache.lucene.store.BufferedIndexOutput.writeBytes(BufferedIndexOutput.java:75) at org.apache.lucene.store.IndexOutput.writeBytes(IndexOutput.java:43) at org.apache.lucene.index.CompoundFileWriter.copyFile(CompoundFileWriter.java:229) at org.apache.lucene.index.CompoundFileWriter.close(CompoundFileWriter.java:184) at org.apache.lucene.index.SegmentMerger.createCompoundFile(SegmentMerger.java:217) at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:5222) at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:4675) at org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:235) at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:291) 2011-08-22 12:37:51,072 ERROR org.dspace.kernel.DSpaceKernelManager @ WARN Failed to unregister the MBean: org.dspace:name=3ad4f6f8-7449-478d-99f5-10aa11360763,type=DSpaceKernel 2011-08-22 12:41:08,335 INFO org.dspace.app.webui.servlet.SimpleSearchServlet @ anonymous:session_id=8F2024E9D25A224752DAD674B3A38CA4:ip_addr=146.165.68.35:search:query=ca024312,results=(0,0,1) 2011-08-22 12:41:10,245 INFO org.dspace.usage.LoggerUsageEventListener @ anonymous:session_id=8F2024E9D25A224752DAD674B3A38CA4:ip_addr=146.165.68.35:view_item:handle=2121/337042 2011-08-22 12:41:10,274 ERROR org.dspace.statistics.SolrLoggerUsageEventListener @ Not found Not found request: http://oursite/solr/statistics/update?wt=javabinversion=1 I did some Googling and found something about maybe this is a problem with the indexes being accessed while being built…? If anyone can help, I would really appreciate it. Btw, we are running on Sun Solaris 10, PostgreSQL 8.2.5. Also, we have not implemented our statistics yet so I haven’t even started trying to figure out where the SOLR errors are coming from. Thanks, Sue Sue Walker-Thornton Software Developer/Database Administrator NASA Langley Research Center|LITES Contract SGT, Inc.|130 Research Drive Hampton, Va. 23666 Office: (757) 224-4074 Mobile: (757) 506-9903 Fax: (757) 224-4001 susan.m.thorn...@nasa.gov -- uberSVN's rich system and user administration capabilities and model configuration take the hassle out of deploying and managing Subversion and the tools developers use with it. Learn more about uberSVN and get a free download at: http://p.sf.net/sfu/wandisco-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Problem with index-init and filter-media in DSpace 1.7.1
Hi Susan, Do you have any disk space left on your hard disk where you run the indexing ? Kind regards, Kevin Van de Velde @mire Esperantolaan 4 - 3001 Heverlee - Belgium 2888 Loker Avenue East, Suite 305 - Carlsbad, CA 92010 - USA atmire.com - Institutional Repository Solutions On 22 August 2011 20:39, Thornton, Susan M. (LARC-B702)[LITES] susan.m.thorn...@nasa.gov wrote: We just went live with DSpace 1.7.1 in Production after upgrading from 1.5.1 to 1.7.1 and we’re having problems with both index-init and filter-media. Our indexes take about 5 hours to build and right at the end, both jobs fail with the following errors: ** ** request: http://oursite/solr/statistics/update?wt=javabinversion=1 2011-08-22 12:37:50,716 ERROR org.dspace.search.DSIndexer @ background merge hit exception: _u88:C181167 _u89:c1 _u8a:c20 _u8b:c20 _u8c:c20 _u8d:c18 into _u8e [optimize] [mergeDocStores] java.io.IOException: background merge hit exception: _u88:C181167 _u89:c1 _u8a:c20 _u8b:c20 _u8c:c20 _u8d:c18 into _u8e [optimize] [mergeDocStores]* *** at org.apache.lucene.index.IndexWriter.optimize(IndexWriter.java:2908) at org.apache.lucene.index.IndexWriter.optimize(IndexWriter.java:2843) at org.apache.lucene.index.IndexWriter.optimize(IndexWriter.java:2813) at org.dspace.search.DSIndexer.optimizeIndex(DSIndexer.java:411) at org.dspace.search.DSIndexer.updateIndex(DSIndexer.java:588)** ** at org.dspace.search.DSIndexer.updateIndex(DSIndexer.java:539)** ** at org.dspace.app.mediafilter.MediaFilterManager.main(MediaFilterManager.java:381) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)** ** at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:183) Caused by: java.io.IOException: No space left on device at java.io.RandomAccessFile.writeBytes(Native Method) at java.io.RandomAccessFile.write(RandomAccessFile.java:466) at org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexOutput.flushBuffer(SimpleFSDirectory.java:192) at org.apache.lucene.store.BufferedIndexOutput.flushBuffer(BufferedIndexOutput.java:96) at org.apache.lucene.store.BufferedIndexOutput.flush(BufferedIndexOutput.java:85) at org.apache.lucene.store.BufferedIndexOutput.writeBytes(BufferedIndexOutput.java:75) at org.apache.lucene.store.IndexOutput.writeBytes(IndexOutput.java:43) at org.apache.lucene.index.CompoundFileWriter.copyFile(CompoundFileWriter.java:229) at org.apache.lucene.index.CompoundFileWriter.close(CompoundFileWriter.java:184) at org.apache.lucene.index.SegmentMerger.createCompoundFile(SegmentMerger.java:217) at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:5222) at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:4675) at org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:235) at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:291) 2011-08-22 12:37:51,072 ERROR org.dspace.kernel.DSpaceKernelManager @ WARN Failed to unregister the MBean: org.dspace:name=3ad4f6f8-7449-478d-99f5-10aa11360763,type=DSpaceKernel 2011-08-22 12:41:08,335 INFO org.dspace.app.webui.servlet.SimpleSearchServlet @ anonymous:session_id=8F2024E9D25A224752DAD674B3A38CA4:ip_addr=146.165.68.35: search:query=ca024312,results=(0,0,1) 2011-08-22 12:41:10,245 INFO org.dspace.usage.LoggerUsageEventListener @ anonymous:session_id=8F2024E9D25A224752DAD674B3A38CA4:ip_addr=146.165.68.35: view_item:handle=2121/337042 2011-08-22 12:41:10,274 ERROR org.dspace.statistics.SolrLoggerUsageEventListener @ Not found ** ** Not found ** ** request: http://oursite/solr/statistics/update?wt=javabinversion=1 ** ** ** ** I did some Googling and found something about maybe this is a problem with the indexes being accessed while being built…? ** ** If anyone can help, I would really appreciate it. ** ** Btw, we are running on Sun Solaris 10, PostgreSQL 8.2.5. Also, we have not implemented our statistics yet so I haven’t even started trying to figure out where the SOLR errors are coming from. ** ** Thanks, Sue * * * * *Sue Walker-Thornton* *Software Developer/Database Administrator* *NASA Langley Research Center|LITES Contract* *SGT, Inc.|130 Research Drive*
Re: [Dspace-tech] Adding Google search box to DSpace
Haven't tried it myself, but should be definitely doable. Here's a service where you can generate a google scholar search box: https://services.google.com/inquiry/scholar_email?hl=en If you want to limit the search to the content of your own site, you'll have to pass the argument site:domain name with kindest regards, Bram Luyten @mire Esperantolaan 4 - 3001 Heverlee - Belgium 2888 Loker Avenue East, Suite 305 - Carlsbad, CA 92010 - USA atmire.com - Institutional Repository Solutions On Mon, Aug 22, 2011 at 7:57 PM, Brown, Simon Contractor, Digital Consulting Services scbr...@nps.edu wrote: I know that DSpace can be configured to be indexed for searching with Google Scholar, but has anyone attempted to put a Google Scholar search box inside a DSpace theme? Thanks, -Simon -- uberSVN's rich system and user administration capabilities and model configuration take the hassle out of deploying and managing Subversion and the tools developers use with it. Learn more about uberSVN and get a free download at: http://p.sf.net/sfu/wandisco-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- uberSVN's rich system and user administration capabilities and model configuration take the hassle out of deploying and managing Subversion and the tools developers use with it. Learn more about uberSVN and get a free download at: http://p.sf.net/sfu/wandisco-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Requesting Troubleshooting Suggestions - AIP Export Errors
Tim, Thanks so much! This is wonderful information. I really appreciate your taking the time to write all this up. I'm going to be looking into the things you mentioned here and do a little exploring to see if I can eliminate the problem or at least use this information to narrow down even further what is really going on. I likely won't email back about it for perhaps two weeks (other things going on), but I'll certainly get back to you with whatever information that I'm able that might help toward the stability of the AIP tool. Thanks again! - Patrick On Mon, Aug 22, 2011 at 2:09 PM, Tim Donohue tdono...@duraspace.org wrote: Hi Patrick, On 8/19/2011 2:33 PM, Patrick Etienne wrote: To start, I should toss out a little system information: DSpace v. 1.7.2 Java version 1.6.0_26 PostgresSQL 8.4.7 All on the same RedHat box. Thanks! This all looks reasonable/normal. The next important detail is that I should have removed the manifestOnly option from the command as I've experienced the error with manifestOnly set to true as well as left out (defaulted to false). As a side note, this use of manifestOnly was more of an afterthought (I'd noted it's experimental nature), and I'm not certain that it actually does quite what I was looking for. My purpose is setting up instances with data so that I can fully test themes I'm building for various institutions, but I'm not really needing content files (bitstreams), just the communities, sub-communities, collections, item-pages, and /references/ to content files (having files or not doesn't really matter as much, but it'd be preferable to leave out the asset store). From the description in your email, it does sound indeed as though setting the manifestOnly option to true would be good for my use-case /as long as/ the feature was stable (which, as it has been said, it's not as of yet). But again, the manifestOnly option is not a priority (for me) at this point. OK, good to know. Yes, the manifestOnly option will not give you bitstreams (as you expected). It just includes metadata structure (communities/collections etc). However, as mentioned, it is still very experimental. I've admittedly never tried to migrate content using the manifestOnly option -- so, I'm not sure how stable the import will be. But, as the import isn't the problem right now...we can leave that for later. It sounds as though the next piece of the puzzle might be the database connection. The postgres service that I'm using for the instance(s) is on the same machine as the dspace instance(s). I think that eliminates network troubles as a potential cause (not that there couldn't be something else going on with the postgres service). Next up would be a little more detail concerning the behavior of the attempted command. The error does not happen immediately, it does run for a while before erroring out. snip After this I ended up shutting down all the tomcat instances save for the large one and also increased the db.maxconnections to 400 (just to give it a whirl). This seemed to allow the AIP export to go even longer before erroring out. Hmm..I wonder. From the reaction after increasing 'db.maxconnections', it sounds as though it could be that your DSpace is just running out of database connections (as though connections are not being closed properly). It's possible you are encountering this bug (which will be fixed in 1.8.0): https://jira.duraspace.org/**browse/DS-930https://jira.duraspace.org/browse/DS-930 The AIP Export uses the RoleCrosswalk listed in DS-930 (to export user permissions/groups into the DSPACE-ROLES schema). We realized there was a small bug in the RoleCrosswalk, where it wasn't closing its DB Connections properly. So, if you don't care whether you are moving user permissions/groups, you can turn off usage of the RoleCrosswalk by changing the following in your dspace.cfg. First, you'd want to turn off the DSPACE-ROLES schema export, by removing it from this line (also remove the comma) aip.disseminate.techMD = PREMIS, DSPACE-ROLES Second, you'd want to turn off the METSRIGHTS schema export, by removing it from this line (also remove the last comma) aip.disseminate.rightsMD = DSpaceDepositLicense:DSPACE_**DEPLICENSE, \ CreativeCommonsRDF:DSPACE_**CCRDF, CreativeCommonsText:DSPACE_**CCTEXT, METSRIGHTS What this does is disables the export of users/groups (DSPACE-ROLES) and permissions (METSRIGHTS) in AIPs. WARNING: in most backup scenarios, you would NOT want to do this, as you cannot restore users/groups/permissions if they are not in the AIPs. However, for your purposes of moving around test content, you may not care whether users/groups/permissions are moved successfully. More info about DSPACE-ROLES and METSRIGHTS schemas can be found at: https://wiki.duraspace.org/**display/DSDOC/DSpace+AIP+**Formathttps://wiki.duraspace.org/display/DSDOC/DSpace+AIP+Format If you are
Re: [Dspace-tech] duplicate key errors..
Kevin, It sounds like somehow your database handle sequence has gotten messed up. This sequence is used to assign the next handle (and it just increments by one each time). It sounds like it may be attempting to assign a handle that already exists. If that's the case, running the following database script should fix things: [dspace]/etc/postgres/update-sequences.sql All that script does is ensure all the Database sequences are set to the next available value. -Tim On Thursday, August 18, 2011 1:35:14 PM, Kevin P. Foote wrote: Hello all Working on (still) upgrading our dspace from 1.3.SOMETHING to 1.7.1 ... I'm getting some data moved over to the new host using the methods that are outlined on this page[1]. This seems to be working for the most part. However, I'm now trying to create a new temporary category for something else and I'm getting the error below: --- org.postgresql.util.PSQLException: ERROR: duplicate key value violates unique constraint handle_handle_key --- The full stack page is viewable here[2]. Additionally I have a general inquiry about importing items into dspace. When you import an item into dspace it is given a unique content identifier (number) within that particular dspace system .. correct? So their should be no conflicts with items I've already imported or trying to create new content. [1] http://wiki.lib.sun.ac.za/index.php/SUNScholar/Asset_Import_and_Export [2] http://www.people.iup.edu/kpfoote/stuff/dspace-stack.html -- thanks kevin.foote -- Get a FREE DOWNLOAD! and learn more about uberSVN rich system, user administration capabilities and model configuration. Take the hassle out of deploying and managing Subversion and the tools developers use with it. http://p.sf.net/sfu/wandisco-d2d-2 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- uberSVN's rich system and user administration capabilities and model configuration take the hassle out of deploying and managing Subversion and the tools developers use with it. Learn more about uberSVN and get a free download at: http://p.sf.net/sfu/wandisco-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Requesting Troubleshooting Suggestions - AIP Export Errors
Patrick, Sounds good. Let us know what you find out. If you notice any other oddity/issue, we'll definitely want to get it resolved for 1.8.0. Also, if you find DS-930 is the cause, you could also just patch your local code with the patch that is attached to DS-930. It's literally a one-line fix to the RoleCrosswalk.java class. So, it's up to you if you'd rather turn off the RoleCrosswalk (as described in the previous email) or just apply the patch to fix it so that it properly closes its database connections. Good luck, - Tim On Monday, August 22, 2011 2:37:13 PM, Patrick Etienne wrote: Tim, Thanks so much! This is wonderful information. I really appreciate your taking the time to write all this up. I'm going to be looking into the things you mentioned here and do a little exploring to see if I can eliminate the problem or at least use this information to narrow down even further what is really going on. I likely won't email back about i t for perhaps two weeks (other things going on), but I'll certainly get back to you with whatever information that I'm able that might help toward the stability of the AIP tool. Thanks again! - Patrick On Mon, Aug 22, 2011 at 2:09 PM, Tim Donohue tdono...@duraspace.org mailto:tdono...@duraspace.org wrote: Hi Patrick, On 8/19/2011 2:33 PM, Patrick Etienne wrote: To start, I should toss out a little system information: DSpace v. 1.7.2 Java version 1.6.0_26 PostgresSQL 8.4.7 All on the same RedHat box. Thanks! This all looks reasonable/normal. The next important detail is that I should have removed the manifestOnly option from the command as I've experienced the error with manifestOnly set to true as well as left out (defaulted to false). As a side note, this use of manifestOnly was more of an aftertho ught (I'd noted it's experimental nature), and I'm not certain that it actually does quite what I was looking for. My purpose is setting up instances with data so that I can fully test themes I'm building for various institutions, but I'm not really needing content files (bitstreams), just the communities, sub-communities, collections, item-pages, and /references/ to content files (having files or not doesn't really matter as much, but it'd be preferable to leave out the asset store). From the description in your email, it does sound indeed as though setting the manifestOnly option to true would be good for my use-case /as long as/ the feature was stable (which, as it has been said, it's not as of yet). But again, the manifestOnly option is not a priority (for me) at this point. OK, good to know. Yes, t he manifestOnly option will not give you bitstreams (as you expected). It just includes metadata structure (communities/collections etc). However, as mentioned, it is still very experimental. I've admittedly never tried to migrate content using the manifestOnly option -- so, I'm not sure how stable the import will be. But, as the import isn't the problem right now...we can leave that for later. It sounds as though the next piece of the puzzle might be the database connection. The postgres service that I'm using for the instance(s) is on the same machine as the dspace instance(s). I think that eliminates network troubles as a potential cause (not that there couldn't be something else going on with the postgres service). Next up would be a little more detail concerning the behavior of the attempted command. The error does no t happen immediately, it does run for a while before erroring out. snip After this I ended up shutting down all the tomcat instances save for the large one and also increased the db.maxconnections to 400 (just to give it a whirl). This seemed to allow the AIP export to go even longer before erroring out. Hmm..I wonder. From the reaction after increasing 'db.maxconnections', it sounds as though it could be that your DSpace is just running out of database connections (as though connections are not being closed properly). It's possible you are encountering this bug (which will be fixed in 1.8.0): https://jira.duraspace.org/__browse/DS-930 https://jira.duraspace.org/browse/DS-930 The AIP Export uses the RoleCrosswalk listed in DS-930 (to export user permissions/groups into the DSPACE-ROLES schema). We realized there was a small bug in the RoleCrosswalk, where it wasn't closing its DB Connections properly. So, if you don't care whether you are moving user
Re: [Dspace-tech] Adding Google search box to DSpace
There doesn't appear to be a scholar API, so you're either bound to screen-scraping the requests, or showing an iframe of scholar. But Bram is spot on with passing site: to your search to get just your content. Peter Dietz On Mon, Aug 22, 2011 at 4:07 PM, Bram Luyten b...@mire.be wrote: Haven't tried it myself, but should be definitely doable. Here's a service where you can generate a google scholar search box: https://services.google.com/inquiry/scholar_email?hl=en If you want to limit the search to the content of your own site, you'll have to pass the argument site:domain name with kindest regards, Bram Luyten @mire Esperantolaan 4 - 3001 Heverlee - Belgium 2888 Loker Avenue East, Suite 305 - Carlsbad, CA 92010 - USA atmire.com - Institutional Repository Solutions On Mon, Aug 22, 2011 at 7:57 PM, Brown, Simon Contractor, Digital Consulting Services scbr...@nps.edu wrote: I know that DSpace can be configured to be indexed for searching with Google Scholar, but has anyone attempted to put a Google Scholar search box inside a DSpace theme? Thanks, -Simon -- uberSVN's rich system and user administration capabilities and model configuration take the hassle out of deploying and managing Subversion and the tools developers use with it. Learn more about uberSVN and get a free download at: http://p.sf.net/sfu/wandisco-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- uberSVN's rich system and user administration capabilities and model configuration take the hassle out of deploying and managing Subversion and the tools developers use with it. Learn more about uberSVN and get a free download at: http://p.sf.net/sfu/wandisco-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- uberSVN's rich system and user administration capabilities and model configuration take the hassle out of deploying and managing Subversion and the tools developers use with it. Learn more about uberSVN and get a free download at: http://p.sf.net/sfu/wandisco-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Adding Google search box to DSpace
Thank you Bram and Peter. From your response, I'm now contemplating the value of a simple Didn't find what you're looking for? Try Google Scholar [search box] type line somewhere that makes sense. From: Peter Dietz [pdiet...@gmail.com] Sent: Monday, August 22, 2011 2:29 PM To: Bram Luyten Cc: Brown, Simon Contractor, Digital Consulting Services; dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Adding Google search box to DSpace There doesn't appear to be a scholar API, so you're either bound to screen-scraping the requests, or showing an iframe of scholar. But Bram is spot on with passing site: to your search to get just your content. Peter Dietz On Mon, Aug 22, 2011 at 4:07 PM, Bram Luyten b...@mire.bemailto:b...@mire.be wrote: Haven't tried it myself, but should be definitely doable. Here's a service where you can generate a google scholar search box: https://services.google.com/inquiry/scholar_email?hl=en If you want to limit the search to the content of your own site, you'll have to pass the argument site:domain name with kindest regards, Bram Luyten @mire Esperantolaan 4 - 3001 Heverlee - Belgium 2888 Loker Avenue East, Suite 305 - Carlsbad, CA 92010 - USA atmire.comhttp://atmire.com/ - Institutional Repository Solutions On Mon, Aug 22, 2011 at 7:57 PM, Brown, Simon Contractor, Digital Consulting Services scbr...@nps.edumailto:scbr...@nps.edu wrote: I know that DSpace can be configured to be indexed for searching with Google Scholar, but has anyone attempted to put a Google Scholar search box inside a DSpace theme? Thanks, -Simon -- uberSVN's rich system and user administration capabilities and model configuration take the hassle out of deploying and managing Subversion and the tools developers use with it. Learn more about uberSVN and get a free download at: http://p.sf.net/sfu/wandisco-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.netmailto:DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- uberSVN's rich system and user administration capabilities and model configuration take the hassle out of deploying and managing Subversion and the tools developers use with it. Learn more about uberSVN and get a free download at: http://p.sf.net/sfu/wandisco-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.netmailto:DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- uberSVN's rich system and user administration capabilities and model configuration take the hassle out of deploying and managing Subversion and the tools developers use with it. Learn more about uberSVN and get a free download at: http://p.sf.net/sfu/wandisco-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
