[Dspace-tech] index-all script
Hi all. We need to re-index all the content of our Dspaces instalation. We have a quite big assetstore (about 80 GB) and I guess it would take some time to complete the task. Is it neccesary to stop Tomcat server to run the index-init script?. Would everything work in Dspace as usual during the reindex process? Thank's. Regards. Manu -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] index-all script
Hi Manu For me it worked well and I believe even for you it will work, inside my bin directory I have used index-init after restoring my database dump and linking my assetstore to the right PATH as well as setting up the handle server again. I never stopped Tomcat but after running index-init I have restarted the Tomcat and everything applied. Regards, Lewatle From: ManuMohedano [mailto:manumohed...@usal.es] Sent: 19 April 2010 01:09 PM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] index-all script Hi all. We need to re-index all the content of our Dspaces instalation. We have a quite big assetstore (about 80 GB) and I guess it would take some time to complete the task. Is it neccesary to stop Tomcat server to run the index-init script?. Would everything work in Dspace as usual during the reindex process? Thank's. Regards. Manu htmlpfont face = verdana size = 0.8 color = navyThis communication is intended for the addressee only. It is confidential. If you have received this communication in error, please notify us immediately and destroy the original message. You may not copy or disseminate this communication without the permission of the University. Only authorized signatories are competent to enter into agreements on behalf of the University and recipients are thus advised that the content of this message may not be legally binding on the University and may contain the personal views and opinions of the author, which are not necessarily the views and opinions of The University of the Witwatersrand, Johannesburg. All agreements between the University and outsiders are subject to South African Law unless the University agrees in writing to the contrary./font/p/html -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] index-all script
For me it worked well and I believe even for you it will work, inside my bin directory I have used index-init after restoring my database dump and linking my assetstore to the right PATH as well as setting up the handle server again. I never stopped Tomcat but after running index-init I have restarted the Tomcat and everything applied. ++1 -- With Regards, Gaurav Paliwal http://gaurav.tk Undergraduate Student GGSIPU http://www.ipu.ac.in/ ( Govt. of NCT , India ) -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] index-all script
Thanks for the reply Lewatle. Regards. Manu. On Mon, Apr 19, 2010 at 1:54 PM, Lewatle Phaladi lewatle.phal...@wits.ac.za wrote: Hi Manu For me it worked well and I believe even for you it will work, inside my bin directory I have used index-init after restoring my database dump and linking my assetstore to the right PATH as well as setting up the handle server again. I never stopped Tomcat but after running index-init I have restarted the Tomcat and everything applied. Regards, Lewatle *From:* ManuMohedano [mailto:manumohed...@usal.es] *Sent:* 19 April 2010 01:09 PM *To:* dspace-tech@lists.sourceforge.net *Subject:* [Dspace-tech] index-all script Hi all. We need to re-index all the content of our Dspaces instalation. We have a quite big assetstore (about 80 GB) and I guess it would take some time to complete the task. Is it neccesary to stop Tomcat server to run the index-init script?. Would everything work in Dspace as usual during the reindex process? Thank's. Regards. Manu This communication is intended for the addressee only. It is confidential. If you have received this communication in error, please notify us immediately and destroy the original message. You may not copy or disseminate this communication without the permission of the University. Only authorized signatories are competent to enter into agreements on behalf of the University and recipients are thus advised that the content of this message may not be legally binding on the University and may contain the personal views and opinions of the author, which are not necessarily the views and opinions of The University of the Witwatersrand, Johannesburg. All agreements between the University and outsiders are subject to South African Law unless the University agrees in writing to the contrary. -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Index-all taking a long time.
Recently we had a citation where our postgres db was consuming our space allocation of 30 GB. This did not seem right, and we realized that we had never run vacuum --full. When this was run, tons of memory was freed-up. Today, I'm running index-all, and the portion that Indexes all items in Dspace... has been running now for close to 4 hours. Last week when I ran index-all, this portion of the script took about 1 hour to run. I'm getting a bit concerned. Does this make sense to any one? Unfortunately, when this portion of index-all runs there are no writes to log the file ( I have INFO set, not DEBUG ), so I have no idea if things are progressing smoothly or not. Thanks for any thoughts on this. Jose - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] index-all (Can't load configuration)
I have try to upgraded from 1.3.2 to 1.4.2 , but when I execute index-all command. I keep on getting the following exception: === Creating browse index Indexing all Items in DSpaceFATAL: Can't load configuration sun.io.MalformedInputException at sun.io.ByteToCharUTF8.convert(ByteToCharUTF8.java(Compiled Code)) at sun.nio.cs.StreamDecoder$ConverterSD.convertInto (StreamDecoder.java:2 87) at sun.nio.cs.StreamDecoder$ConverterSD.implRead (StreamDecoder.java:337) at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:223) at java.io.InputStreamReader.read(InputStreamReader.java:208) at java.io.BufferedReader.fill(BufferedReader.java(Compiled Code)) at java.io.BufferedReader.readLine(BufferedReader.java(Compiled Code)) at java.io.BufferedReader.readLine(BufferedReader.java:379) at org.dspace.core.ConfigurationManager.loadConfig (ConfigurationManager. java:521) at org.dspace.core.ConfigurationManager.getProperty (ConfigurationManager .java:113) at org.dspace.storage.rdbms.DatabaseManager.initialize (DatabaseManager.j ava:1607) at org.dspace.storage.rdbms.DatabaseManager.getConnection (DatabaseManage r.java:715) at org.dspace.core.Context.init(Context.java:105) at org.dspace.browse.InitializeBrowse.main(InitializeBrowse.java:73) Error: Browse index NOT created java.sql.SQLException: java.lang.RuntimeException: Cannot find dspace.cfg at org.dspace.storage.rdbms.DatabaseManager.initialize (DatabaseManager.j ava:1724) at org.dspace.storage.rdbms.DatabaseManager.getConnection (DatabaseManage r.java:715) at org.dspace.core.Context.init(Context.java:105) at org.dspace.browse.InitializeBrowse.main(InitializeBrowse.java:73) Creating search index FATAL: Can't load configuration sun.io.MalformedInputException at sun.io.ByteToCharUTF8.convert(ByteToCharUTF8.java(Compiled Code)) at sun.nio.cs.StreamDecoder$ConverterSD.convertInto (StreamDecoder.java:2 87) at sun.nio.cs.StreamDecoder$ConverterSD.implRead (StreamDecoder.java:337) at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:223) at java.io.InputStreamReader.read(InputStreamReader.java:208) at java.io.BufferedReader.fill(BufferedReader.java(Compiled Code)) at java.io.BufferedReader.readLine(BufferedReader.java(Compiled Code)) at java.io.BufferedReader.readLine(BufferedReader.java:379) at org.dspace.core.ConfigurationManager.loadConfig (ConfigurationManager. java:521) at org.dspace.core.ConfigurationManager.getProperty (ConfigurationManager .java:113) at org.dspace.search.DSIndexer.clinit(DSIndexer.java:116) === Has anyone encountered this before? Thanks . - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Index-all error
Im trying to run index-all on brand new Dspace 1.4.2 installation with only few test items in it. I get this error when running, what could be causing it? Creating browse index Indexing all Items in DSpace ... Done Creating search index Exception in thread main java.lang.NullPointerException: value cannot be null at org.apache.lucene.document.Field.init(Field.java:188) at org.apache.lucene.document.Field.init(Field.java:164) at org.dspace.search.DSIndexer.buildDocument(DSIndexer.java:890) at org.dspace.search.DSIndexer.createIndex(DSIndexer.java:383) at org.dspace.search.DSIndexer.main(DSIndexer.java:547) -Mika - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] index-all out of memory error
Hi Steve Here's some info from the system docs which may pertain to you: ## Tomcat should be run with the following environment variable set, to ensure that Unicode is handled properly. Also, the default JVM memory heap sizes are rather small. Adjust -Xmx512M (512Mb maximum heap size) and -Xms64M (64Mb Java thread stack size) to suit your hardware. JAVA_OPTS=-Xmx512M -Xms64M -Dfile.encoding=UTF-8 ### Also, this wiki page may help: http://wiki.dspace.org/index.php/HowToPerformanceTuneForDspace The JAVA_OPTS configuration seemed to work for us. We changed the value in $TOMCAT_HOME/bin/catalina.sh, bumped it up to 1024 and haven't had any problems since. Cheers Gary Gary Browne Development Programmer Library IT Services University of Sydney Australia ph: 61-2-9351 5946 -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Steve Thomas Sent: Friday, 1 June 2007 1:08 PM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] index-all out of memory error Hi. I'm trying to re-build our indexes, and find that index-all is failing with this message: Exception in thread main java.lang.OutOfMemoryError: Java heap space Any ideas as to a solution? (Was working OK until last night.) Thanks, Steve Stephen Thomas, Senior Systems Analyst, University of Adelaide Library UNIVERSITY OF ADELAIDE SA 5005 AUSTRALIA Phone: +61 8 830 35190 Fax: +61 8 830 34369 Email: [EMAIL PROTECTED] URL: http://www.adelaide.edu.au/directory/stephen.thomas CRICOS Provider Number 00123M --- This email message is intended only for the addressee(s) and contains information that may be confidential and/or copyright. If you are not the intended recipient please notify the sender by reply email and immediately delete this email. Use, disclosure or reproduction of this email by anyone other than the intended recipient(s) is strictly prohibited. No representation is made that this email or any attachments are free of viruses. Virus scanning is recommended and is the responsibility of the recipient. - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] index-all out of memory error
Hi. I'm trying to re-build our indexes, and find that index-all is failing with this message: Exception in thread main java.lang.OutOfMemoryError: Java heap space Any ideas as to a solution? (Was working OK until last night.) Thanks, Steve Stephen Thomas, Senior Systems Analyst, University of Adelaide Library UNIVERSITY OF ADELAIDE SA 5005 AUSTRALIA Phone: +61 8 830 35190 Fax: +61 8 830 34369 Email: [EMAIL PROTECTED] URL: http://www.adelaide.edu.au/directory/stephen.thomas CRICOS Provider Number 00123M --- This email message is intended only for the addressee(s) and contains information that may be confidential and/or copyright. If you are not the intended recipient please notify the sender by reply email and immediately delete this email. Use, disclosure or reproduction of this email by anyone other than the intended recipient(s) is strictly prohibited. No representation is made that this email or any attachments are free of viruses. Virus scanning is recommended and is the responsibility of the recipient. - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] index-all
I think you should shutdown DSpace. I have an script which do index all and then start dspace. Always I do a change I run my script On 3/7/07, wroldfie [EMAIL PROTECTED] wrote: When I run the index-all script should I shutdown DSpace first? Thanks. Bill William Oldfield Networked Information Research Associate University of Waterloo Library 519-888-4567 Ext 32461 - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] index-all
Hello William, it is not necessary to shutdown DSpace for running [dspace]/bin/index-all. Claudia When I run the index-all script should I shutdown DSpace first? Thanks. Bill William Oldfield Networked Information Research Associate University of Waterloo Library 519-888-4567 Ext 32461 - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
