Re: [Dspace-tech] DSpace 1.4.2 Browse performance issues
Sue, You are right both about the performance of browse in 1.4.2, and the problems that you will have trying to limit the number of rows considered by the query. The real problem with the query is the use of the DISTINCT view (note that the 'where sort_author' part outside of the view in your rewritten query shouldn't make any difference - the improvement is all coming from restricting the number of rows that are considered in the DISTINCT query). Now, the good news as far as DSpace is concerned is that all of this has been completely replaced in 1.5, and retrieving the author list does not use similar DISTINCT queries. I don't know what amount of customisations you have, but it's likely that upgrading to 1.5 would be the path of least resistance, and you'll gain a number of additional new features. If you must stick with 1.4.2, then I would suggest that you create a 'materialized view' in postgres that just contains the distinct rows from ItemsByAuthor, and replace the '(SELECT DISTINCT * from ItemsByAuthor) distinct_view' with the materialized view. This page: http://jonathangardner.net/tech/w/PostgreSQL/Materialized_Views contains information on how you can create a materialized view / table using triggers (probably shouldn't use the entirely general purpose triggers presented there - make them specific to handling the ItemsByAuthor table, and ensure that you have an index on sort_author on the created table). G Thornton, Susan M. (LARC-B702)[NCI INFORMATION SYSTEMS] wrote: We are experiencing very poor performance with our DSpace Browses (DSpace 1.4.2/postgreSQL 8.2/Solaris 10). I’ve spent the past day looking at code and experimenting with queries and explains and I’ve got a good idea of a sql query modification I could make to drastically improve performance – I’m not just quite sure how to accomplish it without disrupting other DSpace code and functionality. Here’s an example: I’ve been looking at the */itemsbyauthor /*table. Ours contains 94,401 rows. Here is the DSpace query that clicking on the browse-items-by-author link generates: *select distinct author, sort_author* * from (SELECT DISTINCT * from ItemsByAuthor ) distinct_view* * order by sort_author LIMIT 21* * * and here is the Explain from executing the query against our database: Limit (cost=28209.73..28211.30 rows=21 width=64) (actual time=8382.920..8384.061 rows=21 loops=1) - Unique (cost=28209.73..28917.73 rows=9441 width=64) (actual time=8382.915..8384.045 rows=21 loops=1) - Sort (cost=28209.73..28445.73 rows=94401 width=64) (actual time=8382.910..8383.992 rows=56 loops=1) Sort Key: sort_author, author - Subquery Scan distinct_view (cost=14410.61..16534.63 rows=94401 width=64) (actual time=385.620..671.460 rows=94401 loops=1) - Unique (cost=14410.61..15590.62 rows=94401 width=42) (actual time=385.611..603.050 rows=94401 loops=1) - Sort (cost=14410.61..14646.61 rows=94401 width=42) (actual time=385.605..504.765 rows=94401 loops=1) Sort Key: items_by_author_id, item_id, author, sort_author - Seq Scan on itemsbyauthor (cost=0.00..3383.01 rows=94401 width=42) (actual time=19.232..113.700 rows=94401 loops=1) Total runtime: 8384.581 ms Basically, a Sequential Scan is being done against the itemsbyauthor table and the index is not being used. (By the way, the response time was around 25 seconds last night prior to running a vacuum and reindex! – Terrible!!) Here’s my idea: if I could somehow capture an alphabetic range to use in a where clause, based on what the User clicks on, I could add a “where” clause to the query which would force postgreSQL to use the index, “sort_author_idx”, and the elapsed time that it would take to execute the query would be a fraction of what it’s taking now. For instance, if I knew the User was starting the browse from the letter “B” (I know this is oversimplifying, but you’ll get the idea), I could structure the query as follows: *select distinct author,sort_author from (SELECT DISTINCT * from ItemsByAuthor where sort_author 'a' and sort_author 'c' ) distinct_view * *where sort_author 'a' and sort_author 'c'* *order by sort_author LIMIT 21* Look at the explain from this query, below and just look at the difference in performance! From 8.4 seconds to 1.3 seconds!! Limit (cost=6544.60..6546.17 rows=21 width=64) (actual time=1253.393..1253.710 rows=21 loops=1) - Unique (cost=6544.60..6650.94 rows=1418 width=64) (actual time=1253.388..1253.696 rows=21 loops=1) - Sort (cost=6544.60..6580.04 rows=14179 width=64) (actual time=1253.382..1253.641 rows=56 loops=1) Sort Key: sort_author, author - Subquery Scan distinct_view (cost=4663.32..4982.35 rows=14179 width=64) (actual time=113.859..145.529 rows=11463 loops=1) - Unique (cost=4663.32..4840.56 rows=14179 width=42) (actual time=113.852..137.697 rows=11463 loops=1) - Sort (cost=4663.32..4698.77
[Dspace-tech] problem with apache-tomcat-5.5.17
Dear all, I have installed Dspace on windows and it works when I browse http://127.0.0.1:8080/dspace but it doesn't work with http://localhost:8080/dspace and http:// my IP address:8080/dspace.any one can help me? I am using apache-tomcat-5.5.17. Thank U - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] java.net.UnknownHostException
java.net.UnknownHostException: owasvr.staff.uniten.local Check connectivity to the relevant port on this machine from wherever DSpace is running. cheers, Jim On Fri, Aug 08, 2008 at 12:24:44AM +, Mohamad Asmawi Bin Abdul Rahman wrote: This is what I took from Java Full stacktrace: org.apache.cocoon.ProcessingException: Error calling continuation at resource://aspects/EPerson/eperson.js:108:-1 at map:call - resource://aspects/EPerson/sitemap.xmap:96:36 at map:mount - file:/C:/Tomcat 5.5/webapps/xmlui/aspects/aspects.xmap:119:72 at map:mount - file:/C:/Tomcat 5.5/webapps/xmlui/sitemap.xmap:276:80 at map:serialize - resource://aspects/Submission/sitemap.xmap:326:27 at map:generate - resource://aspects/Submission/sitemap.xmap:302:26 at map:serialize type=xml - file:/C:/Tomcat 5.5/webapps/xmlui/aspects/aspects.xmap:115:34 at map:transform type=PageNotFound - file:/C:/Tomcat 5.5/webapps/xmlui/aspects/aspects.xmap:114:43 at map:generate - file:/C:/Tomcat 5.5/webapps/xmlui/aspects/aspects.xmap:113:22 at map:serialize type=xhtml - file:/C:/Tomcat 5.5/webapps/xmlui/themes/Reference/sitemap.xmap:184:34 at map:transform type=NamespaceFilter - file:/C:/Tomcat 5.5/webapps/xmlui/themes/Reference/sitemap.xmap:181:84 at map:transform type=NamespaceFilter - file:/C:/Tomcat 5.5/webapps/xmlui/themes/Reference/sitemap.xmap:180:78 at map:transform type=i18n - file:/C:/Tomcat 5.5/webapps/xmlui/themes/Reference/sitemap.xmap:174:33 at map:transform - file:/C:/Tomcat 5.5/webapps/xmlui/themes/Reference/sitemap.xmap:170:44 at map:transform type=IncludePageMeta - file:/C:/Tomcat 5.5/webapps/xmlui/themes/Reference/sitemap.xmap:155:45 at map:generate type=file - file:/C:/Tomcat 5.5/webapps/xmlui/themes/Reference/sitemap.xmap:131:55 at map:mount - file:/C:/Tomcat 5.5/webapps/xmlui/themes/themes.xmap:63:45 at map:mount - file:/C:/Tomcat 5.5/webapps/xmlui/sitemap.xmap:325:73 at org.apache.cocoon.ProcessingException.throwLocated(ProcessingException.j ava:144) at org.apache.cocoon.components.flow.javascript.LocationTrackingDebugger.ge tException(LocationTrackingDebugger.java:131) at org.apache.cocoon.components.flow.javascript.fom.FOM_JavaScriptInterpret er.handleContinuation(FOM_JavaScriptInterpreter.java:855) at org.apache.cocoon.components.treeprocessor.sitemap.CallFunctionNode.invo ke(CallFunctionNode.java:123) at org.apache.cocoon.components.treeprocessor.AbstractParentProcessingNode. invokeNodes(AbstractParentProcessingNode.java:46) at org.apache.cocoon.components.treeprocessor.sitemap.MatchNode.invoke(Matc hNode.java:107) at org.apache.cocoon.components.treeprocessor.AbstractParentProcessingNode. invokeNodes(AbstractParentProcessingNode.java:46) at org.apache.cocoon.components.treeprocessor.sitemap.PreparableMatchNode.i nvoke(PreparableMatchNode.java:130) at org.apache.cocoon.components.treeprocessor.AbstractParentProcessingNode. invokeNodes(AbstractParentProcessingNode.java:68) at org.apache.cocoon.components.treeprocessor.sitemap.PipelineNode.invoke(P ipelineNode.java:142) at org.apache.cocoon.components.treeprocessor.AbstractParentProcessingNode. invokeNodes(AbstractParentProcessingNode.java:68) at org.apache.cocoon.components.treeprocessor.sitemap.PipelinesNode.invoke( PipelinesNode.java:92) at org.apache.cocoon.components.treeprocessor.ConcreteTreeProcessor.process (ConcreteTreeProcessor.java:234) at org.apache.cocoon.components.treeprocessor.ConcreteTreeProcessor.buildPi peline(ConcreteTreeProcessor.java:192) at org.apache.cocoon.components.treeprocessor.TreeProcessor.buildPipeline(T reeProcessor.java:265) at org.apache.cocoon.components.treeprocessor.sitemap.MountNode.invoke(Moun tNode.java:110) at org.apache.cocoon.components.treeprocessor.AbstractParentProcessingNode. invokeNodes(AbstractParentProcessingNode.java:68) at org.apache.cocoon.components.treeprocessor.sitemap.SelectNode.invoke(Sel ectNode.java:102) at org.apache.cocoon.components.treeprocessor.AbstractParentProcessingNode. invokeNodes(AbstractParentProcessingNode.java:46) at org.apache.cocoon.components.treeprocessor.sitemap.MatchNode.invoke(Matc hNode.java:107) at org.apache.cocoon.components.treeprocessor.AbstractParentProcessingNode. invokeNodes(AbstractParentProcessingNode.java:68) at org.apache.cocoon.components.treeprocessor.sitemap.PipelineNode.invoke(P ipelineNode.java:142) at org.apache.cocoon.components.treeprocessor.AbstractParentProcessingNode. invokeNodes(AbstractParentProcessingNode.java:68) at org.apache.cocoon.components.treeprocessor.sitemap.PipelinesNode.invoke( PipelinesNode.java:92) at
[Dspace-tech] Ldap on dspace 1.4.2 and manakin.
Are there any issues with ldap on dspace 1.4.2 and manakin ? It doens't seem to work. I get a null pointer exception. It works fine in jspui. /Klaus -- View this message in context: http://www.nabble.com/Ldap-on-dspace-1.4.2-and-manakin.-tp18892032p18892032.html Sent from the DSpace - Tech mailing list archive at Nabble.com. - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] ItemImport
Hi Jose: Looks like the doc is a little behind the code - you might have noticed the thread where we are trying to rationalize the documentation process. For now, the ItemImporter code is your best bet. But yes, the Bitstream description can be added as you suggest, but note that the '\t' really refers to a tab separation in the import file, not the literal token '\t'. Hope this helps, Richard On Fri, 2008-08-08 at 10:54 -0400, Blanco, Jose wrote: I remember seeing that in 1.5 when using the item importer you can pass in a file description, and perhaps even permission info, but I can't find the documentation. From looking at the code, it seems that to put in a file description, the following must be added to the line listing the file: \tdescription: Your description. Is this right? Is there documentation on this? Thanks! Jose - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] ItemImport
Thanks for verifying this. Jose -Original Message- From: Richard Rodgers [mailto:[EMAIL PROTECTED] Sent: Friday, August 08, 2008 11:23 AM To: Blanco, Jose Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] ItemImport Hi Jose: Looks like the doc is a little behind the code - you might have noticed the thread where we are trying to rationalize the documentation process. For now, the ItemImporter code is your best bet. But yes, the Bitstream description can be added as you suggest, but note that the '\t' really refers to a tab separation in the import file, not the literal token '\t'. Hope this helps, Richard On Fri, 2008-08-08 at 10:54 -0400, Blanco, Jose wrote: I remember seeing that in 1.5 when using the item importer you can pass in a file description, and perhaps even permission info, but I can't find the documentation. From looking at the code, it seems that to put in a file description, the following must be added to the line listing the file: \tdescription: Your description. Is this right? Is there documentation on this? Thanks! Jose -- --- This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] ItemImport
Jose, You are correct about both file descriptions and access restrictions for the batch ItemImporter. In the example below, you will find: 1)The bitstream being imported, 2)The bundle it is placed into, 3)Permissions restricted to Administrator only, and 4)A description of the file. AI010.jpg '\t' bundle:ORIGINAL '\t' permissions:-r Administrator '\t' description:Archival Master As Richard noted '\t' is a tab-delimiter. Make sure 'bundle' is lower case, and if you are adding an item to a preexisting bundle (e.g. THUMBNAIL) make sure it is in upper case. It's also worth noting the 'description' information is displayed under the Edit This Item--Item Bitstream tab, not in the DC metadata. Hope this helps, John Davison Ohio Digital Resource Commons -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Blanco, Jose Sent: Friday, August 08, 2008 11:14 AM To: Richard Rodgers Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] ItemImport Thanks for verifying this. Jose -Original Message- From: Richard Rodgers [mailto:[EMAIL PROTECTED] Sent: Friday, August 08, 2008 11:23 AM To: Blanco, Jose Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] ItemImport Hi Jose: Looks like the doc is a little behind the code - you might have noticed the thread where we are trying to rationalize the documentation process. For now, the ItemImporter code is your best bet. But yes, the Bitstream description can be added as you suggest, but note that the '\t' really refers to a tab separation in the import file, not the literal token '\t'. Hope this helps, Richard On Fri, 2008-08-08 at 10:54 -0400, Blanco, Jose wrote: I remember seeing that in 1.5 when using the item importer you can pass in a file description, and perhaps even permission info, but I can't find the documentation. From looking at the code, it seems that to put in a file description, the following must be added to the line listing the file: \tdescription: Your description. Is this right? Is there documentation on this? Thanks! Jose -- --- This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] ItemImport
First, this is awesome, props to the devs! I've been wanting bitstream descriptions in batch imports for a long time. Second, I have a possibly-stupid question... On Fri, Aug 8, 2008 at 11:54 AM, John Davison [EMAIL PROTECTED] wrote: Jose, You are correct about both file descriptions and access restrictions for the batch ItemImporter. In the example below, you will find: 1)The bitstream being imported, 2)The bundle it is placed into, 3)Permissions restricted to Administrator only, and 4)A description of the file. AI010.jpg '\t' bundle:ORIGINAL '\t' permissions:-r Administrator '\t' description:Archival Master Is this line parsed such that bits of it can be omitted? For example, if I'm fine with whatever permissions the collection would normally assign, but I have a description to add, can I leave the permissions: segment out? Alternately, is there a keyword for default permissions? Dorothea -- Dorothea Salo [EMAIL PROTECTED] Digital Repository Librarian AIM: mindsatuw University of Wisconsin Rm 218, Memorial Library (608) 262-5493 - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] ItemImport
Dorothea- Props to devs indeed. I think Mark Diggory and Christine Moulen pointed this out to me late last year. We've been using it ever since. Regarding line parsing, yes you can use this to simply add descriptions. Your 'contents' manifest would look like this: AI010.jpg '\t' description:Archival Master -John -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Dorothea Salo Sent: Friday, August 08, 2008 1:11 PM To: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] ItemImport First, this is awesome, props to the devs! I've been wanting bitstream descriptions in batch imports for a long time. Second, I have a possibly-stupid question... On Fri, Aug 8, 2008 at 11:54 AM, John Davison [EMAIL PROTECTED] wrote: Jose, You are correct about both file descriptions and access restrictions for the batch ItemImporter. In the example below, you will find: 1)The bitstream being imported, 2)The bundle it is placed into, 3)Permissions restricted to Administrator only, and 4)A description of the file. AI010.jpg '\t' bundle:ORIGINAL '\t' permissions:-r Administrator '\t' description:Archival Master Is this line parsed such that bits of it can be omitted? For example, if I'm fine with whatever permissions the collection would normally assign, but I have a description to add, can I leave the permissions: segment out? Alternately, is there a keyword for default permissions? Dorothea -- Dorothea Salo [EMAIL PROTECTED] Digital Repository Librarian AIM: mindsatuw University of Wisconsin Rm 218, Memorial Library (608) 262-5493 - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Problem with ant fresh_install
Dear All, I installed all required software's for Dspace, but at the time of ant fresh_install I am facing the problem. errer report is : build fail build.xml dos not exist. Pl help any one Thanks Venkat Narayana Asst Librarian S.V.Engineeirng College Suryapet Unlimited freedom, unlimited storage. Get it now, on http://help.yahoo.com/l/in/yahoo/mail/yahoomail/tools/tools-08.html/- This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Problem with ant fresh_install
Hi! this link may be of help. Probably it could be because of the PATH variable. http://ardb4.ncsi.iisc.ernet.in/dspace/dspacewindows.htm Jayan -Original Message- From: [EMAIL PROTECTED] on behalf of thandu venkat narayana Sent: Sat 8/9/2008 8:20 AM To: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Problem with ant fresh_install Dear All, I installed all required software's for Dspace, but at the time of ant fresh_install I am facing the problem. errer report is : build fail build.xml dos not exist. Pl help any one Thanks Venkat Narayana Asst Librarian S.V.Engineeirng College Suryapet Unlimited freedom, unlimited storage. Get it now, on http://help.yahoo.com/l/in/yahoo/mail/yahoomail/tools/tools-08.html/ - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
