[Dspace-tech] Upload of files larger then 2 GB
Dear all, I tried to submit a file larger then 2 GB but it is not possible using the Web-Interface. As far as I know it is not a limit by DSpace, nor HTML, Browser or HTTP. May be it is a Web server limit? Since files with such a size will be an exception an an upload limit is a good barrier for misuse it is ok for us. But I'd like to know how we can add this file to DSpace, given the situation I have it on DVD or on the local file system? Had someone developed a solution for this situation? Best regards Robert -- === Robert Roggenbuck Universitaetsbibliothek Osnabrueck Germany === - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] DSpace database migration from Postgres to Oracle
Hi Shaun, We are actually in the middle of this process and thought we had succeeded until it has come about that our ORACLE instance is setup with latin ISO8859 rather than UTF and believe this is why our import has not worked correctly for our eastern European characters. Everything else is fine. For the moment we have a mixture of western and eastern European characters and had no problem in Postgres. We used Pentaho for the import (You can download this). We did the following: 1. Create db using the database_schema.sql 2. Disable constraints 3. Import data (We used pentaho and can send you the import schema) 4. Enable constraints 5. reset seunces running script (updated version attached which drops and recreates the sequences and sets them correctly). 6. Move/Copy the assetstore under new DSPACE home directory, no change required. 7. remove null data from metadatavalue, itemsbytitle, itemsbyauthor 8. Run a modified installation of DPSACE which only installs front end and runs indexing on DB without any database setup etc. (modified build.xml attached) Watch out for already raised issue: format the db.url like this in the dspace.cfg: db.url = jdbc:oracle:thin:@//host:port/dspace as opposed to the Install doc which lists: db.url = jdbc.oracle.thin:@//host:port/dspace Hope this helps Gabrielle Horan. From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Shaun Burriss Sent: 26 November 2007 01:08 To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] DSpace database migration from Postgres to Oracle Hello DSpace group. We are wanting to move our repository from the Postgres database to an Oracle database, and would like some guidance for this process. We originally had DSpace 1.4.1 and wanted to do this migration, but waited for 1.4.2 as it was said this version had better Oracle support. We would like to get an estimate of how long this process could take, and a general outline of the steps required. At present our idea of this process is to take an SQL dump of the Postgres database and load this dump (with some steps in between?) into Oracle. It is the intermediate steps that we are unsure about. I have heard that we may need some tools, or make some changes to ensure everything loads into Oracle smoothly. Also, we would like to know if any changes to the assets (assetstore) structure would be required? Any help on this would be appreciated. Regards, Shaun. Swinburne University of Technology CRICOS Provider Code: 00111D NOTICE This e-mail and any attachments are confidential and intended only for the use of the addressee. They may contain information that is privileged or protected by copyright. If you are not the intended recipient, any dissemination, distribution, printing, copying or use is strictly prohibited. The University does not warrant that this e-mail and any attachments are secure and there is also a risk that it may be corrupted in transmission. It is your responsibility to check any attachments for viruses or defects before opening them. If you have received this transmission in error, please contact us on +61 3 9214 8000 and delete it immediately from your system. We do not accept liability in connection with computer virus, data corruption, delay, interruption, unauthorised access or unauthorised amendment. Please consider the environment before printing this email. update-sequences-updated.sql Description: update-sequences-updated.sql ?xml version=1.0? !-- - Copyright (c) 2002, Hewlett-Packard Company and Massachusetts - Institute of Technology. All rights reserved. - - Redistribution and use in source and binary forms, with or without - modification, are permitted provided that the following conditions are - met: - - - Redistributions of source code must retain the above copyright - notice, this list of conditions and the following disclaimer. - - - Redistributions in binary form must reproduce the above copyright - notice, this list of conditions and the following disclaimer in the - documentation and/or other materials provided with the distribution. - - - Neither the name of the Hewlett-Packard Company nor the name of the - Massachusetts Institute of Technology nor the names of their - contributors may be used to endorse or promote products derived from - this software without specific prior written permission. - - THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS - ``AS IS'' AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT - LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR - A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT - HOLDERS OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, - INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, - BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS - OF
Re: [Dspace-tech] Upload of files larger then 2 GB
Hi Robert, Have you set the upload.max setting in dspace.cfg to a negative number (or bigger than 2 Gigs)? By default this setting has an upload limit of 512MB. You can disable the limit by setting it to upload.max=-1. Kyle -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Robert Roggenbuck Sent: November 26, 2007 7:07 AM To: dspace-tech@lists.sourceforge.net Tech Subject: [Dspace-tech] Upload of files larger then 2 GB Dear all, I tried to submit a file larger then 2 GB but it is not possible using the Web-Interface. As far as I know it is not a limit by DSpace, nor HTML, Browser or HTTP. May be it is a Web server limit? Since files with such a size will be an exception an an upload limit is a good barrier for misuse it is ok for us. But I'd like to know how we can add this file to DSpace, given the situation I have it on DVD or on the local file system? Had someone developed a solution for this situation? Best regards Robert -- === Robert Roggenbuck Universitaetsbibliothek Osnabrueck Germany === -- --- This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Upload of files larger then 2 GB
Hi Kyle, Thaks to the hint. I did not changed the standard setting: it still 512MB. When I try to upload a 1 GB file, the submit-process starts to work but ends up on a white page (with the tomcat-favicon at the URL instead of the DSpace one). additionally I have entries in the dspace.log with a clear error message that I exceed the configured upload limit. But when I try it with a 2 GB file the situation is different: there is no reaction at the browser (with firefox and IE) or it crashes (Konquerer) and there are no entries in the dspace.log, nor in any tomcat- or system-log. As far as I understood the 2 GB limit is known to the DSpace delelopers and outside or there realm (http://wiki.dspace.org/index.php/ArchReviewNotes). Since the 2 GB limit is ok for us I will look for an alternative to the upload via HTTP. Greetings Robert --- Kyle Brentnell schrieb: Hi Robert, Have you set the upload.max setting in dspace.cfg to a negative number (or bigger than 2 Gigs)? By default this setting has an upload limit of 512MB. You can disable the limit by setting it to upload.max=-1. Kyle -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Robert Roggenbuck Sent: November 26, 2007 7:07 AM To: dspace-tech@lists.sourceforge.net Tech Subject: [Dspace-tech] Upload of files larger then 2 GB Dear all, I tried to submit a file larger then 2 GB but it is not possible using the Web-Interface. As far as I know it is not a limit by DSpace, nor HTML, Browser or HTTP. May be it is a Web server limit? Since files with such a size will be an exception an an upload limit is a good barrier for misuse it is ok for us. But I'd like to know how we can add this file to DSpace, given the situation I have it on DVD or on the local file system? Had someone developed a solution for this situation? Best regards Robert -- === Robert Roggenbuck Universitaetsbibliothek Osnabrueck Germany === - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Upload of files larger then 2 GB
Robert, One alternative that works well for us is the ItemImport program. On the DSpace server create a directory with the large content file, a contents file listing the name of that file, and a simple XML file (dublin_core.xml) with the metadata. See section 7.4.4 of the DSpace 1.4.1 beta 1 System Documentation. -Don On Mon, November 26, 2007 8:46 am, Robert Roggenbuck wrote: Hi Kyle, Thaks to the hint. I did not changed the standard setting: it still 512MB. When I try to upload a 1 GB file, the submit-process starts to work but ends up on a white page (with the tomcat-favicon at the URL instead of the DSpace one). additionally I have entries in the dspace.log with a clear error message that I exceed the configured upload limit. But when I try it with a 2 GB file the situation is different: there is no reaction at the browser (with firefox and IE) or it crashes (Konquerer) and there are no entries in the dspace.log, nor in any tomcat- or system-log. As far as I understood the 2 GB limit is known to the DSpace delelopers and outside or there realm (http://wiki.dspace.org/index.php/ArchReviewNotes). Since the 2 GB limit is ok for us I will look for an alternative to the upload via HTTP. Greetings Robert --- Kyle Brentnell schrieb: Hi Robert, Have you set the upload.max setting in dspace.cfg to a negative number (or bigger than 2 Gigs)? By default this setting has an upload limit of 512MB. You can disable the limit by setting it to upload.max=-1. Kyle -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Robert Roggenbuck Sent: November 26, 2007 7:07 AM To: dspace-tech@lists.sourceforge.net Tech Subject: [Dspace-tech] Upload of files larger then 2 GB Dear all, I tried to submit a file larger then 2 GB but it is not possible using the Web-Interface. As far as I know it is not a limit by DSpace, nor HTML, Browser or HTTP. May be it is a Web server limit? Since files with such a size will be an exception an an upload limit is a good barrier for misuse it is ok for us. But I'd like to know how we can add this file to DSpace, given the situation I have it on DVD or on the local file system? Had someone developed a solution for this situation? Best regards Robert -- === Robert Roggenbuck Universitaetsbibliothek Osnabrueck Germany === - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] [Dspace-general] Dspace 1.5 - test community administrator
Hi Roberta, what do you mean for community administrator? DSpace have not out-of-box a similar role, have you used my patch Community Admin? Andrea Roberta Caccialupi ha scritto: Hi, we are testing Dspace 1.5 alpha and have a question about the community administration. The last Dspace version allowed to the community administrator to create new collections, manage item's permissions, etc. On the contrary with the new version only the system administrator can do it. We would ask you if it is the new policy, and in this case if it is possible to restore the previous functionality. Thank you Best regards Roberta Caccialupi - Roberta Caccialupi Centro di Produzione Multimediale Università degli Studi di Milano Bicocca V.le dell'Innovazione, 10 Edificio U9 I-20125 Milano Tel: +39 02 6448.7458 www.cpm.unimib.it ___ Dspace-general mailing list [EMAIL PROTECTED] http://mailman.mit.edu/mailman/listinfo/dspace-general -- Dott. Andrea Bollini Responsabile tecnico sviluppo e formazione applicativi JAVA Sezione Servizi per le Biblioteche e l'Editoria Elettronica CILEA, http://www.cilea.it tel. +39 06-59292831 cel. +39 348-8277525 - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Upload of files larger then 2 GB
Dear Jayan, I agree that this must be a possible way. But I do not know how to update an existing metadata record using the BatchItemImport and XSLTIngest. Adding to a collection works well. But in the description of the DIM-format there seems to be no possibility to include the ID of an already existing record. but at the Wiki-page about BatchItemImport it is written that update is possible. @Christophe Dupriez: Did You forgot to document an ID-attribute for the DIM? Best regards Robert - Jayan Chirayath Kurian schrieb: will it work will batch import i.e using itemimport - just a thought Cheers! Jayan From: [EMAIL PROTECTED] on behalf of Robert Roggenbuck Sent: Mon 11/26/2007 8:07 PM To: dspace-tech@lists.sourceforge.net Tech Subject: [Dspace-tech] Upload of files larger then 2 GB Dear all, I tried to submit a file larger then 2 GB but it is not possible using the Web-Interface. As far as I know it is not a limit by DSpace, nor HTML, Browser or HTTP. May be it is a Web server limit? Since files with such a size will be an exception an an upload limit is a good barrier for misuse it is ok for us. But I'd like to know how we can add this file to DSpace, given the situation I have it on DVD or on the local file system? Had someone developed a solution for this situation? Best regards Robert -- === Robert Roggenbuck Universitaetsbibliothek Osnabrueck Germany === - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] streaming video?
Naveed, We're doing something similar, not using DSpace to store the video but to store a pointer to the streaming server instead. We use a RAM formatted file, but SMIL would work the same. Here's an example: http://www.kumc.edu/archie/handle/2271/192 Jason Message: 1 Date: Sun, 25 Nov 2007 21:06:46 + From: NS Hashmi, Information Systems and Computing [EMAIL PROTECTED] Subject: Re: [Dspace-tech] streaming video? To: dspace-tech@lists.sourceforge.net Message-ID: [EMAIL PROTECTED] Content-Type: text/plain; charset=us-ascii; format=flowed Hi, do you have a demo in action? I assume 'actual stream' refers to the file prior to becoming a bitstream located in the asset store? For info :- http://wiki.dspace.org/index.php/SymlinkDSpace Naveed Date: Fri, 23 Nov 2007 10:08:34 -0500 From: Mark H. Wood [EMAIL PROTECTED] Subject: Re: [Dspace-tech] streaming video? To: dspace-tech@lists.sourceforge.net Message-ID: [EMAIL PROTECTED] Content-Type: text/plain; charset=us-ascii I've tinkered a bit with storing an item consisting of a SMIL document that points at the actual stream. I got it to work but we haven't used this in production yet. -- Jason Stirnaman OME/Biomedical Digital Projects Librarian A.R. Dykes Library The University of Kansas Medical Center Kansas City, Kansas Work: 913-588-7319 Email: [EMAIL PROTECTED] - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] [Dspace-general] Dspace 1.5 - test communityadministrator
This is a related question. If a user belongs to a group that has REMOVE,ADD,WRITE, and READ permissions on a community, should the person be able to create sub-communities and collections within that community? We have found that it is possible with the JSP interface, but when using the Manakin interface, the user is told that s/he does not have permissions for these actions. I personally would like for this to be possible. This would let us give persons full control over a community on our shared test/training server, without giving them full administrative privileges. Keith Gilbertson Systems Developer OhioLINK -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Andrea Bollini Sent: Monday, November 26, 2007 9:00 AM To: Roberta Caccialupi Cc: DSpace Tech; [EMAIL PROTECTED] Subject: Re: [Dspace-tech] [Dspace-general] Dspace 1.5 - test communityadministrator Hi Roberta, what do you mean for community administrator? DSpace have not out-of-box a similar role, have you used my patch Community Admin? Andrea Roberta Caccialupi ha scritto: Hi, we are testing Dspace 1.5 alpha and have a question about the community administration. The last Dspace version allowed to the community administrator to create new collections, manage item's permissions, etc. On the contrary with the new version only the system administrator can do it. We would ask you if it is the new policy, and in this case if it is possible to restore the previous functionality. Thank you Best regards Roberta Caccialupi - Roberta Caccialupi Centro di Produzione Multimediale Università degli Studi di Milano Bicocca V.le dell'Innovazione, 10 Edificio U9 I-20125 Milano Tel: +39 02 6448.7458 www.cpm.unimib.it ___ Dspace-general mailing list [EMAIL PROTECTED] http://mailman.mit.edu/mailman/listinfo/dspace-general -- Dott. Andrea Bollini Responsabile tecnico sviluppo e formazione applicativi JAVA Sezione Servizi per le Biblioteche e l'Editoria Elettronica CILEA, http://www.cilea.it tel. +39 06-59292831 cel. +39 348-8277525 - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] streaming video?
Agree completely. Ideally, the video would be served and streamed from DSpace, or maybe the streaming server setup as a SRB. Jason On 11/26/2007 at 9:55 AM, in message [EMAIL PROTECTED], Shane Beers [EMAIL PROTECTED] wrote: I have run into this need at our university as well, and the only really proper solution (in my opinion, of course) is one that would store the bitstream of the actual video in the repository. One of the most fundamental parts of a repository is that the data bitstreams are archived and managed in a central location. By having something like a .ram file which points to an external server, or an .html file that loads up the streaming media, this circumvents that management and can potentially lead to nearly useless records in the repository, even with the best intentions of the current managers of the various servers that store the media. It's essentially creating the same kinds of issues that the current web URL standards do - broken links due to server name changes and external reliances. In my view, a well-managed DSpace repository should avoid these issues by storing all the bitstreams within the repository itself. Shane Beers Digital Repository Services Librarian George Mason University [EMAIL PROTECTED] 703-993-3742 On Nov 26, 2007, at 9:52 AM, Jason Stirnaman wrote: Naveed, We're doing something similar, not using DSpace to store the video but to store a pointer to the streaming server instead. We use a RAM formatted file, but SMIL would work the same. Here's an example: http://www.kumc.edu/archie/handle/2271/192 Jason Message: 1 Date: Sun, 25 Nov 2007 21:06:46 + From: NS Hashmi, Information Systems and Computing [EMAIL PROTECTED] Subject: Re: [Dspace-tech] streaming video? To: dspace-tech@lists.sourceforge.net Message-ID: [EMAIL PROTECTED] Content-Type: text/plain; charset=us-ascii; format=flowed Hi, do you have a demo in action? I assume 'actual stream' refers to the file prior to becoming a bitstream located in the asset store? For info :- http://wiki.dspace.org/index.php/SymlinkDSpace Naveed Date: Fri, 23 Nov 2007 10:08:34 -0500 From: Mark H. Wood [EMAIL PROTECTED] Subject: Re: [Dspace-tech] streaming video? To: dspace-tech@lists.sourceforge.net Message-ID: [EMAIL PROTECTED] Content-Type: text/plain; charset=us-ascii I've tinkered a bit with storing an item consisting of a SMIL document that points at the actual stream. I got it to work but we haven't used this in production yet. -- Jason Stirnaman OME/Biomedical Digital Projects Librarian A.R. Dykes Library The University of Kansas Medical Center Kansas City, Kansas Work: 913-588-7319 Email: [EMAIL PROTECTED] - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] External database authentication in dspace
Yes, but this would require a bit of programming on your part. Because these are systems with custom protocols and implementation, you would need to implement your own AuthenticationMethod that would bridge the gap between the two systems allowing credentials/tokens/ cookies from the system to be mapped to an eperson account in DSpace. Sorry, the documentation is a little messy and out of date in this area. Cheers, Mark On Nov 26, 2007, at 1:42 AM, Mohammad Ehtesham wrote: Hello, Can we have “External database authentication” or single sign-on feature in dspace? For i.e.: If we are using some CMS or LMS like Joomla or Moodle and some easy link is embedded and once the user clicks on the link the user’s login authentication should pass on to the dspace also. In simple words: We are looking to make a secure link to dspace from within our LMS, with the same sign-on. With Regards, Mohammad Ehtesham - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] administering many DSpace/manakin instances
Does anyone have any experience and/or advice on administering multiple installations of DSpace/Manakin applications? Our plan is to have about a dozen installations of the DSpace and Manakin web applications by early Spring, and then build up to approximately 100 installations as they are needed. Each installation will belong to a separate institution or organization, typically an academic library. We will be performing customizations to the software. Some customizations will apply only to an individual instance; others will be global. We will also need a way to search/browse for items globally across all instances. It's likely that we'll collect OAI/PMH records into an external tool to implement the global search. I'm interested in collecting information about memory/disk cache requirements, any tools that have been developed for applying updates and customizations to multiple instances of the web applications, and any changes to tools, handle servers, etc. that are necessary/helpful for this type of setup. I recently saw an example of a multiple institution repository that is running under a single instance of the application here: http://dspace.nitle.org/ (NITLE DSpace Service ). Managing multiple institutions under a single instance of the DSpace application is an interesting approach. It looks like it would simplify administration for the developers and engineers, make global search work automatically, and possibly reduce system requirements. I'm not sure that it would work in our situation here, though, for several reasons: 1. Customizations. We're unsure specifically which customizations each institution will need, and we may not be able to implement a customization for one institution without affecting another if they're running in the same application space. 2. Control. Our goal is to give each institution as much control over their space as possible, and we're not sure that we'd be able to do this if they all shared the same application space. One example is that we've had problems giving institution heads control to add subcommunities/collections to a community in Manakin, without giving them full administrative access to the system. If each institution owned their own instance, we'd avoid this problem, and possibly other unknown issues. 3. Scalability. How much load can a single set of DSpace/Manakin web applications handle? If necessary, does the DSpace application cluster well? If clustered, would the clustered applications still talk to a single database, or should the database also be replicated? Any advice, statistics, anecdotes from anyone about experiences managing DSpace for multiple parties with differing needs? Thanks, Keith Gilbertson Systems Developer OhioLINK - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Facetted / faster browsing [was Development goals]
Hi Christophe: See remarks below on Dwell... Thanks, Richard On Fri, 2007-11-23 at 05:29 +0100, Christophe Dupriez wrote: Hi MacKenzie, Mark and Jim! Thanks for insisting on the idea of a client based interface! DWELL: I will explore Dwell further. I tried it with http://simile.mit.edu/longwell/demo/libraries/ but it is rather slow from here. That is a very old demo - Longwell's speed has improved. See http://dspace-test.mit.edu/dspace-longwell for a test server here at MIT using more recent code. Is the inventory of values for a given facet evaluated locally, in DSpace or in an intermediary server application? Dwell is a server application with an RDF triple-store backend (like DSpace's database, but in RDF) - the metadata is a copy of what is in DSpace - optimized for presentation in the Dwell UI. I understood Dwell is based on OAI-PMH but there is no Search request in OAI-PMH. Actually, Dwell is independent of how the metadata is obtained, so it does not rely on OAI-PMH. We have provided an OAI-PMH exporter as one way to feed Dwell. In 1.5, we are adding another way based on the event mechanism, and there is already a large library of SIMILE tools for turning a lot of metadata formats into the RDF Dwell expects. An extension has be defined for this: http://www.dlese.org/dds/services/oai2-0/odl_service_documentation.jsp but I suppose it is not part of DSpace (am I wrong?). OAI-PMH+Search(ODL) has similar capabilities than RSS and would ensure better metadata transmission. RSS: Mark+Jim advice opened my eyes on a simple fact: RSS standard(s) may be used to represent a DSpace search result set (if I add a RSS flow generation to DSpace search). The nice thing with RSS is the potential promise of subscription for searches where new records are regularly retrieved and highlighted. RSS clients are not completely aware of their potential for databases searches (and not only news feed) and could be improved to manage easily simple ad hoc searches and not only subscriptions to searches. Some of them have the three frames interface I wish for my users to browse DSpace results (like an e-mail management software). I made some experiments with RSSBandit (open-source: http://www.rssbandit.org/ ) and I think it is a possible way to go. Anybody digged in that direction? Christophe MacKenzie Smith a écrit : Hi Mark, I've been saying for some time that, nice as the DSpace user interface is in many respects, it is not and should not be the only way to plumb a DSpace archive. If it is (currently) difficult to get a particular search style put into DSpace, may I suggest trying a different approach. One could harvest metadata via the PMH responder, organize them any way one wishes, and search them in any desired way. I can't resist pointing out that this is exactly what DWell does -- the faceted browsing and search UI that is layered over DSpace via an OAI-PMH plugin for RDFized metadata. See http://simile.mit.edu/wiki/Dwell or Richard Rodger's presentation on same at http://www.aepic.it/conf/viewpaper.php?id=212print=1cf=11 I think this is an excellent approach to building better DSpace UIs, and just leaves us with the problem of the underlying data rigidity, which I hope we can address by relying more on RDF or other rich metadata that is stored in the assetstore alongside the content files. The current DSpace metadata tables are great for managing content, but suboptimal for discovering what's in the repository (assuming we can get better discovery metadata from outside the system, somehow). MacKenzie - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Differences between the data model and the trunk
On Nov 21, 2007, at 2:44 AM, Larry Stone wrote: This is really getting out of scope for dspace-tech, But its important to discuss direction transparently, so I do not consider it out of scope. but I'd just like to make a plea to look at the data model in the abstract rather than at the implementation level: the way it appears in database tables *doesn't* *matter* at this stage of thinking about it, and I think it muddies the waters even to talk about them. No, this is the dilemma, it really doesn't matter what we talk of conceptually, the only real thing is what is implemented. Everything else is a speculative attempt to describe what really exists as the implementation of the DSpace storage solution. Per, DSpace 2.0, yes we will have an abstract model, but it should be rooted in reality, in what can actually be accomplished with the existing storage solution a.k.a a relational database. There are objects, which perhaps have both attributes and relationships; that's the abstract way to discuss it. It is inconsequential whether attributes are implemented as columns in a table and relationships are an RDF triplestore -- what matters is the abstract model. I would find it overly complex and dismaying if the result of the 2.0 re-architecture could not be expressed in simple relational terms. That said, I notice there is a tendancy to add, or want to add, lots of different kinds of relationships to the data model. For example, an Item has an owning collection (or several) for the purpose of access control, and perhaps a different parent for UI appearance and yet another for navigation. Those could be typed relationships. There was some discussion of this in http://wiki.dspace.org/index.php/BitstreamRelationships too. I'm actually, attempting just to clarify what really exists in the existing implementation of our data model. We currently do have that relationship present in the schema. Thus, either that data model documentation is really out of date, or the column shouldn't exist in the schema implementing that model. Perhaps we could benefit from a very general relationship model that lets the API client create typed relationships between *any* DSOs, but of course it would need to enforce rules as well: - acceptable domain and range of each kind of relationship operator - schema restrictions on relationships (e.g. one-to-many, one-to-one) - access control on the relationships themselves. Sure, and we will ultimately return to how these would be expressed in the schema. And I predict ultimately once proper normalization and exclusion of non-model properties occurred in the database schema, the above would most certainly exist. All DSpace Objects would inherit some common traits, e.g. an identifier unique among all DSOs, and this mechanism that manages relationships between any DSOs. The mechanism implements all the schema restrictions and policies. We already did all that at the Architectural review and the DAO prototype. ...but that's what I mean about keeping the discussion abstract: I'm not going to say if the relationship is really an RDF statement no matter how much it looks like one.. Let's just look at the problem without getting boxed into a particular solution. Well, if you get too abstract, then nothing gets done, as well, developers loose interest and threads die... We have a particular solution right now. My use of RDF or relational terms isn't to box us in, but to begin to draw out what is analogous across these technologies, and thus where there is true abstraction, not abstraction for abstractions sake. Cheers, Mark -- Larry On Nov 20, 2007, at 3:55 AM, Andrea Bollini wrote: Larry Stone ha scritto: Collection * - * Item It's worth noting that while an Item may be a member of multiple Collections, it still refers to only one of them as its owner; it is returned by getOwningCollection(). true but IMHO this is not really needed... Well, what I've suggested in my previous email is not wether it is needed or not, but where it should correctly reside in relational terms, owner is a relationship, not an attribute of Item and Collection, thus the more appropriate location would be in the container or relationship tables. I.E. rather than: --- -- Item table --- CREATE TABLE Item ( item_id INTEGER PRIMARY KEY, submitter_idINTEGER REFERENCES EPerson(eperson_id), in_archive BOOL, withdrawn BOOL, last_modified TIMESTAMP WITH TIME ZONE, owning_collection INTEGER ); --- -- Collection2Item table --- CREATE TABLE Collection2Item ( idINTEGER PRIMARY KEY, collection_id INTEGER REFERENCES
Re: [Dspace-tech] Expunging question
Hi Glenn, expunging an item via the UI does not delete the item at once it's just flagged deleted. The final deletion is done with the cleanup. Do you run this nightly? Hope that helps Claudia Dspace 1.3.2 When I expunge an item is it totally and completely gone from the machine? I have a user who claims, even after I've expunged the item, that she is pulling up the document using the extended url directly to the bitstream. Any ideas why that might be happening if the document is completely gone from the server? Or is it not really gone? Thanks in advance. == Mr. Glenn Bunton Head of Systems Development Old Dominion University Libraries Norfolk, Virginia 23529 [EMAIL PROTECTED] (757) 683-5952 === - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Reading other files in Manakin (was: Re: Desired hierarchical display of communities and collection list)
I haven't looked at the Manakin code, but the MIME media-type of a Bitstream must be coming from its associated BitstreamFormat -- so why not get the human-readable name from the BitstreamFormat as well? There is no need to establish a separate map of MIME-type to user-friendly name when it already exists in teh BitstreamFormat registry. String friendly = bitstream.getFormat().getShortDescription(); One complication, or perhaps advantage, of using BSFs directly is that some of them have the same MIME-type, so getting the friendly name from the BSF actually identifies the format more precisely -- e.g. XML-based formats might all have the MIME-type text/xml, but distinct friendly names. Thus, you should go to the Bitstream's BSF to get the friendly name rather than attempt to use the BSF registry as a map, because it might have multiple matches for one MIME-type. -- Larry On Nov 21, 2007 10:06 PM, Conal Tuohy [EMAIL PROTECTED] wrote: On Wed, 2007-11-21 at 16:43 -0600, Dorothea Salo wrote: The mapping between media-types and friendly names could be introduced into the pipeline using a Manakin Aspect, and then utilised in a View, via XSLT. Aha. I can try to tackle this. What would be the closest existing code? Alternatively, perhaps this is really just a case of i18n? I thought about that, but I can't quite make it work happily. Every time an administrator adds a new bitstream format (something I assume Manakin still has UI for?), DSpace itself would have to make an automatic change to messages.xml, which is under most circumstances a human-authored and source-controlled file. Automagically changing it will make a mess of any installation that keeps its source in source control, I would think. Dorothea -- Dorothea Salo[EMAIL PROTECTED] Digital Repository Librarian AIM: mindsatuw University of Wisconsin Rm 218, Memorial Library (608) 262-5493 - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] External database authentication in dspace
On Mon, 2007-11-26 at 12:12 +0530, Mohammad Ehtesham wrote: Hello, Can we have “External database authentication” or single sign-on feature in dspace? For i.e.: If we are using some CMS or LMS like Joomla or Moodle and some easy link is embedded and once the user clicks on the link the user’s login authentication should pass on to the dspace also. In simple words: We are looking to make a secure link to dspace from within our LMS, with the same sign-on. Depending on how far you want to take things, one approach that might be worth investigating using Shibboleth, which will will allow ID management collaboration with other institutions. A quick search suggests that joomla, moodle and dspace are all shibbolisable. http://shibboleth.internet2.edu/ http://wiki.psigrid.gov.ph/index.php/Joomla_Content_Management_System_with_Shibboleth_Service_Provider http://docs.moodle.org/en/Shibboleth https://mams.melcoe.mq.edu.au/zope/mams/pubs/Installation/dspace14 Regards, Nik Lam -- Unix-like Systems Administrator -- Library IT Services Level 1, Fisher Library (Building F03) The University of Sydney, NSW 2006, Australia Phone: +61 2 9351 4304 Fax: +61 2 9351 7769 CRICOS Provider Number: 00026A -- - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] External database authentication in dspace
Thanks for your reply Nik, I have checked the links and it seems using shibboleth it is possible. I want to discuss further, I have already integrated our LMS (moodle) with our organization's MS AD (LDAP server) and I think we can integrate it with Dspace as well and this will give same sign on to both. But I am looking for the feature to enable single sign on (Once the user is logged in LMS (Moodle) his/her login authentication should pass on to dspace as well). Dspace should not prompt the users to login. Looking forward for the suggestions Thanks Regards, Mohammad Ehtesham -Original Message- From: Nikolas Lam [mailto:[EMAIL PROTECTED] Sent: Tuesday, November 27, 2007 4:49 AM To: Mohammad Ehtesham Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] External database authentication in dspace On Mon, 2007-11-26 at 12:12 +0530, Mohammad Ehtesham wrote: Hello, Can we have External database authentication or single sign-on feature in dspace? For i.e.: If we are using some CMS or LMS like Joomla or Moodle and some easy link is embedded and once the user clicks on the link the user's login authentication should pass on to the dspace also. In simple words: We are looking to make a secure link to dspace from within our LMS, with the same sign-on. Depending on how far you want to take things, one approach that might be worth investigating using Shibboleth, which will will allow ID management collaboration with other institutions. A quick search suggests that joomla, moodle and dspace are all shibbolisable. http://shibboleth.internet2.edu/ http://wiki.psigrid.gov.ph/index.php/Joomla_Content_Management_System_wi th_Shibboleth_Service_Provider http://docs.moodle.org/en/Shibboleth https://mams.melcoe.mq.edu.au/zope/mams/pubs/Installation/dspace14 Regards, Nik Lam -- Unix-like Systems Administrator -- Library IT Services Level 1, Fisher Library (Building F03) The University of Sydney, NSW 2006, Australia Phone: +61 2 9351 4304 Fax: +61 2 9351 7769 CRICOS Provider Number: 00026A -- DISCLAIMER:The information contained in this message and the attachments (if any) may be privileged and confidential and protected from disclosure. You are hereby notified that any unauthorized use, dissemination, distribution or copying of this communication, review, retransmission, or taking of any action based upon this information, by persons or entities other than the intended recipient, is strictly prohibited. If you are not the intended recipient or an employee or agent responsible for delivering this message, and have received this communication in error, please notify us immediately by replying to the message and kindly delete the original message, attachments, if any, and all its copies from your computer system. Thank you for your cooperation. - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Facetted / faster browsing
Thanks for the reference! It is really much more usable! Data in DSpace is mostly in one table (metadatavalue) which may be seen as / replaced by a triple store : do you think it would be possible to remove a layer to make things more integrated? Have a nice day! Christophe Richard Rodgers a écrit : Hi Christophe: See remarks below on Dwell... Thanks, Richard On Fri, 2007-11-23 at 05:29 +0100, Christophe Dupriez wrote: Hi MacKenzie, Mark and Jim! Thanks for insisting on the idea of a client based interface! DWELL: I will explore Dwell further. I tried it with http://simile.mit.edu/longwell/demo/libraries/ but it is rather slow from here. That is a very old demo - Longwell's speed has improved. See http://dspace-test.mit.edu/dspace-longwell for a test server here at MIT using more recent code. Is the inventory of values for a given facet evaluated locally, in DSpace or in an intermediary server application? Dwell is a server application with an RDF triple-store backend (like DSpace's database, but in RDF) - the metadata is a copy of what is in DSpace - optimized for presentation in the Dwell UI. I understood Dwell is based on OAI-PMH but there is no Search request in OAI-PMH. Actually, Dwell is independent of how the metadata is obtained, so it does not rely on OAI-PMH. We have provided an OAI-PMH exporter as one way to feed Dwell. In 1.5, we are adding another way based on the event mechanism, and there is already a large library of SIMILE tools for turning a lot of metadata formats into the RDF Dwell expects. An extension has be defined for this: http://www.dlese.org/dds/services/oai2-0/odl_service_documentation.jsp but I suppose it is not part of DSpace (am I wrong?). OAI-PMH+Search(ODL) has similar capabilities than RSS and would ensure better metadata transmission. RSS: Mark+Jim advice opened my eyes on a simple fact: RSS standard(s) may be used to represent a DSpace search result set (if I add a RSS flow generation to DSpace search). The nice thing with RSS is the potential promise of subscription for searches where new records are regularly retrieved and highlighted. RSS clients are not completely aware of their potential for databases searches (and not only news feed) and could be improved to manage easily simple ad hoc searches and not only subscriptions to searches. Some of them have the three frames interface I wish for my users to browse DSpace results (like an e-mail management software). I made some experiments with RSSBandit (open-source: http://www.rssbandit.org/ ) and I think it is a possible way to go. Anybody digged in that direction? Christophe MacKenzie Smith a écrit : Hi Mark, I've been saying for some time that, nice as the DSpace user interface is in many respects, it is not and should not be the only way to plumb a DSpace archive. If it is (currently) difficult to get a particular search style put into DSpace, may I suggest trying a different approach. One could harvest metadata via the PMH responder, organize them any way one wishes, and search them in any desired way. I can't resist pointing out that this is exactly what DWell does -- the faceted browsing and search UI that is layered over DSpace via an OAI-PMH plugin for RDFized metadata. See http://simile.mit.edu/wiki/Dwell or Richard Rodger's presentation on same at http://www.aepic.it/conf/viewpaper.php?id=212print=1cf=11 I think this is an excellent approach to building better DSpace UIs, and just leaves us with the problem of the underlying data rigidity, which I hope we can address by relying more on RDF or other rich metadata that is stored in the assetstore alongside the content files. The current DSpace metadata tables are great for managing content, but suboptimal for discovering what's in the repository (assuming we can get better discovery metadata from outside the system, somehow). MacKenzie - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech begin:vcard fn:Christophe Dupriez n:Dupriez;Christophe org:DESTIN inc. SSEB adr;quoted-printable:;;rue des Palais 44, bo=C3=AEte 1;Bruxelles;;B-1030;Belgique email;internet:[EMAIL PROTECTED] title:Informaticien tel;work:+32/2/216.66.15 tel;fax:+32/2/242.97.25 tel;cell:+32/475.77.62.11 note;quoted-printable:D=C3=A9veloppement de Syst=C3=A8mes de Traitement de l'Information x-mozilla-html:TRUE url:http://www.destin.be version:2.1 end:vcard - This SF.net email is sponsored by: Microsoft Defy all challenges.
