Re: [Dspace-tech] Space 1.7.0 and special groups
Hi Clive,
The authentication classes have changed very little (if at all) over the past
few versions, so the code should still work fine.
Thanks,
Stuart Lewis
Digital Development Manager
Te Tumu Herenga The University of Auckland Library
Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand
Ph: +64 (0)9 373 7599 x81928
On 15/12/2011, at 12:51 AM, Clive Gould wrote:
Hi Stuart
You kindly helped me customise the special groups code in
/home/dspace/dspace-1.7.0-src-release/dspace-pi/src/main/java/org/dspace/authenticate/LDAPHierarchicalAuthentication.java
to differentiate between staff and student login.
Before I build DSpace 1.7.1 from source can you please confirm that
the patch below should work properly with 1.7.1
Thanks very much
Clive
/*
* New code written by Stuart Lewis and added by Clive Gould on
7th April 2011 (modified 20/10/11)
*/
public int[] getSpecialGroups(Context context, HttpServletRequest request)
{
try
{
if (!context.getCurrentUser().getNetid().equals())
{
Group staffGroup = Group.findByName(context, all-staff);
Group studentsGroup = Group.findByName(context, all-students);
// Does the username start with a '1', '4', or '7'?
if ((studentsGroup != null)
(context.getCurrentUser().getNetid().startsWith(1) ||
context.getCurrentUser().getNetid().startsWith(4) ||
context.getCurrentUser().getNetid().startsWith(7)))
{
// Add them to the students group
return new int[] { studentsGroup.getID() };
}
else if (staffGroup != null)
{
// Add them to the staff group
return new int[] { staffGroup.getID() };
}
}
}
catch (Exception npe) {
// The user is not an LDAP user, so we don't need to worry about
them
}
return new int[0];
}
--
Cloud Computing - Latest Buzzword or a Glimpse of the Future?
This paper surveys cloud computing today: What are the benefits?
Why are businesses embracing it? What are its payoffs and pitfalls?
http://www.accelacomm.com/jaw/sdnl/114/51425149/
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Exception in thread main java.lang.NoClassDefFoundError: org/dspace/app/launcher/ScriptLauncher
Hi Abhishek, It looks like you are using the GNU libgcj version of Java. DSpace requires the use of the Sun / Oracle JDK. Swapping to the Sun / Oracle version might help with this problem. Thanks, Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 On 6/12/2011, at 6:00 PM, Abhishek Raval wrote: Hello Helix, I hv installed dspace-1.7.2 in red hat 5.5 .every thing is done act i can see the UI but i m not able to make any administrator i made that by entering required data in POSTGRES and made a admin ;) but wen it comes to indexing this i do need to run a command n that is not happening :( any idea wat sud i do now error is bin]$ ./dspace filter-media Exception in thread main java.lang.ClassFormatError: org.dspace.app.launcher.ScriptLauncher (unrecognized class file version) at java.lang.VMClassLoader.defineClass(libgcj.so.7rh) at java.lang.ClassLoader.defineClass(libgcj.so.7rh) at java.security.SecureClassLoader.defineClass(libgcj.so.7rh) at java.net.URLClassLoader.findClass(libgcj.so.7rh) at gnu.gcj.runtime.SystemClassLoader.findClass(libgcj.so.7rh) at java.lang.ClassLoader.loadClass(libgcj.so.7rh) at java.lang.ClassLoader.loadClass(libgcj.so.7rh) at gnu.java.lang.MainThread.run(libgcj.so.7rh) On Mon, Dec 5, 2011 at 5:00 PM, helix84 heli...@centrum.sk wrote: On Mon, Dec 5, 2011 at 11:39, Abhishek Raval abhis...@webinito.com wrote: I am also getting the same problem .in dspace create-administrator in dspace filter-media how do i resolve this proble ??? I am using dspace-1.7.2 Hello Abishek, my explanation also applies to your dspace version - you need to actually install dspace before you run those scripts. Look at the documentation I linked to. Regards, ~~helix84 -- Thanks n Regards Abhishek Raval Software Engg. Webinito Networks Ph no.-+919601077584 -- Cloud Services Checklist: Pricing and Packaging Optimization This white paper is intended to serve as a reference, checklist and point of discussion for anyone considering optimizing the pricing and packaging model of a cloud services business. Read Now! http://www.accelacomm.com/jaw/sfnl/114/51491232/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Cloud Services Checklist: Pricing and Packaging Optimization This white paper is intended to serve as a reference, checklist and point of discussion for anyone considering optimizing the pricing and packaging model of a cloud services business. Read Now! http://www.accelacomm.com/jaw/sfnl/114/51491232/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] How to clear all monthly reports and start from the beginning
Hi Evelthon, If you enable DEBUG logging in DSpace, and then re-run the command, the dspace.log file should show the SQL that is failing. If you could show us that, it might help to work out where the error is. My guess is a bad value in the dspace statistics config file, but the SQL should help. - https://wiki.duraspace.org/display/DSPACE/TechnicalFaq#TechnicalFaq-SettingloggingleveluptoDEBUG Thanks, Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 On 29/11/2011, at 1:42 AM, Evelthon Prodromou wrote: Hello again, I am asking once more in case someone missed my last email. It will be really helpful if anyone can point me to the right direction. I did the following since my last email. I edited dstat.cfg and changed start.year to 2001 and start.month to 11. I then cleared /[dspace]/reports and executed dspace stat-initial. Still the same problem. Many thanks, Evelthon On 11/19/2011 11:58 PM, Evelthon Prodromou wrote: Hello everyone, I am facing an issue with dspace 17.0 and monthly reports. We are moving collections from greenstone to dspace. The monthly reports worked fine up to 02/2011. Seems like whenever a stat-* command is run it returns the error below. - Exception: ERROR: more than one row returned by a subquery used as an expression org.postgresql.util.PSQLException: ERROR: more than one row returned by a subquery used as an expression at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:1531) at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1313) at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:188) at org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:452) at org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:354) at org.postgresql.jdbc2.AbstractJdbc2Statement.executeQuery(AbstractJdbc2Statement.java:258) at org.apache.commons.dbcp.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:96) at org.apache.commons.dbcp.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:96) at org.apache.commons.dbcp.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:96) at org.dspace.storage.rdbms.DatabaseManager.query(DatabaseManager.java:284) at org.dspace.storage.rdbms.DatabaseManager.querySingle(DatabaseManager.java:330) at org.dspace.app.statistics.LogAnalyser.getNumItems(LogAnalyser.java:1249) at org.dspace.app.statistics.LogAnalyser.processLogs(LogAnalyser.java:498) at org.dspace.app.statistics.CreateStatReport.statInitial(CreateStatReport.java:259) at org.dspace.app.statistics.CreateStatReport.main(CreateStatReport.java:129) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:183) - Since we have not yet gone public on dspace, it is of no problem to just clear everything out and start our monthly reports from scratch. Any pointers on how can that be accomplished? Thanks -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity, and more. Splunk takes this data and makes sense of it. IT sense. And common sense. http://p.sf.net/sfu/splunk-novd2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech prodromou_evelthon.vcf-- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity, and more. Splunk takes this data and makes sense of it. IT sense. And common sense. http://p.sf.net/sfu/splunk-novd2d___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security
Re: [Dspace-tech] Registering Users via Command Line
Hi Justin, This isn't possible right now, however we have created a ticket in our software issue tracker to see if we can get this implemented: - https://jira.duraspace.org/browse/DS-1083 Thanks, Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 On 24/10/2011, at 8:47 AM, Justin A. Diana wrote: Hey all, Is there a way to register a new user via the command line on the server? I want to perform the same activity as would happen via the “Register” link on the dspace site, but via some scripted process. Is that doable? Thanks in advance! Justin -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity, and more. Splunk takes this data and makes sense of it. IT sense. And common sense. http://p.sf.net/sfu/splunk-novd2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Configuring LDAP Users Group
Hi Art, We are running version 1.7.2 and the xmlui and would like to configure the LDAP Users Group. I created a group with the permissions I wanted then I edited the .cfg file with the appropriate group name. I have been testing it and it is not working. I would like for users who authenticate against the LDAP serve to be automatically added to this group but that is not happening. I wonder if there are some other values I need to specify for this to work? Any advice is greatly appreciated. This aspect of the LDAP authentication makes use of what is known as 'special groups'. Membership of special group is transitory, only for the period of their login. THis means that members of the group are not 'added' to the group as such, but just become members for the duration of the time that they are logged in. During this time they inherit the attributes of that group, but are not added to it. What behaviour are you seeing? Is it that they are not added to that group when you list the group membership (this is normal), or is it that they don't seem to get the attributes they should, as members of that special group? Thanks, Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- RSA(R) Conference 2012 Save $700 by Nov 18 Register now http://p.sf.net/sfu/rsa-sfdev2dev1 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] SWORD item submission in DSpace 1.7.2
Hi Nikolaos, You need to pass a few more headers with your deposit: curl -i --data-binary @dspace-sword/example/example.zip -H Content-Disposition: filename=myDSpaceMETSItem.zip -H Content-Type: application/zip -H X-Packaging: http://purl.org/net/sword-types/METSDSpaceSIP; http://dspace:dspace@localhost:8080/sword/deposit/123456789/2 These let the server know what type of object you are depositing. I hope this helps, Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 On 24/10/2011, at 11:52 PM, Nikolaos Konstantinou wrote: Hi all, I am using DSpace 1.7.2 and I am trying to submit the example.zip provided by the sword package into a DSpace repository I have installed locally. I execute from Eclipse the class: org.purl.sword.client.ClientFactory with the parameters: -cmd -t post -host localhost -port 8080 -href http://localhost:8080/sword/deposit/123456789/2 -file C:/Users/nkons/Temp/example/example.zip -filetype application/zip -u [my username] -p [my password] I see in the debug messages that the authentication is successful, but then I get the error: Id: null Title: ERROR type: text There is no generator Published: null There is no content element. There is no right element. Summary - content: No ingester configured for this package type type: text Update: 2011-10-24T13:45:46.836Z Published: null Verbose Description: null Treatment: null Packaging: null Inside dspace.cfg, I have left the default values in the Sword section. The debug outputs: 2011-10-24 13:48:03,670 DEBUG org.dspace.sword.CollectionDepositor @ Created instance of CollectionDepositor 2011-10-24 13:48:03,671 INFO org.dspace.sword.SWORDIngesterFactory @ looking for named plugin interface org.dspace.sword.SWORDIngester 2011-10-24 13:48:03,672 DEBUG org.dspace.core.PluginManager @ Got Named configuration for interface=org.dspace.sword.SWORDIngester, config=org.dspace.sword.SWORDMETSIngester = http://purl.org/net/sword-types/METSDSpaceSIP org.dspace.sword.SimpleFileIngester = SimpleFileIngester 2011-10-24 13:48:03,674 DEBUG org.dspace.core.PluginManager @ Got Named Plugin, intfc=org.dspace.sword.SWORDIngester, name=http://purl.org/net/sword-types/METSDSpaceSIP, class=org.dspace.sword.SWORDMETSIngester 2011-10-24 13:48:03,674 DEBUG org.dspace.core.PluginManager @ Got Named Plugin, intfc=org.dspace.sword.SWORDIngester, name=SimpleFileIngester, class=org.dspace.sword.SimpleFileIngester 2011-10-24 13:48:03,674 WARN org.dspace.core.PluginManager @ Cannot find named plugin for interface=org.dspace.sword.SWORDIngester, name=text/xml 2011-10-24 13:48:03,674 WARN org.dspace.sword.DepositManager @ Unable to store SWORD package as file: org.purl.sword.base.SWORDErrorException: No ingester configured for this package type 2011-10-24 13:48:03,675 ERROR org.purl.sword.server.DepositServlet @ org.purl.sword.base.SWORDErrorException: No ingester configured for this package type Could someone please point me to what I am doing wrong? Is it some extra configuration I would have to add? I see the following line in dspace.cfg but I have not configured it, it is not clear what should go there: sword.accept-packaging.[package format].identifier = [package format identifier] Thank you in advance for your reply. Best regards, Nikolaos Konstantinou -- The demand for IT networking professionals continues to grow, and the demand for specialized networking skills is growing even more rapidly. Take a complimentary Learning@Cisco Self-Assessment and learn about Cisco certifications, training, and career opportunities. http://p.sf.net/sfu/cisco-dev2dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- The demand for IT networking professionals continues to grow, and the demand for specialized networking skills is growing even more rapidly. Take a complimentary Learning@Cisco Self-Assessment and learn about Cisco certifications, training, and career opportunities. http://p.sf.net/sfu/cisco-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Regenerate monthly reports
Hi Alan, Another question, there's nothing that gets modified in the database when this happens, so I shouldn't need to restart Tomcat, right? Yes - that is correct. Everything happens on disk (not in the DB): .log files -- .dat files -- .html reports The .html reports are then loaded when required. Thanks, Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity and more. Splunk takes this data and makes sense of it. Business sense. IT sense. Common sense. http://p.sf.net/sfu/splunk-d2d-oct ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] solr statistics
Hi Tint, Our repository is running on 1.6.2 and we have been using solr for a few months now. There seems to be some problem with solr statistics. Bitstream for some items were downloaded more than a few thousand times within a month from the same place. How can I filter out such systematic access (by bots/spiders etc)? Take a look at the following tool: /dspace/bin/dspace stats-util -h usage: StatisticsClient -b,--reindex-bitstreams Reindex the bitstreams to ensure we have the bundle name -r,--remove-deleted-bitstreams While indexing the bundle names remove the statistics about deleted bitstreams -u,--update-spider-files Update Spider IP Files from internet into /dspace/config/spiders -f,--delete-spiders-by-flag Delete Spiders in Solr By isBot Flag -i,--delete-spiders-by-ipDelete Spiders in Solr By IP Address -m,--mark-spidersUpdate isBot Flag in Solr -h,--helphelp -o,--optimizeRun maintenance on the SOLR index You might need to first register the IP address of the bots in /dspace/config/spiders/ I hope that helps, Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity and more. Splunk takes this data and makes sense of it. Business sense. IT sense. Common sense. http://p.sf.net/sfu/splunk-d2d-oct ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] item counter failed
Are you running the following command to refresh the strength cache?
- [dspace]/bin/dspace itemcounter
Perhaps run it every 10 minutes as a cron job.
Thanks,
Stuart Lewis
Digital Development Manager
Te Tumu Herenga The University of Auckland Library
Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand
Ph: +64 (0)9 373 7599 x81928
On 13/10/2011, at 7:04 PM, Webshet, Sisay (ILRI) wrote:
Hi,
I just tried but it doesn’t work
Thanks
sisay
-Original Message-
From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84
Sent: Wednesday, October 12, 2011 4:11 PM
To: Webshet, Sisay (ILRI)
Cc: dspace-tech@lists.sourceforge.net
Subject: Re: [Dspace-tech] item counter failed
AFAICT you did everything correctly. The numbers may stop updating
because Cocoon can serve you the whole page from cache.
You should try to clean the Cocoon cache:
1.) First, don't forget to shutdown Tomcat.
2.) cd ${tomcat6.home}/work/Catalina/{appropriate.domain.dir}/_/
3.) rm -rf cache-dir
4.) Start Tomcat again.
Regards,
~~helix84
--
All the data continuously generated in your IT infrastructure contains a
definitive record of customers, application performance, security
threats, fraudulent activity and more. Splunk takes this data and makes
sense of it. Business sense. IT sense. Common sense.
http://p.sf.net/sfu/splunk-d2d-oct
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
--
All the data continuously generated in your IT infrastructure contains a
definitive record of customers, application performance, security
threats, fraudulent activity and more. Splunk takes this data and makes
sense of it. Business sense. IT sense. Common sense.
http://p.sf.net/sfu/splunk-d2d-oct
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] About Java Unknown failure when filtering media with XPDF
Hi Antonio, In your [dspace]/config/dspace.cfg file, what do you have set for the 'filter.plugins' setting? The error you sent suggested that there is is no 'filter.plugins' set in your dspace.cfg. A typical value you be: filter.plugins = PDF Text Extractor, HTML Text Extractor, \ PowerPoint Text Extractor, \ Word Text Extractor, JPEG Thumbnail Thanks, Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 On 26/09/2011, at 6:33 PM, Antonio Calderón wrote: Hi Scott, I followed the instructions, but get this: Exception: null java.lang.NullPointerException at org.dspace.app.mediafilter.MediaFilterManager.main(MediaFilterManager.java:214) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:183) Thank you very much for your help, A. 2011/9/23 Scott Thurston scott.thurs...@noaa.gov: Hello Antonio, Are you able to install your own JDK and configure your environment to use it to build, install and run DSpace? Your $JAVA_HOME should point to the new JDK. If you have downloaded the jai_imageio JAR file for your system, you can unzip it to extract the installer jai_imageio*.bin. The installer is a shell script that contains the binary installer image at the end of the file. Search the installer for the tail command, which looks like this in my installer: tail +215 $0 $outname I was able to get the installer to work by following these steps: 1. tail -n +215 jai_imageio-1_1-lib-linux-amd64-jdk.bin $JAVA_HOME/jai_installer 2. cd $JAVA_HOME 3. ./jai_installer Those steps should install the JAI ImageIO library in your JDK. I hope that is helpful. Regards, Scott On 9/22/2011 10:27 PM, neocalde...@gmail.com wrote: Hi, how do you do? Sorry to contact you directly. About: UPDATE: I resolved the problem This Afternoon. The solution is to JAI ImageIO install the library in the JDK itself. In my case I do not Have permissions to update the system's JDK so I installed my own JDK and Then installed the ImageIO library there. I rebuilt my using DSpace JDK own filtering and verified That dog now produces half thumbnail images for a PDF file . Do you have any guidance or howto? Thank you very much for your response. -- Scott Thurston scott.thurs...@noaa.gov NOAA / NGDC / WDC http://www.ngdc.noaa.gov/ Marine Geology Geophysics 303-497-4411 (phone) 325 Broadway E/GC3 303-497-6513 (fax) Boulder, CO 80305-3337 -- Antonio Calderón - Calderón Cardona Ltda. http://calderoncardona.com | http://ventura-systems.net *Proudly running Debian GNU/Linux. -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity and more. Splunk takes this data and makes sense of it. Business sense. IT sense. Common sense. http://p.sf.net/sfu/splunk-d2dcopy1 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity and more. Splunk takes this data and makes sense of it. Business sense. IT sense. Common sense. http://p.sf.net/sfu/splunk-d2dcopy1 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] help!!!
On 15/09/2011, at 10:04 PM, Akeredolu Joshua wrote: Gud day, I have installed dspace on my system and its working fine but I have been trying to connect it from other local computer using wireless router, and also with cross-over cable as an intranet but the othe system are not connecting even when i use the ip address in edited in dspace.cfg thats 192.168.0.1:8080/dspace. what should i do or whats wrong. -- Do you have a firewall on your server that is stopping external traffic to Tomcat's 8080 port? Thanks, Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- Doing More with Less: The Next Generation Virtual Desktop What are the key obstacles that have prevented many mid-market businesses from deploying virtual desktops? How do next-generation virtual desktops provide companies an easier-to-deploy, easier-to-manage and more affordable virtual desktop model.http://www.accelacomm.com/jaw/sfnl/114/51426474/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Where can I see the log of activity in DSpace as a file in the file system?
Hi Magnus,
Where can I see the log of activity in DSpace as a file in the file system?
Look in [dspace]/log/
Depending on your version of DSpace, the file will be called dspace.log, or in
the most recent versions, dspace.log.{datestamp} (e.g. dspace.log.2011.08.26}
I hope that helps,
Stuart Lewis
Digital Development Manager
Te Tumu Herenga The University of Auckland Library
Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand
Ph: +64 (0)9 373 7599 x81928
--
EMC VNX: the world's simplest storage, starting under $10K
The only unified storage solution that offers unified management
Up to 160% more powerful than alternatives and 25% more efficient.
Guaranteed. http://p.sf.net/sfu/emc-vnx-dev2dev
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] How to share a collection among many communities?
Hi all, Using the batch CSV editor won't work, as this just allows items to be added to collections, not to communities. There is no way in the user interface to put collections into multiple communities, although I think the database might support it. Try looking at the community2collection table, as you might be able to assign a collection to multiple communities in there. Thanks, Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 On 19/08/2011, at 8:12 AM, helix84 wrote: On Thu, Aug 18, 2011 at 16:09, Alexandre de Mello Zart z...@pucrs.br wrote: There is an observation in the Dspace System Documentation (http://www.dspace.org/1_6_2Documentation/ch02.html#N100DE) that says “A collection may appear in more than one community”. I already know how to map items from one collection to other, but how can I map an entire collection to another community? Is this a native functionality of Dspace? You're reading it correctly, this is possible. Probably the easiest way for you to do it would be using the Batch Metadata Editing facility (http://www.dspace.org/1_6_2Documentation/ch08.html#N161D0). It will export a CSV file with metadata for the collection you choose. You can edit it in Excel. If you're adding an item to multiple communities, separate their handles in the collection column by || (two pipe characters). Then you can save it as CSV and import it back to DSpace. After uploading the CSV, it lets you review the changes and confirm or refuse them. Regards, ~~helix84 -- Get a FREE DOWNLOAD! and learn more about uberSVN rich system, user administration capabilities and model configuration. Take the hassle out of deploying and managing Subversion and the tools developers use with it. http://p.sf.net/sfu/wandisco-d2d-2 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Get a FREE DOWNLOAD! and learn more about uberSVN rich system, user administration capabilities and model configuration. Take the hassle out of deploying and managing Subversion and the tools developers use with it. http://p.sf.net/sfu/wandisco-d2d-2 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] SSL and HTTPS Question
Hi Jospeh, So, I've turned on the configuration flag that forces the user to use HTTPS when they log in to DSpace; Should the rest of their session take place over an https connection or is it safe for them to go back to regular http after they have logged in? For most sites, it is considered safe to go back to http. You might want to consider securing a few other pages, such as the password change page. Thanks, Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- Got Input? Slashdot Needs You. Take our quick survey online. Come on, we don't ask for help often. Plus, you'll get a chance to win $100 to spend on ThinkGeek. http://p.sf.net/sfu/slashdot-survey ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] batch import of Bagit-formated collections and/or conversion script for Bagit to SAF
Hi Hardy, SWORD is completely agnostic about what packages it transports, however out the box, DSpace does not know how to ingest bags via SWORD. You might therefore need to write a bag ingester than knows how to unpack and ingest the contents of the bag. This would make an excellent addition to DSpace :) Thanks, Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 On 28/07/2011, at 9:29 AM, Pottinger, Hardy J. wrote: Thanks, Mark, that code from MIT looks interesting, I will look into it more. I did notice that the Bagit spec is supported by the SWORD protocol, and when I mentioned this to our archivist, he went and looked and it does appear that the BIL 3.9 can send a bag using SWORD (see output of the BIL -h command, pasted below). So, it looks like Bagger and/or BIL + turning on SWORD for our repository will get us what we want. Huzzah! * BagIt Library (BIL) Version 3.9 Usage: bag operation [operation arguments] [--help] Parameters: operation Valid operations are: baginplace, bob, checkpayloadoxum, create, fillholey, generatepayloadoxum, makecomplete, makeholey, retrieve, splitbagbyfiletype, splitbagbysize, splitbagbysizeandfiletype, sword, update, updatetagmanifests, verifycomplete, verifypayloadmanifests, verifytagmanifests and verifyvalid. Operation explanations: baginplace: Creates a bag-in-place. The source must be a directory on a filesystem and may already have a data directory. bob: Sends a bag using BOB. checkpayloadoxum: Generates Payload-Oxum and checks against Payload-Oxum in bag-info.txt. create: Creates a bag from supplied files/directories, completes the bag, and then writes in a specified format. fillholey: Retrieves any missing pieces of a local bag. generatepayloadoxum: Generates and returns the Payload-Oxum for the bag. makecomplete: Completes a bag and then writes in a specified format. Completing a bag fills in any missing parts. makeholey: Generates a fetch.txt and then writes bag in a specified format. retrieve: Retrieves a bag exposed by a web server. A local holey bag is not required. splitbagbyfiletype: Splits a bag by file types. splitbagbysize: Splits a bag by size. splitbagbysizeandfiletype: Splits a bag by size and file types. sword: Sends a bag using SWORD. update: Updates the manifests and (if it exists) the bag-info.txt for a bag. updatetagmanifests: Updates the tag manifests for a bag. The bag must be unserialized. verifycomplete: Verifies the completeness of a bag. verifypayloadmanifests: Verifies the checksums in all payload manifests. verifytagmanifests: Verifies the checksums in all tag manifests. verifyvalid: Verifies the validity of a bag. [--version] Prints version of BIL and exits. [--help] Prints usage message for the operation. Examples: bag verifyvalid --help Prints help for the verifyvalid operation. -- HARDY POTTINGER pottinge...@umsystem.edu University of Missouri Library Systems http://lso.umsystem.edu/~pottingerhj/ No matter how far down the wrong road you've gone, turn back. --Turkish proverb On 7/26/11 5:31 PM, Mark Diggory mdigg...@atmire.com wrote: Hardy, Be aware that MIT / Richard Rodgers also has some Bagit work available, currently nested within the modules directory here: http://scm.dspace.org/svn/repo/modules/dspace-replicate/trunk/src/main/jav a/org/dspace/pack/ http://scm.dspace.org/svn/repo/modules/dspace-replicate/trunk/src/main/ja va/org/dspace/pack/Mark On Tue, Jul 26, 2011 at 2:33 PM, Pottinger, Hardy J. pottinge...@umsystem.edu wrote: Hi, I've done a bit of googling on Bagit, and I see that Dryad (and @mire) have done some work with Bagit as a repository interchange mechanism. I am interested in something a bit more mundane. There exists a very nice tool for constructing a bag, called Bagger: http://sourceforge.net/projects/loc-xferutils/files/loc-bagger/ Which would be ideal for adapting for our needs--we need a tool that a scanner technician can use to feed scanned images into our repository. Bags, in my mind, are not much different than SAF packages. It would be trivial to script a converter between the two formats, though I'm thinking someone is likely to have walked this path already. If so, and if you can share any code, or just talk
Re: [Dspace-tech] Batch metadata corrections question: does anyone know why the limit is set to just 20 items at a time?
Hi Irene, We're experimenting with making batch corrections to metadata using the Import Metadata feature in the jsp. We'd like to raise the limit on the number of items that may be changed at a time. I can see the file: http://scm.dspace.org/svn/repo/dspace/tags/dspace-1.6.2/dspace-jspui/dspace-jspui-api/src/main/java/org/dspace/app/webui/servlet/MetadataImportServlet.java Where it says this: // Set the lmimt to the number of items that may be changed in one go, default to 20 limit = ConfigurationManager.getIntProperty(bulkedit.gui-item-limit, 20); log.debug(Setting bulk edit limit to + limit + items); Correct - adjust the setting 'bulkedit.gui-item-limit' in dspace.cfg. …We’d like to up it from 20 to maybe 500 as an experiment -- but potentially much higher. Does anyone know if that's a really bad idea? We just don’t know what the consequence is of making this limit larger, but 20 seems way too low for a typical batch of changes. We set it to 20 initially so that there is a low risk of anything going wrong. If you are are happy with the tool, and the way it works, then it is fine to set it higher (but of course it carries the risk of potentially wrecking 500 records at once instead of 20!). We don't recommend setting it too high as the changes are all made in one hit, and this can cause timeouts or memory problems on the server. 500 should be fine. We've heard of problems when people start going over 1 or 2 thousand records at a time. Thanks, Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- Got Input? Slashdot Needs You. Take our quick survey online. Come on, we don't ask for help often. Plus, you'll get a chance to win $100 to spend on ThinkGeek. http://p.sf.net/sfu/slashdot-survey ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] no browse index for request
Hi Gregory, There is probably nothing to worry about. Usually this particular error occurs when a search engine spider is crawling your site. As well as following links, some spiders (Yahoo slurp in particular I think) has a habit of trying out URLs that aren't normally linked to, by stripping off query string parameters, or visiting partial URLs. This is what may have happened - the spider might have stripped off the ?type=xyz. The exception error report has been fixed in newer versions of DSpace when running the JSPUI. See the following for details: - https://jira.duraspace.org/browse/DS-640 Thanks, Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 On 23/07/2011, at 8:13 AM, Heh, Gregory wrote: Can anyone give me some insight to this error message? I find it weird that the URL ends simply on “/browse”. Not something like “/browse?type=author”. I can’t see how a user would navigate to this URL aside from directly editing it. I am currently running a 1.5.1 installation of Dspace. Let me know if I should provide any additional info. An internal server error occurred on http://www.clpdigital.org/jspui: Date: 7/21/11 4:50 AM Session ID: 18D18A93AF8AD980B6E2A5C27DE625BF -- URL Was: http://www.clpdigital.org/jspui/handle/10493/63/browse -- Method: GET -- Parameters were: Exception: javax.servlet.ServletException: There is no browse index for the request at org.dspace.app.webui.servlet.BrowserServlet.doDSGet(BrowserServlet.java:92) at org.dspace.app.webui.servlet.DSpaceServlet.processRequest(DSpaceServlet.java:151) at org.dspace.app.webui.servlet.DSpaceServlet.doGet(DSpaceServlet.java:99) at javax.servlet.http.HttpServlet.service(HttpServlet.java:617) at javax.servlet.http.HttpServlet.service(HttpServlet.java:717) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.catalina.core.ApplicationDispatcher.invoke(ApplicationDispatcher.java:646) at org.apache.catalina.core.ApplicationDispatcher.processRequest(ApplicationDispatcher.java:436) at org.apache.catalina.core.ApplicationDispatcher.doForward(ApplicationDispatcher.java:374) at org.apache.catalina.core.ApplicationDispatcher.forward(ApplicationDispatcher.java:302) at org.dspace.app.webui.servlet.HandleServlet.doDSGet(HandleServlet.java:230) at org.dspace.app.webui.servlet.DSpaceServlet.processRequest(DSpaceServlet.java:151) at org.dspace.app.webui.servlet.DSpaceServlet.doGet(DSpaceServlet.java:99) at javax.servlet.http.HttpServlet.service(HttpServlet.java:617) at javax.servlet.http.HttpServlet.service(HttpServlet.java:717) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:128) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293) at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:849) at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:583) at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:454) at java.lang.Thread.run(Thread.java:619) Thanks. Gregory Heh Systems Analyst III/Applications Developer Information Technology Carnegie Library of Pittsburgh This email message and any files transmitted with it are intended only for the use of the individual or entity to which it is addressed and may contain information that is privileged, confidential, and exempt from disclosure under applicable law.? Any use, distribution, copying or disclosure by anyone other than the intended individual or entity is prohibited without prior approval.? If you have received this information in error, please notify
Re: [Dspace-tech] Problem in DSpace 1.5.1 deleting an eperson who is also a previous Item submitter (item.submitter_id)
Hi all, Yes - this is constrained via database foreign key rules. You can, if you want to, update the relevant user id for the item, but of course you'd lose the submitter / owner information. What we've done at the University of Auckland is to make all theses (which are the biggest source of stale accounts) be submitted via SWORD. This means the actual deposits are made with a single user account, while our SWORD client (http://easydeposit.swordapp.org/) takes care of the user authentication. It also has the benefit of students not having how to learn the DSpace submission system for a single one-off deposit. Likewise, all our research outputs are deposited via a CRIS system (http://www.symplectic.co.uk/) which means our repository is now just a downstream system, with all its data being fed from more specialized systems. This model seems to work well for us. Thanks, Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 On 22/07/2011, at 2:53 AM, Brian Freels-Stendel wrote: Morning, There doesn't seem to be a solid reason in the codebase that epeople who've submitted can't be deleted; it seems to be something that was decided on a database level. It makes sense, though, to keep it, on that level. Otherwise, you have database fields that point nowhere, and that can't be good. For general mass submissions, a workaround might be to use the original admin account (assuming that's not a person who might later want to be deleted.) For things like theses/dissertations, I think we have to be stuck with having those one-shot accounts pile up year after year. There might be some filter feature added so we don't have to look at accounts that are locked, but with the search functionality, I'm not sure that would be necessary. B-- On 7/21/2011 at 7:32 AM, in message a3e58c957c81584e933f5da65fd9680606494fe...@mbxa.exchange.cornell.edu, George S Kozak g...@cornell.edu wrote: Susan: I have run into the same problem, but in my case I was trying to delete the ids of graduate students who left the University, but who had submitted Theses and Dissertations to DSpace. I ended up disabling their logins, but could find no way to actually delete them. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: Thornton, Susan M. (LARC-B702)[LITES] [mailto:susan.m.thorn...@nasa.gov] Sent: Wednesday, July 20, 2011 6:33 PM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Problem in DSpace 1.5.1 deleting an eperson who is also a previous Item submitter (item.submitter_id) I ran into a problem I wanted to report in one of our DSpace instances. I was trying to delete an Eperson record as an Administrator, and I kept getting an Internal Server Error. The error message in the dspace.log file didn’t really give me too much to go on, but I finally figured out that I couldn’t delete that person because that person (me!) was the person who had added every Item to the repository and every single row in the Item table had that eperson_id in column “submitter_id”. I don’t think there should be any referential integrity between eperson.eperson_id and item.submitter_id, because it would certainly be possible and appropriate that the person who originally loaded the Items might eventually leave. I suppose something would have to be done in that case or you might end up with an eperson_id in “submitter_id” in the Item rows that no longer exists in the eperson table, but maybe in that instance a generic eperson_id could be used. Does anyone have thoughts on this? I’m not sure if this has been addressed in a subsequent release of DSpace (we’re in the process of implementing version 1.7.1 in our main Production DSpace instance). Thanks and Best regards, Sue Sue Walker-Thornton Software Developer/Database Administrator NASA Langley Research Center|LITES Contract SGT, Inc.|130 Research Drive Hampton, Va. 23666 Office: (757) 224-4074 Mobile: (757) 506-9903 Fax: (757) 224-4001 susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov -- 5 Ways to Improve Secure Unified Communications Unified Communications promises greater efficiencies for business. UC can improve internal communications as well as offer faster, more efficient ways to interact with customers and streamline customer service. Learn more! http://www.accelacomm.com/jaw/sfnl/114/51426253/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] indexing error: too many open files
Hi Joshua, Do you have any cron jobs setup that might be using the openjdk? Are you able to uninstall the openjdk library so that it can't be used any more? Thanks, Stuart On 21/07/2011, at 2:36 AM, Joshua Gomez wrote: I installed java-6-sun jdk and made it the default, but I am still getting the error with the index, though it now references the sunJDK instead of the OpenJDK. However, when I run a list of open files, I see several files opened by jsvc (with dspace as the user) that are from the openjdk library. I don't understand why it would still be using those .jar and .so files if the sunjdk is the default. Stuart Lewis s.le...@auckland.ac.nz 7/11/2011 6:06 PM Hi Joshua, The error message below suggests that you are running the openjdk. Instead, try installing the official Sun JDK: - https://wiki.duraspace.org/display/DSPACE/Installing+DSpace+1.7+on+Ubuntu#InstallingDSpace1.7onUbuntu-%28OPTIONAL%29ChangetousingSun%2FOracleJavaJDK This will hopefully help. Thanks, Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 On 12/07/2011, at 3:33 AM, Joshua Gomez wrote: I ran across the following error last week while trying to run the media filter (I'm using DSpace 1.7.2, on Ubuntu 10.04.2): Exception in thread Thread-2 java.lang.UnsatisfiedLinkError: /usr/lib/jvm/java-6-openjdk/jre/lib/amd64/libmanagement.so: /usr/lib/jvm/java-6-openjdk/jre/lib/amd64/libmanagement.so: cannot open shared object file: Too many open files at java.lang.ClassLoader$NativeLibrary.load(Native Method) at java.lang.ClassLoader.loadLibrary0(ClassLoader.java:1750) at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1667) at java.lang.Runtime.loadLibrary0(Runtime.java:840) at java.lang.System.loadLibrary(System.java:1047) at sun.security.action.LoadLibraryAction.run(LoadLibraryAction.java:67) at sun.security.action.LoadLibraryAction.run(LoadLibraryAction.java:47) at java.security.AccessController.doPrivileged(Native Method) at sun.management.ManagementFactory.clinit(ManagementFactory.java:485) at java.lang.management.ManagementFactory.getPlatformMBeanServer(ManagementFactory.java:521) at org.dspace.kernel.DSpaceKernelManager.unregisterMBean(DSpaceKernelManager.java:178) at org.dspace.servicemanager.DSpaceKernelImpl.destroy(DSpaceKernelImpl.java:211) at org.dspace.servicemanager.DSpaceKernelImpl.doDestroy(DSpaceKernelImpl.java:233) at org.dspace.servicemanager.DSpaceKernelImpl$1.run(DSpaceKernelImpl.java:78) It appears this error is not a problem with DSpace so much as the server environment, but I'm wondering if anyone else has come across such an error before? This error occurred after the new items had been filtered and the script was in the process of updating the index. I recently added about a thousand items that had very poor OCR (they were very old documents) and our index word limit is not set, so I am wondering if the index has become too large due to all the new words from the bad OCR. Many of the pdfs we added are pretty large so I'm also wondering if it's just a memory issue. Any thoughts? Joshua Joshua Gomez Digital Library Programmer Analyst Gelman Library George Washington University (202) 994-8267 jngo...@library.gwu.edu -- All of the data generated in your IT infrastructure is seriously valuable. Why? It contains a definitive record of application performance, security threats, fraudulent activity, and more. Splunk takes this data and makes sense of it. IT sense. And common sense. http://p.sf.net/sfu/splunk-d2d-c2___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- 10 Tips for Better Web Security Learn 10 ways to better secure your business today. Topics covered include: Web security, SSL, hacker attacks Denial of Service (DoS), private keys, security Microsoft Exchange, secure Instant Messaging, and much more. http://www.accelacomm.com/jaw/sfnl/114/51426210/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Login and IE8
I've just tested Tomcat 7.0.16 in my development environment (a Mac). I don't have IE to test with, but this also seems to affect Chrome, but not Firefox. While we track this down, or await a fix from Tomcat if the problem is their end, perhaps the best advice is to downgrade tomcat. If anyone is suffering from this problem whilst running other versions of Tomcat, it would be good to know. There is a JIRA issue to track this: https://jira.duraspace.org/browse/DS-959 Please add any extra information there. Thanks, Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 On 19/07/2011, at 7:26 AM, Cameron, Jacob wrote: I upgraded TOMCAT from 7.0.11 to 7.0.16 on Friday and this problem started for us here as well. We are using 1.7.1, XMLUI/Mirage. We only use the default DSpace login functionality. IE8 and IE9 both will just take you back to the homepage without logging you in. I have only changed the look and feel of the repository, I haven't made any other changes. -- Jake Cameron, BCS(UNB) Technical Specialist III Information Systems and Technical Services University of Lethbridge Library Phone:(403)329-2756 This e-mail, including any and all attachments, is only for the use of the intended recipient(s) and may contain information that is confidential or privileged. If you are not the intended recipient, you are advised that any dissemination, copying or other use of this e-mail is prohibited. Please notify the sender of the error in communication by return e-mail and destroy all copies of this e-mail. Thank you. -Original Message- From: Pottinger, Hardy J. [mailto:pottinge...@umsystem.edu] Sent: Monday, July 18, 2011 12:11 PM To: Tim Donohue; Amir Pourabdollah Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Login and IE8 Hi, this sounds eerily similar to this issue, which came up right around OR11 time: http://dspace.2283337.n4.nabble.com/jsessionid-in-cocoon-cache-td3580756 .ht ml The fix for us Shib people was to deploy a rewrite rule. I haven't yet investigated the mechanics behind this bug. It's on my list of things to look into. Perhaps the same XMLUI caching behavior with the login form is affecting the standard login? -- HARDY POTTINGER pottinge...@umsystem.edu University of Missouri Library Systems http://lso.umsystem.edu/~pottingerhj/ No matter how far down the wrong road you've gone, turn back. --Turkish proverb On 7/18/11 11:16 AM, Tim Donohue tdono...@duraspace.org wrote: Hi Amir, I just tried your site, and it is also not working for me in IE8/IE9. A few guesses on what could be the problem: (1) It could be something in your custom XMLUI Theme. If you have a Test or Development Server, you might want to try putting up the out-of-the-box Mirage Theme to see if that works (with the same/similar dspace.cfg configurations as you have in Production). If the out-of-the-box Mirage Theme works, then that may mean that something in your custom Theme is causing the DSpace login to not work properly in IE/Opera/Chrome, etc. Perhaps some custom Javascript which isn't working properly in IE/Opera/Chrome? It's hard to say what exactly could be the cause in a Theme. If you find this is the case find a resolution, it'd be useful to report back what the Theme issue was (so that we can all learn from it). (2) Did you modify any of the code underneath DSpace with regards to the out-of-the-box Authentication/Login Plugin? Did you modify which Authentication plugin is being used in your 'dspace.cfg' file? By default it should read: plugin.sequence.org.dspace.authenticate.AuthenticationMethod = \ org.dspace.authenticate.PasswordAuthentication If you've changed this config, or changed the PasswordAuthentication class itself, then it'd be good to know. However, if this is unchanged, then it should work fine for all web browsers (as it does on the demo.dspace.org site). Maybe someone else on this list has encountered this before, and may have some more hints or ideas? - Tim On 7/18/2011 10:50 AM, Amir Pourabdollah wrote: Hi Tim and thanks for following this up, My repository is on http://elogeo.nottingham.ac.uk/xmlui please feel free to test. As you see it is on xmlui/Mirage. The same repository in /jspui works fine in all browsers. I use DSpace default login functionality. My test on DSpace demo was also fine using IE8. Even it was all fine when I had my repository on my localhost, but when I reinstalled it on the server, this problem started. I also tried different browser running on the server (as its localhost) but same results.The DSpace log file also doesn't show any error or warning. It just shows that a login is attempted but then still the user
Re: [Dspace-tech] indexing error: too many open files
Hi Joshua, The error message below suggests that you are running the openjdk. Instead, try installing the official Sun JDK: - https://wiki.duraspace.org/display/DSPACE/Installing+DSpace+1.7+on+Ubuntu#InstallingDSpace1.7onUbuntu-%28OPTIONAL%29ChangetousingSun%2FOracleJavaJDK This will hopefully help. Thanks, Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 On 12/07/2011, at 3:33 AM, Joshua Gomez wrote: I ran across the following error last week while trying to run the media filter (I'm using DSpace 1.7.2, on Ubuntu 10.04.2): Exception in thread Thread-2 java.lang.UnsatisfiedLinkError: /usr/lib/jvm/java-6-openjdk/jre/lib/amd64/libmanagement.so: /usr/lib/jvm/java-6-openjdk/jre/lib/amd64/libmanagement.so: cannot open shared object file: Too many open files at java.lang.ClassLoader$NativeLibrary.load(Native Method) at java.lang.ClassLoader.loadLibrary0(ClassLoader.java:1750) at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1667) at java.lang.Runtime.loadLibrary0(Runtime.java:840) at java.lang.System.loadLibrary(System.java:1047) at sun.security.action.LoadLibraryAction.run(LoadLibraryAction.java:67) at sun.security.action.LoadLibraryAction.run(LoadLibraryAction.java:47) at java.security.AccessController.doPrivileged(Native Method) at sun.management.ManagementFactory.clinit(ManagementFactory.java:485) at java.lang.management.ManagementFactory.getPlatformMBeanServer(ManagementFactory.java:521) at org.dspace.kernel.DSpaceKernelManager.unregisterMBean(DSpaceKernelManager.java:178) at org.dspace.servicemanager.DSpaceKernelImpl.destroy(DSpaceKernelImpl.java:211) at org.dspace.servicemanager.DSpaceKernelImpl.doDestroy(DSpaceKernelImpl.java:233) at org.dspace.servicemanager.DSpaceKernelImpl$1.run(DSpaceKernelImpl.java:78) It appears this error is not a problem with DSpace so much as the server environment, but I'm wondering if anyone else has come across such an error before? This error occurred after the new items had been filtered and the script was in the process of updating the index. I recently added about a thousand items that had very poor OCR (they were very old documents) and our index word limit is not set, so I am wondering if the index has become too large due to all the new words from the bad OCR. Many of the pdfs we added are pretty large so I'm also wondering if it's just a memory issue. Any thoughts? Joshua Joshua Gomez Digital Library Programmer Analyst Gelman Library George Washington University (202) 994-8267 jngo...@library.gwu.edu -- All of the data generated in your IT infrastructure is seriously valuable. Why? It contains a definitive record of application performance, security threats, fraudulent activity, and more. Splunk takes this data and makes sense of it. IT sense. And common sense. http://p.sf.net/sfu/splunk-d2d-c2___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- All of the data generated in your IT infrastructure is seriously valuable. Why? It contains a definitive record of application performance, security threats, fraudulent activity, and more. Splunk takes this data and makes sense of it. IT sense. And common sense. http://p.sf.net/sfu/splunk-d2d-c2 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] OAI-PMH
Hi Eric, We are implementing the discovery tool Summon at our library and they would like to harvest our DSpace IR via OAI-PMH. Does anyone out there know what URL I should send them? We are currently on 1.4.2 with a rather generic install. - http://dspace.oakland.edu:8080/dspace-oai/request To test, visit: - http://dspace.oakland.edu:8080/dspace-oai/request?verb=Identify Thanks, Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- All of the data generated in your IT infrastructure is seriously valuable. Why? It contains a definitive record of application performance, security threats, fraudulent activity, and more. Splunk takes this data and makes sense of it. IT sense. And common sense. http://p.sf.net/sfu/splunk-d2d-c2 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Welcome to the latest DSpace committer: Andrea Schweer
Dear DSpace community member, The DSpace committers team are delighted to announce a new member to the group: Andrea Schweer. Andrea is based at the ITS department of the University of Waikato in New Zealand and works for the Library Consortium of New Zealand (LCoNZ). She is the technical person responsible for four DSpace instances of members and clients of the consortium and has been in this position since the end of last year. Her goal is to program herself out of a job by writing code that gives the repository managers as much control over the repositories as possible. Andrea is originally from Germany and moved to New Zealand a few years ago. She holds a Diploma in Computer Science from the University of Dortmund and a PhD in Computer Science from the University of Waikato. We are always on the lookout for new developers, contributors, and committers within the DSpace community. Anyone who would like to get more involved is encouraged to do so. You're also welcome to contact us at any time if you'd like ideas of how to start contributing: - https://wiki.duraspace.org/display/DSPACE/DSpaceContributors Contributions can take many forms, from writing code to editing documentation, or testing new releases to designing new themes for our user interfaces. Thanks, (on behalf of the DSpace committers group) Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- All of the data generated in your IT infrastructure is seriously valuable. Why? It contains a definitive record of application performance, security threats, fraudulent activity, and more. Splunk takes this data and makes sense of it. IT sense. And common sense. http://p.sf.net/sfu/splunk-d2d-c2 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] How to set up scripts and parameters in launcher.xml in DSpace 1.7.1
Hi Sue, Have you tried using the argument options? command namestat-general/name descriptionCompile the general statistics/description step passuserargs=false classorg.dspace.app.statistics.CreateStatReport/class argument-r/argument argumentstat-general/argument /step /command You should be able to pass in command line options, and state whether or not you allow further parameters to be passed from the user calling the script. Thanks, Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 On 22/06/2011, at 4:47 AM, Thornton, Susan M. (LARC-B702)[LITES] wrote: Can someone please give me an example of how you would set up the execution of a script, for example “import”, in /dspace/config/launcher.xml? The software comes delivered with the following: command nameimport/name descriptionImport items into DSpace/description step classorg.dspace.app.itemimport.ItemImport/class /step /command Here is the command line from our “import” script in DSpace 1.5.1: ./dsrun org.dspace.app.itemimport.ItemImport --add --eperson=susan.m.thorn...@nasa.gov --collection=2121/39071 --source=/dspace/tmp/imported/articles --mapfile=/dspace/outfiles/imports/20090326_Articles.map /dspace/outfiles/imports/20090326_Articles.out How do I set all this up in launcher.xml? Note also that I am writing the output of the script into /dspace/outfiles/imports/20090326_Articles.out. How do I do this in launcher.xml? Thanks in advance, Sue Sue Walker-Thornton Software Developer/Database Administrator NASA Langley Research Center|LITES Contract SGT, Inc.|130 Research Drive Hampton, Va. 23666 Office: (757) 224-4074 Mobile: (757) 506-9903 Fax: (757) 224-4001 susan.m.thorn...@nasa.gov -- EditLive Enterprise is the world's most technically advanced content authoring tool. Experience the power of Track Changes, Inline Image Editing and ensure content is compliant with Accessibility Checking. http://p.sf.net/sfu/ephox-dev2dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- EditLive Enterprise is the world's most technically advanced content authoring tool. Experience the power of Track Changes, Inline Image Editing and ensure content is compliant with Accessibility Checking. http://p.sf.net/sfu/ephox-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] large video files in dspace
Hi Tint, Thanks very much for the explanation. Another question (this is an issue with another repository): we have some records in our repository with links to video files on our streaming server. Now, we want to archive those files in dspace. I'm aware that we can upload additional bitstreams to an existing record from front end. But how can I do it from backend? Export item and then import again? Or is there any other way? The 'itemupdate' command introduced in DSpace 1.6 should allow you to do this. See: - https://wiki.duraspace.org/display/DSDOC/System+Administration#SystemAdministration-ItemUpdate Thanks, Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- EditLive Enterprise is the world's most technically advanced content authoring tool. Experience the power of Track Changes, Inline Image Editing and ensure content is compliant with Accessibility Checking. http://p.sf.net/sfu/ephox-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Storage capacity of Dspace to version 1.7.1 - Help
Hi Patrícia, Anyone know what the storage capacity of Dspace to version 1.7.1? Does anyone know the capacity of items that can be included in each collection? We want to store more than 3 million items and do not know if the system supports. In theory, the system will hold much more than that - there are no fixed limits as such. The limits that you'll find will depend upon several factors, including: - The number of users of the system (is it for public use with lots of visitors, or private with few users) - The size and speed of your servers + disks, and how you architect the systems - What facilities you have to add capacity via load balancing, or advanced tuning of components such as the database A DSpace repository with 3 million items would probably easily be the biggest installation that we know of. If you do choose to use DSpace, it will be interesting hearing your experiences. Thanks, Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- EditLive Enterprise is the world's most technically advanced content authoring tool. Experience the power of Track Changes, Inline Image Editing and ensure content is compliant with Accessibility Checking. http://p.sf.net/sfu/ephox-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] IIS DC Shelfmark identifier
Hi George, I just installed an instance of DSpace on a Windows machine running IIS. I have two questions: 1. Is there a documentation on how to have IIS communicate with Tomcat? I have DSpace running on the machine from http://localhost, but I need to be able to access it via a URL like www.abc.org. You can use the ISAPI filter. See: - http://tomcat.apache.org/connectors-doc/webserver_howto/iis.html Thanks, Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- vRanger cuts backup time in half-while increasing security. With the market-leading solution for virtual backup and recovery, you get blazing-fast, flexible, and affordable data protection. Download your free trial now. http://p.sf.net/sfu/quest-d2dcopy1 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Bitstream Description in Batch import
Hi Joseph, I know you can add a description to a bitstream when you upload it through the XMLUI Can you do this when you do a batch upload using the CLI? dspace import Try adding : - \tdescription: my description Other options are \tpermissions: and \tprimary:true Also, dspace import -h shows an option -z for a zip file. The Documentation doesn't describe how to use this option, (or mention it) http://www.dspace.org/1_7_1Documentation/System%20Administration.html#SystemAdministration-ItemImporterandExporter Does anyone have experience using this option? If you perform an export via the web user interface, it downloads as a zip file. There is also a 'give this to me as a zip file' option in the CLI exporter. Inside the zip file is the normal import structure or directories 1.. / 2.. / 3.. etc, each with metadata files and content files. The zip option makes it easier to import these without first unzipping them. Thanks, Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- vRanger cuts backup time in half-while increasing security. With the market-leading solution for virtual backup and recovery, you get blazing-fast, flexible, and affordable data protection. Download your free trial now. http://p.sf.net/sfu/quest-d2dcopy1 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Bulk Edit Export problem resolved--kind of.
Hi Jeff, Yes - we tend to advise using OpenOffice as it doesn't try to be so 'clever' when it interprets the CSV. For the date issue - we recommend setting all columns to 'Text' in the 'how shall I open this file' dialog by clicking on the top left cell (which highlights all cells) and selecting text. If you do this, then the dates won't get interpreted, but will stay as literal strings. Thanks, Stuart On 26/05/2011, at 6:51 AM, Jeffrey Trimble wrote: The problem really isn't the exporter. It's Microsoft Excel and how it reads a .cvs file. If I open a exported metadata file with a long field, such as description.abstract. That field, if it has paragraph breaks, is interpreted as a line return by Microsoft. Very strange. If you open this same file using Open Office, the file is fine. Perfectly fine, well save a data issue. Dates input by the humans, such as 2005-01-03 (and stored that way in Postgres) are interpreted as 01/03/05. But, if you have 2005-01-03:00:04, etc or other kinds of data, the data is extrapolated perfectly. Also, iWorks 09 / Numbers is just fuggly when dealing with this. LOL --Jeff On May 25, 2011, at 2:16 PM, Jeffrey Trimble wrote: I'm seeing something really strange. When exporting the .csv file, I'm getting large fields in the first column (which should be the ITEM ID). I've set the field separator to $ instead of the comma. Anyone seen anything like this? I'll send an example to anyone who wants to see this. Any thoughts? Jeffrey Trimble System LIbrarian William F. Maag Library Youngstown State University 330.941.2483 (Office) jatrim...@ysu.edu http://www.maag.ysu.edu http://digital.maag.ysu.edu For he is the Kwisatz Haderach... -- vRanger cuts backup time in half-while increasing security. With the market-leading solution for virtual backup and recovery, you get blazing-fast, flexible, and affordable data protection. Download your free trial now. http://p.sf.net/sfu/quest-d2dcopy1 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech Jeffrey Trimble System LIbrarian William F. Maag Library Youngstown State University 330.941.2483 (Office) jatrim...@ysu.edu http://www.maag.ysu.edu http://digital.maag.ysu.edu For he is the Kwisatz Haderach... -- vRanger cuts backup time in half-while increasing security. With the market-leading solution for virtual backup and recovery, you get blazing-fast, flexible, and affordable data protection. Download your free trial now. http://p.sf.net/sfu/quest-d2dcopy1 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- vRanger cuts backup time in half-while increasing security. With the market-leading solution for virtual backup and recovery, you get blazing-fast, flexible, and affordable data protection. Download your free trial now. http://p.sf.net/sfu/quest-d2dcopy1 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] springframework error calling dspace script
Hi Jennifer, See: - https://jira.duraspace.org/browse/DS-875 The error message can be ignored. There is a temporary patch with that issue to remove the error message, and a final fix will be included in the upcoming 1.7.2 release. Thanks, Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 On 25/05/2011, at 12:59 PM, Jennifer Whalan wrote: We are getting this issue as well, on 1.7.1. Did you find any fix for it? Thanks Jennifer Jennifer Whalan Territory Stories Administrator Innovation Access, Northern Territory Library Department of Natural Resources, Environment, The Arts and Sport Northern Territory Government Phone: (08) 8922 0752 Fax:(08) 8922 0722 Email: jennifer.wha...@nt.gov.au Web:www.ntl.nt.gov.au The information contained in this message and any attachments may be confidential information and may be subject to legal privilege, public interest or legal profession privilege. If you are not the intended recipient, any use, disclosure or copying of this message or any attachments is unauthorised. If you have received this document in error, please advise the sender. No representation or warranty is given that attached files are free from viruses or other defects. The recipient assumes all responsibility for any loss or damage resulting directly or indirectly from the use of any attached files. From: Moisés Álvarez [mailto:moises.alva...@urv.cat] Sent: Friday, 1 April 2011 7:40 PM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] springframework error calling dspace script Hello all, I've recently updated my repository from 1.7.0 to 1.7.1 and now everytime I call [dspace]/bin/dspace commands I get this error before command is done: [dspace@localhost bin]$ ./dspace index -r java.lang.IllegalArgumentException: Resource path [/home/dspace/bin/dspace] does not denote a directory at org.springframework.core.io.support.PathMatchingResourcePatternResolver.retrieveMatchingFiles(PathMatchingResourcePatternResolver.java:563) at org.springframework.core.io.support.PathMatchingResourcePatternResolver.doFindMatchingFileSystemResources(PathMatchingResourcePatternResolver.java:543) at org.springframework.core.io.support.PathMatchingResourcePatternResolver.doFindPathMatchingFileResources(PathMatchingResourcePatternResolver.java:526) at org.springframework.core.io.support.PathMatchingResourcePatternResolver.findPathMatchingResources(PathMatchingResourcePatternResolver.java:342) at org.springframework.core.io.support.PathMatchingResourcePatternResolver.getResources(PathMatchingResourcePatternResolver.java:263) at org.dspace.servicemanager.config.DSpaceConfigurationService.loadInitialConfig(DSpaceConfigurationService.java:375) at org.dspace.servicemanager.config.DSpaceConfigurationService.init(DSpaceConfigurationService.java:60) at org.dspace.servicemanager.DSpaceKernelImpl.start(DSpaceKernelImpl.java:145) at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:51) Process is done, but this message appears always, I'm not sure which is it's origin. My previous version 1.7.0 doesn't show this message. I will be really pleased If someone can help me on this. Thanks in advance. ATT1..txtATT2..txt -- vRanger cuts backup time in half-while increasing security. With the market-leading solution for virtual backup and recovery, you get blazing-fast, flexible, and affordable data protection. Download your free trial now. http://p.sf.net/sfu/quest-d2dcopy1 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Last-Modified handling
Hi Monika,
There appears to be a problem with last modified handling of bitstreams
For the bitstream
http://scholars.indstate.edu/bitstream/10484/108/1/Yazvac.pdf
the last modified is reported as Thu, 06 Jan 2011 17:54:26
but requesting the stream with
curl -z 'Thu, 06 Jan 2011 17:54:26 GMT'
http://scholars.indstate.edu/bitstream/10484/108/1/Yazvac.pdf
returns the bitstream itself
curl realizes that the bitstream is unchanged when doing (date + 1second)
curl -z 'Thu, 06 Jan 2011 17:54:27 GMT'
http://scholars.indstate.edu/bitstream/10484/108/1/Yazvac.pdf
I found the same behavior for a bitstream from another DSPACE instance:
http://smartech.gatech.edu/bitstream/handle/1853/32992/museum_program.pdf?sequence=3
It seems that the servlet may compare last modified dates with = instead of
Where can I check/fix this ?
Take a look in:
-
dspace-jspui/dspace-jspui-api/src/main/java/org/dspace/app/webui/servlet/BitstreamServlet.java
And look for the following code:
// Check for if-modified-since header
long modSince = request.getDateHeader(If-Modified-Since);
if (modSince != -1 item.getLastModified().getTime() modSince)
{
// Item has not been modified since requested date,
// hence bitstream has not; return 304
response.setStatus(HttpServletResponse.SC_NOT_MODIFIED);
return;
}
That might be the bit to check.
Last modified date for an item is based on the last date that the item was
modified (e.g. metadata updated, new file uploaded).
Thanks,
Stuart Lewis
Digital Development Manager
Te Tumu Herenga The University of Auckland Library
Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand
Ph: +64 (0)9 373 7599 x81928
--
WhatsUp Gold - Download Free Network Management Software
The most intuitive, comprehensive, and cost-effective network
management toolset available today. Delivers lowest initial
acquisition cost and overall TCO of any competing solution.
http://p.sf.net/sfu/whatsupgold-sd
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Change the URI in items already imported
Hi Verónica,
I have a problem, I had already migrated such 2000 items to dspace, but I
forgot configure the handle prefix before to do this, now the URI in the
general info of the items shows this:
URI: http://hdl.handle.net/123456789/1043
I've re-configured the handle prefix in dspace.cfg, but the URI in the
general info doesn't change, only the new items imported have the new URI.
Mi question is: How do I change the URI of the imported items before..???
You should be able to run:
- [dspace]/bin/dspace update-handle-prefix {old handle} {new handle}
For example:
- [dspace]/bin/dspace update-handle-prefix 123456789 10438
See:
-
https://wiki.duraspace.org/display/DSDOC/Installation#Installation-UpdatingExistingHandlePrefixes
Thanks,
Stuart Lewis
Digital Development Manager
Te Tumu Herenga The University of Auckland Library
Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand
Ph: +64 (0)9 373 7599 x81928
--
WhatsUp Gold - Download Free Network Management Software
The most intuitive, comprehensive, and cost-effective network
management toolset available today. Delivers lowest initial
acquisition cost and overall TCO of any competing solution.
http://p.sf.net/sfu/whatsupgold-sd
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Setting JSESSIONID cookie to httpOnly in DSpace 1.5.1
Hi Sue, Can someone help me figure out the correct code to use if I wanted to modify DSpace 1.5.1 to set the JSESSIONID cookie to httpOnly, and where would be the best place to put it? Header-default.jsp? Index.jsp? Any help would very much be appreciated. If you are running a recent-ish version of Tomcat, you can set this in [tomcat]/conf/context.xml: Change: Context to Context useHttpOnly=true I was able to verify it was set by using Firebug+FireCookie in Firefox. Thanks, Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- WhatsUp Gold - Download Free Network Management Software The most intuitive, comprehensive, and cost-effective network management toolset available today. Delivers lowest initial acquisition cost and overall TCO of any competing solution. http://p.sf.net/sfu/whatsupgold-sd ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] issue w/sword interface on dspace 1.7.1
Hi Rudi, Excellent - thanks for reporting back that it now works. (Sometimes we don't hear back, and we're unsure if there is a still a problem, or if it all works fine. So much appreciated). Thanks, Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 On 12/04/2011, at 1:21 AM, Rudi Bergval wrote: Hey there Stuart, I fixed the problem. Or rather, there was no problem... Apparently, I made some changes to dspace.cfg but forgot(?) to follow the correct update procedure: 'ant update_configs' and 'ant -Dconfig=/[dspace]/config/dspace.cfg update'. Afer making some additional changes I ran both commands and now I can deposit items using EasyDeposit. Sorry for the mix-up ;) Rudi **Hi Stuart, ** **Thanks for your reply. The DSpace installation I'm working with is a **clean install of version 1.7.0 w/update to 1.7.1. I have checked and **re-checked my dspace.cfg to see if I could find anything out of the **ordinary but unfortunately, without success; the same error occurs. ** **I have the [plugin.named.org.dspace.content.packager.PackageIngester] **configured as you suggested but to no avail. Attached I have the SWORD **configuration section from my dspace.cfg (sword-config.dspace.txt). ** **I will try to set up another DSpace installation (version 1.7.1) to see **if I can reproduce the error and rule out and update-related issues. I **will post back my results later this week (probably). ** **Thanks again so far, ** **Rudi ** ** Hi Rudi, I'm trying to deposit an item into DSpace with EasyDeposit. All **goes **well until the actual deposit when I get the error message **below. I **have also tried to make a deposit via curl, unfortunately, **with the **same result. 2011-04-07 09:06:45,163 INFO org.dspace.sword.SWORDService @ **[2011- 04-07 09:06:45.163] Initialising depositor for an Item in a **Collection; ** ** 2011-04-07 09:06:45,164 INFO **org.dspace.sword.SWORDService @ [2011- 04-07 09:06:45.164] Loaded ingester: org.dspace.sword.SWORDMETSIngester; 2011-04-07 09:06:45,164 INFO org.dspace.sword.SWORDService @ **[2011- 04-07 09:06:45.164] Using package manifest format: METS; ** ** **2011-04-07 09:06:45,164 WARN org.dspace.core.PluginManager @ Cannot find named plugin for interface=org.dspace.content.packager.PackageIngester, name=METS Is your DSpace system an upgrade from a older version? If so, I think there were quite a few changes to the dspace.cfg file **in **version 1.7 relating to packaging because of some extensive re- **working **of this functionality to help with computability with **Duraspace **initiatives. For example, do you have the following section in dspace.cfg? plugin.named.org.dspace.content.packager.PackageIngester = \ org.dspace.content.packager.DSpaceAIPIngester = AIP, \ org.dspace.content.packager.PDFPackager = Adobe PDF, PDF, \ org.dspace.content.packager.DSpaceMETSIngester = METS, \ org.dspace.content.packager.RoleIngester = DSPACE-ROLES Thanks, Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library **Auckland Mail **Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- Forrester Wave Report Recovery time is now measured in hours and minutes not days. key insights are discussed in the 2010 Forrester Wave Report as part of an in-depth evaluation of disaster recovery service providers. ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] issue w/sword interface on dspace 1.7.1
Hi Rudi, I’m trying to deposit an item into DSpace with EasyDeposit. All goes well until the actual deposit when I get the error message below. I have also tried to make a deposit via curl, unfortunately, with the same result. 2011-04-07 09:06:45,163 INFO org.dspace.sword.SWORDService @ [2011-04-07 09:06:45.163] Initialising depositor for an Item in a Collection; 2011-04-07 09:06:45,164 INFO org.dspace.sword.SWORDService @ [2011-04-07 09:06:45.164] Loaded ingester: org.dspace.sword.SWORDMETSIngester; 2011-04-07 09:06:45,164 INFO org.dspace.sword.SWORDService @ [2011-04-07 09:06:45.164] Using package manifest format: METS; 2011-04-07 09:06:45,164 WARN org.dspace.core.PluginManager @ Cannot find named plugin for interface=org.dspace.content.packager.PackageIngester, name=METS Is your DSpace system an upgrade from a older version? If so, I think there were quite a few changes to the dspace.cfg file in version 1.7 relating to packaging because of some extensive re-working of this functionality to help with computability with Duraspace initiatives. For example, do you have the following section in dspace.cfg? plugin.named.org.dspace.content.packager.PackageIngester = \ org.dspace.content.packager.DSpaceAIPIngester = AIP, \ org.dspace.content.packager.PDFPackager = Adobe PDF, PDF, \ org.dspace.content.packager.DSpaceMETSIngester = METS, \ org.dspace.content.packager.RoleIngester = DSPACE-ROLES Thanks, Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- Xperia(TM) PLAY It's a major breakthrough. An authentic gaming smartphone on the nation's most reliable network. And it wants your games. http://p.sf.net/sfu/verizon-sfdev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Sword servicedocument
Hi Lewatle,
I want to enable servicedocument for our sword I dit this previously but I
think I am missing some steps now, anyone please tell me what properties do
I need to change in order to configure sword servicedocument .
As long as you have the 'sword' webapp deployed, there is usually no
configuration required. The service document will be found at
/sword/servicedocument.
Depending upon how you deploy it and name it, you may need to adjust these two
settings in dspace.cfg:
# sword.deposit.url = http://www.myu.ac.uk/sword/deposit
# sword.servicedocument.url = http://www.myu.ac.uk/sword/servicedocument
But these will only need to be edited if you're not using the default locations
of:
{dspace.url}/sword/deposit
{dspace.url}/sword/servicedocument
Thanks,
Stuart Lewis
Digital Development Manager
Te Tumu Herenga The University of Auckland Library
Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand
Ph: +64 (0)9 373 7599 x81928
--
Colocation vs. Managed Hosting
A question and answer guide to determining the best fit
for your organization - today and in the future.
http://p.sf.net/sfu/internap-sfd2d
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] bulk loading
Hi Lewatle, I have items that I want to load to dspace, they are PDF documents, I want to use bulk loading facility to load them at once to my collection, can someone advice on how to do that. Perform a web search for 'dspace import' and you'll find a lot of helpful resources. Or look in the DSpace wiki for instructions: - https://wiki.duraspace.org/display/DSDOC/System+Administration#SystemAdministration-ItemImporterandExporter One useful resource in the form of a teaching course module can be found at: - http://hdl.handle.net/2160/627 I hope that helps, Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- Colocation vs. Managed Hosting A question and answer guide to determining the best fit for your organization - today and in the future. http://p.sf.net/sfu/internap-sfd2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Google Apps Email
Hi Jason, I know that DSpace has the ability to use LDAP for authentication. Recently, however, our institution decided to switch to Google Apps for our email. We were wondering if DSpace is able to support authentication via Google Apps. Does anyone have any experience with this? We do the same here, however we provide the authentication to Google Apps. We use Shibboleth as the authentication into Google apps, so that our users can use their normal logins. When they try to log-in, they are bounced to our shibboleth server, get authenticated, and are then bounced back to Google apps. We also use Shibboleth for our DSpace instance. Thanks, Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- Colocation vs. Managed Hosting A question and answer guide to determining the best fit for your organization - today and in the future. http://p.sf.net/sfu/internap-sfd2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Difference viewing in IE
Hi Karen, This has been fixed for 1.7.1 / 1.8. The changes required (a couple of lines in 2 files) can be seen at: - https://fisheye3.atlassian.com/changelog/dspace/?cs=6044 The problem report is at: - https://jira.duraspace.org/browse/DS-809 Thanks, Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 On 9/03/2011, at 8:08 AM, Daniel Ishimitsu wrote: Hi Karen, We had this problem also. If I recall, our solution involved removing the display:none for the short-description in style.css. It seems like IE couldn't differentiate the singular span class=short-description / tag from an opening span class=short-description tag. So it expects a /span, but can't find one and hides everything below the first community without a short description. Daniel Ishimitsu Hamilton Library University of Hawaii On 3/8/2011 6:51 AM, Savage, Karen R. wrote: We're using the mirage theme in our new instance of dspace, and we've noticed a difference in the layout between IE and other browsers. On pages with lists, e.g. The front page with the list of communities, the Communities Collections page, other browsers display the entire list; IE shows only the first two items in the list (see the two image captures). I know that the reset.css file controls differences in browsers, but I don't see which item might affect this particular problem. -- Karen Savage Baylor University Libraries Electronic Library Library Systems karen_sav...@baylor.edu (254) 710-3275 -- What You Don't Know About Data Connectivity CAN Hurt You This paper provides an overview of data connectivity, details its effect on application quality, and explores various alternative solutions. http://p.sf.net/sfu/progress-d2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech ATT1..txtATT2..txt -- What You Don't Know About Data Connectivity CAN Hurt You This paper provides an overview of data connectivity, details its effect on application quality, and explores various alternative solutions. http://p.sf.net/sfu/progress-d2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] problem in metadata import
Hi Ahmed, // csv file itle,Creator,Publisher,Type,Format,Language,Subject_Text,Description_Text,Date_Text Counselling children with special needs / Gill Brearley.,Brearley. Gill. 171,Oxford [England] ; Malden. MA. USA : Blackwell Science.,Text,ix. 149 p. :,eng Please see: - https://wiki.duraspace.org/display/DSDOC/System+Administration#SystemAdministration-TheCSVFiles The format of your CSV files need to be different. The best way to look at a valid CSV is to export some items, and see how they look. Your headers all need to be different, and you need to put an id column in at the beginning. Thanks, Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- What You Don't Know About Data Connectivity CAN Hurt You This paper provides an overview of data connectivity, details its effect on application quality, and explores various alternative solutions. http://p.sf.net/sfu/progress-d2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] problem in metadata import
Hi Ahmed, Are you able to email the top 10 lines, as Andrea suggested? The likely problem is that one of your headings only has one element, for example: title Everything needs at least two elements, schema.element, for example: dc.title (or dc.title.alternative, or dc.title.alternative[en_NZ]) If you are able to show us your file, we might be able to spot the issue. We are also aware that the error messages need to be improved with this, and hope to do this better in the next release of DSpace. Thanks, Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 On 2/03/2011, at 9:17 PM, Ahmed Maher wrote: yes , i tried all , and i tried using the import command ./dspace metadata-import -f bib-59.dublin-core.xml and it return this error Error reading file: 1 On 3/1/11, Andrea Schweer schw...@waikato.ac.nz wrote: Hi, On 02/03/11 01:26, Ahmed Maher wrote: i have problem in metadata import i try to import some dublin core records via metadata import through xmlui this error appears java.lang.ArrayIndexOutOfBoundsException: 1 Make sure your metadata file follows the format described here: https://wiki.duraspace.org/display/DSDOC/System+Administration#SystemAdministration-TheCSVFiles Some more detail is needed to diagnose this error. Are there more lines in the error message? If so, could you send the top 10 lines or so? Have you tried submitting just a single record? Do you get the same error? If not, you could try submitting parts of your file at a time to find out which record is causing the problem. cheers, Andrea -- Andrea Schweer IRR Technical Specialist, ITS Information Systems The University of Waikato, Hamilton, New Zealand -- Free Software Download: Index, Search Analyze Logs and other IT data in Real-Time with Splunk. Collect, index and harness all the fast moving IT data generated by your applications, servers and devices whether physical, virtual or in the cloud. Deliver compliance at lower cost and gain new business insights. http://p.sf.net/sfu/splunk-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Free Software Download: Index, Search Analyze Logs and other IT data in Real-Time with Splunk. Collect, index and harness all the fast moving IT data generated by your applications, servers and devices whether physical, virtual or in the cloud. Deliver compliance at lower cost and gain new business insights. http://p.sf.net/sfu/splunk-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Free Software Download: Index, Search Analyze Logs and other IT data in Real-Time with Splunk. Collect, index and harness all the fast moving IT data generated by your applications, servers and devices whether physical, virtual or in the cloud. Deliver compliance at lower cost and gain new business insights. http://p.sf.net/sfu/splunk-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Moving data from one instance to another Dspace 1.6.2
Hi Stephen, I have used the Export (Migrate) Collection option in DSpace which has generated a zip file with the requisite information. I assume I now upload this to the new server, unzip it an appropriate location and then run the dsrun command with the appropriate options. Could someone confirm and give me the specific switches/options for the dsrun in this case? adding items from zip file:dspace import -a -e eperson -c collection -s sourcedir -z filename.zip -m mapfile e.g. [dspace]/bin/dspace import -a -e y...@email.com -c 123456789/55 -s /tmp -z filename.zip -m mapfile You don't need to unzip the import file first - the importer can do that for you. Also, is there options that can be used with the dsrun to export and import only the metadata but not bitstreams for a collection? I have tried using the Export Metadata option on the first server and and then the Import Metadata option on the second instance but that keeps failing with an unknown error. Could you send a message with the complete output the command gives, and we'll see if we can help work out the error. Thanks, Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- Free Software Download: Index, Search Analyze Logs and other IT data in Real-Time with Splunk. Collect, index and harness all the fast moving IT data generated by your applications, servers and devices whether physical, virtual or in the cloud. Deliver compliance at lower cost and gain new business insights. http://p.sf.net/sfu/splunk-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] sword issue
Hi Jose, I'm testing out my new sword (1.7) setup and I see that the email I get when depositing an item using sword does not contain the title of the item. Has anyone seen this? Thanks for spotting this. We've tracked the problem down now. It was related to some changes in the METS packager in 1.7 that allows community and collection APIs to be ingested. We've have it recorded in JIRA now (including a full description of the problem): - https://jira.duraspace.org/browse/DS-821 Hopefully this will get fixed in 1.7.1. Thanks, Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- The ultimate all-in-one performance toolkit: Intel(R) Parallel Studio XE: Pinpoint memory and threading errors before they happen. Find and fix more than 250 security defects in the development cycle. Locate bottlenecks in serial and parallel code that limit performance. http://p.sf.net/sfu/intel-dev2devfeb ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] sword issue
Hi Jose, I've just tested this, and we see it too. We also see the following: - Perform a SWORD deposit - While the deposit is completing, refresh the collection homepage (JSPUI) of the collection you are depositing into - Look at the title of the most recent item - For several seconds it is set to 'untitled', before then getting updated to the real title So I think what is happening, is that the item's metadata isn't getting stored until a short while after the deposit, therefore the email cannot find the title of the item. I'm not sure what is causing this though! Thanks, Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 On 16/02/2011, at 10:55 AM, Blanco, Jose wrote: I just tried it with a clean dspace 17 installation and I'm seeing the same thing. This must be a bug in 1.7. Could someone confirm this. Thank you! Jose -Original Message- From: Blanco, Jose [mailto:blan...@umich.edu] Sent: Tuesday, February 15, 2011 4:26 PM To: dspace-tech Subject: Re: [Dspace-tech] sword issue Any input on this question would be appreciated. I can't seem to figure out why this is happening. When I deposit an item using the jspui, I get an email that tells me the title of the item I deposited, but if I use sword the title comes across as Untitled. I have put some debug statements in the routine that grabs the item from the dc object, and the title does not seem to be there - not sure why this is happening. The item is deposited just fine, but the email is wrong. I wonder if anyone has seen this. Thank you! Jose -Original Message- From: Blanco, Jose [mailto:blan...@umich.edu] Sent: Tuesday, February 15, 2011 11:17 AM To: dspace-tech Subject: [Dspace-tech] sword issue I'm testing out my new sword (1.7) setup and I see that the email I get when depositing an item using sword does not contain the title of the item. Has anyone seen this? -- The ultimate all-in-one performance toolkit: Intel(R) Parallel Studio XE: Pinpoint memory and threading errors before they happen. Find and fix more than 250 security defects in the development cycle. Locate bottlenecks in serial and parallel code that limit performance. http://p.sf.net/sfu/intel-dev2devfeb ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- The ultimate all-in-one performance toolkit: Intel(R) Parallel Studio XE: Pinpoint memory and threading errors before they happen. Find and fix more than 250 security defects in the development cycle. Locate bottlenecks in serial and parallel code that limit performance. http://p.sf.net/sfu/intel-dev2devfeb ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- The ultimate all-in-one performance toolkit: Intel(R) Parallel Studio XE: Pinpoint memory and threading errors before they happen. Find and fix more than 250 security defects in the development cycle. Locate bottlenecks in serial and parallel code that limit performance. http://p.sf.net/sfu/intel-dev2devfeb ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- The ultimate all-in-one performance toolkit: Intel(R) Parallel Studio XE: Pinpoint memory and threading errors before they happen. Find and fix more than 250 security defects in the development cycle. Locate bottlenecks in serial and parallel code that limit performance. http://p.sf.net/sfu/intel-dev2devfeb ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Dspace on IIS
Hi Palash, I have installed Dspace 1.7.0 on Windows using Apache Tomcat 5.5. But due to some reason I want to run it on IIS. See: - http://www.mail-archive.com/dspace-tech@lists.sourceforge.net/msg02694.html Thanks, Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- The ultimate all-in-one performance toolkit: Intel(R) Parallel Studio XE: Pinpoint memory and threading errors before they happen. Find and fix more than 250 security defects in the development cycle. Locate bottlenecks in serial and parallel code that limit performance. http://p.sf.net/sfu/intel-dev2devfeb ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] DSpace 1.7.0 statistics scripts
Hi, I am not sure if I did not express myself well. I meant to ask what is the equivalent of that [dspace]/bin/stat-general in the new command launcher? [dspace]/bin/dspace stat-general You can get a complete list of commands along with brief descriptions supported by the new '[dspace]/bin/dspace' script by running it with no arguments on the end. Thanks, Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- The ultimate all-in-one performance toolkit: Intel(R) Parallel Studio XE: Pinpoint memory and threading errors before they happen. Find and fix more than 250 security defects in the development cycle. Locate bottlenecks in serial and parallel code that limit performance. http://p.sf.net/sfu/intel-dev2devfeb ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] DSpace 1.7.0 statistics scripts
Hi, I am at a loss on how to use the new command to update the statistics. The online manual does not specify how we can go ahead and run the cron jobs. I will appreciate it if you can point on how we can run new command launcher. For instance how do we run the command [dspace]/bin/dspace stat-general in the new command launcher? That is using the new command launcher. The old way of doing it was to execute: [dspace]/bin/stat-general Thanks, Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- The modern datacenter depends on network connectivity to access resources and provide services. The best practices for maximizing a physical server's connectivity to a physical network are well understood - see how these rules translate into the virtual world? http://p.sf.net/sfu/oracle-sfdevnlfb ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] LDAP Authentication
Hi Karen, This is what I'm finding in the log file: 2011-02-07 10:09:04,284 INFO org.dspace.authenticate.LDAPHierarchicalAuthentication @ anonymous:session_id=36F5668310DE405281CC4104721E98AD:ip_addr=129.62.210.158:auth:attempting trivial auth of user=karen_savage 2011-02-07 10:09:04,779 INFO org.dspace.authenticate.LDAPHierarchicalAuthentication @ anonymous:session_id=36F5668310DE405281CC4104721E98AD:ip_addr=129.62.210.158:failed_login:no DN found for user karen_savage 2011-02-07 10:09:04,779 INFO org.dspace.app.xmlui.utils.AuthenticationUtil @ anonymous:session_id=36F5668310DE405281CC4104721E98AD:ip_addr=129.62.210.158:failed_login:email=karen_savage, realm=null, result=2 The first thing I'm noticing is the anonymous session. Our LDAP server doesn't allow anonymous access and our LDAP guy gave me the DN and password of a user to put in the config file. He's also double-checked the rest of the LDAP related variables to confirm they are correct. So is it normal for it to say anonymous in the log file, or is it missing something in the config file? Seeing the anonymous session is normal. Once you have logged in, that will change to your login. Could you show us the LDAP configuration values you have (except for the password!). This might give us a clue. If it helps, there is a set of example LDAP settings (which should work if you want to try them against a public LDAP server) at: - http://blog.stuartlewis.com/2008/08/18/test-ldap-service-upgraded-now-with-branches/ Thanks, Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- The modern datacenter depends on network connectivity to access resources and provide services. The best practices for maximizing a physical server's connectivity to a physical network are well understood - see how these rules translate into the virtual world? http://p.sf.net/sfu/oracle-sfdevnlfb ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Any way to purge empty metadata fields? (csv bulk editor woes)
Hi Timo, Thanks for the update - it will be interesting to hear how your re-import goes. Since there are no spaces in the CSV (these would, I think, although I've not had time to confirm it, be translated into empty strings once they get into the database), I'm not sure what could cause this. Language field shouldn't be an issue, as one of the things the CSV has been used most for by people is to fix up incorrect language codes. The only bug we've encountered (and fixed) recently, which looks like it has been in DSpace for many many previous versions, is a problem with schemas. If you had dc.decription.abstract and xyz.description.abstract, then asking DSpace for the values of one would get the values of both. But from your description I don't think this is the case for you. If you do find anything that causes it, please get in touch and we'll try and work out what is going on. Thanks, Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 On 7/02/2011, at 9:07 PM, Timo Aalto wrote: Hi Stuart, 2011/2/4 Stuart Lewis s.le...@auckland.ac.nz Hi Timo, I did some metadata gardening using the CSV bulk editor and as I uploaded my changes I noticed that the bulk metadata importer added an empty dc.description.abstract (with a 'fi' language identifier that is the default for our installation nowadays) into just about every record I had in that csv. (see: https://helda.helsinki.fi/handle/10138/24620?show=full for example). Mea culpa in that regard that I should have noticed this before pressing the yes key, but I still think there should be a some kind of a sanity check on the importer about not creating empty metadata value fields. There is a sanity check for this, so I'm not sure how it could have happened: - http://scm.dspace.org/trac/dspace/browser/dspace/trunk/dspace-api/src/main/java/org/dspace/app/bulkedit/DSpaceCSV.java#L481 Is the field definitely empty - could it have contained something like a single space? The field is definitely empty. I checked the csv for any spaces between commas and there is none, also a SQL query SELECT text_value, text_lang from metadatavalue where metadata_field_id=27 and text_value='' and text_lang='fi'; returns 392 rows, about the amount of affected Items. The same query with one or more spaces in text_value returns zero. Just a thought - the CSV contained Items orginating from different DSpace instances that have had different default metadata value languages set at different times (ie. there are abstracts written in finnish but marked with 'en' language flag) - now the default metadata value language is set to finnish. Could it be possible that DSpace does some ill-advised assumptions based on the default metadata language? Meanwhile I will try to re-export, edit and re-import the affected Items if that would get rid of the empties... It looks like Item.java, when ingesting metadata, performs a trim() on the values, to remove any leading or trailing spaces: - http://scm.dspace.org/trac/dspace/browser/dspace/trunk/dspace-api/src/main/java/org/dspace/content/Item.java#L684 The CSV importer does not perform a trim(). I'll need to test this to see if it could be a problem, and if it does cause the problem you're seeing, then we'll need to make sure the CSV importer performs a trim too, so that it doesn't pass on a single space (or multiple spaces) to Item.java, which then trims them and archives them. Thanks, Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- -- Timo Aalto Planning Officer University of Helsinki Library timo dot j dot aalto at helsinki dot fi -- The modern datacenter depends on network connectivity to access resources and provide services. The best practices for maximizing a physical server's connectivity to a physical network are well understood - see how these rules translate into the virtual world? http://p.sf.net/sfu/oracle-sfdevnlfb ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] $PATH in Unix for DSpace
Hi Sue, Hmmm….can anyone else comment on this? What does everyone put in their $CLASSPATH for DSpace? Generally you shouldn't need to set a classpath variable. For the web applications (xmlui / jspui / sword etc) this is all handled by Tomcat by the way in which the web apps store classes in particular pre-defined places. For command-line applications (e.g. importing, filter-media etc), this is handled by the 'dspace' script (1.6+) or the 'dsrun' script (1.5.2 or earlier). Thanks, Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- The modern datacenter depends on network connectivity to access resources and provide services. The best practices for maximizing a physical server's connectivity to a physical network are well understood - see how these rules translate into the virtual world? http://p.sf.net/sfu/oracle-sfdevnlfb ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Any way to purge empty metadata fields? (csv bulk editor woes)
Hi Timo, I did some metadata gardening using the CSV bulk editor and as I uploaded my changes I noticed that the bulk metadata importer added an empty dc.description.abstract (with a 'fi' language identifier that is the default for our installation nowadays) into just about every record I had in that csv. (see: https://helda.helsinki.fi/handle/10138/24620?show=full for example). Mea culpa in that regard that I should have noticed this before pressing the yes key, but I still think there should be a some kind of a sanity check on the importer about not creating empty metadata value fields. There is a sanity check for this, so I'm not sure how it could have happened: - http://scm.dspace.org/trac/dspace/browser/dspace/trunk/dspace-api/src/main/java/org/dspace/app/bulkedit/DSpaceCSV.java#L481 Is the field definitely empty - could it have contained something like a single space? It looks like Item.java, when ingesting metadata, performs a trim() on the values, to remove any leading or trailing spaces: - http://scm.dspace.org/trac/dspace/browser/dspace/trunk/dspace-api/src/main/java/org/dspace/content/Item.java#L684 The CSV importer does not perform a trim(). I'll need to test this to see if it could be a problem, and if it does cause the problem you're seeing, then we'll need to make sure the CSV importer performs a trim too, so that it doesn't pass on a single space (or multiple spaces) to Item.java, which then trims them and archives them. Thanks, Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- The modern datacenter depends on network connectivity to access resources and provide services. The best practices for maximizing a physical server's connectivity to a physical network are well understood - see how these rules translate into the virtual world? http://p.sf.net/sfu/oracle-sfdevnlfb ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Out of memory on metadata-import
Hi Joseph, The way the CSV importer works, for safety, is to process the whole CSV at once, and hold it all in memory (rather than reading and processing it line-by-line). Therefore is probably safer to just import one or two thousand records at a time. THe reason it is probably running out of memory half way through, is that as it goes through each line, it is building up its records of what has changed, so that it can display this information at the end. So it has enough memory to read your long CSV file, but not enough to hold that, and the details of all the changes it has made. Unfortunately no extra information (e.g. about checking the write lock) can be given, as the error you are encountering is an 'out of memory error', and these are provided directly by Java, not DSpace, so we have no control over them. Thanks, Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 On 5/02/2011, at 6:47 AM, Joseph Rhoads wrote: Dear Dspace-tech community, I'm curious if anyone else has had problems using the command line metadata-import? I'm trying to import 12861 items and it dies about half-way through.(7582 items). Before I upped the JAVA_OPTS memory max it would die between 2k and 3k items. The error message is below, but an additional problem that the crash creates is that it leaves a write.lock file in [dspace home]/search/ Which will create problems if you don't realize that it's there. Perhaps something should be mentioned in the error message when that happens. Thank You, Joseph Server Setup: --- Using Dspace 1.7 Ubuntu 10.04 Server JAVA_OPTS=-Xmx512m Postgresql-8.4 Error Message -- 12861 item(s) will be changed Do you want to make these changes? [y/n] y Exception: Java heap space java.lang.OutOfMemoryError: Java heap space at org.apache.lucene.store.BufferedIndexOutput.init(BufferedIndexOutput.java:26) at org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexOutput.init(SimpleFSDirectory.java:185) at org.apache.lucene.store.SimpleFSDirectory.createOutput(SimpleFSDirectory.java:59) at org.apache.lucene.index.FormatPostingsPositionsWriter.init(FormatPostingsPositionsWriter.java:42) at org.apache.lucene.index.FormatPostingsDocsWriter.init(FormatPostingsDocsWriter.java:55) at org.apache.lucene.index.FormatPostingsTermsWriter.init(FormatPostingsTermsWriter.java:33) at org.apache.lucene.index.FormatPostingsFieldsWriter.init(FormatPostingsFieldsWriter.java:59) at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:96) at org.apache.lucene.index.TermsHash.flush(TermsHash.java:154) at org.apache.lucene.index.DocInverter.flush(DocInverter.java:76) at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:63) at org.apache.lucene.index.DocumentsWriter.flush(DocumentsWriter.java:634) at org.apache.lucene.index.IndexWriter.doFlushInternal(IndexWriter.java:4374) at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:4264) at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:4255) at org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:2244) at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:2207) at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:2171) at org.dspace.search.DSIndexer.processIndexingTask(DSIndexer.java:714) at org.dspace.search.DSIndexer.indexContent(DSIndexer.java:271) at org.dspace.search.SearchConsumer.end(SearchConsumer.java:181) at org.dspace.event.BasicDispatcher.dispatch(BasicDispatcher.java:149) at org.dspace.core.Context.commit(Context.java:336) at org.dspace.app.bulkedit.MetadataImport.runImport(MetadataImport.java:254) at org.dspace.app.bulkedit.MetadataImport.main(MetadataImport.java:1060) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:183) - ATT1..txtATT2..txt -- The modern datacenter depends on network connectivity to access resources and provide services. The best practices for maximizing a physical server's connectivity to a physical network are well understood - see how these rules translate into the virtual world? http://p.sf.net/sfu/oracle
Re: [Dspace-tech] LDAP Authentication
Hi Karen,
I'm upgrading our instance of Dspace from 1.3 to 1.7 and at the same time,
migrating to a new server. I have the LDAP config information from the old
config file (and have confirmed with our IT guy that it is still correct),
but when I enter it on the new config file, I can't log in. Is there
something I need to do to the server itself before it'll work? (I wasn't
around when our live instance first went up). This is the last bit I need to
get working.
If you look in your [dspace]/log/dspace.log-{datestamp} file, there should be
some information saying why the authentication failed. This might give a clue
as to what is going on.
Thanks,
Stuart Lewis
Digital Development Manager
Te Tumu Herenga The University of Auckland Library
Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand
Ph: +64 (0)9 373 7599 x81928
--
The modern datacenter depends on network connectivity to access resources
and provide services. The best practices for maximizing a physical server's
connectivity to a physical network are well understood - see how these
rules translate into the virtual world?
http://p.sf.net/sfu/oracle-sfdevnlfb
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Error SWORD, servicedocument
Hi Julio, Hello, We have Dspace 1.6.2 version on Oracle with sword, we have tested sword with the SWORD Servlet Client (http://client.swordapp.org/client/) and we get Server returned: org.purl.sword.client.SWORDClientException: Read timed out, We have checked the logs, but we haven´t found any sword-specific entries in the log It might be easier to try interacting with the server manually to start with, to make sure it is configured and working. There are interactions with the SWORD server: - GETting a Service Document - POSTing some content to deposit To test the service document, point your web browser at: - http://your-repository.com/sword/servicedocument You should get prompted for a username and password. Enter your normal username and password (this only works with in-built authentication methods such as eperson password or LDAP, but not external systems such as Shibboleth). If SWORD is working, an xml file should be downloaded that contains a lit of collections into which you can deposit. To test the deposit, you'll need a test package, and use of the curl command (linux or mac). For details, see: - http://scm.dspace.org/trac/dspace/browser/dspace/trunk/dspace-sword/README.txt#L63 I hope that helps, Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- The modern datacenter depends on network connectivity to access resources and provide services. The best practices for maximizing a physical server's connectivity to a physical network are well understood - see how these rules translate into the virtual world? http://p.sf.net/sfu/oracle-sfdevnlfb ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Statistics versions
Assuming you mean 'classic' dspace.log based stats (1.5) and 'solr' stats (1.6) Yes. Out the box, 1.6+ does this by default. They are completely separate and have no relation to each other in how they work, or collect / display statistics. Both work together. Thanks, Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 On 3/02/2011, at 9:06 AM, Hilton Gibson wrote: Hi All Is it possible to run DSpace version 1.5.2 stats and DSpace version 1.6.2 stats at the same time ? Cheers hg -- Hilton Gibson Systems Administrator JS Gericke Library Room 1025 Stellenbosch University Private Bag X5036 Stellenbosch 7599 South Africa Tel: +27 21 808 4100 | Cell: +27 84 646 4758 Simplicity is the ultimate sophistication Leonardo da Vinci ATT1..txtATT2..txt -- Special Offer-- Download ArcSight Logger for FREE (a $49 USD value)! Finally, a world-class log management solution at an even better price-free! Download using promo code Free_Logger_4_Dev2Dev. Offer expires February 28th, so secure your free ArcSight Logger TODAY! http://p.sf.net/sfu/arcsight-sfd2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] SWORD overview?
Hi Sue, We are considering interfacing our DSpace 1.5+ instance(s) with some legacy applications and I’m wondering if SWORD might work for us. I’ve looked over some of the documentation, but I’m wondering if someone who’s implemented SWORD can give me a brief overview of the effort involved. I imagine that there is some mapping of fields from the legacy app to DSpace and assume the data ends up in the standard DSpace import files format. I would appreciate any comments or recommendations anyone can give. Making use of DSpace's out-the-box SWORD typically requires two things - 1) Packaged content. Typically this involves zipping up the file(s) with a mets.xml manifest containing the metadata. You will need to create something that takes the data from your legacy systems and creates these packages. In terms of effort, it is probably the same as writing something to that the same data and convert it into the classic importer file structure. 2) Some way of firing the deposits at DSpace. SWORD is a web service, so packages are POSTed to a collection. This can be as simple as one-off deposits using a command line tool such as curl, to a more complex script. The hardest part will probably be generating the packages, and then potentially adjusting [dspace]/config/crosswalks/sword-swap-ingest.xsl to crosswalk whatever data you put in the mets.xml. One slight caveat to watch - DSpace 1.5.2 introduced a slightly different package format identification, so SWORD deposits to 1.5.1 or lower, differ very slightly to 1.5.2 or higher. Any more questions, please ask, or email https://lists.sourceforge.net/lists/listinfo/sword-app-tech with specific technical questions. Thanks, Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- Special Offer-- Download ArcSight Logger for FREE (a $49 USD value)! Finally, a world-class log management solution at an even better price-free! Download using promo code Free_Logger_4_Dev2Dev. Offer expires February 28th, so secure your free ArcSight Logger TODAY! http://p.sf.net/sfu/arcsight-sfd2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] batch modifications
Hi Sisay,
Peter's suggestion will work, and is perhaps the best option. Remove any
columns that you are not editing.
However what might be happening is that Excel is converting the date string to
a date-formatted cell, and when it saves it back to the CSV it saves it in a
different format. DSpace will then replace the date format with the new
version from Excel.
You might find it easier to use OpenOffice to edit the CSVs, as you can more
easily tell it to use UTF-8 encoding, and to leave dates alone, than you can in
Excel.
See: -
https://wiki.duraspace.org/display/DSPACE/Batch+Metadata+Editing+Prototype
('CSV editing hints' section)
Thanks,
Stuart Lewis
Digital Development Manager
Te Tumu Herenga The University of Auckland Library
Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand
Ph: +64 (0)9 373 7599 x81928
On 26/01/2011, at 7:09 AM, Peter Dietz wrote:
Hi Sisay,
My colleague Maureen gave a presentation on batch editing at the DSpace
User's Group a few months ago.
http://hdl.handle.net/1811/47279 -- Batch Metadata Editing in DSpace 1.6+
To answer your question, I think the trick is to delete the columns from the
spreadsheet that you will not be modifying, otherwise it reapplies each
column of data in your spreadsheet.
--
Peter Dietz
Systems Developer/Engineer
Ohio State University Libraries
On Tue, Jan 25, 2011 at 8:56 AM, Webshet, Sisay (ILRI) s.webs...@cgiar.org
wrote:
Dear Friends,
I want to do batch modifications on dspace 1.6.2. I have modified some
metadata information
on some .csv file using excel When I try to import it the issue date is
added and removed the previous issue data setting.
Is there a way to block or ignore issue data modification.
Thanks
Sisay
--
Special Offer-- Download ArcSight Logger for FREE (a $49 USD value)!
Finally, a world-class log management solution at an even better price-free!
Download using promo code Free_Logger_4_Dev2Dev. Offer expires
February 28th, so secure your free ArcSight Logger TODAY!
http://p.sf.net/sfu/arcsight-sfd2d
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
ATT1..txtATT2..txt
--
Special Offer-- Download ArcSight Logger for FREE (a $49 USD value)!
Finally, a world-class log management solution at an even better price-free!
Download using promo code Free_Logger_4_Dev2Dev. Offer expires
February 28th, so secure your free ArcSight Logger TODAY!
http://p.sf.net/sfu/arcsight-sfd2d
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] dspace and opensso
Hi Bill, We're looking into integrating SSO into dspace. We currently use OpenSSO. Our dsapace instance now uses ldap-login and password-login. We'd want SSO for the ldap-login people. Ideally, instead of ldap-login, the user would be redirected to our main OpenSSO login screen. I've seen some info on integrating Shibboleth and dspace - but none with OpenSSO. If so, I'd appreciate any pointers on where to start, or to know what's involved. http://developers.sun.com/identity/reference/techart/app-integration.html This all looks extremely similar to how Shibboleth works, and you might actually find that the Shibboleth authentication method in DSpace will do what you need, with no or very little customization. If you deploy OpenSSO in a reverse proxy configuration (as shown on the page which you provided a link to), then it looks like OpenSSO will work in front of DSpace, hijack any applicable *-login requests, force the user through the login process (if not already logged in), and then send the user back to the application with some additional headers set to say who the authenticated user is. If you can get it working by setting headers of the authenticated user and passing these onto a demo script, then putting it in front of DSpace with the Shibboleth authN plugin should work. The Shibboleth plugin will then read these headers, and tell DSpace who is logged-in. Thanks, Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- Forrester recently released a report on the Return on Investment (ROI) of Google Apps. They found a 300% ROI, 38%-56% cost savings, and break-even within 7 months. Over 3 million businesses have gone Google with Google Apps: an online email calendar, and document program that's accessible from your browser. Read the Forrester report: http://p.sf.net/sfu/googleapps-sfnew ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] DSpace and Cross-site scripting/SQL Injection attack vulnerabilities?
Hi Sue, Thanks a bunch for the information. That's great news. I wonder if you would be willing to share details of exactly how this testing was done so others might be able to do and/or continue this testing? It all depends on your particular testing tool - you may have local expertise in how to use it. For example at The University of Auckland we have an application security specialist who ran AppScan for us. First it spidered the site to discover all the URLs, we provided it with some extra information to customise the attacks it tried (which web server / database platform etc), and then it ran. The spidering was where we hit the first problem! DSpace has many, many, many(!) URLs. By the time you try every browse combination etc, AppScan was unable to complete the spidering. The spidering also did things like exported every collection, community, item, CSV exports too etc. So it went on for some time before we decided to kill it. In the end, rather than running on our full development server, we ran it on a test instance with about 10 items in it. AppScan was then able to complete. I hope that helps, Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- Lotusphere 2011 Register now for Lotusphere 2011 and learn how to connect the dots, take your collaborative environment to the next level, and enter the era of Social Business. http://p.sf.net/sfu/lotusphere-d2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] DSpace and Cross-site scripting/SQL Injection attack vulnerabilities?
Hi Sue, I am trying to find out if DSpace has ever been tested for cross-site scripting and/or SQL injection vulnerabilities? Yes it has. It was first scanned some years back, and a big exercise was undertaken to clean up all database access via 'safe' centrally-managed database access methods that ensure safe practices such as parameter binding etc. One institutional user of DSpace also undertook a scan during the development of 1.6, which resulted in some additional improvements such as session invalidation. We (The University of Auckland) undertook an IBM AppScan a few months back, and this came out clean. However... we would be foolish to rest on our laurels, trust fully trust automated scans and not to keep up to date with regular testing, so there is always room for more if anyone has access to these tools and the time to run them, or to undertake more manual checks. Also to note for anyone who does ever have concerns: The committers group has fast-track methods of dealing with any possible security issues if they do arise, so please get in contact with any of the central Dursapce team who will be able to pass these on to the committers who ensure that they are dealt with top priority. Thanks, Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- Lotusphere 2011 Register now for Lotusphere 2011 and learn how to connect the dots, take your collaborative environment to the next level, and enter the era of Social Business. http://p.sf.net/sfu/lotusphere-d2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] retrieve or reset Duraspace Jira password?
Hi Jason, I can't find any link or form in Duraspace Jira to reset my password if I've forgotten it. https://jira.duraspace.org/secure/ForgotLoginDetails!default.jspa Thanks, Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] error in sequence of 1.5.x - 1.6.x upgrade instructions?
Hi Jason, I'm attempting to upgrade using the 1.5.x - 1.6.x upgrade instructions found in DSpace Manual 1.7.0-rc1. On page 65, shouldn't steps #7 and #8 (CC registry update and database update) follow #9 (install with Ant)? Step 8 (database upgrade is ok where it is), but I think you're right, step 7 (cc registry upgrade) needs to be after step 9 (ant update). If you tried running it before the upgrade, then the '[dspace]/bin/dspace registry-loader' script won't yet have been installed. Thanks for spotting this - I'll report it in our JIRA bug tracking system. Thanks, Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] [Dspace-general] Dspace OAI
Hi Matt, 1. Does the DSpace OAI export function support mapping from qualified Dublin Core to standard Dublin Core? Yes, when exposing via the oai_dc metadata prefix it does this. How it performs the mapping is configurable. See the config file for details: - http://scm.dspace.org/trac/dspace/browser/dspace/trunk/dspace/config/crosswalks/oaidc.properties Thanks, Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- What happens now with your Lotus Notes apps - do you make another costly upgrade, or settle for being marooned without product support? Time to move off Lotus Notes and onto the cloud with Force.com, apps are easier to build, use, and manage than apps on traditional platforms. Sign up for the Lotus Notes Migration Kit to learn more. http://p.sf.net/sfu/salesforce-d2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Deleting items via bulk metadata editor?
Hi Timo, Is it possible to somehow mark items for deletion when using the bulk metadata editor? I have an ultra-vague recollection from OR10 that this would be possible but didn't find any proof in the documentation. We had some duplicate items come up with our CRIS integration and it seems that the bulk editor would be a handy tool to locate delete them. No - it isn't currently possible to do that. If you think it would make a useful feature, please feel free to add it to Jira (http://jira.dspace.org/). What do you think the best way might be to tag items for removal? Maybe prepend the item ID with a '-'? Thanks, Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- Increase Visibility of Your 3D Game App Earn a Chance To Win $500! Tap into the largest installed PC base get more eyes on your game by optimizing for Intel(R) Graphics Technology. Get started today with the Intel(R) Software Partner Program. Five $500 cash prizes are up for grabs. http://p.sf.net/sfu/intelisp-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] [dspace-tech] Sword ingestion error
Hi Domingo, This looks quite a strange problem. The stack trace suggests that when it has downloaded the epdcx (eprints dublin core) schema, it has become corrupted somehow: - http://purl.org/eprint/epdcx/xsd/2006-11-16/epdcx.xsd - Caused by: org.jdom.input.JDOMParseException: Error on line 132 of document http://purl.org/eprint/epdcx/xsd/2006-11-16/epdcx.xsd: src-resolve: Cannot resolve the name 'xml:lang' to a(n) 'attribute declaration' component. This problem may go away on its own once it manages to get a good copy of the schema - maybe it has cached a bad one? Alternatively, you can host copies of these files on your DSpace server, and reference them from the mets.xml, for example: - file:///dspace/schema/epdcx.xsd instead of http://purl.org/eprint/epdcx/xsd/2006-11-16/epdcx.xsd (you'll have to download and store these schemas in the location you specify) You'll find that this probably makes your deposits a bit quicker too. Thanks, Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 On 24/11/2010, at 9:48 PM, Domingo Iglesias wrote: Hello We have a parsing problem when ingesting documents to our repository via sword interface. The strange thing is that It was working properly until last week and we are sure we haven't change anything in the installation. Here is the dspace.log output: 2010-11-24 08:48:28,688 ERROR org.dspace.sword.SWORDMETSIngester @ caught exception: org.dspace.content.crosswalk.MetadataValidationException: Error validating METS in org.dspace.content.packager.packageutils$unclosableinputstr...@1df55f2 at org.dspace.content.packager.METSManifest.create(METSManifest.java:301) at org.dspace.content.packager.AbstractMETSIngester.ingest(AbstractMETSIngester.java:233) at org.dspace.sword.SWORDMETSIngester.ingest(SWORDMETSIngester.java:115) at org.dspace.sword.CollectionDepositor.doDeposit(CollectionDepositor.java:179) at org.dspace.sword.DepositManager.deposit(DepositManager.java:173) at org.dspace.sword.DSpaceSWORDServer.doDeposit(DSpaceSWORDServer.java:149) at org.purl.sword.server.DepositServlet.doPost(DepositServlet.java:336) at javax.servlet.http.HttpServlet.service(HttpServlet.java:763) at javax.servlet.http.HttpServlet.service(HttpServlet.java:856) at com.evermind.server.http.ServletRequestDispatcher.invoke(ServletRequestDispatcher.java:713) at com.evermind.server.http.ServletRequestDispatcher.forwardInternal(ServletRequestDispatcher.java:370) at com.evermind.server.http.HttpRequestHandler.doProcessRequest(HttpRequestHandler.java:871) at com.evermind.server.http.HttpRequestHandler.processRequest(HttpRequestHandler.java:453) at com.evermind.server.http.AJPRequestHandler.run(AJPRequestHandler.java:313) at com.evermind.server.http.AJPRequestHandler.run(AJPRequestHandler.java:199) at oracle.oc4j.network.ServerSocketReadHandler$SafeRunnable.run(ServerSocketReadHandler.java:260) at com.evermind.util.ReleasableResourcePooledExecutor$MyWorker.run(ReleasableResourcePooledExecutor.java:303) at java.lang.Thread.run(Thread.java:595) Caused by: org.jdom.input.JDOMParseException: Error on line 132 of document http://purl.org/eprint/epdcx/xsd/2006-11-16/epdcx.xsd: src-resolve: Cannot resolve the name 'xml:lang' to a(n) 'attribute declaration' component. at org.jdom.input.SAXBuilder.build(SAXBuilder.java:465) at org.jdom.input.SAXBuilder.build(SAXBuilder.java:770) at org.dspace.content.packager.METSManifest.create(METSManifest.java:290) ... 17 more Caused by: org.xml.sax.SAXParseException: src-resolve: Cannot resolve the name 'xml:lang' to a(n) 'attribute declaration' component. at org.apache.xerces.util.ErrorHandlerWrapper.createSAXParseException(Unknown Source) at org.apache.xerces.util.ErrorHandlerWrapper.error(Unknown Source) at org.apache.xerces.impl.XMLErrorReporter.reportError(Unknown Source) at org.apache.xerces.impl.xs.traversers.XSDHandler.reportSchemaError(Unknown Source) at org.apache.xerces.impl.xs.traversers.XSDHandler.getGlobalDecl(Unknown Source) at org.apache.xerces.impl.xs.traversers.XSDAttributeTraverser.traverseLocal(Unknown Source) at org.apache.xerces.impl.xs.traversers.XSDAbstractTraverser.traverseAttrsAndAttrGrps(Unknown Source) at org.apache.xerces.impl.xs.traversers.XSDAttributeGroupTraverser.traverseGlobal(Unknown Source) at org.apache.xerces.impl.xs.traversers.XSDHandler.getGlobalDecl(Unknown Source) at org.apache.xerces.impl.xs.traversers.XSDAttributeGroupTraverser.traverseLocal(Unknown Source
Re: [Dspace-tech] XMLUI and filters
Hi Lucas, DSpace now has a 'pluggable' authentication system where you can write different authentication providers. See the following for examples that come shipped with DSpace: - http://scm.dspace.org/trac/dspace/browser/dspace/trunk/dspace-api/src/main/java/org/dspace/authenticate These are then configured, as a list of which ones you want to use, in dspace.cfg: plugin.sequence.org.dspace.authenticate.AuthenticationMethod = \ org.dspace.authenticate.LDAPAuthentication, \ org.dspace.authenticate.PasswordAuthentication Your best option may be to re-write your filter as a DSpace authentication class. For the xmlui, see the EPerson sitemap for how to reference the authentication class and url: - dspace-xmlui/dspace-xmlui-api/src/main/resources/aspects/EPerson/sitemap.xmap (search for 'shibboleth' or 'LDAP' for an example). I hope this helps, Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 On 20/11/2010, at 2:40 AM, Schaik, L.B. van wrote: Hi all, We are currently upgrading from DSpace 1.3 to Dspace 1.6 xmlui. In 1.3 we have a custom filter to allow users authenticated by another system to directly link to DSpace. The user should not login again in DSpace, because the authentication did already take place in the other system we trust. This is done with a token. In DSpace 1.3 you can add a custom filter to etc/dspace-web.xml, besides the already existing AdminOnlyFilter and the RegisteredOnlyFilter. We have added this to etc/dspace-web.xml: filter filter-namefrom-metis/filter-name filter-classnl.leidenuniv.dspace.app.webui.filter.FromMetisFilter/filter-class /filter filter-mapping filter-namefrom-metis/filter-name url-pattern/metis/url-pattern /filter-mapping And we have made a custom class FromMetisFilter to check the token and authenticity of the user. My question: how can I accomplish the same thing in DSpace 1.6? Where should I start? Thanks in advance for any help you can give me Regards, Lucas ATT1..txtATT2..txt -- Beautiful is writing same markup. Internet Explorer 9 supports standards for HTML5, CSS3, SVG 1.1, ECMAScript5, and DOM L2 L3. Spend less time writing and rewriting code and more time creating great experiences on the web. Be a part of the beta today http://p.sf.net/sfu/msIE9-sfdev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] dspace 1.6.2 + shib logout + item description + global stat
Hi Martins, Currently I am setting up our dspace (1.6.2. jspui) and I have following questions. I would be very appreciated, if someone gived some guidelines. 1. I have set up dspace with shibboleth, but found that there is no logout mechanism. I have changed jspui/layout/navbar-default.jsp and changed %= request.getContextPath() %/logout with http://dspace/Shibboleth.sso/Logout?return=http://dspace/dspace/logout;. I dont know is this correct way but seams it works. Which xmlui file correspont to logout? It all depends on if or how you implement Single Log Out in Shibboleth. - https://spaces.internet2.edu/display/SHIB2/SLOIssues If it works for you, then you've probably implemented it correctly for your Shibboleth setup. 2. My librarians want to see dc.type in item description ( currently dc.type are visible only under Show+full+item+record).Is it possible to add visibility attribute to this parameter and where can I do it? See 'webui.itemdisplay.default' in dspace.cfg: - http://www.dspace.org/1_6_2Documentation/ch05.html#N1445D 3. Under administer statistic is statistic about user logins, but in tab of users I see only Address 12, Address 18, Address 17 What does these addresses mean and how can I change them to real user logins ore ip addressees? See dstat.cfg, and the 'user.email' setting. Thanks, Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- Centralized Desktop Delivery: Dell and VMware Reference Architecture Simplifying enterprise desktop deployment and management using Dell EqualLogic storage and VMware View: A highly scalable, end-to-end client virtualization framework. Read more! http://p.sf.net/sfu/dell-eql-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Password Encryption
Hi, I was looking through the Dspace manual it could not find anything to tell me what kind of password encryption Dspace uses and what it uses for the key (password, username+password...) For the in-built eperson username and database table, the passwords are stored in an MD5 hash. Thanks, Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- Centralized Desktop Delivery: Dell and VMware Reference Architecture Simplifying enterprise desktop deployment and management using Dell EqualLogic storage and VMware View: A highly scalable, end-to-end client virtualization framework. Read more! http://p.sf.net/sfu/dell-eql-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] email problem
Hi Amjad, i am using dspace 1.5.2 with postgresql 9. when a user user registers himself, it does not send registration message his email rather returns system internal error. i checked the email parameters. i m using gmail mail server with correct port and authentication, but still in vain. can anybody pliz help me ? i am getting sick of this problem. There could be a number of causes for this. In order to diagnose the specific problem we'll need more details. You can find out how to get these details here: - https://wiki.duraspace.org/display/DSPACE/Troubleshoot+an+error Thanks, Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- Centralized Desktop Delivery: Dell and VMware Reference Architecture Simplifying enterprise desktop deployment and management using Dell EqualLogic storage and VMware View: A highly scalable, end-to-end client virtualization framework. Read more! http://p.sf.net/sfu/dell-eql-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Java Servlet and JavaServer Page versions
Hi Admire, I am interested in establishing the versions for Java Servlet and JavaServer Page supported in DSpace 1.6.2 . I would like download the appropriate version of Apache Tomcat. The versions of required software are listed in the online documentation: - http://www.dspace.org/1_6_2Documentation/ch03.html#N106A8 For Tomcat we'd probably recommend version 6, or if your operating system packaging manager only support it, then 5.5 would be fine too. Thanks, Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- The Next 800 Companies to Lead America's Growth: New Video Whitepaper David G. Thomson, author of the best-selling book Blueprint to a Billion shares his insights and actions to help propel your business during the next growth cycle. Listen Now! http://p.sf.net/sfu/SAP-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] how to install and configure LDAP on fedora 10 for dspace 1.6............
Hi Shashidhar, I successfully installed dspace 1.6. Now i want to install and configure LDAP server with my dspace Any one please tell me how will i do this. i have no idea about this. Any help will appreciate. There is a section in the manual that describes how to configure it: - http://www.dspace.org/1_6_2Documentation/ch05.html#N12C9B Usually the person that administrates the LDAP server will know the correct settings to put into dspace.cfg for their LDAP server, so if you can find that person it will be easier. Thanks, Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- The Next 800 Companies to Lead America's Growth: New Video Whitepaper David G. Thomson, author of the best-selling book Blueprint to a Billion shares his insights and actions to help propel your business during the next growth cycle. Listen Now! http://p.sf.net/sfu/SAP-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] thumbnails restricted if main item is restricted
Hi Steve and George, I've opened up a JIRA issue to discuss this: - https://jira.duraspace.org/browse/DS-740 The code that sets this at the moment is very simple, just two lines long. First all the permissions are cleared on the thumbnail, and then they are set to copy the parent. It could be quite easy to override this, but we need to be careful as not all filtered bitstreams would need this sort of treatment (e.g. extracted text of private documents). For example if the requirement was for a new filter-media command line option that says 'set all derivative bitstreams in the THUMBNAIL bundle to be Anonymous READ' then this wouldn't be too hard to do. If you could comment on the JIRA issue with your thoughts and requirements, that would be great. Thanks, Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 On 5/11/2010, at 2:32 AM, Steve Swinsburg wrote: Hi George, Thanks for your reply. Do you have open access to any of your content or is it all restricted? We have a mix which makes running the filter-media etc scripts interesting. Ideally the solution would be to set permissions at a collection level for each of the types of bundles. The item permissions would then inherit from the collection, or override if policies are set on individual items.. I don't seem to be able to do that (1.5). For reference, heres the (cutdown) SQL. This will update all thumbnail bitstream policies and set them to anonymous. We only had to do it for one group though. If you want to update intermediates, change THUMBNAIL to BRANDED_PREVIEW. update resourcepolicy set epersongroup_id=0 where policy_id in ( select rp.policy_id from resourcepolicy rp, bundle2bitstream bb, bundle b where b.name='THUMBNAIL' and b.bundle_id=bb.bundle_id and bb.bitstream_id=rp.resource_id ); cheers, Steve On 04/11/2010, at 11:59 PM, George Stanley Kozak wrote: Steve: This is the way that thumbnails have worked for me at my site (we have been using DSpace since 2003). It can be frustrating. Your solution is interesting. I never thought about going into SQL to update the policies on the thumbnail bundles. I am not sure if there are any other solutions. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -Original Message- From: Steve Swinsburg [mailto:steve.swinsb...@gmail.com] Sent: Wednesday, November 03, 2010 9:39 PM To: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] thumbnails restricted if main item is restricted We've fixed this up with some carefully crafted SQL to update the policies to the Anonymous group for the bitstreams in the thumbnail bundles, but it would be interesting to know if this is actually how things are meant to work, ie inherit the permissions from the parent item when generating the thumbnails. regards, Steve On 04/11/2010, at 10:53 AM, Steve Swinsburg wrote: Hi, We have a situation where some items in a collection are restricted, ie you need to login to access the full version. However we want the thumbnails and branded previews to still show up for the general public. When we run the thumbnail generator, it seems to inherit the permissions from the main bitstream, which means if the bitstream is protected, the thumbnail doesn't show up unless you are logged in and have the appropriate permission. Is this a common situation? We've inherited this instance so it might be a change made by people before us, but if anyone has addressed this, it would be great to hear from you. thanks, Steve -- The Next 800 Companies to Lead America's Growth: New Video Whitepaper David G. Thomson, author of the best-selling book Blueprint to a Billion shares his insights and actions to help propel your business during the next growth cycle. Listen Now! http://p.sf.net/sfu/SAP-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech ATT1..txtATT2..txt -- The Next 800 Companies to Lead America's Growth: New Video Whitepaper David G. Thomson, author of the best-selling book Blueprint to a Billion shares his insights and actions to help propel your business during the next growth cycle. Listen Now! http://p.sf.net/sfu/SAP-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] How to reset SOLR stats
Hi Eric, How can I reset my SOLR statistics? I ended up importing my old logs several times while investigating a problem with unknown IPs, so now my statistics are artificially inflated. I want to delete the existing statistics and start from scratch. I'm 99% sure that just removing the [dspace]/solr/statistics/data/ will do the trick, and it will be recreated automatically as soon as the solr webapp is started. (Back it up first just in case!) Thanks, Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- Nokia and ATT present the 2010 Calling All Innovators-North America contest Create new apps games for the Nokia N8 for consumers in U.S. and Canada $10 million total in prizes - $4M cash, 500 devices, nearly $6M in marketing Develop with Nokia Qt SDK, Web Runtime, or Java and Publish to Ovi Store http://p.sf.net/sfu/nokia-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Embargoed Item Message
Hi Sean, I'm not an expert on the embargo system, but I think you could do the following: Embargos are 'set' and 'lifted'. The business logic for these are implemented in java classes such as: - org.dspace.embargo.DefaultEmbargoSetter - org.dspace.embargo.DefaultEmbargoLifter In the setter, you could edit the object to add another metadata field with details of the embargo in a human-consumable way. This metadata element could then be displayed on the item view pages. The lifter could be edited to either remove that metadata field, or edit it instead to say it was under an embargo but is no more. Like with lots of things in DSpace, there are probably many ways of achieving this. Thanks, Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 On 29/10/2010, at 11:01 PM, Sean Carte wrote: Currently attempting to access an embargoed bitstream results in 'The file is restricted' (xmlui.BitstreamReader.auth_message) message. I can change the content of that message in messages.xml, of course, but I wonder if it would be possible to include details of the embargo either at that point, or before that at the item record page. Any ideas on whether this would be possible? Sean -- Sean Carte esAL Library Systems Manager +27 72 898 8775 +27 31 373 2490 fax: 0866741254 http://esal.dut.ac.za/ -- Nokia and ATT present the 2010 Calling All Innovators-North America contest Create new apps games for the Nokia N8 for consumers in U.S. and Canada $10 million total in prizes - $4M cash, 500 devices, nearly $6M in marketing Develop with Nokia Qt SDK, Web Runtime, or Java and Publish to Ovi Store http://p.sf.net/sfu/nokia-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Nokia and ATT present the 2010 Calling All Innovators-North America contest Create new apps games for the Nokia N8 for consumers in U.S. and Canada $10 million total in prizes - $4M cash, 500 devices, nearly $6M in marketing Develop with Nokia Qt SDK, Web Runtime, or Java and Publish to Ovi Store http://p.sf.net/sfu/nokia-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Welcome to the latest DSpace committer: Sands Fish
Dear DSpace community member, The DSpace committers team are delighted to announce a new member to the group: Sands Fish from MIT. Sands has been an active member of the DSpace community for some time, contributing patches, helping fix bugs, and to develop new features in the software. Sands started programming in the early 80's when he discovered the Beginner's BASIC book that came with his TI-99/4a. He earned a degree in Computer Science from Assumption College and has worked on a wide range of software and projects, from embedded code in network analysis boxes, to RPG code for AS220 systems, to managing development groups in the start-up environment. Most recently, he has focused on web applications and services, specifically in the context of DSpace and the semantic web. He currently works as a software engineer for the MIT Libraries. We are always on the lookout for new developers, contributors, and committers within the DSpace community. Anyone who would like to get more involved is encouraged to do so. You're also welcome to contact us at any time if you'd like ideas of how to start contributing: - https://wiki.duraspace.org/display/DSPACE/DSpaceContributors Contributions can take many forms, from writing code to editing documentation, or testing new releases or designing new themes for our user interfaces. Thanks, (on behalf of the DSpace committers group) Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- Nokia and ATT present the 2010 Calling All Innovators-North America contest Create new apps games for the Nokia N8 for consumers in U.S. and Canada $10 million total in prizes - $4M cash, 500 devices, nearly $6M in marketing Develop with Nokia Qt SDK, Web Runtime, or Java and Publish to Ovi Store http://p.sf.net/sfu/nokia-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Easy Deposit responding with HTTP 202
Hi Mark, I have set up easy deposit to deposit items into our DSpace IR. When an item is submitted I can see it in DSpace but DSpace is returning a HTTP 202 response. This seems to me to be okay but EasyDeposit is set up to only consider 200 and 201 a success? Does anybody have any thoughts on this? According to the SWORD specification, the only acceptable responses are 201 (created) and 202 (accepted) - unless you are using the noOp header, where a 200 is deemed OK: - http://swordapp.org/docs/sword-profile-1.3.html#b.5.5 I've modified EasyDeposit to now accept any 20x response. If you download a new copy (or git update if using the source) you should get this change. Thanks, Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- Nokia and ATT present the 2010 Calling All Innovators-North America contest Create new apps games for the Nokia N8 for consumers in U.S. and Canada $10 million total in prizes - $4M cash, 500 devices, nearly $6M in marketing Develop with Nokia Qt SDK, Web Runtime, or Java and Publish to Ovi Store http://p.sf.net/sfu/nokia-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] DSpace searches within documents?
Hi Sophie, DSpace makes no differentiation on full text indexing or searching based on the permissions of the items. However the item itself, and the plain-text version that is created to enable the full-text searching remain locked from public view. If we did build full text search highlighting, I would imagine that it would be built for xmlui and jspui, as the current limitation is around how the full text is stored in the index rather than how we display the results. Thanks, Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 On 22/10/2010, at 3:26 AM, Deng, Sai wrote: Hi Stuart, Thanks for the information! Our library is interested in depositing license restricted materials for some departments and intends to open certain documents only to certain groups and make them full text searchable to those groups. How will the license/access restriction affect full text indexing? (Is DSpace a fit system for this purpose?) I saw your jspui example of full text search results highlighting, will the full text configuration patch work for xmlui as well? If it'll be built into future release, which version will it be included possibly? Thank you for your time to look at the questions! Sophie Metadata Librarian -Original Message- From: Stuart Lewis [mailto:s.le...@auckland.ac.nz] Sent: Wednesday, October 20, 2010 7:14 PM To: Deng, Sai Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] DSpace searches within documents? Hi Sophie, We are looking for systems which have full text search capability and access control (we already have DSpace). I always thought DSpace only searches metadata, but I saw a wiki page showing how to configure full text indexing. However, I haven't seen any DSpace instance which shows the full text search results as I would see from vendor databases. How does the DSpace full text search look like? Will it meet the expectation of search within documents? Full-text indexing and searching of PDFs / HTML docs / Word docs is available within DSpace. If you run the following script, it will generate these indexes: - http://www.dspace.org/1_6_2Documentation/ch08.html#N1605F - [dspace]/bin/dspace filter-media The current version of DSpace does not show snippets of text in the search results to indicate where in the full text the search string was found. This is possible, and we have an open ticket in our development tracking system to address this: https://jira.duraspace.org/browse/DS-172 Thanks, Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- Nokia and ATT present the 2010 Calling All Innovators-North America contest Create new apps games for the Nokia N8 for consumers in U.S. and Canada $10 million total in prizes - $4M cash, 500 devices, nearly $6M in marketing Develop with Nokia Qt SDK, Web Runtime, or Java and Publish to Ovi Store http://p.sf.net/sfu/nokia-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] DSpace searches within documents?
Hi Sophie, We are looking for systems which have full text search capability and access control (we already have DSpace). I always thought DSpace only searches metadata, but I saw a wiki page showing how to configure full text indexing. However, I haven't seen any DSpace instance which shows the full text search results as I would see from vendor databases. How does the DSpace full text search look like? Will it meet the expectation of search within documents? Full-text indexing and searching of PDFs / HTML docs / Word docs is available within DSpace. If you run the following script, it will generate these indexes: - http://www.dspace.org/1_6_2Documentation/ch08.html#N1605F - [dspace]/bin/dspace filter-media The current version of DSpace does not show snippets of text in the search results to indicate where in the full text the search string was found. This is possible, and we have an open ticket in our development tracking system to address this: https://jira.duraspace.org/browse/DS-172 Thanks, Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- Nokia and ATT present the 2010 Calling All Innovators-North America contest Create new apps games for the Nokia N8 for consumers in U.S. and Canada $10 million total in prizes - $4M cash, 500 devices, nearly $6M in marketing Develop with Nokia Qt SDK, Web Runtime, or Java and Publish to Ovi Store http://p.sf.net/sfu/nokia-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Error importing SOLR stats
Hi Eric, I can convert logs from 1.5.2 using stats-log-converter, but I get an error from stats-log-importer. I can connect to http://127.0.0.1:8080/solr using lynx, but nothing shows up on XMLUI statistics page. From config.cfg: solr.log.server = http://127.0.0.1:8080/solr/statistics The error: request: http://127.0.0.1/solr/statistics/update?wt=javabinversion=2.2 org.apache.solr.common.SolrException: Service Temporarily Unavailable That is strange - your dspace.cfg says to use port 8080, but the importer is not using that port. Could you update solr.log.server to use http://localhost:8080/solr/statistics instead, and see if the error reports that URL instead? If not, then there is second config file or solr.log.server somewhere which is upsetting the process. Thanks, Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- Beautiful is writing same markup. Internet Explorer 9 supports standards for HTML5, CSS3, SVG 1.1, ECMAScript5, and DOM L2 L3. Spend less time writing and rewriting code and more time creating great experiences on the web. Be a part of the beta today. http://p.sf.net/sfu/beautyoftheweb ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Scalability issues report, dsp...@cambridge
Hi Hilton, - Assetstore: random structure causes large overhead on filesystem for no real gain Are you able to expand on the overhead that is caused, and from your profiling, explain how the structure could be improved? My gut (and uniformed) instinct would be that since asset store reads are completely random depending on the items being viewed at the time, the layout of directories would be irrelevant. Writes may be slightly less efficient, but since writes only tend to occur once, they are of less consequence. Apologies for sounding cryptic; I was trying not to be too verbose in the template. :-) This has mostly to do with back-ups. With about 600,000 files in random directories, it can be hard to find out what files have changed. We implemented an simple asset store structure that stores files by year/month/day. This means we can mirror new files very quickly, and only traverse the entire assetstore every other day to check if files have changed. See: http://hdl.handle.net/10019.1/3161 How strange, I also proposed such a thing !! I've just read this paper and have a question. You state the following: At the moment, December 2009, the following two are the most widely used software packages for building and maintaining institutional repositories according the opendoar website. • http://www.dspace.org with 502 installations. • http://www.eprints.org with 261 installations. The digital objects and store are located as follows for the above: • DSpace = $DSPACE_HOME/assetstore • EPrints = $EPRINTS_HOME/disk0 None of the above use a time/date based file system for storing digital objects. None of them use UUID's to create unique digital objects and stores. In one hundred years time how can any of the above satisfy a future researcher that the digital object is unique and has remained persistently so during the years to 2109. Are you able to expand for us your reasoning that repositories that do not use datestamped directories and filenames containing UUIDs will not satisfy future researchers? Just because a file is stored in that location with a UUID makes it no more or less likely that it has remained unique and persistent. Filenames alone cannot guarantee this - it is up the repository to manage the integrity of the stored items, and the wider system to ensure that this is the case. This is where the notion of a 'trusted repository' comes into play - the fact the the repository pltform and the system as a whole is trusted to have maintained the integrity of the contents. [A side note: You'll find a lot of the work that Tim has been leading recently regarding AIPs is of interest in this area. https://wiki.duraspace.org/display/DSPACE/AipBackupRestore ] Cheers, Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- Beautiful is writing same markup. Internet Explorer 9 supports standards for HTML5, CSS3, SVG 1.1, ECMAScript5, and DOM L2 L3. Spend less time writing and rewriting code and more time creating great experiences on the web. Be a part of the beta today. http://p.sf.net/sfu/beautyoftheweb ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Scalability issues report, dsp...@cambridge
Hi Tom, Thanks again for your answers - apologies for following these up with more questions... with 16GB of memory and fast local storage Java memory: -Xmx2048M -Xms2048M Is there a reason why you only allocate 1/8th of the system memory to the application? Have you found that adding extra doesn't help? In our experience, it merely delays when the error occurs, and we'd still need to restart. Whether we do this nightly or every other night doesn't make much difference. I'm not sure it would actually make it go faster. Additionally, we need to keep memory free for file caching and thumbnail generation; we found that if we assign too much memory to Java then the system needs to read from disk more for these other tasks and we get a slow-down there. Is this a linear relationship between memory and time, or does it start to flatten out over time? - Assetstore: random structure causes large overhead on filesystem for no real gain Are you able to expand on the overhead that is caused, and from your profiling, explain how the structure could be improved? My gut (and uniformed) instinct would be that since asset store reads are completely random depending on the items being viewed at the time, the layout of directories would be irrelevant. Writes may be slightly less efficient, but since writes only tend to occur once, they are of less consequence. Apologies for sounding cryptic; I was trying not to be too verbose in the template. :-) This has mostly to do with back-ups. With about 600,000 files in random directories, it can be hard to find out what files have changed. We implemented an simple asset store structure that stores files by year/month/day. This means we can mirror new files very quickly, and only traverse the entire assetstore every other day to check if files have changed. Maybe I should expand a bit on our storage set-up: - our live system has about 90TB capacity, with an EMC SAN connected to a pair of Sun servers. These present them to our private network at about 4Gbps, as well as running the checksums (I wrote some Perl to do this job locally, rather than add to the I/O of the live server.) - we have two sets of back-up servers (ZFS-based) off-site for the live system, which use rsync to mirror all this data. (Two systems because otherwise, if we lose one, it'd be vulnerable too long while the data is re-sync'ed). A small script makes copies of the day's assetstore every hour; a complete rsync runs across assetstores (the original one as well as the new one with our own datestamp format) every alternating day, and at week-ends we run rsync with checksums. Essentially this system is copy-on-write: if a file changes on disk, the old back-up copy is moved into a holding area to be deleted when necessary, and the new file copied in its place. My initial concern with that setup would be the use rsync over such a large amount of storage: rsync is horrendous for processor consumption, and you have a lot of disk for rsync to chew through in order to detect changed files. Is there a reason you don't use the in-built ZFS replication facility? This will presumably be much more efficient as the filesystem itself implicitly knows when to perform replication, and will be quicker and more up-to-date than hourly syncs. Cheers, Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- Beautiful is writing same markup. Internet Explorer 9 supports standards for HTML5, CSS3, SVG 1.1, ECMAScript5, and DOM L2 L3. Spend less time writing and rewriting code and more time creating great experiences on the web. Be a part of the beta today. http://p.sf.net/sfu/beautyoftheweb ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Scalability issues report, dsp...@cambridge
Hi Tom, Thanks for this extra level of information - it will really help. A few random questions come to mind: d. Separate servers for webapp, DB, storage and ancillary functions Webapp/DB servers are HT 8-core Intel servers running Ubuntu Linux with 16GB of memory and fast local storage Java memory: -Xmx2048M -Xms2048M Is there a reason why you only allocate 1/8th of the system memory to the application? Have you found that adding extra doesn't help? - Assetstore: random structure causes large overhead on filesystem for no real gain Are you able to expand on the overhead that is caused, and from your profiling, explain how the structure could be improved? My gut (and uniformed) instinct would be that since asset store reads are completely random depending on the items being viewed at the time, the layout of directories would be irrelevant. Writes may be slightly less efficient, but since writes only tend to occur once, they are of less consequence. - Search indexer: fails on large repositories, slowing down and eventually running out of memory. Do you have any percentages on the amount of page views that relate to browse, and how many relate to other views? I'm curious if browse from the front end is causing an issue too? The reason I'm asking, is that with the potential inclusion of the dspace-discovery layer in a future version, this could replace the database-driven browse system with solr. Not only will this provide a richer faceted search, but it could likely offer a good performance boost for browse-related functions. It also offers another way of scaling-out, by putting solr on a different server. 4. We can't commit to volunteering unless this can be incorporated into the work we need to undertake in our primary capacity of running the University's Institutional Repository. However, we would be willing to try and make this happen. That would be great if you could, and we'd all really appreciate your input. Users of the software such as yourself, or BioMed Central's Open Repository are pushing the software in ways that 95% of installations don't (yet). In order to push past these boundaries in terms of scalability the only way we can effectively do so is with the active participation of those who are encountering the problems. One of the joys of working in an open source environment is that we have the structures and process that enable this, and it is great to watch the results when everyone pitches in together to improve the software for us all. Cheers, Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- Beautiful is writing same markup. Internet Explorer 9 supports standards for HTML5, CSS3, SVG 1.1, ECMAScript5, and DOM L2 L3. Spend less time writing and rewriting code and more time creating great experiences on the web. Be a part of the beta today. http://p.sf.net/sfu/beautyoftheweb ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] 1.6.2 metadata export - incorrect diacritics
Hi Ronee, Has anyone experienced a metadata export where the diacritics are not handled properly? Here is an example of what it should look like and what it came out in the exported Excel file as. Jrade, Cathy Login. Rubén Darío y la búsqueda romántica de la unidad : el recurso modernista a la tradición esotérica. México: Fondo de Cultura Económica, 1986. Jrade, Cathy Login. RubeÌn DariÌo y la buÌsqueda romaÌntica de la unidad : el recurso modernista a la tradicioÌn esoteÌrica. Is this something that could be generated by the export or by importing into excel? Any ideas? It is possible that the text is being mutilated by Excel. If the CSV file opens by default in Excel, then it tends to get upset by the diacritics, and converts dates to date objects rather than leaving them as text. OpenOffice is better at opening CSV files - it asks what encoding you want to use (select 'UTF-8') and you can select what formatting to apply to the columns (click on the top left cell to highlight them all, and select the column type of 'Text'. - http://oldwiki.dspace.org/index.php/Batch_Metadata_Editing_Prototype#CSV_editing_hints Thanks, Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- Virtualization is moving to the mainstream and overtaking non-virtualized environment for deploying applications. Does it make network security easier or more difficult to achieve? Read this whitepaper to separate the two and get a better understanding. http://p.sf.net/sfu/hp-phase2-d2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] SWORD Easy Deposit
Hi Baseer, We have installed SWORD easy deposit for our new website and it is accessible through http://homepage/easydeposit. I was not able to find the documentation for configuration part which will allow me to design the user interface and create steps for easy deposit. (http://easydeposit.swordapp.org/instructions/configuration/ Looks like there should be some documentation here but they are missing.) Yes - there should be more detail there, I just need to write it! Unfortunately I've been busy with another project at work for the past few months, and haven't had much time for anything else. This project is finished now, so I should be able to find some time to write them. Please feel free to contact me directly with any questions, or post them to the sword-app-tech email list: - https://lists.sourceforge.net/lists/listinfo/sword-app-tech Hopefully most of the settings are reasonably easy to configure. The main thing to know is that deposits are made up of steps, and you can reorder and configure these steps via the web interface to build the submission forms that you want. There are some further instructions and a tutorial video here: - http://swordapp.org/2010/09/the-sword-course/ (see 'Module 5 - Create your own SWORD client') Thanks, Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- Start uncovering the many advantages of virtual appliances and start using them to simplify application deployment and accelerate your shift to cloud computing. http://p.sf.net/sfu/novell-sfdev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Help with non-running DSpace scripts
Hi Stan, I've update 1.5.1 to 1.6.2 on a Windows 2003 server and it is running. However, when I try to start the handle server, I got an error. It depends on what I use - dspace or dsrun: C:\DSpace\bindspace start-handle-server Using DSpace installation in: C:\DSpace Command not found: start-handle-server C:\DSpace\bindsrun start-handle-server Using DSpace installation in: C:\DSpace Error in launcher.xml: Invalid class name: start-handle-server How did you do this in 1.5.1? I think that most people using Windows tend to use this approach: - https://wiki.duraspace.org/display/DSPACE/Handle+Server+Setup+as+Windows+Service+%28using+Tanuki%29 This allows you to set it up as a Windows Service, so that it starts up automatically when the machines boots up. Thanks, Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- Start uncovering the many advantages of virtual appliances and start using them to simplify application deployment and accelerate your shift to cloud computing. http://p.sf.net/sfu/novell-sfdev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Quick question about the metadata import maximum number of lines in the csv file
Hi Renata, I have successfully loaded over a thousand record through the Metadata Import but had to work with .csv file containing maximum 20 or 21 lines at the time. It sort of suited me at the time but I want to speed up the process for my next collection upload. Where can I change this maximum load number? Anyone knows? If you perform the import via the command line, the number is not restricted. If you want to allow more via the user interface, then uncomment and edit the following setting in dspace.cfg: # A hard limit of the number of items allowed to be edited in one go in the UI # (does not apply to the command line version) # bulkedit.gui-item-limit = 20 Thanks, Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- Start uncovering the many advantages of virtual appliances and start using them to simplify application deployment and accelerate your shift to cloud computing. http://p.sf.net/sfu/novell-sfdev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Shibboleth+Sword problem
Hi Hélder, See: - http://blog.stuartlewis.com/2008/05/27/shibboleth-sword-and-dspace-15/ What you can do is to have two copies of dspae.cfg, and edit [tomcat]/webapps/sword/WEB-INF/web.xml (dspace-config context-param) to point to a different dspace.cfg. In that other dspace.cfg (maybe [dspace]/config/dspace-sword.cfg) you can define a different set of authentication options. The easiest option is to use either LDAP or the the PasswordAuthentcation method. How you do it really depends on your SWORD use case and client. If your SWORD client has a hard-coded username and password, then either of these will do. What we do with our SWORD clients is to perform the authentication in the client, and if that is OK, use a hardcoded username and password to make the actual SWORD deposit into DSpace. Thanks, Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 On 7/09/2010, at 9:03 PM, Hélder Silva wrote: Hi everyone, I'm having some problems with Shibboleth authentication while using Sword. I use Sword to submit documents to DSpace, and therefore I need to be authenticated in DSpace. But as you know (or may know), the Shibboleth authentication process is a little diferent from the others, because the authentication is done outside the repository (in the Identity Provider) with username and password, but in this case one can't give that information to the authentication system as you would do with, for example, LDAP. Therefore, I think the problem should be solved in the sword code. Anyone experiencing the same problem? Any solutions out there? -- Cumprimentos, Hélder Silva KEEP SOLUTIONS, LDA. Departamento de Informática Universidade do Minho 4710-057 Gualtar, Braga, Portugal W www.keep.pt E i...@keep.pt T +351 253604461 F +351 253604471 -- This SF.net Dev2Dev email is sponsored by: Show off your parallel programming skills. Enter the Intel(R) Threading Challenge 2010. http://p.sf.net/sfu/intel-thread-sfd ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- This SF.net Dev2Dev email is sponsored by: Show off your parallel programming skills. Enter the Intel(R) Threading Challenge 2010. http://p.sf.net/sfu/intel-thread-sfd ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] LDAP settings
LDAPServlet is one of those strange remnants where despite having an pluggable authentication system, this remains from before that. So it is normal to see entries relating to it in the logs: dspace/log/dspace.log.2010-06-15:2010-06-15 07:16:41,862 INFO org.dspace.app.webui.servlet.LDAPServlet @ stuart.le...@testathon.net:session_id=5CD14C51E5AB3672D7E537F99EC361DD:ip_addr=0:0:0:0:0:0:0:1%0:login:type=explicit IIRC, its use is controlled by the ldap.enable flag in dspace.cfg Cheers, Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 On 7/09/2010, at 7:25 AM, Flavio Botelho wrote: You are using the LDAP Servlet, when it seems you want to use LDAP Hierarchical?? You should use the normal login screen to use the LDAPHierarchicalAuthentication... BTW, hasn't LDAPServlet been removed already? Kudos, Flavio On Fri, Sep 3, 2010 at 3:10 AM, Webshet, Sisay (ILRI) s.webs...@cgiar.org wrote: Hi, I checked with some other browser like softera.look How the structure viewed. The log file says this. 010-09-03 09:04:02,239 INFO org.dspace.app.webui.servlet.LDAPServlet @ anonymous:session_id=EE6A969F57BF518D0D5343F6BF33520C:ip_addr=172.27.5.70:failed_login:netid=Swebshet, result=2 May be you can suggest me on the values for ldap.search.user= Should the system be redeployed? For LDAP to work. I did restart Tomcat only Thanks image001.jpg -Original Message- image002.jpg image005.jpg From: Stuart Lewis [mailto:s.le...@auckland.ac.nz] Sent: Friday, September 03, 2010 1:10 AM To: Flavio Botelho; Webshet, Sisay (ILRI) Cc: dspace-tech@lists.sourceforge.net Tech Subject: Re: [Dspace-tech] LDAP settings You shouldn't need to escape the values at all. Commas are fine, and quite normal in LDAP configurations. Check using a tool such as http://jxplorer.org/ that you can log in to the LDAP server with those credentials. Thanks, Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 On 3/09/2010, at 5:42 AM, Flavio Botelho wrote: Please post any errors in the log that are appearing? But I will take a wild guess that there might be problems with escaping, you might need to use 2 backslashes instead of just 1 for each comma... On Thu, Sep 2, 2010 at 9:18 AM, Webshet, Sisay (ILRI) s.webs...@cgiar.org wrote: Hi, Support I login to our local LDAP server using the following settings, but cannot login. I can search users name account using sAMAccountName attribute. Host ILRI.CGIARAD.ORG base DN DC=ILRI,DC=CGIARAD,DC=ORG Bind DN(entry DN) CN=Webshet\, Sisay (ILRI),OU=ILRI Ethiopia Employees,OU=ILRI Ethiopia,DC=ILRI,DC=CGIARAD,DC=ORG What will be the setting in dspace.cfg ( dspace 1.5.2 on debian ) if something is wrong please correct me.i can't login to dspace using LADP. ldap.provider_url = ldap://ILRI.CGIARAD.ORG/ ldap.id_field = sAMAccountName ldap.object_context = OU=ILRI Ethiopia Employees,OU=ILRI Ethiopia,DC=ILRI,DC=CGIARAD,DC=ORG ldap.search_context = OU=ILRI Ethiopia Employees,OU=ILRI Ethiopia,DC=ILRI,DC=CGIARAD,DC=ORG ldap.email_field = mail ldap.surname_field = sn ldap.givenname_field = givenName ldap.phone_field = telephoneNumber Hierarchical LDAP Settings # # If your users are spread out across a hierarchical tree on your # LDAP server, you will need to use the following stackable authentication class: plugin.sequence.org.dspace.authenticate.AuthenticationMethod = \ org.dspace.authenticate.LDAPHierarchicalAuthentication # object scope : 0 # one level scope : 1 # subtree scope : 2 ldap.search_scope = 2 #ldap.search.user = cn=admin,ou=people,o=myu.edu ldap.search.user = CN=Webshet\, Sisay (ILRI),OU=ILRI Ethiopia Employees,OU=ILRI Ethiopia,DC=ILRI,DC=CGIARAD,DC=ORG ldap.search.password = * -- This SF.net Dev2Dev email is sponsored by: Show off your parallel programming skills. Enter the Intel(R) Threading Challenge 2010. http://p.sf.net/sfu/intel-thread-sfd
Re: [Dspace-tech] LDAP settings
It makes use of the authentication stack: Line 110 of LDAPServlet: int status = AuthenticationManager.authenticate(context, netid, password, null, request); Cheers, Stuart On 7/09/2010, at 5:14 PM, Flavio Botelho wrote: The problem is it routes directly to LDAPAuthentication instead of using the pluggable authentication system, doesn't it? On Mon, Sep 6, 2010 at 6:08 PM, Stuart Lewis s.le...@auckland.ac.nz wrote: LDAPServlet is one of those strange remnants where despite having an pluggable authentication system, this remains from before that. So it is normal to see entries relating to it in the logs: dspace/log/dspace.log.2010-06-15:2010-06-15 07:16:41,862 INFO org.dspace.app.webui.servlet.LDAPServlet @ stuart.le...@testathon.net:session_id=5CD14C51E5AB3672D7E537F99EC361DD:ip_addr=0:0:0:0:0:0:0:1%0:login:type=explicit IIRC, its use is controlled by the ldap.enable flag in dspace.cfg Cheers, Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 On 7/09/2010, at 7:25 AM, Flavio Botelho wrote: You are using the LDAP Servlet, when it seems you want to use LDAP Hierarchical?? You should use the normal login screen to use the LDAPHierarchicalAuthentication... BTW, hasn't LDAPServlet been removed already? Kudos, Flavio On Fri, Sep 3, 2010 at 3:10 AM, Webshet, Sisay (ILRI) s.webs...@cgiar.org wrote: Hi, I checked with some other browser like softera.look How the structure viewed. The log file says this. 010-09-03 09:04:02,239 INFO org.dspace.app.webui.servlet.LDAPServlet @ anonymous:session_id=EE6A969F57BF518D0D5343F6BF33520C:ip_addr=172.27.5.70:failed_login:netid=Swebshet, result=2 May be you can suggest me on the values for ldap.search.user= Should the system be redeployed? For LDAP to work. I did restart Tomcat only Thanks image001.jpg -Original Message- image002.jpg image005.jpg From: Stuart Lewis [mailto:s.le...@auckland.ac.nz] Sent: Friday, September 03, 2010 1:10 AM To: Flavio Botelho; Webshet, Sisay (ILRI) Cc: dspace-tech@lists.sourceforge.net Tech Subject: Re: [Dspace-tech] LDAP settings You shouldn't need to escape the values at all. Commas are fine, and quite normal in LDAP configurations. Check using a tool such as http://jxplorer.org/ that you can log in to the LDAP server with those credentials. Thanks, Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 On 3/09/2010, at 5:42 AM, Flavio Botelho wrote: Please post any errors in the log that are appearing? But I will take a wild guess that there might be problems with escaping, you might need to use 2 backslashes instead of just 1 for each comma... On Thu, Sep 2, 2010 at 9:18 AM, Webshet, Sisay (ILRI) s.webs...@cgiar.org wrote: Hi, Support I login to our local LDAP server using the following settings, but cannot login. I can search users name account using sAMAccountName attribute. Host ILRI.CGIARAD.ORG base DN DC=ILRI,DC=CGIARAD,DC=ORG Bind DN(entry DN) CN=Webshet\, Sisay (ILRI),OU=ILRI Ethiopia Employees,OU=ILRI Ethiopia,DC=ILRI,DC=CGIARAD,DC=ORG What will be the setting in dspace.cfg ( dspace 1.5.2 on debian ) if something is wrong please correct me.i can't login to dspace using LADP. ldap.provider_url = ldap://ILRI.CGIARAD.ORG/ ldap.id_field = sAMAccountName ldap.object_context = OU=ILRI Ethiopia Employees,OU=ILRI Ethiopia,DC=ILRI,DC=CGIARAD,DC=ORG ldap.search_context = OU=ILRI Ethiopia Employees,OU=ILRI Ethiopia,DC=ILRI,DC=CGIARAD,DC=ORG ldap.email_field = mail ldap.surname_field = sn ldap.givenname_field = givenName ldap.phone_field = telephoneNumber Hierarchical LDAP Settings # # If your users are spread out across a hierarchical tree on your # LDAP server, you will need to use the following stackable authentication class: plugin.sequence.org.dspace.authenticate.AuthenticationMethod = \ org.dspace.authenticate.LDAPHierarchicalAuthentication # object scope : 0 # one level scope : 1 # subtree scope : 2 ldap.search_scope = 2 #ldap.search.user = cn=admin,ou=people,o=myu.edu ldap.search.user = CN=Webshet\, Sisay (ILRI),OU=ILRI Ethiopia
Re: [Dspace-tech] LDAP settings
Hi again, Apologies - you may indeed need to escape the comma as this isn't the normal separator between dn/ou/cn type elements. As Flavio suggests, try two backslashes. Java can sometimes be worse than that and require four as it will strip them out twice, each time the string is handled. Depending on which copy of dspace.cfg you update, you may or may not need to redeploy DSpace. If you edit the version in your DSpace installation directory, then a restart of Tomcat is fine. If you edit the version in the source directory where you run 'mvn' from, then you will need to redeploy. Thanks, Stuart On 3/09/2010, at 6:10 PM, Webshet, Sisay (ILRI) wrote: Hi, I checked with some other browser like softera.look How the structure viewed. The log file says this. 010-09-03 09:04:02,239 INFO org.dspace.app.webui.servlet.LDAPServlet @ anonymous:session_id=EE6A969F57BF518D0D5343F6BF33520C:ip_addr=172.27.5.70:failed_login:netid=Swebshet, result=2 May be you can suggest me on the values for ldap.search.user= Should the system be redeployed? For LDAP to work. I did restart Tomcat only Thanks image001.jpg -Original Message- image002.jpg image005.jpg From: Stuart Lewis [mailto:s.le...@auckland.ac.nz] Sent: Friday, September 03, 2010 1:10 AM To: Flavio Botelho; Webshet, Sisay (ILRI) Cc: dspace-tech@lists.sourceforge.net Tech Subject: Re: [Dspace-tech] LDAP settings You shouldn't need to escape the values at all. Commas are fine, and quite normal in LDAP configurations. Check using a tool such as http://jxplorer.org/ that you can log in to the LDAP server with those credentials. Thanks, Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 On 3/09/2010, at 5:42 AM, Flavio Botelho wrote: Please post any errors in the log that are appearing? But I will take a wild guess that there might be problems with escaping, you might need to use 2 backslashes instead of just 1 for each comma... On Thu, Sep 2, 2010 at 9:18 AM, Webshet, Sisay (ILRI) s.webs...@cgiar.org wrote: Hi, Support I login to our local LDAP server using the following settings, but cannot login. I can search users name account using sAMAccountName attribute. Host ILRI.CGIARAD.ORG base DN DC=ILRI,DC=CGIARAD,DC=ORG Bind DN(entry DN) CN=Webshet\, Sisay (ILRI),OU=ILRI Ethiopia Employees,OU=ILRI Ethiopia,DC=ILRI,DC=CGIARAD,DC=ORG What will be the setting in dspace.cfg ( dspace 1.5.2 on debian ) if something is wrong please correct me.i can't login to dspace using LADP. ldap.provider_url = ldap://ILRI.CGIARAD.ORG/ ldap.id_field = sAMAccountName ldap.object_context = OU=ILRI Ethiopia Employees,OU=ILRI Ethiopia,DC=ILRI,DC=CGIARAD,DC=ORG ldap.search_context = OU=ILRI Ethiopia Employees,OU=ILRI Ethiopia,DC=ILRI,DC=CGIARAD,DC=ORG ldap.email_field = mail ldap.surname_field = sn ldap.givenname_field = givenName ldap.phone_field = telephoneNumber Hierarchical LDAP Settings # # If your users are spread out across a hierarchical tree on your # LDAP server, you will need to use the following stackable authentication class: plugin.sequence.org.dspace.authenticate.AuthenticationMethod = \ org.dspace.authenticate.LDAPHierarchicalAuthentication # object scope : 0 # one level scope : 1 # subtree scope : 2 ldap.search_scope = 2 #ldap.search.user = cn=admin,ou=people,o=myu.edu ldap.search.user = CN=Webshet\, Sisay (ILRI),OU=ILRI Ethiopia Employees,OU=ILRI Ethiopia,DC=ILRI,DC=CGIARAD,DC=ORG ldap.search.password = * -- This SF.net Dev2Dev email is sponsored by: Show off your parallel programming skills. Enter the Intel(R) Threading Challenge 2010. http://p.sf.net/sfu/intel-thread-sfd ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- This SF.net Dev2Dev email is sponsored by: Show off your parallel programming skills. Enter the Intel(R) Threading Challenge 2010. http://p.sf.net/sfu/intel-thread-sfd ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre
Re: [Dspace-tech] LDAP settings
You shouldn't need to escape the values at all. Commas are fine, and quite normal in LDAP configurations. Check using a tool such as http://jxplorer.org/ that you can log in to the LDAP server with those credentials. Thanks, Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 On 3/09/2010, at 5:42 AM, Flavio Botelho wrote: Please post any errors in the log that are appearing? But I will take a wild guess that there might be problems with escaping, you might need to use 2 backslashes instead of just 1 for each comma... On Thu, Sep 2, 2010 at 9:18 AM, Webshet, Sisay (ILRI) s.webs...@cgiar.org wrote: Hi, Support I login to our local LDAP server using the following settings, but cannot login. I can search users name account using sAMAccountName attribute. Host ILRI.CGIARAD.ORG base DN DC=ILRI,DC=CGIARAD,DC=ORG Bind DN(entry DN) CN=Webshet\, Sisay (ILRI),OU=ILRI Ethiopia Employees,OU=ILRI Ethiopia,DC=ILRI,DC=CGIARAD,DC=ORG What will be the setting in dspace.cfg ( dspace 1.5.2 on debian ) if something is wrong please correct me.i can't login to dspace using LADP. ldap.provider_url = ldap://ILRI.CGIARAD.ORG/ ldap.id_field = sAMAccountName ldap.object_context = OU=ILRI Ethiopia Employees,OU=ILRI Ethiopia,DC=ILRI,DC=CGIARAD,DC=ORG ldap.search_context = OU=ILRI Ethiopia Employees,OU=ILRI Ethiopia,DC=ILRI,DC=CGIARAD,DC=ORG ldap.email_field = mail ldap.surname_field = sn ldap.givenname_field = givenName ldap.phone_field = telephoneNumber Hierarchical LDAP Settings # # If your users are spread out across a hierarchical tree on your # LDAP server, you will need to use the following stackable authentication class: plugin.sequence.org.dspace.authenticate.AuthenticationMethod = \ org.dspace.authenticate.LDAPHierarchicalAuthentication # object scope : 0 # one level scope : 1 # subtree scope : 2 ldap.search_scope = 2 #ldap.search.user = cn=admin,ou=people,o=myu.edu ldap.search.user = CN=Webshet\, Sisay (ILRI),OU=ILRI Ethiopia Employees,OU=ILRI Ethiopia,DC=ILRI,DC=CGIARAD,DC=ORG ldap.search.password = * -- This SF.net Dev2Dev email is sponsored by: Show off your parallel programming skills. Enter the Intel(R) Threading Challenge 2010. http://p.sf.net/sfu/intel-thread-sfd ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- This SF.net Dev2Dev email is sponsored by: Show off your parallel programming skills. Enter the Intel(R) Threading Challenge 2010. http://p.sf.net/sfu/intel-thread-sfd ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- This SF.net Dev2Dev email is sponsored by: Show off your parallel programming skills. Enter the Intel(R) Threading Challenge 2010. http://p.sf.net/sfu/intel-thread-sfd ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Import LDAP users and groups
Hi Anthony, I'm in the process of implementing dspace for a prof-of-concept project. Is it possible to import (auto enroll) a batch of eperson and groups? I will like to import 30+ users and 10+ groups from LDAP. It isn't possible to import users from LDAP, however DSpace has an ability to create user accounts automatically the first time they log in via LDAP. This is from the config file: # This will turn LDAP autoregistration on or off. With this # on, a new EPerson object will be created for any user who # successfully authenticates against the LDAP server when they # first login. With this setting off, the user # must first register to get an EPerson object by # entering their ldap username and password and filling out # the forms. webui.ldap.autoregister = true This may help you achieve what you need. For groups, it is possible to extend the 'special groups' functionality that allows users to be added to groups dynamically each time they are log on. This could be based on LDAP group membership, and if someone were to create a patch that enables this, I'm sure it would make an excellent addition to DSpace. Thanks, Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- This SF.net Dev2Dev email is sponsored by: Show off your parallel programming skills. Enter the Intel(R) Threading Challenge 2010. http://p.sf.net/sfu/intel-thread-sfd ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Filter-Media / index-update
Hi Marcelo, Today we have approx. 400.000 items in the repository Consider three PDF files per day, with a variable number os pages (100 ~ 5000) each. We create the hierarchy Year (community) - Month (Community) - Day (Community) - File (collection) for each file. For instance, 2008 - Aug - 13 - My file 1; 2008 - Aug - 13 - My file 2; 2008 - Aug - 13 - My file 3. We upload each file page (a PDF of approx. 100Kb) as a different item. In short, we have to index hundreds of small items per day. The server configuration is: CPU: Intel(R) Xeon(TM) CPU 3.00GHz (2992.52-MHz K8-class CPU) FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs real memory = 2147483648 (2048 MB) avail memory = 2056413184 (1961 MB) Postgres db running in the same machine Disk (for DSpace and database) is a sorage mounted with nfs Depending on where the bottleneck is (possible in several places) you could try a few changes. Of course all this advice should be taken with a pinch of salt as everyone's system is different. The first change I would try is to move the postgres database (data directory) and search index files (dspace/search/) to a local (or locally attached) disk. This should be a lot faster. NFS is naturally slower than local disk, and operates slightly differently. Both Postgres and Lucene recommend that you don't run them over NFS. Since the indexing is primarily building search indexes in the database and in lucene, you should see some speed improvements. NFS should be fine for the assetstore though. Of course if you move the search index and postgres database files to a local disk, you'll need to remember to ensure they are included in your backup schedule. (Some people don't backup their DSpace lucene search index as it changes often and can be regenerated from DSpace - but that is up to you). If you still need a speed improvement, then depending on your budget you could try a few options: - Databases thrive well with a lot of RAM. The more data they can cache in memory, the faster they will be. Luckily RAM is quite cheap. Also read the documentation online about tuning Postgres to make sure it uses the RAM. - If you have a bit more money, try buying a second server, and running postgres on that. If you do find any of these give a useful improvement, please could you report back - that way we'll be able to give useful advice to other people in a similar situation. I hope that helps, Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- This SF.net email is sponsored by Make an app they can't live without Enter the BlackBerry Developer Challenge http://p.sf.net/sfu/RIM-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Filter-Media / index-update
Hi Marcelo, Every day, I import hundreds pdfs to my DSpace. I developed the small program to help this task. After this, I need to update my index. I run filter-media.sh whith parameter -s to disconsider the previous top communities. But the index-update is very slow, spend +- 2 hours. How can I optimize this task? It's hard to know without knowing a bit more detail. For example: - How big are the PDFs - What is your server setup like? (1 server, or DSpace on a different server to your database) - How fast are your disks Really you'll need to do a bit of work to see where the bottlenecks are. It maybe that your disks are slow, or you're running out of RAM (databases perform better with lots of RAM), or the PDFs are very big so will take a while, your processors are at capacity etc. If you can answer some of these questions, we may be able to help you tune your setup, of suggest ways of improving the process. Thanks, and good luck, Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- This SF.net email is sponsored by Make an app they can't live without Enter the BlackBerry Developer Challenge http://p.sf.net/sfu/RIM-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] DSpace 1.6.2 issue date format
Hi Clive, The problem with the issue date truncation on DSpace 1.6.2 has been solved :) Excellent - glad it works! :) It appears that the patch http://jira.dspace.org/jira/browse/DS-469 had not been applied to DCDate.java in the 1.6.2 source code. I've just worked out what's happened here by trawling though the subversion commit logs: The patch was applied to 'trunk' (which will become 1.7) but NOT to the 1_6_x branch which was used to make 1.6.1 and 1.6.2. At least together we have worked this out :) Therefore if it comes up again, we know how to fix it! If for some reason we do release a 1.6.3, then we can make sure it gets included. Thanks, Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- This SF.net email is sponsored by Make an app they can't live without Enter the BlackBerry Developer Challenge http://p.sf.net/sfu/RIM-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] DSpace 1.6.2 and solr statistics
Hi Clive, 1) How to convert and import the old log files into solr as I cannot find the scripts stats-log-converter and stats-log-importer anywhere (I installed DSpace 1.6.2 from source) With 1.6 we've introduced a new way of running scripts. You used to have to run scripts such as: - [dspace]/bin/create-administrator - [dspace]/bin/filter-media All the scripts are now replaced with a single script called 'dspace': - [dspace]/bin/dspace create-administrator - [dspace]/bin/dspace filter-media This means we only have to maintain two scripts - one for unix, and one for Windows. To run the scripts you need, try: - [dspace]/bin/dspace stats-log-converter - [dspace]/bin/dspace stats-log-importer (The old scripts will likely be removed in future versions, but were left there in 1.6 versions during the transition). 2) Additionally what do I do about the old cron tasks for statistics processing? Do I still need the following entries in the DSpace crontab: # Run stat analyses 0 1 * * * /home/dspace/bin/stat-general 0 1 * * * /home/dspace/bin/stat-monthly 0 2 * * * /home/dspace/bin/stat-report-general 0 2 * * * /home/dspace/bin/stat-report-monthly That is up to you. The old statistics system still works, so if you want to keep them up to date, then there is no need to remove the cronjobs. Thanks, Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- This SF.net email is sponsored by Make an app they can't live without Enter the BlackBerry Developer Challenge http://p.sf.net/sfu/RIM-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] DSpace 1.6.2 issue date format
Hi Clive / Rajshekhar, I notice that with DSpace 1.5.2 on our server the strange codes were already there before the database upgrade: dc date accessioned 2009-04-29T05:57:26Z dc date available 2009-04-29T05:57:26Z dc date issued 2009-04-29T05:57:26Z These dates are completely normal. See: http://en.wikipedia.org/wiki/ISO_8601#UTC Basically it is a way of describing date / time fields in a timezone neutral way. year-month-day T (to denote the start of the Time part) hour:minute:second Z (zulu time) Therefore the contents of your database appear to be fine. When you view an item, are the dates correct in there - is it just the browse screens that appear wrong? Since upgrading, have you re-indexed your browse tables? Step 10 of the upgrade instructions (http://www.dspace.org/1_6_2Documentation/ch04.html#N10FE6) says to run: - [dspace]/bin/dspace index-init You could look in your browse index tables bi_* and see what values they are holding. Are they holding the expected dates in the format you would expect? Thanks, Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- This SF.net email is sponsored by Make an app they can't live without Enter the BlackBerry Developer Challenge http://p.sf.net/sfu/RIM-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] DSpace 1.6.2 issue date format
Hi Clive, 2) I then stopped tomcat, and modified the line you mentioned in dspace.cfg as follows: webui.itemdisplay.default = dc.title, dc.title.alternative, dc.contributor.*, \ dc.subject, dc.date.issued, dc.publisher, \ dc.identifier.citation, dc.relation.ispartofseries, \ dc.description.abstract, dc.description, \ dc.identifier.govdoc, dc.identifier.uri(link), \ dc.identifier.isbn, dc.identifier.issn, \ dc.identifier.ismn, dc.identifier The full, unabridged issue date is now shown as you can see below: So what is it about (date) ??? Adding (date) to a field in that list tells DSpace that you want to display the date as a data, rather than as the raw string that it retrieves from the database in the 'simple item view'. Typically this will involve stripping off the time, and, depending on the original date you entered, displaying just the year, month and year, or day month and year. So the suggestion to remove it was to check that it was getting the correct data - not as a fix to the other problems. We need to work out why the date isn't being The class that does this is DCDate.java, and we know this class has a few issues and limitations in the way it does this, and we have some open issues in our JIRA bug tracking system to look at this and address it. I've had a quick look around our JIRA system, and there are some other reports of the same problem, for example this one: - http://jira.dspace.org/jira/browse/DS-469 However this suggests it was fixed in 1.6.1. Are you using the source or binary distribution of DSpace 1.6.2? I'll try and find some time to big into this a bit further. Thanks, Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- This SF.net email is sponsored by Make an app they can't live without Enter the BlackBerry Developer Challenge http://p.sf.net/sfu/RIM-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] SWORD submission
Hi Rajshekhar, Can I upload a single file using sword? I have tried this with sword-client-1.1 by uploading single pdf file, it gives me unsupported media file. If no, then I need to upload the whole zip file similar to [dspace-source]/dspace-sword/example/example.zip file. but it contains mets.xml file, which contains meta data information. The SWORD implementation in DSpace will accept two types of deposit: - Full packages (such as example.zip) can be deposit into COLLECTIONS. The packages must contain the metadata (mets.xml) and files in order to create a new ITEM. - Single files can be deposited into existing ITEMS, and the new file will be added to the list of bitstreams. You probably received that error because you were trying to deposit a single file into a COLLECTION, whereas you can only deposit it into an existing ITEM. How can I write that file? You either have to create them yourself, or look at using a tools such as the PHP SWORD client library (http://github.com/stuartlewis/swordapp-php-library/) which includes a SWAP/METS packager that you can use (http://github.com/stuartlewis/swordapp-php-library/blob/master/packager_mets_swap.php). Thanks, Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://p.sf.net/sfu/dev2dev-palm ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Using SWORD
Hi Ahmda, Can anyone provide me a solid reference on how to make applicants communicate with DSPACE using SWORD? Is there any other tool through which my application, deployed on a separate server from that of DSPACE, can communicate with DSPACE (webservices …)? The following links might help: - The SWORD website: http://swordapp.org/ - The current SWORD specification: http://swordapp.org/docs/sword-profile-1.3.html - A PHP library to interact with SWORD: http://github.com/stuartlewis/swordapp-php-library - A Java library to interact with SWORD: http://sword-app.svn.sourceforge.net/viewvc/sword-app/java-common/trunk/src/main/java/org/purl/sword/client/ The setting you'll need for your server is: - http://your-dspace.com/sword/servicedocument (clients will require this) If you have specific questions please ask them, or send them to the SWORD technical email list: - https://lists.sourceforge.net/lists/listinfo/sword-app-tech Thanks, Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 -- ThinkGeek and WIRED's GeekDad team up for the Ultimate GeekDad Father's Day Giveaway. ONE MASSIVE PRIZE to the lucky parental unit. See the prize list and enter to win: http://p.sf.net/sfu/thinkgeek-promo ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
