Re: [Dspace-tech] [Dspace-general] Certificate for LDAP
Hello, Am 14.01.2015 um 04:33 schrieb Olivier Nicole olivier.nic...@cs.ait.ac.th: I would like to configure DSpace to authenticate against LDAP, but I want to use encrypted ldaps. The certificate and CA I am using are self-signed, so where should I configure these (CERT and CA) for DSpace to work? Hiltons answer contains the essential information I guess, but I feel it is not that obvious what exactly is important. The first answer is, well it depends on the server setup you use. There are many different SSL libraries out there and since last years big breaks in OpenSSL even more of them arise. Each server software has a default configuration that decides which library to use. Then, these default configurations might differ for the same server software depending on the (linux/BSD) distribution you run because of the policies of this particular distribution. Distribution policies might contain decisions particularly regarding the preferred SSL Library, because SSL is such an important building block for basic system security. So, find out which library you use first. Each library requires different steps to store ceritficates, searches for them in different path and support different storage formats. It seems that there is a standard way, just because OpenSSL is so widely used. But what seems to be a standard is actually only the OpenSSL way of doing the job. If you run tomcat or jetty behind apache, then apache is the place where to search. Well, this is true for port 443, but which port is LDAP using for secure communication? Maybe that tomcat (supposed this is your container) uses OpenLDAP for requesting authentication from your central LDAP Server. Then you have to find out which SSL Library OpenLDAP uses. Apache uses OpenSSL as default on many distributions. Tomcat uses the Java specific SSL implementation JSSE as default but can be configured to use OpenSSL instead. When I finally configured our server to use SSL for login (years too late actually) I had to learn a lot about SSL and I was surprised how little documentation there was. Culprit me, I did not document my solution as well. I run Tomcat without Apache in front of it and I decided to stay with JSSE because OpenSSL was seen as a bad solution then. JSSE is a rather basic implementation I guess, but is probably not under attack the way OpenSSL is currently. The official documentation for JSSE configuration is deceiving, particularly when it comes to creating the keystore. Note that I am not talking about communication between your Servlet container and the authenticating LDAP server though, but only about login to DSpace. If it turns out that JSSE via BIO in Tomcat is your way to go and you run into trouble with that, please ask and I will look up, who I solved the issues in my instance. Bye, Christian -- New Year. New Location. New Benefits. New Data Center in Ashburn, VA. GigeNET is offering a free month of service with a new server in Ashburn. Choose from 2 high performing configs, both with 100TB of bandwidth. Higher redundancy.Lower latency.Increased capacity.Completely compliant. http://p.sf.net/sfu/gigenet ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Urgent: database layer spontaneously closing connections(…)
Hello, the impact of this issue seems to be severe in our case: Please have a look at this item: http://stadtteilgeschichten.net/handle/2339/5620?show=full compared to any other item in our DSpace, such as: http://stadtteilgeschichten.net/handle/2339/5621?show=full Obviously, we have lost most of the metadata for the first item during insertion in our database! Even required fields got lost like dc.contributor.author or dc.type. This means that the item will not be indexed, not be shown e.g. while browsing by type or when using faceted search. Obviously with this little metadata, it will also hardly be visible when searching by Google. So far I have lowered drastically the cycle of thumbnail generation, but honestly, this is solution is neither sufficient nor satisfactory. I think whether I should close login to avoid partial input altogether. But as I have no idea as of how to fix the issue, it is also a tough decision to spoil our users timetable, especially, when they have promised to fulfill a certain amount of work until the end of the year. My postgresql logfile looks like this: 2014-12-02 04:00:10 CET LOG: unexpected EOF on client connection 2014-12-02 08:00:05 CET LOG: unexpected EOF on client connection 2014-12-02 08:00:05 CET LOG: unexpected EOF on client connection 2014-12-02 08:01:15 CET LOG: unexpected EOF on client connection 2014-12-02 08:01:15 CET LOG: unexpected EOF on client connection 2014-12-02 10:00:09 CET LOG: unexpected EOF on client connection 2014-12-02 10:00:09 CET LOG: unexpected EOF on client connection 2014-12-02 10:00:11 CET LOG: unexpected EOF on client connection 2014-12-02 10:00:11 CET LOG: unexpected EOF on client connection 2014-12-02 10:01:14 CET LOG: unexpected EOF on client connection 2014-12-02 10:01:14 CET LOG: unexpected EOF on client connection 2014-12-02 12:00:05 CET LOG: unexpected EOF on client connection 2014-12-02 12:00:05 CET LOG: unexpected EOF on client connection 2014-12-02 12:01:13 CET LOG: unexpected EOF on client connection 2014-12-02 12:01:13 CET LOG: unexpected EOF on client connection Four entries every even hour means that I have two interruptions in database connection for each run of filter-media and itemcounter. Six such events at ten o'clock are caused by a third batch running at that time, generate-sitemaps, while update-discovery-index at four o'clock causes a single interruption. I dont know exactly when this has started. I dont look to these logs routinely and removal of old logs follows default rules. I can see now that it was at least the case since September, but nobody ever noticed any malfunction. Although my postgresql is in standard configuration running autovacuum regularly, I did a manual vacuum full and a reindex database and reindex system for the dspace database yesterday. These jobs finished fast without problems. The snippet of the logfile above was recorded after this maintainance. Please suggest on appropriate measures. Thanks, Christian Am 01.12.2014 um 14:23 schrieb Christian Völker c.voel...@gmx.net: Hello, has this issue ever been solved? I encounter it here with DSpace 1.8.3 and Postgres 9.1 Thanks, Christian Am 31.01.2012 um 15:59 schrieb Tim Donohue tdono...@duraspace.org: Rui, Sorry, I haven't gotten any further with this issue. Does anyone else on this list have any ideas here? Anyone else encountering this issue on either 1.7.x or 1.8.x, or find a way to resolve it? - Tim On 1/31/2012 6:28 AM, Rui Ramos wrote: Tim Hi, Have you manage to solve this issue ? I have the same problem and from the logs it seams the Database resets the connection. Dspace - 1.7.2 PostgreSQL- 8.4.9 Any ideias ? On Fri, 2011-12-09 at 10:58 -0600, Tim Donohue wrote: Actually, looking at these error messages a bit more closely, this may be entirely unrelated. It could be an XMLUI specific issue, rather than a database layer issue that you are seeing. - Tim On 12/9/2011 10:54 AM, Tim Donohue wrote: Hi Mark, Unfortunately, I don't have an answer for you. But, digging around I noticed a similar oddity on demo.dspace.org. On demo.dspace.org we're getting some similar sorts of SocketException errors (thoughbroken pipe rather thansocket closed) in the dspace.log files, but these are from the XMLUI. demo.dspace.org is currently running: * DSpace 1.8.0 * PostgreSQL 8.4.2 * Tomcat 6.0.29 * Java 1.6.0_24 The error on demo.dspace.org is aClientAbortException: java.net.SocketException: Broken pipe (in XMLUI), which is caused by an underlyingjava.net.SocketException: Broken pipe. Not the same error, but eerily similar. The XMLUI seems to handle it in stride, but it does cause frequent lines like this to appear in the logs: 2011-12-09 10:51:48,663 ERROR org.dspace.app.xmlui.cocoon.DSpaceCocoonServletFilter @ Serious Error Occurred Processing Request! In the PostgreSQL logs I see some occasionalunexpected EOF on client
[Dspace-tech] Fwd: *** GMX Spamverdacht *** Re: database layer spontaneously closing connections, crashes packager
Hello, has this issue ever been solved? I encounter it here with DSpace 1.8.3 and Postgres 9.1 Thanks, Christian Am 31.01.2012 um 15:59 schrieb Tim Donohue tdono...@duraspace.org: Rui, Sorry, I haven't gotten any further with this issue. Does anyone else on this list have any ideas here? Anyone else encountering this issue on either 1.7.x or 1.8.x, or find a way to resolve it? - Tim On 1/31/2012 6:28 AM, Rui Ramos wrote: Tim Hi, Have you manage to solve this issue ? I have the same problem and from the logs it seams the Database resets the connection. Dspace - 1.7.2 PostgreSQL- 8.4.9 Any ideias ? On Fri, 2011-12-09 at 10:58 -0600, Tim Donohue wrote: Actually, looking at these error messages a bit more closely, this may be entirely unrelated. It could be an XMLUI specific issue, rather than a database layer issue that you are seeing. - Tim On 12/9/2011 10:54 AM, Tim Donohue wrote: Hi Mark, Unfortunately, I don't have an answer for you. But, digging around I noticed a similar oddity on demo.dspace.org. On demo.dspace.org we're getting some similar sorts of SocketException errors (thoughbroken pipe rather thansocket closed) in the dspace.log files, but these are from the XMLUI. demo.dspace.org is currently running: * DSpace 1.8.0 * PostgreSQL 8.4.2 * Tomcat 6.0.29 * Java 1.6.0_24 The error on demo.dspace.org is aClientAbortException: java.net.SocketException: Broken pipe (in XMLUI), which is caused by an underlyingjava.net.SocketException: Broken pipe. Not the same error, but eerily similar. The XMLUI seems to handle it in stride, but it does cause frequent lines like this to appear in the logs: 2011-12-09 10:51:48,663 ERROR org.dspace.app.xmlui.cocoon.DSpaceCocoonServletFilter @ Serious Error Occurred Processing Request! In the PostgreSQL logs I see some occasionalunexpected EOF on client connection errors, but the times don't seem to match up with the SocketExceptions above. I'm also seeing these same logged issues on my local development box, now that I look closer. Again, I cannot verify this is 100% related to your same issue, but it does look a bit similar. An example of a full error stack trace from the dspace logs is attached. Sorry I don't have more help to add. Just wanted to send along what I've noticed that seems a bit similar. So far, I haven't noticed this same issue with the packager -- but, admittedly I'm using 1.8.0 (which did include some changes/bug fixes to the packager, though I'm not sure that any were related to this issue). - Tim On 12/9/2011 10:18 AM, Mark H. Wood wrote: I'm trying to script a daily incremental dump using the packager. Sometimes it completes, but most often it throwsPSQLException: An I/O error occurred while sending to the backend caused by java.net.SocketException: Socket closed. About the same time PostgreSQL logsunexpected EOF on client connection and tears down its session. I turned logging way up on both ends but saw nothing unusual on the DSpace side and only the unexpected EOF on the Pg side. Digging through the Pg log, I see lots of these unexpected EOFs. Apparently the webapp is getting this too but takes it in stride. Commandline app.s seem to be less fortunate. I captured a packet trace while running my script and can see that the client is chugging along, making requests and getting responses, then suddenly the client sends a TCP FIN, ACK packet and that's the end of that. No Pg shutdown message was sent, so far as I can tell, and that's why Pg saysunexpected EOF. After fairly rapid exchanges there's a pause of about 0.8 seconds between the previous packet (client ACKing the server's last response) and the FIN. The Pg backend is v9.0.5. This DSpace instance is v1.7.2. OS is Gentoo Linux x86 with all current userspace updates and kernel 2.6.39. JRE is Oracle (Sun) 1.6.0_29-b11. Ideas for debugging this? -- Cloud Services Checklist: Pricing and Packaging Optimization This white paper is intended to serve as a reference, checklist and point of discussion for anyone considering optimizing the pricing and packaging model of a cloud services business. Read Now! http://www.accelacomm.com/jaw/sfnl/114/51491232/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net mailto:DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Cloud Services Checklist: Pricing and Packaging Optimization This white paper is intended to serve as a reference, checklist and point of discussion for anyone considering optimizing the pricing and packaging model of a cloud services business. Read Now! http://www.accelacomm.com/jaw/sfnl/114/51491232/
Re: [Dspace-tech] Problem to upload files (pdf) or items
Hi, First guess is a permissions problem. Has the system user your servlet container runs with have write permissions in the upload folder? I would read the containers log ( in case of tomcat: catalina.out) besides the DSpace log. Give us more details to chew on. Bye, Christian Auf dem Telefon geschrieben Am 25.06.2014 um 13:07 schrieb Yelena Islen San Juan yelena.is...@idict.cu: Hi I have an emergency. I am new working with DSpace. I have installed three instances of dspace 1.8.2, but only one works well up an item. I get the following error Internal system error The system has experienced an internal error. Please try again again, and if the problem persists, please contact us to fix it. I need as soon as possible to give solution to this, since it leaves no uploading files, in this case only use pdf. Please I hope your answer thanks -- Open source business process management suite built on Java and Eclipse Turn processes into business applications with Bonita BPM Community Edition Quickly connect people, data, and systems into organized workflows Winner of BOSSIE, CODIE, OW2 and Gartner awards http://p.sf.net/sfu/Bonitasoft ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Open source business process management suite built on Java and Eclipse Turn processes into business applications with Bonita BPM Community Edition Quickly connect people, data, and systems into organized workflows Winner of BOSSIE, CODIE, OW2 and Gartner awards http://p.sf.net/sfu/Bonitasoft ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Regarding dspace installation on Cloud server
Hello, I am not used to netstat and itsoutput format, but tome it looks like there are several procceses listening on the same port. Is that possible at all? I would try to run nmap on the client to make sure the port is not blocked somehow. You telling that the browser reloads forever means that such an issue is unlikely, but just check. on the server I would use top or ps to find out more about the processes mentioned by netstat. the netstat output reports on IPv6 only. Is that right? I still suspect software like tomcat to have issues with IPv6 and would google for hints in this direction or search the apache issue tracker. I would try to get all running on standard port 8080 before switchin to another port. Do you have a setup with several tomcat instances with e.g. CATALINA_BASE in the user home directory? please tell us more about your setup, SW versions etc. bye, Christian Auf dem Telefon geschrieben Am 26.06.2014 um 07:56 schrieb rocky bang rockyba...@gmail.com: Hi friends, I have installed dspace 4.1 on ubuntu 12.04 which is cloud based server. I have successfully installed the dspace till the create-administrator command. I want to run dspace on port 8087 and i have made changes in the dspace.cfg as well as in tomcat7/server.xml file. The problem i am facing is when i type the url on my web browser it shows nothing just continuously re-freshing the page. After typing the command netstat -taupen | grep :8087 getting the following below error tcp6 0 0 :::8087 :::*LISTEN 110296675 6851/java tcp6 351 0 :8087 203.187.221.210:55182 CLOSE_WAIT 0 0 - tcp6 377 0 :8087 203.187.221.210:20271 CLOSE_WAIT 0 0 - tcp6 351 0 :8087 203.187.221.210:39621 CLOSE_WAIT 0 0 - Any suggestions regarding the above error will be helpfull. I have also googled it with no success. Thanks in advance. -- Open source business process management suite built on Java and Eclipse Turn processes into business applications with Bonita BPM Community Edition Quickly connect people, data, and systems into organized workflows Winner of BOSSIE, CODIE, OW2 and Gartner awards http://p.sf.net/sfu/Bonitasoft ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Open source business process management suite built on Java and Eclipse Turn processes into business applications with Bonita BPM Community Edition Quickly connect people, data, and systems into organized workflows Winner of BOSSIE, CODIE, OW2 and Gartner awards http://p.sf.net/sfu/Bonitasoft___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Problem to upload files (pdf) or items
Hello Yelena, first off, please report back to the list, maybe someone else reads the thread and takes over. As you see I am not at my desk, cant try right now to follow your steps. Second, it sounds to me as if the issues happens while you are chosing your file locally. But them, a server error can only be given back after submitting the upload page. Did you try from another client? Did you try another type of file, e.g. .jpg? Auf dem Telefon geschrieben Am 26.06.2014 um 12:52 schrieb Yelena Islen San Juan yelena.is...@idict.cu: Hi, Christian Thank you for your attention. I'll tell you that I use dspace 1.8.2. Now I describe my problem step by step. I do the following: 1 - Go to Mydspace and log in. 2 - I select the option to start a new submission 3-I select the collection 4 - I follow the steps Describe Describe Describe 5 - Upload (in this step pdf search, but throws the following error) Internal System Error The system has experienced an internal error. Please try to do what you were doing again, and if the problem Persists, please contact us so we can fix the problem. Leave a message for the Digital Repository Theses the administrators. Go to the DSpace home page Thank you, I await your prompt answer -- Open source business process management suite built on Java and Eclipse Turn processes into business applications with Bonita BPM Community Edition Quickly connect people, data, and systems into organized workflows Winner of BOSSIE, CODIE, OW2 and Gartner awards http://p.sf.net/sfu/Bonitasoft ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] XPDF Thumbnail Preview issue
Hello, Am 13.06.2014 um 04:47 schrieb SUZUKI Keiji z...@mbc.ocn.ne.jp: 1) Set the logging level to DEBUG and rerun. Should have done so before. Thanks you for the heads up. You were perfectly right. But then, the result leaves me a bit clueless for now: esxh-15:/srv/dspace tail -n 10 log/dspace.log.2014-06-15 2014-06-15 12:45:17,812 DEBUG org.dspace.content.BitstreamFormat @ anonymous::find_bitstream_format:bitstream_format_id=2 2014-06-15 12:45:17,812 DEBUG org.dspace.storage.rdbms.DatabaseManager @ Running query SELECT * FROM fileextension WHERE bitstream_format_id= ? with parameters: 2 2014-06-15 12:45:17,851 DEBUG org.dspace.storage.rdbms.DatabaseManager @ Running query select * from bitstream where bitstream_id = ? with parameters: 27442 2014-06-15 12:45:17,852 DEBUG org.dspace.storage.bitstore.BitstreamStorageManager @ Local filename for 8706628839618174761158592395102959 is /srv/dspace/assetstore/87/06/62/8706628839618174761158592395102959 2014-06-15 12:45:17,865 INFO net.sf.ehcache.util.UpdateChecker @ New update(s) found: 2.4.7 [http://www.terracotta.org/confluence/display/release/Release+Notes+Ehcache+Core+2.4] 2014-06-15 12:45:17,919 DEBUG org.dspace.app.mediafilter.XPDF2Thumbnail @ DPI: pdfinfo method got dpi=75 for max dim=759 (points, 1/72) 2014-06-15 12:45:17,920 DEBUG org.dspace.app.mediafilter.XPDF2Thumbnail @ Running xpdf command: [/usr/bin/pdftoppm, -q, -f, 1, -l, 1, -r, 75, /tmp/DSfilt2327548125683453130.pdf, /tmp/prevu8591868713129272046out] 2014-06-15 12:45:18,357 DEBUG org.dspace.app.mediafilter.XPDF2Thumbnail @ PDFTOPPM output is: /tmp/prevu8591868713129272046out-01.ppm, exists=false 2014-06-15 12:45:18,420 ERROR org.dspace.app.mediafilter.XPDF2Thumbnail @ Unable to delete file 2014-06-15 12:45:18,421 DEBUG org.dspace.storage.rdbms.DatabaseManager @ Running query SELECT bundle.* FROM bundle, bundle2bitstream WHERE bundle.bundle_id=bundle2bitstream.bundle_id AND bundle2bitstream.bitstream_id= ? with parameters: 27442 esxh-15:/srv/dspace ls -l /tmp insgesamt 1272 drwx-- 2 amanda backup 4096 Jun 15 11:27 amanda drwxr-xr-x 2 rootroot 4096 Jun 15 12:17 hsperfdata_root drwxr-xr-x 2 tomcat7 tomcat74096 Jun 15 12:45 hsperfdata_tomcat7 -rw-r--r-- 1 tomcat7 tomcat7 1281435 Jun 15 12:45 prevu8591868713129272046out-1.ppm drwxr-xr-x 2 tomcat7 root 4096 Jun 15 12:12 tomcat7-tomcat7-tmp drwx-- 2 rootroot 4096 Jun 15 11:26 vmware-root esxh-15:/srv/dspace This means, the enumeration scheme used by pdftoppm for writing image files from several pages is different from what the XPDF Plugin expects. If I got it right, the plugin tells pdftoppm to do this: /usr/bin/pdftoppm -q -f 1 -l 1 -r 75 /tmp/DSfilt2327548125683453130.pdf /tmp/prevu8591868713129272046out It expects to find the resulting file here: /tmp/prevu8591868713129272046out-01.ppm However, the file gets written here: /tmp/prevu8591868713129272046out-1.ppm Everything is fine regarding file permissions, the file is in the expected directory /tmp, only the six digits instead of a single digit make the difference. There are several questions here. Why does the filter write a .ppm file and not a .jpg file using the -jpeg option of pdftoppm and when does the actual conversion happen? The task of the filter is always to produce a thumbnail image of the first page. So it would seem much more logical and robust to me to use the -singlepage attribute of pdftoppm which does not add anything to the output name besides the file extension. Instead first page -f and last page -l are set to 1. But well I would not need to bother if everything worked fine. Where does this six digit rule get set? During my tests I had produced thousands of files starting with /tmp/prevu*. Most of them ended on -1.ppm, but some of them on -01.ppm. Mysterious. I will try to produce the same fault on my test system which works fine for now, just to understand where are the differences. For now, I wont try the second suggestion to recompile with source code commented out, because I guess, I already found the issue, just dont understand it yet. Thanks for your support. Further suggestions welcome. Bye, Christian -- HPCC Systems Open Source Big Data Platform from LexisNexis Risk Solutions Find What Matters Most in Your Big Data with HPCC Systems Open Source. Fast. Scalable. Simple. Ideal for Dirty Data. Leverages Graph Analysis for Fast Processing Easy Data Exploration http://p.sf.net/sfu/hpccsystems ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] XPDF Thumbnail Preview issue
Hello, I just try to get the XPDF based PDF Thumbnail creation working. It works fine in my DSpace 4.1 test instance. The feature was already available in DSpace 1.8.2 which is still our production release. Instead of waiting until the new version is production ready, I install the features step by step in the production environment. On the production machine, I get this error: esxh-15:/srv/dspace# bin/dspace filter-media -i 2339/4318 -v The following MediaFilters are enabled: Full Filter Name: org.dspace.app.mediafilter.HTMLFilter org.dspace.app.mediafilter.HTMLFilter Full Filter Name: org.dspace.app.mediafilter.WordFilter org.dspace.app.mediafilter.WordFilter Full Filter Name: org.dspace.app.mediafilter.JPEGFilter org.dspace.app.mediafilter.JPEGFilter Full Filter Name: org.dspace.app.mediafilter.XPDF2Text org.dspace.app.mediafilter.XPDF2Text Full Filter Name: org.dspace.app.mediafilter.XPDF2Thumbnail org.dspace.app.mediafilter.XPDF2Thumbnail Full Filter Name: org.dspace.app.mediafilter.PowerPointFilter org.dspace.app.mediafilter.PowerPointFilter SKIPPED: bitstream 27442 (item: 2339/4318) because 'Limmerstraße.pdf.txt' already exists ERROR filtering, skipping bitstream: Item Handle: 2339/4318 Bundle Name: ORIGINAL File Size: 2667225 Checksum: 3db0096cb62b6d595c1e4bb77f6833d0 (MD5) Asset Store: 0 javax.imageio.IIOException: Can't read input file! javax.imageio.IIOException: Can't read input file! at javax.imageio.ImageIO.read(ImageIO.java:1291) at org.dspace.app.mediafilter.XPDF2Thumbnail.getDestinationStream(XPDF2Thumbnail.java:244) at org.dspace.app.mediafilter.MediaFilterManager.processBitstream(MediaFilterManager.java:737) at org.dspace.app.mediafilter.MediaFilterManager.filterBitstream(MediaFilterManager.java:561) at org.dspace.app.mediafilter.MediaFilterManager.filterItem(MediaFilterManager.java:511) at org.dspace.app.mediafilter.MediaFilterManager.applyFiltersItem(MediaFilterManager.java:479) at org.dspace.app.mediafilter.MediaFilterManager.main(MediaFilterManager.java:353) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:622) at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:183) Updating search index: Note, that the text extraction took place in an earlier run of filter-media. So the message Can't read input file! is not very credible. Also the method called when the Exeption took place was XPDF2Thumbnail.getDestinationStream, which means that this issue might not be with the input file but with creating the output file. In 2012, Osama Alkadi reported a similar issue and solved it by updating the pdftoppm tool. On Debian and Ubuntu, the required tools are contained in the package poppler-utils. I have installed Version 0.18.4 on both test and production machine. Here is the output: esxh-15:/srv/dspace# pdftoppm -v pdftoppm version 0.18.4 Copyright 2005-2011 The Poppler Developers - http://poppler.freedesktop.org Copyright 1996-2004 Glyph Cog, LLC The version numberings seems to have changed in unexpected ways as Osama Alkadi told that he updated from 3.0 to 3.0.2. For the moment, this does not help too much. All other components involved are also the same on both machines. jai_imageio is version 1.1 and jai_core is 1.1.3. As the file is hard to find in the assetstore, I downloaded it using the browser, scped it back to the server and converted it manually using pdftoppm -jpeg inputfile.pdf outputname. It worked. I exported the item containing the file using the AIP packager, transferred it to the test server running DSpace 4.1, imported it and ran filter-media there. It worked fine. I compared the installation instructions of DSpace 4.1 and 1.8.2 and could not find a significant difference regarding the XPDF Feature. The mvn package and ant update command had not shown any irregularities. File permissions in assetstore did not show any problems. On both machines, DSpace is run as the daemon user tomcat7. In both cases, I run Tomcat 7, albeit in slightly different versions. But Tomcat is not involved in running the command line tool like bin/dspace filter-media anyway. So far, I have not found a clue, where to search for the reason. If anybody has an idea, Id be grateful. Bye, Christian -- HPCC Systems Open Source Big Data Platform from LexisNexis Risk Solutions Find What Matters Most in Your Big Data with HPCC Systems Open Source. Fast. Scalable. Simple. Ideal for Dirty Data. Leverages Graph Analysis for Fast Processing Easy Data Exploration http://p.sf.net/sfu/hpccsystems
[Dspace-tech] Exporting communities or collections with bin/dspace packager -d -a … throws an error
Hello, I am using the dspace packer command line feature for the first time. My Repository runs DSpace 1.8.3 on Tomcat 7, Ubuntu 12.04 LTS and Postgres 9.1. Disseminating single items works flawlessly. However, disseminating whole collections or communities constantly throws the same Exception. I tried various collections or communities. The communities I tried contained two or more collections but no subcommunities. I chose collections and communities that hold about twenty items or less for now. As this is an IOException while creating a tempfile it is worth noting that my dspace user is tomcat7 who is not allowed to write to his own home directory by default in Debian/Ubuntu. This did not pose any problems for years and indeed I see this as a security advantage and a means to facilitate relocation to a freshly installed machine which happens from time to time. The filename given on the command line is touched and has a size of zero. I cant see which file the packager actually tries to create when the exception gets thrown. It is just my arbitrary assumption that the packager tries to create a tempfile in the users home directory. I also assume that a tempfile is not required for exporting a single item, even if this item contains several bitstreams. To prove whether it makes a difference, I ran the dspace packager command as root as well. Although this might not be usual operation, running the command as root makes sure that the user can write to its home directory and in fact eveery directory and file and that execution rights are available for the dspace CLI, which would not be the case for e.g. my login account. I dont like the idea of changing the dspace user on a production system. Can anybody explain me what the packager tries to do exactly when failing? Thanks for suggestions. Here comes a link to the collection I tried and a listing of several commands. First as user tomcat7, then as root. Bye, Christian http://stadtteilgeschichten.net/handle/2339/4227 esxh-15:/srv/dspace/packager ../bin/dspace packager -e stadtteilgeschich...@arcor.de -d -t AIP -i 2339/4227 4227.zip Disseminating DSpace COLLECTION [ hdl=2339/4227 ] to 4227.zip Exception: No such file or directory java.io.IOException: No such file or directory at java.io.UnixFileSystem.createFileExclusively(Native Method) at java.io.File.checkAndCreate(File.java:1833) at java.io.File.createTempFile0(File.java:1857) at java.io.File.createTempFile(File.java:1934) at org.dspace.content.crosswalk.RoleCrosswalk.disseminateElement(RoleCrosswalk.java:186) at org.dspace.content.packager.AbstractMETSDisseminator.crosswalkToMetsElement(AbstractMETSDisseminator.java:1359) at org.dspace.content.packager.AbstractMETSDisseminator.makeMdSec(AbstractMETSDisseminator.java:614) at org.dspace.content.packager.AbstractMETSDisseminator.addToAmdSec(AbstractMETSDisseminator.java:727) at org.dspace.content.packager.AbstractMETSDisseminator.addAmdSec(AbstractMETSDisseminator.java:753) at org.dspace.content.packager.AbstractMETSDisseminator.makeManifest(AbstractMETSDisseminator.java:839) at org.dspace.content.packager.AbstractMETSDisseminator.writeZipPackage(AbstractMETSDisseminator.java:311) at org.dspace.content.packager.AbstractMETSDisseminator.disseminate(AbstractMETSDisseminator.java:258) at org.dspace.content.packager.DSpaceAIPDisseminator.disseminate(DSpaceAIPDisseminator.java:160) at org.dspace.app.packager.Packager.disseminate(Packager.java:671) at org.dspace.app.packager.Packager.main(Packager.java:460) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:622) at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:183) esxh-15:/srv/dspace/packager ../bin/dspace packager -e stadtteilgeschich...@arcor.de -d -t AIP -i 2339/4228 4228.zip Disseminating DSpace ITEM [ hdl=2339/4228 ] to 4228.zip CREATED package file: /srv/dspace/packager/4228.zip esxh-15:/srv/dspace/packager id uid=114(tomcat7) gid=122(tomcat7) Gruppen=122(tomcat7) esxh-15:/srv/dspace/packager ls -la insgesamt 9352 drwxr-xr-x 2 tomcat7 tomcat74096 Jun 11 12:48 . drwxrwxr-x 23 tomcat7 tomcat74096 Jun 11 11:33 .. -rw-r--r-- 1 tomcat7 tomcat7 0 Jun 11 12:42 4225.zip -rw-r--r-- 1 tomcat7 tomcat7 0 Jun 11 12:40 4226.zip -rw-r--r-- 1 tomcat7 tomcat7 0 Jun 11 12:49 4227.zip -rw-r--r-- 1 tomcat7 tomcat7 548845 Jun 11 12:49 4228.zip -rw-r--r-- 1 tomcat7 tomcat7 809265 Jun 11 12:48 4229.zip -rw-r--r-- 1 tomcat7 tomcat7 261623 Jun 11 12:47 4230.zip esxh-15:/srv/dspace/packager exit exit cvoelker@esxh-15:/srv/dspace/packager$ sudo
[Dspace-tech] Customization of CC-License Step
Hello, I have a bunch of questions regarding the CC License Step during submission. We use XMLUI and DSpace 1.8.2. I browsed the Git Repository and got the impression that there havent been so many commits in this area since then, so I hope I dont ask questions that are solved meanwhile. Our goal is to make it mandatory for users of our repository to publish under either CC-BY-SA or CC-BY-ND. The task includes to contact all users who have published their items in our repository in the past and get their consent to change the license on all existing items. These license types are widely accepted by aggregators, who harvest us already or will do so in the future if we can guarantee these license terms for all our content. We welcome the gain in visibility provided by aggregators and see this as a cause to put a change into effect right now that we agree to anyway. I could imagine changing and limiting licensing options might be a task that others running a DSpace repository are faced with as well sooner or later. Limiting the number of choices opens a chance to further simplify the User Interface. Best case would be to have checkboxes for CC-License and deposit license on the bottom of the review step of the submission process, but I guess that requires more then just a little bit of configuration. At least, Id like to understand why there remain some strings that cant be localized in the CC License step. When thinking about how to fix the licenses for existing items, I stumbled across the option cc.submit.addbistream in dspace.cfg which defaults to true. It attaches a small file containing a desription of the license chosen in RDF format. When changing the license, this file requires extra work to keep it in sync with the dc.rights and dc.rights.uri fields, so I thought about what it might be good for. If keeping it offers any advantage, I will deal with that, but I am curious what it was meant for in the beginning. I cant see, that there is made use of it e.g. during OAI-export. Currently I tend to disable this feature for all future ingests as well. Please stop me from doing so if I overlook something important. After reading both CCLicenseStep.java files in either dspace-api and dspace-xmlui and playing with the creative commons api manually (http://api.creativecommons.org/docs/readme_15.html) I dont yet understand how they work their magic. When somebody chooses to ad a CC license, currently the item gets a field dc.rights.uri, filled with a value like http://creativecommons.org/licenses/by/3.0/de/;. We use jurisdiction german, but I wonder why we get specifically version 3.0. International version 4.0 is current, but not yet translated to german. Can I expect the system to switch to the most current version within my jurisdiction for future items as soon as they get online without me configuring anything? The CC License page during the submission process offers a drop menu set to Select or modify your license ... as a default. May I set the option Creative Commons (standard) as a default instead? Or does its existence in the menue depend on the answer of http://api.creativecommons.org/rest/1.5/?locale=de? (besides cc.license.classfilter in dspace.cfg). Why do the following questions Allow commercial uses of your work? and Allow modifications of your work? get displayed in english including there options in the german interface? I want to translate them, but I dont know where this should be done. Also, I want to set a default option for the answers. Third, I would like to remove the question regarding commercial use completely and maybe limit the choice regarding modifications to ShareAlike or No. I could not find these questions in the messages.xml nor anywhere else in the source hardcoded. Tinkering with http://api.creativecommons.org/rest/1.5/ supplying various arguments I could not force the creativecommons.org server to supply these messages. In reading the source of CCLicenseStep.java, I found variables commercial_chooser and derivatives_chooser which probably describe just these two questions and there answering options, but I did not understand where they are read from. My catalogue of questions has grown rather large already. Thats why I stop here. Only one thing regarding the deposit license Id like to mention. It gets customized for each item by prepending a line starting with License granted by . This message is hardcoded in LicenseUtils.java and can not be translated using the messages.xml system. Bye, Christian -- Time is money. Stop wasting it! Get your web API in 5 minutes. www.restlet.com/download http://p.sf.net/sfu/restlet ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette:
Re: [Dspace-tech] Creative Commons license link broken?
Hello, Am 25.03.2014 um 18:53 schrieb Bill Tantzen wile...@gmail.com: DSpace 4.1, XMLUI I have enabled the creative commons step for a collection. Everything seems to be working fine on submission. But when I view the full record, in the Files in this item section and in the sub-section entitled The following license files are associated with this item, the Creative Commons link refers to the page it is on instead of the license bitstream. ( e.g. /handle/11299/12345?show=full ). Is this a mis-configuration on my part, or bug? As I am just thinking about how to have my depositors to agree on a new license for all there previously deposited items, I stumbled upon the same behaviour in my DSpace 1.8.3 XMLUI yesterday. Obviously, this has not changed since several years. So I guess, it is intended behaviour. From a users perspective, the behaviour is surprising and limits functionality. Note that in the item view, first there comes a text link mentioning a CC-License in general. It links back to the item itself they way you told. Then, the collection containing the item gets shown (which can be found just as good in the breadcrumbs, albeit without the collections weight) and afterwords the interface returns to the licensing aspect and the CC-Logo gets displayed (without the short form of the license). This logo is linked properly! I doubt that many people will try to click the logo after clicking the text link without success. I like the mirage theme for its clean look in general and creating an own theme turned out to be much too complicated, but the sequence described at the bottom of the item page does not make much sense to me in its current state. In your description, you did not mention that you were logged in as an admin while reviewing the item. Although this seems obvious to me, maybe this is the reason why nobody could reproduce the case and you havent got an answer for weeks. Bye, Christian -- Time is money. Stop wasting it! Get your web API in 5 minutes. www.restlet.com/download http://p.sf.net/sfu/restlet ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Fwd: postgreSQL Backup: -o (preserve oids) needed?
Hello, my backup command for postgres is /usr/bin/pg_dumpall -o -c -v /srv/dspace/dumpall.sql I have carried that with me since DSpace 1.3 or DSpace 1.4. Currently, I use DSpace 1.8. Now, while moving to a new machine, I revisited the section under Architecture / Storage Layer in th Documentation and could not find any hint as to why I had used the -o option at all. The oldest version of the docs that I still have stored locally is DSpace 1.4.2 and there is no mention of -o either. Had there ever been a requirement to preserve oids while backing up which has been removed meanwhile? Did this option make it into my installation by an arbitrary yet stupid inspiration of mine? Should I preserve it since it has worked so good all the time or should I skip it to make things clean and simple? Any opinion and advice appreciated. Thanks, Christian -- Accelerate Dev Cycles with Automated Cross-Browser Testing - For FREE Instantly run your Selenium tests across 300+ browser/OS combos. Get unparalleled scalability from the best Selenium testing platform available Simple to use. Nothing to install. Get started now for free. http://p.sf.net/sfu/SauceLabs ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Plugging german controlled vocabulary GND into Mirage XMLUI theme
Hello, in a common effort german libraries have developed a controlled vocabulary of german keywords for general use. They provide a web interface to access this vocabulary and ease the search for the canonical notation of keywords in german. Obviously, the interface itself is provided in german only. This web interface is explicitly ment to be included into repository systems such as DSpace. http://xgnd.bsz-bw.de/ Before I start and hurt my brain how to tie together DSpace wit xGND in a reasonable way, Id just like to know whether somebody might have done this already and has some helpful advice on how to modify the XMLUI frontend for this purpose. We are currently using DSpace 1.8.x with XMLUI and Mirage theme and dont have plans to switch to DSpace 3.2.x within the next three or four month. So I would like to use the xGND interface from within 1.8.x / Mirage. It might be not that much of a difference which version of Mirage we use as compared to the difference between different XMLUI themes or even the JSPUI, so experience in combining xGND with Mirage in DSpace 3.2 is also very much appreciated. Thanks, Christian Völker -- Rapidly troubleshoot problems before they affect your business. Most IT organizations don't have a clear picture of how application performance affects their revenue. With AppDynamics, you get 100% visibility into your Java,.NET, PHP application. Start your 15-day FREE TRIAL of AppDynamics Pro! http://pubads.g.doubleclick.net/gampad/clk?id=84349831iu=/4140/ostg.clktrk ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] jQuery Version used - is it save to replace?
Hello, I just checked a bit and found that our instance of DSpace 1.8.2 XMLUI Mirage is using jQuery 1.6.2 which is, well, not current. I found this to be dependent on either the theme in use and the version of jQuery shipped with the DSpace sources. While the standard Kubrick theme seems to even stick with jQuery 1.2, Mirage theme references the version to use in lib/xsl/core/page-structure.xsl, line 613 explicitly. This is true for the current version of DSpace, 3.x as well: https://github.com/DSpace/DSpace/blob/master/dspace-xmlui/src/main/webapp/themes/Mirage/lib/xsl/core/page-structure.xsl xsl:template name=addJavascript xsl:variable name=jqueryVersion xsl:text1.6.2/xsl:text /xsl:variable I guess the actual file used is taken from dspace-xmlui/dspace-xmlui-webapp/src/main/webapp/static/js/. My question here is, would it be safe to drop at least version 1.6.4 http://code.jquery.com/jquery-1.6.4.min.js into this directory and change the version number in page-structure.xsl, then recompile? Or is such a change prone to break a lot stuff? Would it be feasable to do a big leap and switch to jQuery 1.9? Or are there reasons not to even take care of jQuery versions at all? Thanks, Christian -- Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_d2d_jan ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] DSpace will not redirect to /xmlui
Hello, I dont believe such battles to be apropriate on a topic where a seemingly new user of DSpace requests help. Obviously, there are many ways to solve this issue. I guess Hiltons solution is quite a good solution, however I totally disagree with his reasoning. Debian has a rather sensible update system that wont break a thing if used properly. It indicates precisely which changes it found in the conf files it tries to replace and you should know about the changes you have made and why you did so. The apt system lets you edit and merge these changes right in place or provides you with path to work on them later. Debian is made for tailoring it to your needs. The fragment solution looks just as cute. However, I am not completely up to date regarding tomcat Dos and Donts. Tomcat is a beast of utmost configurability which leads part-time users, id est 99,95% of all admins running tomcat to not use any of its powerful features. Tomcat is also an outstanding example of overwhelming documentation which seems typical for the Java world btw. It is hard to pick up the concepts, and as long as you cant get them, you will only scratch the surface. As such, I had plans to switch to a more basic server such as jetty every time I updated my environment, but I never did so far. There were always more important tasks to tackle. Tomcats caching and long startup time make it a particularly bad choice for development. I have to offer a third way. My solution is to edit the build.xml in DSpace to create a directory ROOT instead of xmlui during the last phase of the update process. So, choose wisely, Christian -- Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_d2d_jan ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] dspace instance copy/mirror
Hello, Am 01.02.2013 um 17:54 schrieb Cronin, Catherine Kemble (LARC-B702) catherine.k.cro...@nasa.gov: We have set up and configured a development instance of dspace 1.8 (jspui) that has been tested and approved to go into production. What is the best practice for copying a fully customized and configured instance of dspace over to a new server for each of the following cases? 1. Instance including all of the content (ie bitstreams) – basically a full replication from one server to another. 2. Instance including no items or bitstreams, but all of the Communities and Collections. Basically the “structure” without items. I guess, the latter case is hard to accomplish, I have no idea for this. And as long as there are not hundreds of communities I dont even think it is a good idea. I would use a clean copy and enter the Communities and Collections from scratch. Both cases imply that it will happen only once in a lifetime and that the test environment has turned into a production environment during testing already. It wont make sense to take over items from testing to production any time after the initial setup. Or to say it differently, for further development you should consider to keep data completely separate from the production environment. If you keep data separate and dont want to set up all the stuff required to compile DSpace in your production environment, you can copy over the webapps directory content as required, id est certainly the jspui directory, but other, such as lni or oai depending on whether you will use them at all. If you go deeply into the code, then there will be new versions of some .jar files in the lib directory, specifically dspace.jar you will have to copy over as well. If copying webapps and .jar files manually to the production server, you will have to tweak your config files in the dspace/config directory manually. This should not be too hard to do, they are rarely changed after initial setup. To get started (your case one), you will have to copy over the whole [dspace] directory including the assetstore, config and so on. I would use rsync for this purpose. You can clean out log, history, reports and so on and you can remove the etc subdirectory, but working directories like log, history and so on need to be in the place indicated in your [dspace]/config/dspace.cfg file and writeable for the tomcat user. Besides the [dspace] directory, you will need to dump your postgres database and load it into the production environment. Consider not using dump_all, but to dump the dspace database only. Take care of preserving oids during the transfer of the database. After you have done so, you have to move the webapps stuff as well as described before if you keep your webapps in a place different from your [dspace] directory. Check the DSpace install steps to find any steps missing in my short advisory. For me, it has turned out to be a suitable solution to set up a new machine when it comes to a new DSpace version. I do all my testing on this machine, then move over essentially the assetstore and the database. I then have to run the etc files to update the database to the current version and after a short test I am ready to switch over the DNS entry. The old machine gets to be my testing environment for further development. This way, I have a full DSpace compilation environment on my production machine and can apply small changes without the help of another machine. It is up to me to be conscious and not to apply larger changes on the production machine. Bye, Christian -- Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_d2d_jan ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] dspace 1.8.2 SendFeedbackAction.java Issue
Hello, we run dspace 1.8.2 with XMLUI and a derivative of the Mirage theme under http://stadtteilgeschichten.net/. This is, no hostname such as www.stadtteilgeschichten.net. We use tomcat6 and no apache. The feedback form under http://stadtteilgeschichten.net/feedback throws errors. The contact form in comparison works flawlessly: http://stadtteilgeschichten.net/contact These are the error messages shown in the browser when clicking on Feedback: java.lang.StringIndexOutOfBoundsException: String index out of range: -1 Cocoon stacktrace [hide] Sitemap: error invoking action context:/resource://aspects/ViewArtifacts/sitemap.xmap - 193:68 map:act type=SendFeedbackAction context:/resource://aspects/ViewArtifacts/sitemap.xmap - 192:55 map:match Java stacktrace [hide] java.lang.StringIndexOutOfBoundsException: String index out of range: -1 at java.lang.String.substring(String.java:1943) at java.lang.String.substring(String.java:1916) at org.dspace.app.xmlui.aspect.artifactbrowser.SendFeedbackAction.act(SendFeedbackAction.java:84) The logfiles did not give me any clue to solve the issue myself. I did not change anything in the associated code. Then I found these lines of code in the file SendFeedbackAction.java at the lines indicated by the java stracktrace in the bowser: String basicHost = ; if (localhost.equals(host) || 127.0.0.1.equals(host) || host.equals(InetAddress.getLocalHost().getHostAddress())) { basicHost = host; } else { // cut off all but the hostname, to cover cases where more than one URL // arrives at the installation; e.g. presence or absence of www int lastDot = host.lastIndexOf('.'); basicHost = host.substring(host.substring(0, lastDot).lastIndexOf('.')); } I dont understand exactly what this code does, however I feel the error message fitting this code pretty good. As such I guess I found the culprit. I remember that we had issues long time ago when running DSpace 1.3 or 1.4 under jspui. There was code that made wrong assumptions about the structure of the hostname variable. I suspect this to be a kind of undead which celebrates ressurection at this point. I checked the Contact.java and found that there a no comparable substring manipulations imposed on the hostname as in the SendFeedbackAction.java code. This code has not changed in DSpace 3.0, so updating our Repository will probably not help with our issue. The feedback form not working is actually a major issue I tried to recompile with hostname set to www.stadtteilgeschichten.net. However, this did not fix the issue. Instead, I got a new error message, stating that the feedback form would only work with a referrer from the same site. No wonder, www.stadtteilgeschichten.net does a 301 redirect to stadtteilgeschichten.net. As somebody else runs the nameserver, I did not bother what would happen if we request the site with a www. hostname. It is not desirable for us to do such a move, as all our google ranking we have built up in years is bound to the domain name without preceeding www. hostname. Now, I am an admin, no programmmer I would certainly break DSpace if I would try to fix the code. Actually, I tried already to commenct out the if else clause and even such aesthetically inacceptable solutions as setting basicHost to a fixed value such as stadtteilgeschichten, stadtteilgeschichten.net or just host. It did not work, thats it. I appreciate your help, Bye, Christian -- Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS, MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft MVPs and experts. ON SALE this month only -- learn more at: http://p.sf.net/sfu/learnnow-d2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] DSpace 1.8.2 on OpenJDK6: reports on success or failure appreciated
Hello, I have got a new instance of Ubuntu 12.04 LTS Precixe Pangolin to run our DSpace instance on. We currently use DSpace 1.8.2 and have not decided when we will find the time to move on to DSpace 3.0 which is a major task for a project effectively run by two people in their spare time. Comparing installation requirements of versions 1.8.2 and 3.x, the 1.8 branch still reports issues with Java 7 because of solr incompatiblity and further recommends to use SUN/Oracle JDK 6. Using SUN/Oracle JDK means installing manually without support by the distributions package management which I suspect is the same issue for every OS distribution since it is triggered by Oracles licensing terms. Installing manually means that I will run into trouble as soon as I move on to DSpace 3.0 and OpenJDK 7, a situation discouraging future updates besides of keeping up to date manually until then. Using OpenJDK 6 would be a minor issue as compared to using either SUN/Oracle JDK 6 or 7, because it is still in the package management. Although the version available there is the 13 month old b24, whereas the latest Version of OpenJDK6 is the two month old b27 which likely fixes numerous security issues. This means that it is certainly not advisable either to use OpenJDK6. I am eager to learn, whether the issues with Java7 and solr have been fixed in a way that might encourage me to ignore the warning in the DSpace 1.8 install docs an just try to use Java 7 with DSpace 1.8 branch. Furthermore, is there anybody running DSpace 1.8 who tried OpenJDK, either OpenJDK 6 or OpenJDK7? When did you try? Within the last six month or before? If you tried within the last six month, which obstacles did you run into and were you able to solve them? Are there any notes online for further reading? A quick search did not return anything of interest. Thanks a lot, Christian -- Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS, MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft MVPs and experts. ON SALE this month only -- learn more at: http://p.sf.net/sfu/learnmore_123012 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] changing Discovery sidebarFacets and Localization
Hello, Am 11.11.2012 um 13:53 schrieb helix84 heli...@centrum.sk: 1) There's no need to recompile DSpace, just change the [dspace]/webapps/xmlui/i18/messages.xml (or messages_de.xml) and restart Tomcat. If it still doesn't display, try clearing Cocoon cache [1]. I gave up after tinkering around for quite a while, thinking that I had not understood anything about the whole system. Later on I got a phone call that my changes had become visible meanwhile. Your hint to the cocoon cache gives me a climpse as of what might have happened. Still though, writing in the webapps directory is a quick way for testing, but these changes will be lost as soon as I start over to implement more of the changes we want for our DSpace instance. And there comes the need to know where to put the strings before recompiling them. I guess, your advice would be put it where it makes sense to you. Well, Ill try to gain confidence, but I find it hard, being surprised every time I touch anything, even if these are positive surprises as was the case this time. 2) You can add your changes to this main messages.xml file even if they're for Discovery or any other module, it will work. Your explanation leeds me to the assumption that during compilation all of the separate messages files of the separate modules get merged into one big catalog. Which in turn would mean that it does not matter where I put them in the first place. But well then, it also means that in case I screw it up and put different versions in serveral messages files, I wont know which one wins. Which makes it desirable to know more about the priorities during the merge (if this happens at all, it is only an assumption). Am 11.11.2012 um 13:57 schrieb helix84 heli...@centrum.sk: If you find the documentation lacking, please suggest an updated text. You can have edit access to the official documentation on the wiki if you want. I would not dare to do so. It is not that I am not willing to return some work to the community, I am just afraid that I would make it be even harder for others to find their way, given how confused I am myself about the way things actually work. Thanks for your answers! Bye, Christian -- Monitor your physical, virtual and cloud infrastructure from a single web console. Get in-depth insight into apps, servers, databases, vmware, SAP, cloud infrastructure, etc. Download 30-day Free Trial. Pricing starts from $795 for 25 servers or applications! http://p.sf.net/sfu/zoho_dev2dev_nov ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Current Postgres JDBC Driver
Hello, in the DSpace source tree, there is a rather old build of the Postgres JDBC driver included. It is build number 408, where even the legacy version for Postgres 8.1 offered on postgresql.org is build number 415. Even this is an unsupported, archived version. DSpace requires Postgres 8.2 though and thist implies that it does not make sense to stick with a Driver version that strives to support older versions of Postgres. The current build for Postgres 8.2 is 512 which is the oldest version still in support. The current version is build 703 to get an impression of what we are talking about. That said I would like to use a more recent version of the driver. However I cant figure out, where to put it. Do I really have to put separately in each and every [dsapce-source]/*/*/target/*/WEB-INF/lib/ directory for each module? What happens if I update only some of them? Will they be overwritten next time I run mvn package? Or will I end up with two JDBC drivers for each module? Will these two JDBC Drivers interact in unpredictable ways? I could not find any hints on this in the Docs. They generally just say dont worry. Well, I do. So please… Thanks, Christian -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] *** GMX Spamverdacht *** Re: Localization inside config files?
Hello, Am 29.04.2012 um 17:01 schrieb Christian Völker: just found this: dspace/config/modules/curate.cfg needs to be stored with ISO-Latin-1 Encoding to display properly, as opposed to all other files which are stored as UTF-8 nowadays. You may try to localize ui.tasknames which requires the use of umlauts in german language to understand what I mean. You cant write the words as they should be displayed just like you do in messages.xml. The get displayed as two weird glyphs. You cant use UTF-8 hex encoding which gets displayed as is where it should be interpreted. I finally found storing it using the encoding mentioned above works. This is on Debian, Java 1.6, Tomcat 6 if that would be of any relevance. I just found that this does not work either. As a short workaround for the lengthy and errorprone buildprocess introduced with maven, I tested by placing the reencoded file directly into the directory where the server runs from. At the same time, I changed the file in the source directory (with placeholders like taskqueue.dir = ${dspace.dir}/ctqueues not yet replaced). curate.cfg.iso-latin-1 Description: Binary data After running another cycle of mvn package and ant update I found that the display was broken again, be it in a slightly different manner. ant update worked properly, however mvn package did not copy the file to the target directory as is, but change the encoding at the same time. No stop, it did not just tinker with the encoding, it replaced all Umlauts wit a Replacement Character as of Code page Halfwidth and Fullwidth Forms, Unicode Codeposition U+FFFD, Hex Notation ef bf bd. This is displayed as a lower Letter i with two dots on it, followed by spanish inversed Question mark and a 1/2 sign in the browser and as a white Question mark in a diamond sign in UTF-8 compliant text editors such as vi. curate.cfg.mvn Description: Binary data Apache Maven 2.2.1 (rdebian-4) Java version: 1.6.0_26 Java home: /usr/lib/jvm/java-6-sun-1.6.0.26/jre I intentionally switched back to Maven 2.2 after running in the problems documented with Maven 3 last fall when working on the 1.7 Update. I am not willing to dig into configuring mvn to not touch file encodings. If that is a required step and cannot be done within pom.xml project files I ask you to document how it has to be done in the Installation prerequisite software section. mvn not changing files in unexpected ways would strenghten confidence, though it might not be in line with the way this tool ist meant to behave (id est strenghten confidence). Finding a way to localize DSpace modules without changing config files (and thus tieing the interface to one language) remains a welcome change to be seen in the future. Bye, Christian -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Localization inside config files?
Hello, just found this: dspace/config/modules/curate.cfg needs to be stored with ISO-Latin-1 Encoding to display properly, as opposed to all other files which are stored as UTF-8 nowadays. You may try to localize ui.tasknames which requires the use of umlauts in german language to understand what I mean. You cant write the words as they should be displayed just like you do in messages.xml. The get displayed as two weird glyphs. You cant use UTF-8 hex encoding which gets displayed as is where it should be interpreted. I finally found storing it using the encoding mentioned above works. This is ohn Debian, Java 1.6, Tomcat 6 if that would be of any relevance. Should I mention that I think that it strenghents the case for streamlining the localization process? Bye, Christian -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Localization inside config files?
Hello, in the Mirage theme (or dri2xhtml-alt, have not verified so far), there are three pairs of Button labels Add and Remove Selected. I found them to be hard-coded in the file themes/Mirage/lib/xsl/core/forms.xsl You may find the lines searching for 'input type=submit value='. Bye, Christian -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Localization inside config files?
Hallo, just came across this page on wikipedia: http://en.wikipedia.org/wiki/Computer_Assisted_Translation There is a list of tools (and even better technologies). Among other apps they mention http://omegat.org/en/omegat.html which is ment to support .properties files and is a java app by itself. Webbased systems are mentionend as well: http://www.globalsight.com/ http://sourceforge.net/projects/ote/ I did not try any of them… Bye, Christian -- For Developers, A Lot Can Happen In A Second. Boundary is the first to Know...and Tell You. Monitor Your Applications in Ultra-Fine Resolution. Try it FREE! http://p.sf.net/sfu/Boundary-d2dvs2 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Localization inside config files?
Hello, Am 05.04.2012 um 22:21 schrieb Tim Donohue: To this end, I've attempted to summarize what I've read in this thread into a new Proposal page on our wiki: https://wiki.duraspace.org/display/DSPACE/i18n+Improvements+Proposal The goal of this wiki page is *not* to take discussion away from this listserv. I just found this page and Id like to comment on. We dont need to discuss messages.properties und messages.xml files together. Both types of files can not be mapped to each other because of differences in content, not only differences in format. Thus, translating both user interfaces is a separate effort anyway. With ongoing modularization, they will depart from each other even more, so there is no chance to keep them synced somehow. In the times when there was only a jspui, translation did not seem that troublesome, so I would concentrate on the new situation with Cocconn .xml-files. Furthermore, it was said there a tools available for the .properties files, so one more reason, to deal with them for the moment. Some thoughts on the messages.xml format .ts files for which tools exist are XML files either. With the extremly simple structure of messages.xml catalogues it should not be that much of a deal to create e.g. a XSLT transformation for translating back and forth. The simple structure of message catalogues by itself seems limiting however. I read over this page to get an idea of whether xmlns:i18n=http://apache.org/cocoon/i18n/2.1 contains some more useful attributes or such to store more info but I could not identify. I think a translation file format should support an attribute untranslated or deprecated for each message string at least, with an translators comment being another desirable feature. I havent tried to feed Cocoon with a messages.xml file that was just extended with no regard to the schema definition, but it would be worth to create our own messages.xml format as long as we dont break existing functionality. It should be possible to compare two versions of a messages.xml file based on the key values only. Thus the english and a localized version could be compared to find out about the coverage of the localized version quickly. On the Mac, there is nothing similar to Altovas tools, so I know only of quite simple XML Editors and I prefer diff for now. The aforementioned way of working is not possible with diff. I am sure this is just a lack of knwoledge regarding existing tools on my side. So if anyone has suggestions on great XML Tools to check out, please tell. Scattering messages.xml files all over the file tree is not much of an issue. Inconsistency in using overlays is. Hugh, did I say that? Well, as soon as one knows, that there are several places where messages.xml files go, as long as they are named exactly the same, it is one simple search to find them all. However, using overlays does not seem to be handled consitently for all modules. For now, I have learned that the proper path to put them starts with dspace/config/modules and ends with src/main/webapp/i18n/ For xmlui, the missing middle part is just xmlui. Remember, as an user, I dont have to drop the file just into the right place, but I have to create the path. This requires better understanding. Now, eqipped with this knowledge, I try to derive the proper overlay path for modules from their source path: dspace-xmlui/dspace-xmlui-webapp/src/main/webapp /i18n dspace-xmlui/dspace-xmlui-api /src/main/resources/aspects/XMLWorkflow /i18n dspace-discovery/dspace-discovery-xmlui-api /src/main/resources/aspects/Discovery /i18n Well, dspace-xmlui/dspace-xmlui-webapp gets shortened to xmlui. Should dspace-xmlui/dspace-xmlui-api be shortened to the same xmlui, given that the first part of the path minus dspace- is the same? Or will there be a future name-clash? And for dspace-discovery/dspace-discovery-xmlui-api is it simply discovery then? Ok, then for the second part: It looks as if they cant all be thrown into src/main/resources/i18n, also not into src/main/resources/i18n/$modulename/. I could not even figure out whether overlays need to be supported actively by the programmer, reading files from a place agreed upon, or are they picked up by the maven process automagically? Finally, I just put them in the source path which means I compromise on the build process. Not that much of a deal for now, but you should be aware of the consequences of not explaining the mechanics from a users perspective. To sum up, a separate section Localization under Customization would be a wellcome addition as a one stop to gather this kind of information. Alter- natively, there should be a minimum documentation requirement for all new modules to mention this kind of stuff in a standardized place. Whose convenience counts most? In this thread, programmers versus localizers convenience was discussed. But localizers are still more engaged and