Re: [Dspace-tech] [Dspace-general] Certificate for LDAP

2015-01-14 Thread Christian Völker
Hello,

Am 14.01.2015 um 04:33 schrieb Olivier Nicole olivier.nic...@cs.ait.ac.th:

 I would like to configure DSpace to authenticate against LDAP, but I
 want to use encrypted ldaps.
 
 The certificate and CA I am using are self-signed, so where should I
 configure these (CERT and CA) for DSpace to work?

Hiltons answer contains the essential information I guess, but I feel it is not 
that obvious what exactly is important. 

The first answer is, well it depends on the server setup you use. There are 
many different SSL libraries out there and since last years big breaks in 
OpenSSL even more of them arise. Each server software has a default 
configuration that decides which library to use. 
Then, these default configurations might differ for the same server software 
depending on the (linux/BSD) distribution you run because of the policies of 
this particular distribution. Distribution policies might contain decisions 
particularly regarding the preferred SSL Library, because SSL is such an 
important building block for basic system security.

So, find out which library you use first. Each library requires different steps 
to store ceritficates, searches for them in different path and support 
different storage formats. It seems that there is a standard way, just because 
OpenSSL is so widely used. But what seems to be a standard is actually only the 
OpenSSL way of doing the job.

If you run tomcat or jetty behind apache, then apache is the place where to 
search. Well, this is true for port 443, but which port is LDAP using for 
secure communication? Maybe that tomcat (supposed this is your container) uses 
OpenLDAP for requesting authentication from your central LDAP Server. Then you 
have to find out which SSL Library OpenLDAP uses. Apache uses OpenSSL as 
default on many distributions. Tomcat uses the Java specific SSL implementation 
JSSE as default but can be configured to use OpenSSL instead.

When I finally configured our server to use SSL for login (years too late 
actually) I had to learn a lot about SSL and I was surprised how little 
documentation there was. Culprit me, I did not document my solution as well. I 
run Tomcat without Apache in front of it and I decided to stay with JSSE 
because OpenSSL was seen as a bad solution then. JSSE is a rather basic 
implementation I guess, but is probably not under attack the way OpenSSL is 
currently. The official documentation for JSSE configuration is deceiving, 
particularly when it comes to creating the keystore. Note that I am not talking 
about communication between your Servlet container and the authenticating LDAP 
server though, but only about login to DSpace.

If it turns out that JSSE via BIO in Tomcat is your way to go and you run into 
trouble with that, please ask and I will look up, who I solved the issues in my 
instance.

Bye, Christian


--
New Year. New Location. New Benefits. New Data Center in Ashburn, VA.
GigeNET is offering a free month of service with a new server in Ashburn.
Choose from 2 high performing configs, both with 100TB of bandwidth.
Higher redundancy.Lower latency.Increased capacity.Completely compliant.
http://p.sf.net/sfu/gigenet
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette


[Dspace-tech] Urgent: database layer spontaneously closing connections(…)

2014-12-02 Thread Christian Völker
Hello,

the impact of this issue seems to be severe in our case:
Please have a look at this item:

http://stadtteilgeschichten.net/handle/2339/5620?show=full
compared to any other item in our DSpace, such as:
http://stadtteilgeschichten.net/handle/2339/5621?show=full

Obviously, we have lost most of the metadata for the first item during 
insertion in our database!

Even required fields got lost like dc.contributor.author or dc.type. This means 
that the item will not be indexed, not be shown e.g. while browsing by type or 
when using faceted search. Obviously with this little metadata, it will also 
hardly be visible when searching by Google.


So far I have lowered drastically the cycle of thumbnail generation, but 
honestly, this is solution is neither sufficient nor satisfactory. I think 
whether I should close login to avoid partial input altogether. But as I have 
no idea as of how to fix the issue, it is also a tough decision to spoil our 
users timetable, especially, when they have promised to fulfill a certain 
amount of work until the end of the year.

My postgresql logfile looks like this:

2014-12-02 04:00:10 CET LOG:  unexpected EOF on client connection
2014-12-02 08:00:05 CET LOG:  unexpected EOF on client connection
2014-12-02 08:00:05 CET LOG:  unexpected EOF on client connection
2014-12-02 08:01:15 CET LOG:  unexpected EOF on client connection
2014-12-02 08:01:15 CET LOG:  unexpected EOF on client connection
2014-12-02 10:00:09 CET LOG:  unexpected EOF on client connection
2014-12-02 10:00:09 CET LOG:  unexpected EOF on client connection
2014-12-02 10:00:11 CET LOG:  unexpected EOF on client connection
2014-12-02 10:00:11 CET LOG:  unexpected EOF on client connection
2014-12-02 10:01:14 CET LOG:  unexpected EOF on client connection
2014-12-02 10:01:14 CET LOG:  unexpected EOF on client connection
2014-12-02 12:00:05 CET LOG:  unexpected EOF on client connection
2014-12-02 12:00:05 CET LOG:  unexpected EOF on client connection
2014-12-02 12:01:13 CET LOG:  unexpected EOF on client connection
2014-12-02 12:01:13 CET LOG:  unexpected EOF on client connection

Four entries every even hour means that I have two interruptions in database 
connection for each run of filter-media and itemcounter. Six such events at ten 
o'clock are caused by a third batch running at that time, generate-sitemaps, 
while update-discovery-index at four o'clock causes a single interruption.

I dont know exactly when this has started. I dont look to these logs routinely 
and removal of old logs follows default rules. I can see now that it was at 
least the case since September, but nobody ever noticed any malfunction.

Although my postgresql is in standard configuration running autovacuum 
regularly, I did a manual vacuum full and a reindex database and reindex system 
for the dspace database yesterday. These jobs finished fast without problems. 
The snippet of the logfile above was recorded after this maintainance.

Please suggest on appropriate measures.

Thanks, Christian



Am 01.12.2014 um 14:23 schrieb Christian Völker c.voel...@gmx.net:

 Hello,
 
 has this issue ever been solved?
 
 I encounter it here with DSpace 1.8.3 and Postgres 9.1
 
 Thanks, Christian
 
 
 Am 31.01.2012 um 15:59 schrieb Tim Donohue tdono...@duraspace.org:
 
 Rui,
 
 Sorry, I haven't gotten any further with this issue.
 
 Does anyone else on this list have any ideas here?  Anyone else 
 encountering this issue on either 1.7.x or 1.8.x, or find a way to 
 resolve it?
 
 - Tim
 
 On 1/31/2012 6:28 AM, Rui Ramos wrote:
 Tim Hi,
 
 Have you manage to solve this issue ?
 I have the same problem and from the logs it seams the Database resets
 the connection.
 
 Dspace - 1.7.2
 PostgreSQL- 8.4.9
 
 Any ideias ?
 
 On Fri, 2011-12-09 at 10:58 -0600, Tim Donohue wrote:
 Actually, looking at these error messages a bit more closely, this may
 be entirely unrelated. It could be an XMLUI specific issue, rather than
 a database layer issue that you are seeing.
 
 - Tim
 
 On 12/9/2011 10:54 AM, Tim Donohue wrote:
 Hi Mark,
 
 Unfortunately, I don't have an answer for you. But, digging around I
 noticed a similar oddity on demo.dspace.org. On demo.dspace.org we're
 getting some similar sorts of SocketException errors (thoughbroken
 pipe  rather thansocket closed) in the dspace.log files, but these
 are from the XMLUI.
 
 demo.dspace.org is currently running:
 * DSpace 1.8.0
 * PostgreSQL 8.4.2
 * Tomcat 6.0.29
 * Java 1.6.0_24
 
 The error on demo.dspace.org is aClientAbortException:
 java.net.SocketException: Broken pipe  (in XMLUI), which is caused by an
 underlyingjava.net.SocketException: Broken pipe. Not the same error,
 but eerily similar. The XMLUI seems to handle it in stride, but it does
 cause frequent lines like this to appear in the logs:
 
 2011-12-09 10:51:48,663 ERROR
 org.dspace.app.xmlui.cocoon.DSpaceCocoonServletFilter @ Serious Error
 Occurred Processing Request!
 
 In the PostgreSQL logs I see some occasionalunexpected EOF on client

[Dspace-tech] Fwd: *** GMX Spamverdacht *** Re: database layer spontaneously closing connections, crashes packager

2014-12-01 Thread Christian Völker
Hello,

has this issue ever been solved?

I encounter it here with DSpace 1.8.3 and Postgres 9.1

Thanks, Christian


Am 31.01.2012 um 15:59 schrieb Tim Donohue tdono...@duraspace.org:

 Rui,
 
 Sorry, I haven't gotten any further with this issue.
 
 Does anyone else on this list have any ideas here?  Anyone else 
 encountering this issue on either 1.7.x or 1.8.x, or find a way to 
 resolve it?
 
 - Tim
 
 On 1/31/2012 6:28 AM, Rui Ramos wrote:
 Tim Hi,
 
 Have you manage to solve this issue ?
 I have the same problem and from the logs it seams the Database resets
 the connection.
 
 Dspace - 1.7.2
 PostgreSQL- 8.4.9
 
 Any ideias ?
 
 On Fri, 2011-12-09 at 10:58 -0600, Tim Donohue wrote:
 Actually, looking at these error messages a bit more closely, this may
 be entirely unrelated. It could be an XMLUI specific issue, rather than
 a database layer issue that you are seeing.
 
 - Tim
 
 On 12/9/2011 10:54 AM, Tim Donohue wrote:
 Hi Mark,
 
 Unfortunately, I don't have an answer for you. But, digging around I
 noticed a similar oddity on demo.dspace.org. On demo.dspace.org we're
 getting some similar sorts of SocketException errors (thoughbroken
 pipe  rather thansocket closed) in the dspace.log files, but these
 are from the XMLUI.
 
 demo.dspace.org is currently running:
 * DSpace 1.8.0
 * PostgreSQL 8.4.2
 * Tomcat 6.0.29
 * Java 1.6.0_24
 
 The error on demo.dspace.org is aClientAbortException:
 java.net.SocketException: Broken pipe  (in XMLUI), which is caused by an
 underlyingjava.net.SocketException: Broken pipe. Not the same error,
 but eerily similar. The XMLUI seems to handle it in stride, but it does
 cause frequent lines like this to appear in the logs:
 
 2011-12-09 10:51:48,663 ERROR
 org.dspace.app.xmlui.cocoon.DSpaceCocoonServletFilter @ Serious Error
 Occurred Processing Request!
 
 In the PostgreSQL logs I see some occasionalunexpected EOF on client
 connection  errors, but the times don't seem to match up with the
 SocketExceptions above.
 
 I'm also seeing these same logged issues on my local development box,
 now that I look closer. Again, I cannot verify this is 100% related to
 your same issue, but it does look a bit similar.
 
 An example of a full error stack trace from the dspace logs is attached.
 
 Sorry I don't have more help to add. Just wanted to send along what I've
 noticed that seems a bit similar. So far, I haven't noticed this same
 issue with the packager -- but, admittedly I'm using 1.8.0 (which did
 include some changes/bug fixes to the packager, though I'm not sure that
 any were related to this issue).
 
 - Tim
 
 On 12/9/2011 10:18 AM, Mark H. Wood wrote:
 I'm trying to script a daily incremental dump using the packager.
 Sometimes it completes, but most often it throwsPSQLException: An I/O
 error occurred while sending to the backend  caused by
 java.net.SocketException: Socket closed. About the same time
 PostgreSQL logsunexpected EOF on client connection  and tears down
 its session. I turned logging way up on both ends but saw nothing
 unusual on the DSpace side and only the unexpected EOF on the Pg side.
 
 Digging through the Pg log, I see lots of these unexpected EOFs.
 Apparently the webapp is getting this too but takes it in stride.
 Commandline app.s seem to be less fortunate.
 
 I captured a packet trace while running my script and can see that the
 client is chugging along, making requests and getting responses, then
 suddenly the client sends a TCP FIN, ACK packet and that's the end of
 that. No Pg shutdown message was sent, so far as I can tell, and
 that's why Pg saysunexpected EOF. After fairly rapid exchanges
 there's a pause of about 0.8 seconds between the previous packet
 (client ACKing the server's last response) and the FIN.
 
 The Pg backend is v9.0.5. This DSpace instance is v1.7.2. OS is
 Gentoo Linux x86 with all current userspace updates and kernel
 2.6.39. JRE is Oracle (Sun) 1.6.0_29-b11. Ideas for debugging this?
 
 
 
 
 --
 
 Cloud Services Checklist: Pricing and Packaging Optimization
 This white paper is intended to serve as a reference, checklist and
 point of
 discussion for anyone considering optimizing the pricing and packaging
 model
 of a cloud services business. Read Now!
 http://www.accelacomm.com/jaw/sfnl/114/51491232/
 
 
 
 ___
 DSpace-tech mailing list
 DSpace-tech@lists.sourceforge.net  
 mailto:DSpace-tech@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/dspace-tech
 
 --
 Cloud Services Checklist: Pricing and Packaging Optimization
 This white paper is intended to serve as a reference, checklist and point of
 discussion for anyone considering optimizing the pricing and packaging model
 of a cloud services business. Read Now!
 http://www.accelacomm.com/jaw/sfnl/114/51491232/
 

Re: [Dspace-tech] Problem to upload files (pdf) or items

2014-06-26 Thread Christian Völker
Hi, First guess is a permissions problem. Has the system user your servlet 
container runs with have write permissions in the upload folder? I would read 
the containers log ( in case of tomcat: catalina.out) besides the DSpace log. 
Give us more details to chew on. 

Bye, Christian

Auf dem Telefon geschrieben

 Am 25.06.2014 um 13:07 schrieb Yelena Islen San Juan yelena.is...@idict.cu:
 
 Hi
 
 I have an emergency. I am new working with DSpace. I have installed three 
 instances of dspace 1.8.2, but only one works well up an item. I get the 
 following error
 
 Internal system error
 
 The system has experienced an internal error. Please try again again, and if 
 the problem persists, please contact us to fix it.
 
 I need as soon as possible to give solution to this, since it leaves no 
 uploading files, in this case only use pdf. Please I hope your answer
 
 thanks
 
 --
 Open source business process management suite built on Java and Eclipse
 Turn processes into business applications with Bonita BPM Community Edition
 Quickly connect people, data, and systems into organized workflows
 Winner of BOSSIE, CODIE, OW2 and Gartner awards
 http://p.sf.net/sfu/Bonitasoft
 ___
 DSpace-tech mailing list
 DSpace-tech@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/dspace-tech
 List Etiquette: 
 https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

--
Open source business process management suite built on Java and Eclipse
Turn processes into business applications with Bonita BPM Community Edition
Quickly connect people, data, and systems into organized workflows
Winner of BOSSIE, CODIE, OW2 and Gartner awards
http://p.sf.net/sfu/Bonitasoft
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette


Re: [Dspace-tech] Regarding dspace installation on Cloud server

2014-06-26 Thread Christian Völker
Hello, I am not used to netstat and itsoutput format, but tome it looks like 
there are several procceses listening on the same port. Is that possible at 
all? I would try to run nmap on the client to make sure the port is not blocked 
somehow. You telling that the browser reloads forever means that such an issue 
is unlikely, but just check. on the server I would use top or ps to find out 
more about the processes mentioned by netstat. the netstat output reports on 
IPv6 only. Is that right? I still suspect software like tomcat to have issues 
with IPv6 and would google for hints in this direction or search the apache 
issue tracker. I would try to get all running on standard port 8080 before 
switchin to another port. Do you have a setup with several tomcat instances 
with e.g. CATALINA_BASE in the user home directory? please tell us more about 
your setup, SW versions etc. 

bye, Christian

Auf dem Telefon geschrieben

 Am 26.06.2014 um 07:56 schrieb rocky bang rockyba...@gmail.com:
 
 Hi friends,
 
 I have installed dspace 4.1 on ubuntu 12.04 which is cloud based server.
 I have successfully installed the dspace till the create-administrator 
 command.
 I want to run dspace on port 8087 and i have made changes in the dspace.cfg 
 as well as in tomcat7/server.xml file.
 The problem i am facing is when i type the url on my web browser it shows 
 nothing just continuously re-freshing the page.
 
 After typing the command netstat -taupen | grep :8087 getting the following 
 below error 
 
  tcp6   0  0 :::8087 :::*LISTEN   
110296675  6851/java   
 tcp6 351  0 :8087 203.187.221.210:55182   CLOSE_WAIT  0  
 0   -   
 tcp6 377  0 :8087 203.187.221.210:20271   CLOSE_WAIT  0  
 0   -   
 tcp6 351  0 :8087 203.187.221.210:39621   CLOSE_WAIT  0  
 0   -  
 
 Any suggestions regarding the above error will be helpfull.
 I have also googled it with no success.
 
 Thanks in advance. 
 --
 Open source business process management suite built on Java and Eclipse
 Turn processes into business applications with Bonita BPM Community Edition
 Quickly connect people, data, and systems into organized workflows
 Winner of BOSSIE, CODIE, OW2 and Gartner awards
 http://p.sf.net/sfu/Bonitasoft
 ___
 DSpace-tech mailing list
 DSpace-tech@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/dspace-tech
 List Etiquette: 
 https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
--
Open source business process management suite built on Java and Eclipse
Turn processes into business applications with Bonita BPM Community Edition
Quickly connect people, data, and systems into organized workflows
Winner of BOSSIE, CODIE, OW2 and Gartner awards
http://p.sf.net/sfu/Bonitasoft___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

Re: [Dspace-tech] Problem to upload files (pdf) or items

2014-06-26 Thread Christian Völker
Hello Yelena,

first off, please report back to the list, maybe someone else reads the thread 
and takes over. As you see I am not at my desk, cant try right now to follow 
your steps. 

Second, it sounds to me as if the issues happens while you are chosing your 
file locally. But them, a server error can only be given back after submitting 
the upload page. Did you try from another client? Did you try another type of 
file, e.g. .jpg? 

Auf dem Telefon geschrieben

 Am 26.06.2014 um 12:52 schrieb Yelena Islen San Juan yelena.is...@idict.cu:
 
 Hi, Christian
 
 Thank you for your attention. I'll tell you that I use dspace 1.8.2. Now I 
 describe my problem step by step.
 
 I do the following:
 
 1 - Go to Mydspace and log in.
 2 - I select the option to start a new submission
 3-I select the collection
 4 - I follow the steps Describe Describe Describe
 5 - Upload (in this step pdf search, but throws the following error)
 
 Internal System Error
 
 The system has experienced an internal error. Please try to do what you were 
 doing again, and if the problem Persists, please contact us so we can fix the 
 problem.
 
 Leave a message for the Digital Repository Theses the administrators.
 
 Go to the DSpace home page
 
 Thank you, I await your prompt answer

--
Open source business process management suite built on Java and Eclipse
Turn processes into business applications with Bonita BPM Community Edition
Quickly connect people, data, and systems into organized workflows
Winner of BOSSIE, CODIE, OW2 and Gartner awards
http://p.sf.net/sfu/Bonitasoft
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette


Re: [Dspace-tech] XPDF Thumbnail Preview issue

2014-06-15 Thread Christian Völker
Hello,

Am 13.06.2014 um 04:47 schrieb SUZUKI Keiji z...@mbc.ocn.ne.jp:

 1) Set the logging level to DEBUG and rerun.

Should have done so before. Thanks you for the heads up.

You were perfectly right. But then, the result leaves me a bit clueless for now:

 esxh-15:/srv/dspace tail -n 10 log/dspace.log.2014-06-15
 2014-06-15 12:45:17,812 DEBUG org.dspace.content.BitstreamFormat @ 
 anonymous::find_bitstream_format:bitstream_format_id=2
 2014-06-15 12:45:17,812 DEBUG org.dspace.storage.rdbms.DatabaseManager @ 
 Running query SELECT * FROM fileextension WHERE bitstream_format_id= ?   
 with parameters: 2
 2014-06-15 12:45:17,851 DEBUG org.dspace.storage.rdbms.DatabaseManager @ 
 Running query select * from bitstream where bitstream_id = ?   with 
 parameters: 27442
 2014-06-15 12:45:17,852 DEBUG 
 org.dspace.storage.bitstore.BitstreamStorageManager @ Local filename for 
 8706628839618174761158592395102959 is 
 /srv/dspace/assetstore/87/06/62/8706628839618174761158592395102959
 2014-06-15 12:45:17,865 INFO  net.sf.ehcache.util.UpdateChecker @ New 
 update(s) found: 2.4.7 
 [http://www.terracotta.org/confluence/display/release/Release+Notes+Ehcache+Core+2.4]
 2014-06-15 12:45:17,919 DEBUG org.dspace.app.mediafilter.XPDF2Thumbnail @ 
 DPI: pdfinfo method got dpi=75 for max dim=759 (points, 1/72)
 2014-06-15 12:45:17,920 DEBUG org.dspace.app.mediafilter.XPDF2Thumbnail @ 
 Running xpdf command: [/usr/bin/pdftoppm, -q, -f, 1, -l, 1, -r, 75, 
 /tmp/DSfilt2327548125683453130.pdf, /tmp/prevu8591868713129272046out]
 2014-06-15 12:45:18,357 DEBUG org.dspace.app.mediafilter.XPDF2Thumbnail @ 
 PDFTOPPM output is: /tmp/prevu8591868713129272046out-01.ppm, exists=false
 2014-06-15 12:45:18,420 ERROR org.dspace.app.mediafilter.XPDF2Thumbnail @ 
 Unable to delete file
 2014-06-15 12:45:18,421 DEBUG org.dspace.storage.rdbms.DatabaseManager @ 
 Running query SELECT bundle.* FROM bundle, bundle2bitstream WHERE 
 bundle.bundle_id=bundle2bitstream.bundle_id AND 
 bundle2bitstream.bitstream_id= ?   with parameters: 27442
 esxh-15:/srv/dspace ls -l /tmp
 insgesamt 1272
 drwx-- 2 amanda  backup 4096 Jun 15 11:27 amanda
 drwxr-xr-x 2 rootroot   4096 Jun 15 12:17 hsperfdata_root
 drwxr-xr-x 2 tomcat7 tomcat74096 Jun 15 12:45 hsperfdata_tomcat7
 -rw-r--r-- 1 tomcat7 tomcat7 1281435 Jun 15 12:45 
 prevu8591868713129272046out-1.ppm
 drwxr-xr-x 2 tomcat7 root   4096 Jun 15 12:12 tomcat7-tomcat7-tmp
 drwx-- 2 rootroot   4096 Jun 15 11:26 vmware-root
 esxh-15:/srv/dspace 

This means, the enumeration scheme used by pdftoppm for writing image files 
from several pages is different from what the XPDF Plugin expects. If I got it 
right, the plugin tells pdftoppm to do this:

/usr/bin/pdftoppm -q -f 1 -l 1 -r 75 /tmp/DSfilt2327548125683453130.pdf 
/tmp/prevu8591868713129272046out

It expects to find the resulting file here:

/tmp/prevu8591868713129272046out-01.ppm

However, the file gets written here:

/tmp/prevu8591868713129272046out-1.ppm

Everything is fine regarding file permissions, the file is in the expected 
directory /tmp, only the six digits instead of a single digit make the 
difference. There are several questions here. Why does the filter write a .ppm 
file and not a .jpg file using the -jpeg option of pdftoppm and when does the 
actual conversion happen? The task of the filter is always to produce a 
thumbnail image of the first page. So it would seem much more logical and 
robust to me to use the -singlepage attribute of pdftoppm which does not add 
anything to the output name besides the file extension. Instead first page -f 
and last page -l are set to 1. But well I would not need to bother if 
everything worked fine.

Where does this six digit rule get set? 

During my tests I had produced thousands of files starting with /tmp/prevu*. 
Most of them ended on -1.ppm, but some of them on -01.ppm. Mysterious.

I will try to produce the same fault on my test system which works fine for 
now, just to understand where are the differences.

For now, I wont try the second suggestion to recompile with source code 
commented out, because I guess, I already found the issue, just dont understand 
it yet.

Thanks for your support. Further suggestions welcome.

Bye, Christian


--
HPCC Systems Open Source Big Data Platform from LexisNexis Risk Solutions
Find What Matters Most in Your Big Data with HPCC Systems
Open Source. Fast. Scalable. Simple. Ideal for Dirty Data.
Leverages Graph Analysis for Fast Processing  Easy Data Exploration
http://p.sf.net/sfu/hpccsystems
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette


[Dspace-tech] XPDF Thumbnail Preview issue

2014-06-12 Thread Christian Völker
Hello,

I just try to get the XPDF based PDF Thumbnail creation working. It works fine 
in my DSpace 4.1 test instance. 

The feature was already available in DSpace 1.8.2 which is still our production 
release. Instead of waiting until the new version is production ready, I 
install the features step by step in the production environment.


On the production machine, I get this error:

esxh-15:/srv/dspace# bin/dspace filter-media -i 2339/4318 -v
The following MediaFilters are enabled: 
Full Filter Name: org.dspace.app.mediafilter.HTMLFilter
org.dspace.app.mediafilter.HTMLFilter
Full Filter Name: org.dspace.app.mediafilter.WordFilter
org.dspace.app.mediafilter.WordFilter
Full Filter Name: org.dspace.app.mediafilter.JPEGFilter
org.dspace.app.mediafilter.JPEGFilter
Full Filter Name: org.dspace.app.mediafilter.XPDF2Text
org.dspace.app.mediafilter.XPDF2Text
Full Filter Name: org.dspace.app.mediafilter.XPDF2Thumbnail
org.dspace.app.mediafilter.XPDF2Thumbnail
Full Filter Name: org.dspace.app.mediafilter.PowerPointFilter
org.dspace.app.mediafilter.PowerPointFilter
SKIPPED: bitstream 27442 (item: 2339/4318) because 'Limmerstraße.pdf.txt' 
already exists
ERROR filtering, skipping bitstream:

Item Handle: 2339/4318
Bundle Name: ORIGINAL
File Size: 2667225
Checksum: 3db0096cb62b6d595c1e4bb77f6833d0 (MD5)
Asset Store: 0
javax.imageio.IIOException: Can't read input file!
javax.imageio.IIOException: Can't read input file!
at javax.imageio.ImageIO.read(ImageIO.java:1291)
at 
org.dspace.app.mediafilter.XPDF2Thumbnail.getDestinationStream(XPDF2Thumbnail.java:244)
at 
org.dspace.app.mediafilter.MediaFilterManager.processBitstream(MediaFilterManager.java:737)
at 
org.dspace.app.mediafilter.MediaFilterManager.filterBitstream(MediaFilterManager.java:561)
at 
org.dspace.app.mediafilter.MediaFilterManager.filterItem(MediaFilterManager.java:511)
at 
org.dspace.app.mediafilter.MediaFilterManager.applyFiltersItem(MediaFilterManager.java:479)
at 
org.dspace.app.mediafilter.MediaFilterManager.main(MediaFilterManager.java:353)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:622)
at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:183)
Updating search index:


Note, that the text extraction took place in an earlier run of filter-media. So 
the message Can't read input file! is not very credible. Also the method 
called when the Exeption took place was XPDF2Thumbnail.getDestinationStream, 
which means that this issue might not be with the input file but with creating 
the output file.


In 2012, Osama Alkadi reported a similar issue and solved it by updating the 
pdftoppm tool. On Debian and Ubuntu, the required tools are contained in the 
package poppler-utils. I have installed Version 0.18.4 on both test and 
production machine. Here is the output:

esxh-15:/srv/dspace# pdftoppm -v
pdftoppm version 0.18.4
Copyright 2005-2011 The Poppler Developers - http://poppler.freedesktop.org
Copyright 1996-2004 Glyph  Cog, LLC

The version numberings seems to have changed in unexpected ways as Osama Alkadi 
told that he updated from 3.0 to 3.0.2. For the moment, this does not help too 
much.

All other components involved are also the same on both machines. jai_imageio 
is version 1.1 and jai_core is 1.1.3.


As the file is hard to find in the assetstore, I downloaded it using the 
browser, scped it back to the server and converted it manually using pdftoppm 
-jpeg inputfile.pdf outputname. It worked.

I exported the item containing the file using the AIP packager, transferred it 
to the test server running DSpace 4.1, imported it and ran filter-media there. 
It worked fine.

I compared the installation instructions of DSpace 4.1 and 1.8.2 and could not 
find a significant difference regarding the XPDF Feature. The mvn package and 
ant update command had not shown any irregularities.

File permissions in assetstore did not show any problems. On both machines, 
DSpace is run as the daemon user tomcat7. In both cases, I run Tomcat 7, albeit 
in slightly different versions. But Tomcat is not involved in running the 
command line tool like bin/dspace filter-media anyway.

So far, I have not found a clue, where to search for the reason. If anybody has 
an idea, Id be grateful.

Bye, Christian


--
HPCC Systems Open Source Big Data Platform from LexisNexis Risk Solutions
Find What Matters Most in Your Big Data with HPCC Systems
Open Source. Fast. Scalable. Simple. Ideal for Dirty Data.
Leverages Graph Analysis for Fast Processing  Easy Data Exploration
http://p.sf.net/sfu/hpccsystems

[Dspace-tech] Exporting communities or collections with bin/dspace packager -d -a … throws an error

2014-06-11 Thread Christian Völker
Hello,

I am using the dspace packer command line feature for the first time. 

My Repository runs DSpace 1.8.3 on Tomcat 7, Ubuntu 12.04 LTS and Postgres 9.1.

Disseminating single items works flawlessly.

However, disseminating whole collections or communities constantly throws the 
same Exception. I tried various collections or communities. The communities I 
tried contained two or more collections but no subcommunities. I chose 
collections and communities that hold about twenty items or less for now. 

As this is an IOException while creating a tempfile it is worth noting that my 
dspace user is tomcat7 who is not allowed to write to his own home directory by 
default in Debian/Ubuntu. This did not pose any problems for years and indeed I 
see this as a security advantage and a means to facilitate relocation to a 
freshly installed machine which happens from time to time. 

The filename given on the command line is touched and has a size of zero. I 
cant see which file the packager actually tries to create when the exception 
gets thrown. It is just my arbitrary assumption that the packager tries to 
create a tempfile in the users home directory. I also assume that a tempfile is 
not required for exporting a single item, even if this item contains several 
bitstreams.

To prove whether it makes a difference, I ran the dspace packager command as 
root as well. Although this might not be usual operation, running the command 
as root makes sure that the user can write to its home directory and in fact 
eveery directory and file and that execution rights are available for the 
dspace CLI, which would not be the case for e.g. my login account.

I dont like the idea of changing the dspace user on a production system. Can 
anybody explain me what the packager tries to do exactly when failing? Thanks 
for suggestions.

Here comes a link to the collection I tried and a listing of several commands. 
First as user tomcat7, then as root.

Bye, Christian



http://stadtteilgeschichten.net/handle/2339/4227


esxh-15:/srv/dspace/packager ../bin/dspace packager -e 
stadtteilgeschich...@arcor.de -d -t AIP -i 2339/4227 4227.zip

Disseminating DSpace COLLECTION [ hdl=2339/4227 ] to 4227.zip
Exception: No such file or directory
java.io.IOException: No such file or directory
at java.io.UnixFileSystem.createFileExclusively(Native Method)
at java.io.File.checkAndCreate(File.java:1833)
at java.io.File.createTempFile0(File.java:1857)
at java.io.File.createTempFile(File.java:1934)
at 
org.dspace.content.crosswalk.RoleCrosswalk.disseminateElement(RoleCrosswalk.java:186)
at 
org.dspace.content.packager.AbstractMETSDisseminator.crosswalkToMetsElement(AbstractMETSDisseminator.java:1359)
at 
org.dspace.content.packager.AbstractMETSDisseminator.makeMdSec(AbstractMETSDisseminator.java:614)
at 
org.dspace.content.packager.AbstractMETSDisseminator.addToAmdSec(AbstractMETSDisseminator.java:727)
at 
org.dspace.content.packager.AbstractMETSDisseminator.addAmdSec(AbstractMETSDisseminator.java:753)
at 
org.dspace.content.packager.AbstractMETSDisseminator.makeManifest(AbstractMETSDisseminator.java:839)
at 
org.dspace.content.packager.AbstractMETSDisseminator.writeZipPackage(AbstractMETSDisseminator.java:311)
at 
org.dspace.content.packager.AbstractMETSDisseminator.disseminate(AbstractMETSDisseminator.java:258)
at 
org.dspace.content.packager.DSpaceAIPDisseminator.disseminate(DSpaceAIPDisseminator.java:160)
at org.dspace.app.packager.Packager.disseminate(Packager.java:671)
at org.dspace.app.packager.Packager.main(Packager.java:460)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:622)
at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:183)
esxh-15:/srv/dspace/packager ../bin/dspace packager -e 
stadtteilgeschich...@arcor.de -d -t AIP -i 2339/4228 4228.zip

Disseminating DSpace ITEM [ hdl=2339/4228 ] to 4228.zip

CREATED package file: /srv/dspace/packager/4228.zip
esxh-15:/srv/dspace/packager id
uid=114(tomcat7) gid=122(tomcat7) Gruppen=122(tomcat7)
esxh-15:/srv/dspace/packager ls -la
insgesamt 9352
drwxr-xr-x  2 tomcat7 tomcat74096 Jun 11 12:48 .
drwxrwxr-x 23 tomcat7 tomcat74096 Jun 11 11:33 ..
-rw-r--r--  1 tomcat7 tomcat7   0 Jun 11 12:42 4225.zip
-rw-r--r--  1 tomcat7 tomcat7   0 Jun 11 12:40 4226.zip
-rw-r--r--  1 tomcat7 tomcat7   0 Jun 11 12:49 4227.zip
-rw-r--r--  1 tomcat7 tomcat7  548845 Jun 11 12:49 4228.zip
-rw-r--r--  1 tomcat7 tomcat7  809265 Jun 11 12:48 4229.zip
-rw-r--r--  1 tomcat7 tomcat7  261623 Jun 11 12:47 4230.zip
esxh-15:/srv/dspace/packager exit
exit
cvoelker@esxh-15:/srv/dspace/packager$ sudo 

[Dspace-tech] Customization of CC-License Step

2014-05-31 Thread Christian Völker
Hello,

I have a bunch of questions regarding the CC License Step during submission. We 
use XMLUI and DSpace 1.8.2. I browsed the Git Repository and got the impression 
that there havent been so many commits in this area since then, so I hope I 
dont ask questions that are solved meanwhile.

Our goal is to make it mandatory for users of our repository to publish under 
either CC-BY-SA or CC-BY-ND. The task includes to contact all users who have 
published their items in our repository in the past and get their consent to 
change the license on all existing items. These license types are widely 
accepted by aggregators, who harvest us already or will do so in the future if 
we can guarantee these license terms for all our content. We welcome the gain 
in visibility provided by aggregators and see this as a cause to put a change 
into effect right now that we agree to anyway. I could imagine changing and 
limiting licensing options might be a task that others running a DSpace 
repository are faced with as well sooner or later.

Limiting the number of choices opens a chance to further simplify the User 
Interface. Best case would be to have checkboxes for CC-License and deposit 
license on the bottom of the review step of the submission process, but I guess 
that requires more then just a little bit of configuration. At least, Id like 
to understand why there remain some strings that cant be localized in the CC 
License step.


When thinking about how to fix the licenses for existing items, I stumbled 
across the option cc.submit.addbistream in dspace.cfg which defaults to true. 
It attaches a small file containing a desription of the license chosen in RDF 
format. When changing the license, this file requires extra work to keep it in 
sync with the dc.rights and dc.rights.uri fields, so I thought about what it 
might be good for. If keeping it offers any advantage, I will deal with that, 
but I am curious what it was meant for in the beginning. I cant see, that there 
is made use of it e.g. during OAI-export. Currently I tend to disable this 
feature for all future ingests as well. Please stop me from doing so if I 
overlook something important.

After reading both CCLicenseStep.java files in either dspace-api and 
dspace-xmlui and playing with the creative commons api manually 
(http://api.creativecommons.org/docs/readme_15.html) I dont yet understand how 
they work their magic. When somebody chooses to ad a CC license, currently the 
item gets a field dc.rights.uri, filled with a value like 
http://creativecommons.org/licenses/by/3.0/de/;. We use jurisdiction german, 
but I wonder why we get specifically version 3.0. International version 4.0 is 
current, but not yet translated to german. Can I expect the system to switch to 
the most current version within my jurisdiction for future items as soon as 
they get online without me configuring anything?

The CC License page during the submission process offers a drop menu set to 
Select or modify your license ... as a default. May I set the option 
Creative Commons (standard) as a default instead? Or does its existence in 
the menue depend on the answer of 
http://api.creativecommons.org/rest/1.5/?locale=de? (besides 
cc.license.classfilter in dspace.cfg).

Why do the following questions Allow commercial uses of your work? and Allow 
modifications of your work? get displayed in english including there options 
in the german interface? I want to translate them, but I dont know where this 
should be done. Also, I want to set a default option for the answers. Third, I 
would like to remove the question regarding commercial use completely and maybe 
limit the choice regarding modifications to ShareAlike or No.
I could not find these questions in the messages.xml nor anywhere else in the 
source hardcoded. Tinkering with http://api.creativecommons.org/rest/1.5/ 
supplying various arguments I could not force the creativecommons.org server to 
supply these messages. In reading the source of CCLicenseStep.java, I found 
variables commercial_chooser and derivatives_chooser which probably 
describe just these two questions and there answering options, but I did not 
understand where they are read from.


My catalogue of questions has grown rather large already. Thats why I stop 
here. Only one thing regarding the deposit license Id like to mention. It gets 
customized for each item by prepending a line starting with License granted by 
. This message is hardcoded in LicenseUtils.java and can not be translated 
using the messages.xml system.

Bye, Christian


--
Time is money. Stop wasting it! Get your web API in 5 minutes.
www.restlet.com/download
http://p.sf.net/sfu/restlet
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: 

Re: [Dspace-tech] Creative Commons license link broken?

2014-05-30 Thread Christian Völker
Hello,

Am 25.03.2014 um 18:53 schrieb Bill Tantzen wile...@gmail.com:

 DSpace 4.1, XMLUI
 
 I have enabled the creative commons step for a collection.  Everything
 seems to be working fine on submission. But when I view the full
 record, in the Files in this item section and in the sub-section
 entitled The following license files are associated with this item,
 the Creative Commons link refers to the page it is on instead of the
 license bitstream. ( e.g. /handle/11299/12345?show=full ).
 
 Is this a mis-configuration on my part, or bug?

As I am just thinking about how to have my depositors to agree on a new license 
for all there previously deposited items, I stumbled upon the same behaviour in 
my DSpace 1.8.3 XMLUI yesterday. Obviously, this has not changed since several 
years. So I guess, it is intended behaviour. 

From a users perspective, the behaviour is surprising and limits 
functionality. Note that in the item view, first there comes a text link 
mentioning a CC-License in general. It links back to the item itself they way 
you told. Then, the collection containing the item gets shown (which can be 
found just as good in the breadcrumbs, albeit without the collections weight) 
and afterwords the interface returns to the licensing aspect and the CC-Logo 
gets displayed (without the short form of the license). This logo is linked 
properly! I doubt that many people will try to click the logo after clicking 
the text link without success. I like the mirage theme for its clean look in 
general and creating an own theme turned out to be much too complicated, but 
the sequence described at the bottom of the item page does not make much sense 
to me in its current state.

In your description, you did not mention that you were logged in as an admin 
while reviewing the item. Although this seems obvious to me, maybe this is the 
reason why nobody could reproduce the case and you havent got an answer for 
weeks.

Bye, Christian


--
Time is money. Stop wasting it! Get your web API in 5 minutes.
www.restlet.com/download
http://p.sf.net/sfu/restlet
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette


[Dspace-tech] Fwd: postgreSQL Backup: -o (preserve oids) needed?

2014-05-19 Thread Christian Völker
Hello,

my backup command for postgres is

/usr/bin/pg_dumpall -o -c -v  /srv/dspace/dumpall.sql

I have carried that with me since DSpace 1.3 or DSpace 1.4. Currently, I use 
DSpace 1.8.

Now, while moving to a new machine, I revisited the section under Architecture 
/ Storage Layer in th Documentation and could not find any hint as to why I had 
used the -o option at all. The oldest version of the docs that I still have 
stored locally is DSpace 1.4.2 and there is no mention of -o either.

Had there ever been a requirement to preserve oids while backing up which has 
been removed meanwhile? Did this option make it into my installation by an 
arbitrary yet stupid inspiration of mine? Should I preserve it since it has 
worked so good all the time or should I skip it to make things clean and 
simple? Any opinion and advice appreciated.

Thanks, Christian


--
Accelerate Dev Cycles with Automated Cross-Browser Testing - For FREE
Instantly run your Selenium tests across 300+ browser/OS combos.
Get unparalleled scalability from the best Selenium testing platform available
Simple to use. Nothing to install. Get started now for free.
http://p.sf.net/sfu/SauceLabs
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette


[Dspace-tech] Plugging german controlled vocabulary GND into Mirage XMLUI theme

2013-12-15 Thread Christian Völker
Hello,

in a common effort german libraries have developed a controlled vocabulary of 
german keywords for general use. They provide a web interface to access this 
vocabulary and ease the search for the canonical notation of keywords in 
german. Obviously, the interface itself is provided in german only. This web 
interface is explicitly ment to be included into repository systems such as 
DSpace.

http://xgnd.bsz-bw.de/

Before I start and hurt my brain how to tie together DSpace wit xGND in a 
reasonable way, Id just like to know whether somebody might have done this 
already and has some helpful advice on how to modify the XMLUI frontend for 
this purpose. 

We are currently using DSpace 1.8.x with XMLUI and Mirage theme and dont have 
plans to switch to DSpace 3.2.x within the next three or four month. So I would 
like to use the xGND interface from within 1.8.x / Mirage. It might be not that 
much of a difference which version of Mirage we use as compared to the 
difference between different XMLUI themes or even the JSPUI, so experience in 
combining xGND with Mirage in DSpace 3.2 is also very much appreciated.

Thanks, Christian Völker


--
Rapidly troubleshoot problems before they affect your business. Most IT 
organizations don't have a clear picture of how application performance 
affects their revenue. With AppDynamics, you get 100% visibility into your 
Java,.NET,  PHP application. Start your 15-day FREE TRIAL of AppDynamics Pro!
http://pubads.g.doubleclick.net/gampad/clk?id=84349831iu=/4140/ostg.clktrk
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette


[Dspace-tech] jQuery Version used - is it save to replace?

2013-02-01 Thread Christian Völker
Hello,

I just checked a bit and found that our instance of DSpace 1.8.2 XMLUI Mirage 
is using jQuery 1.6.2 which is, well, not current.

I found this to be dependent on either the theme in use and the version of 
jQuery shipped with the DSpace sources.

While the standard Kubrick theme seems to even stick with jQuery 1.2, Mirage 
theme references the version to use in lib/xsl/core/page-structure.xsl, line 
613 explicitly. This is true for the current version of DSpace, 3.x as well:

https://github.com/DSpace/DSpace/blob/master/dspace-xmlui/src/main/webapp/themes/Mirage/lib/xsl/core/page-structure.xsl

xsl:template name=addJavascript
xsl:variable name=jqueryVersion
xsl:text1.6.2/xsl:text
/xsl:variable

I guess the actual file used is taken from 
dspace-xmlui/dspace-xmlui-webapp/src/main/webapp/static/js/.

My question here is, would it be safe to drop at least version 1.6.4 
http://code.jquery.com/jquery-1.6.4.min.js into this directory and change the 
version number in page-structure.xsl, then recompile? Or is such a change prone 
to break a lot stuff?

Would it be feasable to do a big leap and switch to jQuery 1.9? Or are there 
reasons not to even take care of jQuery versions at all?

Thanks, Christian


--
Everyone hates slow websites. So do we.
Make your web apps faster with AppDynamics
Download AppDynamics Lite for free today:
http://p.sf.net/sfu/appdyn_d2d_jan
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette


Re: [Dspace-tech] DSpace will not redirect to /xmlui

2013-02-01 Thread Christian Völker
Hello,

I dont believe such battles to be apropriate on a topic 
where a seemingly new user of DSpace requests help.
Obviously, there are many ways to solve this issue.

I guess Hiltons solution is quite a good solution,
however I totally disagree with his reasoning. Debian
has a rather sensible update system that wont break
a thing if used properly. It indicates precisely which
changes it found in the conf files it tries to replace
and you should know about the changes you have made
and why you did so. The apt system lets you edit and
merge these changes right in place or provides you
with path to work on them later. Debian is made
for tailoring it to your needs.

The fragment solution looks just as cute. However,
I am not completely up to date regarding tomcat Dos
and Donts. Tomcat is a beast of utmost configurability
which leads part-time users, id est 99,95% of all admins
running tomcat to not use any of its powerful features.
Tomcat is also an outstanding example of overwhelming
documentation which seems typical for the Java world btw.
It is hard to pick up the concepts, and as long as you 
cant get them, you will only scratch the surface. 
As such, I had plans to switch to a more basic server
such as jetty every time I updated my environment, but 
I never did so far. There were always more important 
tasks to tackle. Tomcats caching and long startup time 
make it a particularly bad choice for development.

I have to offer a third way. My solution is to edit the 
build.xml in DSpace to create a directory ROOT instead 
of xmlui during the last phase of the update process.

So, choose wisely, Christian


--
Everyone hates slow websites. So do we.
Make your web apps faster with AppDynamics
Download AppDynamics Lite for free today:
http://p.sf.net/sfu/appdyn_d2d_jan
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette


Re: [Dspace-tech] dspace instance copy/mirror

2013-02-01 Thread Christian Völker
Hello,

Am 01.02.2013 um 17:54 schrieb Cronin, Catherine Kemble (LARC-B702) 
catherine.k.cro...@nasa.gov:

  
 We have set up and configured a development instance of dspace 1.8 (jspui) 
 that has been tested and approved to go into production. 
 What is the best practice for copying a fully customized and configured 
 instance of dspace over to a new server for each of the following cases?
  
 1.   Instance including all of the content (ie bitstreams) – basically a 
 full replication from one server to another.
 2.   Instance including  no items or bitstreams, but all of the 
 Communities and Collections.  Basically the “structure” without items.

I guess, the latter case is hard to accomplish, I have no idea for this. And as 
long as there are not hundreds of communities I dont even think it is a good 
idea. I would use a clean copy and enter the Communities and Collections from 
scratch.

Both cases imply that it will happen only once in a lifetime and that the test 
environment has turned into a production environment during testing already. It 
wont make sense to take over items from testing to production any time after 
the initial setup. Or to say it differently, for further development you should 
consider to keep data completely separate from the production environment.

If you keep data separate and dont want to set up all the stuff required to 
compile DSpace in your production environment, you can copy over the webapps 
directory content as required, id est certainly the jspui directory, but other, 
such as lni or oai depending on whether you will use them at all. If you go 
deeply into the code, then there will be new versions of some .jar files in the 
lib directory, specifically dspace.jar you will have to copy over as well. If 
copying webapps and .jar files manually to the production server, you will have 
to tweak your config files in the dspace/config directory manually. This should 
not be too hard to do, they are rarely changed after initial setup.

To get started (your case one), you will have to copy over the whole [dspace] 
directory including the assetstore, config and so on. I would use rsync for 
this purpose. You can clean out log, history, reports and so on and you can 
remove the etc subdirectory, but working directories like log, history and so 
on need to be in the place indicated in your [dspace]/config/dspace.cfg file 
and writeable for the tomcat user. Besides the [dspace] directory, you will 
need to dump your postgres database and load it into the production 
environment. Consider not using dump_all, but to dump the dspace database only. 
Take care of preserving oids during the transfer of the database. After you 
have done so, you have to move the webapps stuff as well as described before if 
you keep your webapps in a place different from your [dspace] directory. Check 
the DSpace install steps to find any steps missing in my short advisory.

For me, it has turned out to be a suitable solution to set up a new machine 
when it comes to a new DSpace version. I do all my testing on this machine, 
then move over essentially the assetstore and the database. I then have to run 
the etc files to update the database to the current version and after a short 
test I am ready to switch over the DNS entry. The old machine gets to be my 
testing environment for further development. This way, I have a full DSpace 
compilation environment on my production machine and can apply small changes 
without the help of another machine. It is up to me to be conscious and not to 
apply larger changes on the production machine.

Bye, Christian


--
Everyone hates slow websites. So do we.
Make your web apps faster with AppDynamics
Download AppDynamics Lite for free today:
http://p.sf.net/sfu/appdyn_d2d_jan
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette


[Dspace-tech] dspace 1.8.2 SendFeedbackAction.java Issue

2013-01-27 Thread Christian Völker
Hello,

we run dspace 1.8.2 with XMLUI and a derivative of the Mirage theme
under http://stadtteilgeschichten.net/. This is, no hostname such as 
www.stadtteilgeschichten.net. We use tomcat6 and no apache.

The feedback form under http://stadtteilgeschichten.net/feedback throws 
errors.
The contact form in comparison works flawlessly: 
http://stadtteilgeschichten.net/contact
These are the error messages shown in the browser when clicking on Feedback:

java.lang.StringIndexOutOfBoundsException: String index out of range: -1

Cocoon stacktrace [hide]

Sitemap: error invoking action
context:/resource://aspects/ViewArtifacts/sitemap.xmap - 193:68 map:act 
type=SendFeedbackAction 
context:/resource://aspects/ViewArtifacts/sitemap.xmap - 192:55 map:match

Java stacktrace [hide]

java.lang.StringIndexOutOfBoundsException: String index out of range: -1
at java.lang.String.substring(String.java:1943)
at java.lang.String.substring(String.java:1916)
at 
org.dspace.app.xmlui.aspect.artifactbrowser.SendFeedbackAction.act(SendFeedbackAction.java:84)


The logfiles did not give me any clue to solve the issue myself.
I did not change anything in the associated code.

Then I found these lines of code in the file SendFeedbackAction.java
at the lines indicated by the java stracktrace in the bowser:

String basicHost = ;
if (localhost.equals(host) || 127.0.0.1.equals(host)
|| 
host.equals(InetAddress.getLocalHost().getHostAddress()))
{
basicHost = host;
}
else
{
// cut off all but the hostname, to cover cases where more than one 
URL
// arrives at the installation; e.g. presence or absence of www
int lastDot = host.lastIndexOf('.');
basicHost = host.substring(host.substring(0, 
lastDot).lastIndexOf('.'));
}

I dont understand exactly what this code does, however I feel the error 
message fitting this code pretty good. As such I guess I found the culprit.

I remember that we had issues long time ago when running DSpace 1.3 or 1.4
under jspui. There was code that made wrong assumptions about the structure of 
the hostname variable. I suspect this to be a kind of undead which celebrates 
ressurection at this point. 

I checked the Contact.java and found that there a no comparable substring
manipulations imposed on the hostname as in the SendFeedbackAction.java code.
This code has not changed in DSpace 3.0, so updating our Repository will
probably not help with our issue.

The feedback form not working is actually a major issue 

I tried to recompile with hostname set to www.stadtteilgeschichten.net. 
However, 
this did not fix the issue. Instead, I got a new error message, stating that 
the 
feedback form would only work with a referrer from the same site. No wonder, 
www.stadtteilgeschichten.net does a 301 redirect to stadtteilgeschichten.net. 
As somebody else runs the nameserver, I did not bother what would happen if we 
request the site with a www. hostname. It is not desirable for us to do such 
a move, as all our google ranking we have built up in years is bound to the 
domain name without preceeding www. hostname.

Now, I am an admin, no programmmer I would certainly break DSpace if I would try
to fix the code. Actually, I tried already to commenct out the if else clause
and even such aesthetically inacceptable solutions as setting basicHost to
a fixed value such as stadtteilgeschichten, stadtteilgeschichten.net or
just host. It did not work, thats it.

I appreciate your help,

Bye, Christian


--
Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS,
MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current
with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft
MVPs and experts. ON SALE this month only -- learn more at:
http://p.sf.net/sfu/learnnow-d2d
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette


[Dspace-tech] DSpace 1.8.2 on OpenJDK6: reports on success or failure appreciated

2012-12-30 Thread Christian Völker
Hello,

I have got a new instance of Ubuntu 12.04 LTS Precixe Pangolin to run our 
DSpace instance on. 

We currently use DSpace 1.8.2 and have not decided when we will find the time 
to move on to DSpace 3.0 which is a major task for a project effectively run by 
two people in their spare time. 

Comparing installation requirements of versions 1.8.2 and 3.x, the 1.8 branch 
still reports issues with Java 7 because of solr incompatiblity and further 
recommends to use SUN/Oracle JDK 6. 

Using SUN/Oracle JDK means installing manually without support by the 
distributions package management which I suspect is the same issue for every OS 
distribution since it is triggered by Oracles licensing terms. Installing 
manually means that I will run into trouble as soon as I move on to DSpace 3.0 
and OpenJDK 7, a situation discouraging future updates besides of keeping up to 
date manually until then.

Using OpenJDK 6 would be a minor issue as compared to using either SUN/Oracle 
JDK 6 or 7, because it is still in the package management. Although the version 
available there is the 13 month old b24, whereas the latest Version of OpenJDK6 
is the two month old b27 which likely fixes numerous security issues. This 
means that it is certainly not advisable either to use OpenJDK6.

I am eager to learn, whether the issues with Java7 and solr have been fixed in 
a way that might encourage me to ignore the warning in the DSpace 1.8 install 
docs an just try to use Java 7 with DSpace 1.8 branch.

Furthermore, is there anybody running DSpace 1.8 who tried OpenJDK, either 
OpenJDK 6 or OpenJDK7? When did you try? Within the last six month or before? 
If you tried within the last six month, which obstacles did you run into and 
were you able to solve them? Are there any notes online for further reading? A 
quick search did not return anything of interest.

Thanks a lot, Christian


--
Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS,
MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current
with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft
MVPs and experts. ON SALE this month only -- learn more at:
http://p.sf.net/sfu/learnmore_123012
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette


Re: [Dspace-tech] changing Discovery sidebarFacets and Localization

2012-11-12 Thread Christian Völker
Hello,

Am 11.11.2012 um 13:53 schrieb helix84 heli...@centrum.sk:

 1) There's no need to recompile DSpace, just change the
 [dspace]/webapps/xmlui/i18/messages.xml (or messages_de.xml) and
 restart Tomcat. If it still doesn't display, try clearing Cocoon cache
 [1].

I gave up after tinkering around for quite a while, thinking that
I had not understood anything about the whole system. Later on I
got a phone call that my changes had become visible meanwhile.
Your hint to the cocoon cache gives me a climpse as of what might
have happened.

Still though, writing in the webapps directory is a quick way for
testing, but these changes will be lost as soon as I start over to
implement more of the changes we want for our DSpace instance.
And there comes the need to know where to put the strings before
recompiling them.

I guess, your advice would be put it where it makes sense to you.
Well, Ill try to gain confidence, but I find it hard, being surprised
every time I touch anything, even if these are positive surprises
as was the case this time.

 2) You can add your changes to this main messages.xml file even if
 they're for Discovery or any other module, it will work.

Your explanation leeds me to the assumption that during compilation
all of the separate messages files of the separate modules get merged
into one big catalog. Which in turn would mean that it does not matter
where I put them in the first place. 
But well then, it also means that in case I screw it up and put 
different versions in serveral messages files, I wont know which 
one wins. Which makes it desirable to know more about the priorities 
during the merge (if this happens at all, it is only an assumption).


Am 11.11.2012 um 13:57 schrieb helix84 heli...@centrum.sk:

 If you find the documentation lacking, please suggest an updated text.
 You can have edit access to the official documentation on the wiki if
 you want.

I would not dare to do so. It is not that I am not willing to return
some work to the community, I am just afraid that I would make it be
even harder for others to find their way, given how confused I am 
myself about the way things actually work.

Thanks for your answers! 

Bye, Christian



--
Monitor your physical, virtual and cloud infrastructure from a single
web console. Get in-depth insight into apps, servers, databases, vmware,
SAP, cloud infrastructure, etc. Download 30-day Free Trial.
Pricing starts from $795 for 25 servers or applications!
http://p.sf.net/sfu/zoho_dev2dev_nov
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech


[Dspace-tech] Current Postgres JDBC Driver

2012-05-08 Thread Christian Völker
Hello,

in the DSpace source tree, there is a rather old build of the Postgres JDBC 
driver included. It is build number 408, where even the legacy version for 
Postgres 8.1 offered on postgresql.org is build number 415. Even this is an 
unsupported, archived version. 

DSpace requires Postgres 8.2 though and thist implies that it does not make 
sense to stick with a Driver version that strives to support older versions of 
Postgres. The current build for Postgres 8.2 is 512 which is the oldest version 
still in support. The current version is build 703 to get an impression of what 
we are talking about.

That said I would like to use a more recent version of the driver. However I 
cant figure out, where to put it. Do I really have to put separately in each 
and every [dsapce-source]/*/*/target/*/WEB-INF/lib/ directory for each module? 
What happens if I update only some of them? Will they be overwritten next time 
I run mvn package? Or will I end up with two JDBC drivers for each module? Will 
these two JDBC Drivers interact in unpredictable ways?

I could not find any hints on this in the Docs. They generally just say dont 
worry. Well, I do. So please…

Thanks, Christian


--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech


Re: [Dspace-tech] *** GMX Spamverdacht *** Re: Localization inside config files?

2012-04-30 Thread Christian Völker
Hello,

Am 29.04.2012 um 17:01 schrieb Christian Völker:

 just found this:
 
 dspace/config/modules/curate.cfg
 
 needs to be stored with ISO-Latin-1 Encoding to display properly,
 as opposed to all other files which are stored as UTF-8 nowadays.
 
 You may try to localize ui.tasknames which requires the use of
 umlauts in german language to understand what I mean. You cant
 write the words as they should be displayed just like you do in 
 messages.xml. The get displayed as two weird glyphs. You cant 
 use UTF-8 hex encoding which gets displayed as is where it
 should be interpreted. I finally found storing it using the
 encoding mentioned above works.
 
 This is on Debian, Java 1.6, Tomcat 6 if that would be of any
 relevance.

I just found that this does not work either.
As a short workaround for the lengthy and errorprone buildprocess
introduced with maven, I tested by placing the reencoded file
directly into the directory where the server runs from. At the
same time, I changed the file in the source directory (with 
placeholders like taskqueue.dir = ${dspace.dir}/ctqueues not
yet replaced).



curate.cfg.iso-latin-1
Description: Binary data


After running another cycle of mvn package and ant update I found
that the display was broken again, be it in a slightly different
manner. ant update worked properly, however mvn package did not
copy the file to the target directory as is, but change the
encoding at the same time. No stop, it did not just tinker with
the encoding, it replaced all Umlauts wit a Replacement Character
as of Code page Halfwidth and Fullwidth Forms, Unicode Codeposition
U+FFFD, Hex Notation ef bf bd. This is displayed as a lower Letter
i with two dots on it, followed by spanish inversed Question mark
and a 1/2 sign in the browser and as a white Question mark in a
diamond sign in UTF-8 compliant text editors such as vi.



curate.cfg.mvn
Description: Binary data


Apache Maven 2.2.1 (rdebian-4)
Java version: 1.6.0_26
Java home: /usr/lib/jvm/java-6-sun-1.6.0.26/jre

I intentionally switched back to Maven 2.2 after running in the
problems documented with Maven 3 last fall when working on the
1.7 Update.

I am not willing to dig into configuring mvn to not touch file
encodings. If that is a required step and cannot be done within
pom.xml project files I ask you to document how it has to be
done in the Installation prerequisite software section. 

mvn not changing files in unexpected ways would strenghten 
confidence, though it might not be in line with the way this 
tool ist meant to behave (id est strenghten confidence). 

Finding a way to localize DSpace modules without changing
config files (and thus tieing the interface to one language)
remains a welcome change to be seen in the future.

Bye, Christian

--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech


Re: [Dspace-tech] Localization inside config files?

2012-04-29 Thread Christian Völker
Hello,

just found this:

dspace/config/modules/curate.cfg

needs to be stored with ISO-Latin-1 Encoding to display properly,
as opposed to all other files which are stored as UTF-8 nowadays.

You may try to localize ui.tasknames which requires the use of
umlauts in german language to understand what I mean. You cant
write the words as they should be displayed just like you do in 
messages.xml. The get displayed as two weird glyphs. You cant 
use UTF-8 hex encoding which gets displayed as is where it
should be interpreted. I finally found storing it using the
encoding mentioned above works.

This is ohn Debian, Java 1.6, Tomcat 6 if that would be of any
relevance.

Should I mention that I think that it strenghents the case for
streamlining the localization process?

Bye, Christian


--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech


Re: [Dspace-tech] Localization inside config files?

2012-04-29 Thread Christian Völker
Hello,

in the Mirage theme (or dri2xhtml-alt, have not verified so far),
there are three pairs of Button labels Add and Remove Selected.
I found them to be hard-coded in the file

themes/Mirage/lib/xsl/core/forms.xsl

You may find the lines searching for 'input type=submit value='.

Bye, Christian


--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech


Re: [Dspace-tech] Localization inside config files?

2012-04-21 Thread Christian Völker
Hallo,

just came across this page on wikipedia:

http://en.wikipedia.org/wiki/Computer_Assisted_Translation

There is a list of tools (and even better technologies).
Among other apps they mention

http://omegat.org/en/omegat.html

which is ment to support .properties files and is a java
app by itself. Webbased systems are mentionend as well:

http://www.globalsight.com/
http://sourceforge.net/projects/ote/

I did not try any of them…

Bye, Christian


--
For Developers, A Lot Can Happen In A Second.
Boundary is the first to Know...and Tell You.
Monitor Your Applications in Ultra-Fine Resolution. Try it FREE!
http://p.sf.net/sfu/Boundary-d2dvs2
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech


Re: [Dspace-tech] Localization inside config files?

2012-04-06 Thread Christian Völker
Hello,

Am 05.04.2012 um 22:21 schrieb Tim Donohue:

 To this end, I've attempted to summarize what I've read in this thread 
 into a new Proposal page on our wiki:
 
 https://wiki.duraspace.org/display/DSPACE/i18n+Improvements+Proposal
 
 The goal of this wiki page is *not* to take discussion away from this 
 listserv. 

I just found this page and Id like to comment on.


We dont need to discuss messages.properties und messages.xml files together.

Both types of files can not be mapped to each other because of differences
in content, not only differences in format. Thus, translating both user 
interfaces is a separate effort anyway. With ongoing modularization, they 
will depart from each other even more, so there is no chance to keep them
synced somehow. In the times when there was only a jspui, translation did
not seem that troublesome, so I would concentrate on the new situation
with Cocconn .xml-files. Furthermore, it was said there a tools available
for the .properties files, so one more reason, to deal with them for the
moment.


Some thoughts on the messages.xml format

.ts files for which tools exist are XML files either. With the extremly
simple structure of messages.xml catalogues it should not be that much
of a deal to create e.g. a XSLT transformation for translating back and 
forth. 

The simple structure of message catalogues by itself seems limiting
however. I read over this page to get an idea of whether 
xmlns:i18n=http://apache.org/cocoon/i18n/2.1 contains some more useful
attributes or such to store more info but I could not identify. I think
a translation file format should support an attribute untranslated or
deprecated for each message string at least, with an translators comment 
being another desirable feature. 
I havent tried to feed Cocoon with a messages.xml file that was just 
extended with no regard to the schema definition, but it would be worth 
to create our own messages.xml format as long as we dont break existing 
functionality.

It should be possible to compare two versions of a messages.xml file based
on the key values only. Thus the english and a localized version could be
compared to find out about the coverage of the localized version quickly.
On the Mac, there is nothing similar to Altovas tools, so I know only of
quite simple XML Editors and I prefer diff for now. The aforementioned
way of working is not possible with diff. I am sure this is just a lack
of knwoledge regarding existing tools on my side. So if anyone has
suggestions on great XML Tools to check out, please tell.



Scattering messages.xml files all over the file tree is not much of an issue. 
Inconsistency in using overlays is.

Hugh, did I say that? Well, as soon as one knows, that there are several
places where messages.xml files go, as long as they are named exactly the
same, it is one simple search to find them all. However, using overlays 
does not seem to be handled consitently for all modules. For now, I have 
learned that the proper path to put them starts with

dspace/config/modules and ends with src/main/webapp/i18n/

For xmlui, the missing middle part is just xmlui. Remember, as an user,
I dont have to drop the file just into the right place, but I have to
create the path. This requires better understanding. Now, eqipped with
this knowledge, I try to derive the proper overlay path for modules from
their source path:

dspace-xmlui/dspace-xmlui-webapp/src/main/webapp
/i18n
dspace-xmlui/dspace-xmlui-api   
/src/main/resources/aspects/XMLWorkflow /i18n
dspace-discovery/dspace-discovery-xmlui-api 
/src/main/resources/aspects/Discovery   /i18n

Well, dspace-xmlui/dspace-xmlui-webapp gets shortened to xmlui. Should
dspace-xmlui/dspace-xmlui-api be shortened to the same xmlui, given
that the first part of the path minus dspace- is the same? Or will there
be a future name-clash? And for dspace-discovery/dspace-discovery-xmlui-api
is it simply discovery then?
Ok, then for the second part: It looks as if they cant all be thrown into
src/main/resources/i18n, also not into src/main/resources/i18n/$modulename/.

I could not even figure out whether overlays need to be supported actively
by the programmer, reading files from a place agreed upon, or are they picked
up by the maven process automagically? Finally, I just put them in the source
path which means I compromise on the build process. Not that much of a deal
for now, but you should be aware of the consequences of not explaining the
mechanics from a users perspective.

To sum up, a separate section Localization under Customization would be
a wellcome addition as a one stop to gather this kind of information. Alter-
natively, there should be a minimum documentation requirement for all new
modules to mention this kind of stuff in a standardized place.


Whose convenience counts most?

In this thread, programmers versus localizers convenience was discussed.
But localizers are still more engaged and