Re: [Dspace-tech] dspace import throws NullPointerException

[Claudia Jürgen]

Hi Layale,

make sure you got the right structure for the import directory see
https://wiki.duraspace.org/display/DSDOC5x/Importing+and+Exporting+Items+via+Simple+Archive+Format#ImportingandExportingItemsviaSimpleArchiveFormat-DSpaceSimpleArchiveFormat

The command output indicates that there is no directory in:
/backup/staging/1

I assume that your structure looks like
/backup/staging/1/dublin_core.xml
/backup/staging/1/foo.pdf
...
then you got to use
-s /backup/staging

Hope this helps

Claudia


Am 03.08.2015 um 12:12 schrieb Layale Bassil:
 Hello Claudia,

 Thank you so much for your clear response. I have added the below settings to 
 the dspace.cfg file because they were missing. However the import is no more 
 giving an error but the imported items are not being shown. I am getting the 
 below output when importing one item using the below command:

 [root@Lclone ~]# /data/bin/dspace import -a -e dsp...@aub.edu.lb -c 
 10938/10266 -s /backup/staging/1 -m /backup/staging/mapfile
 Destination collections:
 Owning  Collection: Faculty Publications
 Adding items from directory: /backup/staging/1
 Generating mapfile: /backup/staging/mapfile
 Started: 1438596129729
 Ended: 1438596130152
 Elapsed time: 0 secs (423 msecs)

 But when I refresh the items in the collection no new items were added. Do 
 you think it is a handle issue (maybe using an already used handle)? Or do I 
 need to re-index? The mapfile is empty which means no import is occurring. 
 What should I do?

 Thanks!
 Regards.

 -Original Message-
 From: Claudia Jürgen [mailto:claudia.juer...@ub.tu-dortmund.de]
 Sent: Friday, July 31, 2015 2:12 PM
 To: dspace-tech@lists.sourceforge.net
 Subject: Re: [Dspace-tech] dspace import throws NullPointerException


 Hello Layale,

 the import directory is configured in
 [dspace]/config/dspace.cfg
 ### Batch Item import settings ###
 # The directory where the results of imports will be placed (mapfile, upload 
 file) org.dspace.app.batchitemimport.work.dir = ${dspace.dir}/imports

 The dspace.dir ist configured in dspace.cfg too # DSpace installation 
 directory dspace.dir = ${dspace.install.dir}

 which uses the dspace.install.dir from
 [dspace-source]/dspace/build.properties


 There might be other issues like permissions.

 Hope this helps

 Claudia

 Am 31.07.2015 um 12:31 schrieb Layale Bassil:
 Hello Stefan,



 I am also facing exception when I try to import. I am using the same
 import command as the one you used, and I am getting the following
 exception at Line 108 which is (File tempWorkDirFile = new
 File(tempWorkDir);



 Exception in thread main java.lang.ExceptionInInitializerError

   at java.lang.Class.forName0(Native Method)

   at java.lang.Class.forName(Class.java:274)

   at
 org.dspace.app.launcher.ScriptLauncher.runOneCommand(ScriptLauncher.ja
 va:141)

   at
 org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:78)

 Caused by: java.lang.NullPointerException

   at java.io.File.init(File.java:277)

   at
 org.dspace.app.itemimport.ItemImport.clinit(ItemImport.java:108)

   ... 4 more



 The error is not telling me anything, but it might be related to creating 
 the temp working directory. Where can I find the value of this property: 
 ConfigurationManager.getProperty(org.dspace.app.batchitemimport.work.dir); 
 ?



 Your help is very much appreciated to know how to solve this issue.



 Thanks.



 -Original Message-
 From: Stefan Fritzsche [mailto:stefan.fritzs...@tu-dresden.de]
 Sent: Thursday, July 30, 2015 1:50 PM
 To: dspace-tech@lists.sourceforge.net
 Subject: [Dspace-tech] dspace import throws NullPointerException



 Dear Members,



 i try to ingest some content with the commandline tool dspace import.



 I want to ingest the content via the Simple Archive Format 
 (https://wiki.duraspace.org/display/DSDOC5x/Importing+and+Exporting+Items+via+Simple+Archive+Format).





 The ingest is started with



 dspace@server dspace import -a -e f...@bar.demailto:f...@bar.de -s . -m 
 mapfile.

 No collections given. Assuming 'collections' file inside item directory 
 Adding items from directory: .

 Generating mapfile: mapfile

 Processing collections file: collections ...



 The content of the collection file is 123456789/9.



 When i start the ingest, the process throws a NullPointerException but if i 
 use the -c option with the collection_id from the file it works.



 I use the debugger to find the cause of the exception. The method 
 addItem(Context c, Collection[] mycollections, String path, String itemname, 
 PrintWriter mapOut, boolean template) throws Exception) in the package 
 org.dspace.app.itemimport throws the exception.

 I determine that the method addItem is called with the parameter 
 mycollections = null but if i use the -c option the parameter holds the 
 collection_id.



 I add at line 736 the statement mycollections = clist. After this change the 
 process behave like -c

Re: [Dspace-tech] dspace import throws NullPointerException

[Layale Bassil]

Hello Claudia,

Thank you so much for your clear response. I have added the below settings to 
the dspace.cfg file because they were missing. However the import is no more 
giving an error but the imported items are not being shown. I am getting the 
below output when importing one item using the below command:

[root@Lclone ~]# /data/bin/dspace import -a -e dsp...@aub.edu.lb -c 10938/10266 
-s /backup/staging/1 -m /backup/staging/mapfile
Destination collections:
Owning  Collection: Faculty Publications
Adding items from directory: /backup/staging/1
Generating mapfile: /backup/staging/mapfile
Started: 1438596129729
Ended: 1438596130152
Elapsed time: 0 secs (423 msecs)

But when I refresh the items in the collection no new items were added. Do you 
think it is a handle issue (maybe using an already used handle)? Or do I need 
to re-index? The mapfile is empty which means no import is occurring. What 
should I do?

Thanks!
Regards.

-Original Message-
From: Claudia Jürgen [mailto:claudia.juer...@ub.tu-dortmund.de] 
Sent: Friday, July 31, 2015 2:12 PM
To: dspace-tech@lists.sourceforge.net
Subject: Re: [Dspace-tech] dspace import throws NullPointerException


Hello Layale,

the import directory is configured in
[dspace]/config/dspace.cfg
### Batch Item import settings ###
# The directory where the results of imports will be placed (mapfile, upload 
file) org.dspace.app.batchitemimport.work.dir = ${dspace.dir}/imports

The dspace.dir ist configured in dspace.cfg too # DSpace installation directory 
dspace.dir = ${dspace.install.dir}

which uses the dspace.install.dir from
[dspace-source]/dspace/build.properties


There might be other issues like permissions.

Hope this helps

Claudia

Am 31.07.2015 um 12:31 schrieb Layale Bassil:
 Hello Stefan,



 I am also facing exception when I try to import. I am using the same 
 import command as the one you used, and I am getting the following 
 exception at Line 108 which is (File tempWorkDirFile = new 
 File(tempWorkDir);



 Exception in thread main java.lang.ExceptionInInitializerError

  at java.lang.Class.forName0(Native Method)

  at java.lang.Class.forName(Class.java:274)

  at 
 org.dspace.app.launcher.ScriptLauncher.runOneCommand(ScriptLauncher.ja
 va:141)

  at 
 org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:78)

 Caused by: java.lang.NullPointerException

  at java.io.File.init(File.java:277)

  at 
 org.dspace.app.itemimport.ItemImport.clinit(ItemImport.java:108)

  ... 4 more



 The error is not telling me anything, but it might be related to creating the 
 temp working directory. Where can I find the value of this property: 
 ConfigurationManager.getProperty(org.dspace.app.batchitemimport.work.dir); ?



 Your help is very much appreciated to know how to solve this issue.



 Thanks.



 -Original Message-
 From: Stefan Fritzsche [mailto:stefan.fritzs...@tu-dresden.de]
 Sent: Thursday, July 30, 2015 1:50 PM
 To: dspace-tech@lists.sourceforge.net
 Subject: [Dspace-tech] dspace import throws NullPointerException



 Dear Members,



 i try to ingest some content with the commandline tool dspace import.



 I want to ingest the content via the Simple Archive Format 
 (https://wiki.duraspace.org/display/DSDOC5x/Importing+and+Exporting+Items+via+Simple+Archive+Format).





 The ingest is started with



 dspace@server dspace import -a -e f...@bar.demailto:f...@bar.de -s . -m 
 mapfile.

 No collections given. Assuming 'collections' file inside item directory 
 Adding items from directory: .

 Generating mapfile: mapfile

 Processing collections file: collections ...



 The content of the collection file is 123456789/9.



 When i start the ingest, the process throws a NullPointerException but if i 
 use the -c option with the collection_id from the file it works.



 I use the debugger to find the cause of the exception. The method 
 addItem(Context c, Collection[] mycollections, String path, String itemname, 
 PrintWriter mapOut, boolean template) throws Exception) in the package 
 org.dspace.app.itemimport throws the exception.

 I determine that the method addItem is called with the parameter 
 mycollections = null but if i use the -c option the parameter holds the 
 collection_id.



 I add at line 736 the statement mycollections = clist. After this change the 
 process behave like -c option is set.



 My questions are:

 Is this a bug and should i report it?

 Has my fix some side effects?



 Thanks in advance,

 Stefan



 --
 

 ___

 DSpace-tech mailing list

 DSpace-tech@lists.sourceforge.netmailto:DSpace-tech@lists.sourceforge
 .net

 https://lists.sourceforge.net/lists/listinfo/dspace-tech

 List Etiquette: 
 https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

Re: [Dspace-tech] dspace import throws NullPointerException

[Layale Bassil]

Hello,

Thank you so much Kostas and Claudia! Well everything was correct except that I 
should use /backup/staging instead of /backup/staging/1. I thought using 
the full path will work by importing only the specified item. The items are now 
properly imported. Is it normal that I have to re-index for them to be 
searchable?

Many thanks again for your continuous support.
Regards.

Layale.

-Original Message-
From: Claudia Jürgen [mailto:claudia.juer...@ub.tu-dortmund.de] 
Sent: Monday, August 03, 2015 1:28 PM
To: dspace-tech@lists.sourceforge.net
Subject: Re: [Dspace-tech] dspace import throws NullPointerException

Hi Layale,

make sure you got the right structure for the import directory see 
https://wiki.duraspace.org/display/DSDOC5x/Importing+and+Exporting+Items+via+Simple+Archive+Format#ImportingandExportingItemsviaSimpleArchiveFormat-DSpaceSimpleArchiveFormat

The command output indicates that there is no directory in:
/backup/staging/1

I assume that your structure looks like
/backup/staging/1/dublin_core.xml
/backup/staging/1/foo.pdf
...
then you got to use
-s /backup/staging

Hope this helps

Claudia


Am 03.08.2015 um 12:12 schrieb Layale Bassil:
 Hello Claudia,

 Thank you so much for your clear response. I have added the below settings to 
 the dspace.cfg file because they were missing. However the import is no more 
 giving an error but the imported items are not being shown. I am getting the 
 below output when importing one item using the below command:

 [root@Lclone ~]# /data/bin/dspace import -a -e dsp...@aub.edu.lb -c 
 10938/10266 -s /backup/staging/1 -m /backup/staging/mapfile Destination 
 collections:
 Owning  Collection: Faculty Publications Adding items from directory: 
 /backup/staging/1 Generating mapfile: /backup/staging/mapfile
 Started: 1438596129729
 Ended: 1438596130152
 Elapsed time: 0 secs (423 msecs)

 But when I refresh the items in the collection no new items were added. Do 
 you think it is a handle issue (maybe using an already used handle)? Or do I 
 need to re-index? The mapfile is empty which means no import is occurring. 
 What should I do?

 Thanks!
 Regards.

 -Original Message-
 From: Claudia Jürgen [mailto:claudia.juer...@ub.tu-dortmund.de]
 Sent: Friday, July 31, 2015 2:12 PM
 To: dspace-tech@lists.sourceforge.net
 Subject: Re: [Dspace-tech] dspace import throws NullPointerException


 Hello Layale,

 the import directory is configured in
 [dspace]/config/dspace.cfg
 ### Batch Item import settings ###
 # The directory where the results of imports will be placed (mapfile, 
 upload file) org.dspace.app.batchitemimport.work.dir = 
 ${dspace.dir}/imports

 The dspace.dir ist configured in dspace.cfg too # DSpace installation 
 directory dspace.dir = ${dspace.install.dir}

 which uses the dspace.install.dir from 
 [dspace-source]/dspace/build.properties


 There might be other issues like permissions.

 Hope this helps

 Claudia

 Am 31.07.2015 um 12:31 schrieb Layale Bassil:
 Hello Stefan,



 I am also facing exception when I try to import. I am using the same 
 import command as the one you used, and I am getting the following 
 exception at Line 108 which is (File tempWorkDirFile = new 
 File(tempWorkDir);



 Exception in thread main java.lang.ExceptionInInitializerError

   at java.lang.Class.forName0(Native Method)

   at java.lang.Class.forName(Class.java:274)

   at
 org.dspace.app.launcher.ScriptLauncher.runOneCommand(ScriptLauncher.j
 a
 va:141)

   at
 org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:78)

 Caused by: java.lang.NullPointerException

   at java.io.File.init(File.java:277)

   at
 org.dspace.app.itemimport.ItemImport.clinit(ItemImport.java:108)

   ... 4 more



 The error is not telling me anything, but it might be related to creating 
 the temp working directory. Where can I find the value of this property: 
 ConfigurationManager.getProperty(org.dspace.app.batchitemimport.work.dir); 
 ?



 Your help is very much appreciated to know how to solve this issue.



 Thanks.



 -Original Message-
 From: Stefan Fritzsche [mailto:stefan.fritzs...@tu-dresden.de]
 Sent: Thursday, July 30, 2015 1:50 PM
 To: dspace-tech@lists.sourceforge.net
 Subject: [Dspace-tech] dspace import throws NullPointerException



 Dear Members,



 i try to ingest some content with the commandline tool dspace import.



 I want to ingest the content via the Simple Archive Format 
 (https://wiki.duraspace.org/display/DSDOC5x/Importing+and+Exporting+Items+via+Simple+Archive+Format).





 The ingest is started with



 dspace@server dspace import -a -e f...@bar.demailto:f...@bar.de -s . -m 
 mapfile.

 No collections given. Assuming 'collections' file inside item directory 
 Adding items from directory: .

 Generating mapfile: mapfile

 Processing collections file: collections ...



 The content of the collection file is 123456789/9.



 When i start the ingest, the process

Re: [Dspace-tech] dspace import throws NullPointerException

[Graham Triggs]

Hi,

I think the point is that the value is returning null - e.g. it is not set
in your dspace.cfg - and so a null is passed into the new File(), and
throwing a NullPointerException.

Ugh.

That code needs updating - the static initializer in ItemImport ought to
have try {} catch around it, and there should be explicit handling of the
configuration property not being present (null).

G

On 31 July 2015 at 11:31, Layale Bassil l...@aub.edu.lb wrote:

 Hello Stefan,



 I am also facing exception when I try to import. I am using the same
 import command as the one you used, and I am getting the following
 exception at Line 108 which is (File tempWorkDirFile = new
 File(tempWorkDir);



 Exception in thread main java.lang.ExceptionInInitializerError

 at java.lang.Class.forName0(Native Method)

 at java.lang.Class.forName(Class.java:274)

 at
 org.dspace.app.launcher.ScriptLauncher.runOneCommand(ScriptLauncher.java:141)

 at
 org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:78)

 Caused by: java.lang.NullPointerException

 at java.io.File.init(File.java:277)

 at
 org.dspace.app.itemimport.ItemImport.clinit(ItemImport.java:108)

 ... 4 more



 The error is not telling me anything, but it might be related to creating
 the temp working directory. Where can I find the value of this property:
 ConfigurationManager.getProperty(org.dspace.app.batchitemimport.work.dir);
 ?



 Your help is very much appreciated to know how to solve this issue.



 Thanks.



 -Original Message-
 From: Stefan Fritzsche [mailto:stefan.fritzs...@tu-dresden.de]
 Sent: Thursday, July 30, 2015 1:50 PM
 To: dspace-tech@lists.sourceforge.net
 Subject: [Dspace-tech] dspace import throws NullPointerException



 Dear Members,



 i try to ingest some content with the commandline tool dspace import.



 I want to ingest the content via the Simple Archive Format (
 https://wiki.duraspace.org/display/DSDOC5x/Importing+and+Exporting+Items+via+Simple+Archive+Format
 ).





 The ingest is started with



 dspace@server dspace import -a -e f...@bar.de -s . -m mapfile.

 No collections given. Assuming 'collections' file inside item directory
 Adding items from directory: .

 Generating mapfile: mapfile

 Processing collections file: collections ...



 The content of the collection file is 123456789/9.



 When i start the ingest, the process throws a NullPointerException but if
 i use the -c option with the collection_id from the file it works.



 I use the debugger to find the cause of the exception. The method
 addItem(Context c, Collection[] mycollections, String path, String
 itemname, PrintWriter mapOut, boolean template) throws Exception) in the
 package org.dspace.app.itemimport throws the exception.

 I determine that the method addItem is called with the parameter
 mycollections = null but if i use the -c option the parameter holds the
 collection_id.



 I add at line 736 the statement mycollections = clist. After this change
 the process behave like -c option is set.



 My questions are:

 Is this a bug and should i report it?

 Has my fix some side effects?



 Thanks in advance,

 Stefan




 --

 ___

 DSpace-tech mailing list

 DSpace-tech@lists.sourceforge.net

 https://lists.sourceforge.net/lists/listinfo/dspace-tech

 List Etiquette:
 https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette


 --

 ___
 DSpace-tech mailing list
 DSpace-tech@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/dspace-tech
 List Etiquette:
 https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

--
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

Re: [Dspace-tech] dspace import throws NullPointerException

[Layale Bassil]

Hello Stefan,



I am also facing exception when I try to import. I am using the same import 
command as the one you used, and I am getting the following exception at Line 
108 which is (File tempWorkDirFile = new File(tempWorkDir);



Exception in thread main java.lang.ExceptionInInitializerError

at java.lang.Class.forName0(Native Method)

at java.lang.Class.forName(Class.java:274)

at 
org.dspace.app.launcher.ScriptLauncher.runOneCommand(ScriptLauncher.java:141)

at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:78)

Caused by: java.lang.NullPointerException

at java.io.File.init(File.java:277)

at org.dspace.app.itemimport.ItemImport.clinit(ItemImport.java:108)

... 4 more



The error is not telling me anything, but it might be related to creating the 
temp working directory. Where can I find the value of this property: 
ConfigurationManager.getProperty(org.dspace.app.batchitemimport.work.dir); ?



Your help is very much appreciated to know how to solve this issue.



Thanks.



-Original Message-
From: Stefan Fritzsche [mailto:stefan.fritzs...@tu-dresden.de]
Sent: Thursday, July 30, 2015 1:50 PM
To: dspace-tech@lists.sourceforge.net
Subject: [Dspace-tech] dspace import throws NullPointerException



Dear Members,



i try to ingest some content with the commandline tool dspace import.



I want to ingest the content via the Simple Archive Format 
(https://wiki.duraspace.org/display/DSDOC5x/Importing+and+Exporting+Items+via+Simple+Archive+Format).





The ingest is started with



dspace@server dspace import -a -e f...@bar.demailto:f...@bar.de -s . -m 
mapfile.

No collections given. Assuming 'collections' file inside item directory Adding 
items from directory: .

Generating mapfile: mapfile

Processing collections file: collections ...



The content of the collection file is 123456789/9.



When i start the ingest, the process throws a NullPointerException but if i use 
the -c option with the collection_id from the file it works.



I use the debugger to find the cause of the exception. The method 
addItem(Context c, Collection[] mycollections, String path, String itemname, 
PrintWriter mapOut, boolean template) throws Exception) in the package 
org.dspace.app.itemimport throws the exception.

I determine that the method addItem is called with the parameter mycollections 
= null but if i use the -c option the parameter holds the collection_id.



I add at line 736 the statement mycollections = clist. After this change the 
process behave like -c option is set.



My questions are:

Is this a bug and should i report it?

Has my fix some side effects?



Thanks in advance,

Stefan



--

___

DSpace-tech mailing list

DSpace-tech@lists.sourceforge.netmailto:DSpace-tech@lists.sourceforge.net

https://lists.sourceforge.net/lists/listinfo/dspace-tech

List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
--
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

Re: [Dspace-tech] dspace import throws NullPointerException

[Stefan Fritzsche]

Hello Claudia,

thanks for your reply. I got the same problem when i use the replace
options instead the add.
Should i report both as one issues or should be open a issue for each case?

Kind regards,
Stefan

On 07/30/2015 01:44 PM, Claudia Jürgen wrote:
 Hello Stefan,

 you are right this looks (not tested it) like a bug in:

 https://github.com/DSpace/DSpace/blob/master/dspace-api/src/main/java/org/dspace/app/itemimport/ItemImport.java#L736

 addItem(c, mycollections, sourceDir, dircontents[i], mapOut, template);
 should be
 addItem(c, clist, sourceDir, dircontents[i], mapOut, template);

 If you add the line you mentioned
  I add at line 736 the statement mycollections = clist. After this 
 change the process behave like -c option is set.
 This will fail if using the importer with the -c option.

 You can file it in our issue Tracker:
 https://jira.duraspace.org/browse/DS/?selectedTab=com.atlassian.jira.jira-projects-plugin:summary-panel

 Hope this helps

 and

 Grüße aus dem Ruhrpott

 Claudia


 Am 30.07.2015 um 12:50 schrieb Stefan Fritzsche:
 Dear Members,

 i try to ingest some content with the commandline tool dspace import.

 I want to ingest the content via the Simple Archive Format
 (https://wiki.duraspace.org/display/DSDOC5x/Importing+and+Exporting+Items+via+Simple+Archive+Format).


 The ingest is started with

 dspace@server dspace import -a -e f...@bar.de -s . -m mapfile.
 No collections given. Assuming 'collections' file inside item directory
 Adding items from directory: .
 Generating mapfile: mapfile
 Processing collections file: collections
 ...

 The content of the collection file is 123456789/9.

 When i start the ingest, the process throws a NullPointerException but
 if i use the -c option with the collection_id from the file it works.

 I use the debugger to find the cause of the exception. The method
 addItem(Context c, Collection[] mycollections, String path, String
 itemname, PrintWriter mapOut, boolean template) throws Exception) in the
 package org.dspace.app.itemimport throws the exception.
 I determine that the method addItem is called with the parameter
 mycollections = null but if i use the -c option the parameter holds the
 collection_id.

 I add at line 736 the statement mycollections = clist. After this change
 the process behave like -c option is set.

 My questions are:
 Is this a bug and should i report it?
 Has my fix some side effects?

 Thanks in advance,
 Stefan

 --
 ___
 DSpace-tech mailing list
 DSpace-tech@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/dspace-tech
 List Etiquette: 
 https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette



-- 
Stefan Fritzsche
email: stefan.fritzs...@tu-dresden.de
tel: (49) 351 463-33212
-
Zellescher Weg 12 // Willersbau A 109
01069 Dresden


--
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

Re: [Dspace-tech] dspace import throws NullPointerException

[Claudia Jürgen]

Hello Stefan,

you are right this looks (not tested it) like a bug in:

https://github.com/DSpace/DSpace/blob/master/dspace-api/src/main/java/org/dspace/app/itemimport/ItemImport.java#L736

addItem(c, mycollections, sourceDir, dircontents[i], mapOut, template);
should be
addItem(c, clist, sourceDir, dircontents[i], mapOut, template);

If you add the line you mentioned
 I add at line 736 the statement mycollections = clist. After this 
change the process behave like -c option is set.
This will fail if using the importer with the -c option.

You can file it in our issue Tracker:
https://jira.duraspace.org/browse/DS/?selectedTab=com.atlassian.jira.jira-projects-plugin:summary-panel

Hope this helps

and

Grüße aus dem Ruhrpott

Claudia


Am 30.07.2015 um 12:50 schrieb Stefan Fritzsche:
 Dear Members,

 i try to ingest some content with the commandline tool dspace import.

 I want to ingest the content via the Simple Archive Format
 (https://wiki.duraspace.org/display/DSDOC5x/Importing+and+Exporting+Items+via+Simple+Archive+Format).


 The ingest is started with

 dspace@server dspace import -a -e f...@bar.de -s . -m mapfile.
 No collections given. Assuming 'collections' file inside item directory
 Adding items from directory: .
 Generating mapfile: mapfile
 Processing collections file: collections
 ...

 The content of the collection file is 123456789/9.

 When i start the ingest, the process throws a NullPointerException but
 if i use the -c option with the collection_id from the file it works.

 I use the debugger to find the cause of the exception. The method
 addItem(Context c, Collection[] mycollections, String path, String
 itemname, PrintWriter mapOut, boolean template) throws Exception) in the
 package org.dspace.app.itemimport throws the exception.
 I determine that the method addItem is called with the parameter
 mycollections = null but if i use the -c option the parameter holds the
 collection_id.

 I add at line 736 the statement mycollections = clist. After this change
 the process behave like -c option is set.

 My questions are:
 Is this a bug and should i report it?
 Has my fix some side effects?

 Thanks in advance,
 Stefan

 --
 ___
 DSpace-tech mailing list
 DSpace-tech@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/dspace-tech
 List Etiquette: 
 https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette


-- 
Claudia Juergen
Eldorado

Technische Universität Dortmund
Universitätsbibliothek
Vogelpothsweg 76
44227 Dortmund

Tel.: +49 231-755 40 43
Fax: +49 231-755 40 32
claudia.juer...@ub.tu-dortmund.de
www.ub.tu-dortmund.de


Wichtiger Hinweis: Die Information in dieser E-Mail ist vertraulich. Sie 
ist ausschließlich für den Adressaten bestimmt. Sollten Sie nicht der 
für diese E-Mail bestimmte Adressat sein, unterrichten Sie bitte den 
Absender und vernichten Sie diese Mail. Vielen Dank.
Unbeschadet der Korrespondenz per E-Mail sind unsere Erklärungen 
ausschließlich final rechtsverbindlich, wenn sie in herkömmlicher 
Schriftform (mit eigenhändiger Unterschrift) oder durch Übermittlung 
eines solchen Schriftstücks per Telefax erfolgen.

Important note: The information included in this e-mail is confidential. 
It is solely intended for the recipient. If you are not the intended 
recipient of this e-mail please contact the sender and delete this 
message. Thank you.
Without prejudice of e-mail correspondence our statements are only 
legally binding when they are made in the conventional written form 
(with personal signature) or when such documents are sent by fax.

--
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

Re: [Dspace-tech] dspace import throws NullPointerException

[Claudia Jürgen]

Hello Stefan,

file one, they are most likely closely related.

Sunny greetings

Claudia


Am 30.07.2015 um 14:02 schrieb Stefan Fritzsche:
 Hello Claudia,

 thanks for your reply. I got the same problem when i use the replace
 options instead the add.
 Should i report both as one issues or should be open a issue for each case?

 Kind regards,
 Stefan

 On 07/30/2015 01:44 PM, Claudia Jürgen wrote:
 Hello Stefan,

 you are right this looks (not tested it) like a bug in:

 https://github.com/DSpace/DSpace/blob/master/dspace-api/src/main/java/org/dspace/app/itemimport/ItemImport.java#L736

 addItem(c, mycollections, sourceDir, dircontents[i], mapOut, template);
 should be
 addItem(c, clist, sourceDir, dircontents[i], mapOut, template);

 If you add the line you mentioned
  I add at line 736 the statement mycollections = clist. After this
 change the process behave like -c option is set.
 This will fail if using the importer with the -c option.

 You can file it in our issue Tracker:
 https://jira.duraspace.org/browse/DS/?selectedTab=com.atlassian.jira.jira-projects-plugin:summary-panel

 Hope this helps

 and

 Grüße aus dem Ruhrpott

 Claudia


 Am 30.07.2015 um 12:50 schrieb Stefan Fritzsche:
 Dear Members,

 i try to ingest some content with the commandline tool dspace import.

 I want to ingest the content via the Simple Archive Format
 (https://wiki.duraspace.org/display/DSDOC5x/Importing+and+Exporting+Items+via+Simple+Archive+Format).


 The ingest is started with

 dspace@server dspace import -a -e f...@bar.de -s . -m mapfile.
 No collections given. Assuming 'collections' file inside item directory
 Adding items from directory: .
 Generating mapfile: mapfile
 Processing collections file: collections
 ...

 The content of the collection file is 123456789/9.

 When i start the ingest, the process throws a NullPointerException but
 if i use the -c option with the collection_id from the file it works.

 I use the debugger to find the cause of the exception. The method
 addItem(Context c, Collection[] mycollections, String path, String
 itemname, PrintWriter mapOut, boolean template) throws Exception) in the
 package org.dspace.app.itemimport throws the exception.
 I determine that the method addItem is called with the parameter
 mycollections = null but if i use the -c option the parameter holds the
 collection_id.

 I add at line 736 the statement mycollections = clist. After this change
 the process behave like -c option is set.

 My questions are:
 Is this a bug and should i report it?
 Has my fix some side effects?

 Thanks in advance,
 Stefan

 --
 ___
 DSpace-tech mailing list
 DSpace-tech@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/dspace-tech
 List Etiquette: 
 https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette




--
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

[Dspace-tech] dspace import throws NullPointerException

[Stefan Fritzsche]

Dear Members,

i try to ingest some content with the commandline tool dspace import.

I want to ingest the content via the Simple Archive Format
(https://wiki.duraspace.org/display/DSDOC5x/Importing+and+Exporting+Items+via+Simple+Archive+Format).


The ingest is started with

dspace@server dspace import -a -e f...@bar.de -s . -m mapfile.
No collections given. Assuming 'collections' file inside item directory
Adding items from directory: .
Generating mapfile: mapfile
Processing collections file: collections
...

The content of the collection file is 123456789/9.

When i start the ingest, the process throws a NullPointerException but
if i use the -c option with the collection_id from the file it works.

I use the debugger to find the cause of the exception. The method
addItem(Context c, Collection[] mycollections, String path, String
itemname, PrintWriter mapOut, boolean template) throws Exception) in the
package org.dspace.app.itemimport throws the exception.
I determine that the method addItem is called with the parameter
mycollections = null but if i use the -c option the parameter holds the
collection_id.

I add at line 736 the statement mycollections = clist. After this change
the process behave like -c option is set.

My questions are:
Is this a bug and should i report it?
Has my fix some side effects?

Thanks in advance,
Stefan

--
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

[Dspace-tech] dspace import

[Webshet, Sisay (ILRI)]

Hi All

For dsapce 3.2 xmlui version I was importing this item 
http://ciat-library.ciat.cgiar.org:8080/jspui/handle/123456789/4156
via Simple Archive Format in to another dsapce site i.e. 
http://dspacetest.cgiar.org/handle/10568/44287

And as you see on the destination  the URI have 2 links and the handle doesn't 
work,

Does anyone a hint to solve this problem

Thanks

Sisay

--
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

[Dspace-tech] DSpace import from .tar archives

[Manuel Subredu]

Hi,

we are trying to set up a DSpace instance in which we would like add the
content of the .tar files we have received from our old supplier. I
managed to set up a DSpace 4 instance with all the services up and running.
 Now, I'm trying to import the data he have into DSpace. So, I have:

 1. a collection in place
 2. a user defined
 3. multiple .tar files containing some data. For testing, I picked one
of them and dearchived the content into /tmp/some_dir .

When I try to import the data using:

 ./dspace import -t -p -add -c 123456789/2 -e user@domain -s
/tmp/ROM2013006018/ --mapfile=/dspace/Import/Col_2/mapfile

I get:

java.io.FileNotFoundException:
/tmp/ROM2013006018/02731177/dublin_core.xml (No such file or directory)

When I looked into the directories I can't see and dublin_core.xml
files. I see:

drwxr-xr-x  4 u u   4096 Feb 18 14:37 02731177
drwxr-xr-x  5 u u   4096 Feb 18 14:37 17529298
-rw-r--r--  1 u u 232999 Jan 16 08:06 dataset.xml

And the above dirs only contain some subdirectories and some main.{xml,
raw, pdf) files. Is what we have a format that's not understood by
dspace ? Or I'm doing something wrong here ?

Thank you,



signature.asc
Description: OpenPGP digital signature
--
Managing the Performance of Cloud-Based Applications
Take advantage of what the Cloud has to offer - Avoid Common Pitfalls.
Read the Whitepaper.
http://pubads.g.doubleclick.net/gampad/clk?id=121054471iu=/4140/ostg.clktrk___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

Re: [Dspace-tech] DSpace import from .tar archives

[helix84]

On Tue, Feb 18, 2014 at 1:58 PM, Manuel Subredu
manuel.subr...@roedu.net wrote:
 drwxr-xr-x  4 u u   4096 Feb 18 14:37 02731177
 drwxr-xr-x  5 u u   4096 Feb 18 14:37 17529298
 -rw-r--r--  1 u u 232999 Jan 16 08:06 dataset.xml

 And the above dirs only contain some subdirectories and some main.{xml,
 raw, pdf) files. Is what we have a format that's not understood by
 dspace ? Or I'm doing something wrong here ?

Yes, most likely it's not a format directly understood by DSpace. What
system do the files originate from? What's in the subdirectories (e.g.
02731177)? Feel free to attach an example item (again, e.g. the
02731177 subdirectory), otherwise there's not enough information to
tell what it is that you have there.


Regards,
~~helix84

Compulsory reading: DSpace Mailing List Etiquette
https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

--
Managing the Performance of Cloud-Based Applications
Take advantage of what the Cloud has to offer - Avoid Common Pitfalls.
Read the Whitepaper.
http://pubads.g.doubleclick.net/gampad/clk?id=121054471iu=/4140/ostg.clktrk
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

Re: [Dspace-tech] DSpace import from .tar archives

[Manuel Subredu]

On 18/02/14 15:37, helix84 wrote:
 On Tue, Feb 18, 2014 at 1:58 PM, Manuel Subredu
 manuel.subr...@roedu.net wrote:
 drwxr-xr-x  4 u u   4096 Feb 18 14:37 02731177
 drwxr-xr-x  5 u u   4096 Feb 18 14:37 17529298
 -rw-r--r--  1 u u 232999 Jan 16 08:06 dataset.xml

 And the above dirs only contain some subdirectories and some main.{xml,
 raw, pdf) files. Is what we have a format that's not understood by
 dspace ? Or I'm doing something wrong here ?
 
 Yes, most likely it's not a format directly understood by DSpace. What
 system do the files originate from? What's in the subdirectories (e.g.

 I don't know yet :( One of these days we will have some guy from
source talking to us.

 02731177)? Feel free to attach an example item (again, e.g. the
 02731177 subdirectory), otherwise there's not enough information to
 tell what it is that you have there.

 attached is a ls -laR on one of the directories. I'm not allowed to
publish the files public on the web but I can send a private URL to who
can help me (helix: already sent).

 Thanks !
total 0
drwxr-xr-x+ 3 no one  _avipm  102 Feb 18 15:48 .
drwxr-xr-x+ 4 no one  _avipm  170 Feb 18 15:50 ..
drwxr-xr-x+ 4 no one  _avipm  136 Feb 18 15:48 v53i6-7

01410229//v53i6-7:
total 0
drwxr-xr-x+ 4 no one  _avipm  136 Feb 18 15:48 .
drwxr-xr-x+ 3 no one  _avipm  102 Feb 18 15:48 ..
drwxr-xr-x+ 2 no one  _avipm  170 Feb 18 15:48 S014102291300197X
drwxr-xr-x+ 4 no one  _avipm  238 Feb 18 15:48 S0141022913001993

01410229//v53i6-7/S014102291300197X:
total 344
drwxr-xr-x+ 2 no one  _avipm 170 Feb 18 15:48 .
drwxr-xr-x+ 4 no one  _avipm 136 Feb 18 15:48 ..
-rw-r--r--+ 1 no one  _avipm  167442 Jan 15 05:28 main.pdf
-rw-r--r--+ 1 no one  _avipm1346 Jan 15 05:28 main.raw
-rw-r--r--+ 1 no one  _avipm3681 Jan 15 05:28 main.xml

01410229//v53i6-7/S0141022913001993:
total 3544
drwxr-xr-x+ 4 no one  _avipm  238 Feb 18 15:48 .
drwxr-xr-x+ 4 no one  _avipm  136 Feb 18 15:48 ..
drwxr-xr-x+ 2 no one  _avipm  748 Feb 18 15:48 main.assets
-rw-r--r--+ 1 no one  _avipm  1640638 Jan 15 05:28 main.pdf
-rw-r--r--+ 1 no one  _avipm45921 Jan 15 05:28 main.raw
drwxr-xr-x+ 2 no one  _avipm  204 Feb 18 15:48 main.stripin
-rw-r--r--+ 1 no one  _avipm   121960 Jan 15 05:28 main.xml

01410229//v53i6-7/S0141022913001993/main.assets:
total 1800
drwxr-xr-x+ 2 no one  _avipm 748 Feb 18 15:48 .
drwxr-xr-x+ 4 no one  _avipm 238 Feb 18 15:48 ..
-rw-r--r--+ 1 no one  _avipm   17041 Jan 15 05:28 fx1.jpg
-rw-r--r--+ 1 no one  _avipm3117 Jan 15 05:28 fx1.sml
-rw-r--r--+ 1 no one  _avipm   48572 Jan 15 05:28 gr1.jpg
-rw-r--r--+ 1 no one  _avipm4928 Jan 15 05:28 gr1.sml
-rw-r--r--+ 1 no one  _avipm  133963 Jan 15 05:28 gr2.jpg
-rw-r--r--+ 1 no one  _avipm8137 Jan 15 05:28 gr2.sml
-rw-r--r--+ 1 no one  _avipm   54143 Jan 15 05:28 gr3.jpg
-rw-r--r--+ 1 no one  _avipm4925 Jan 15 05:28 gr3.sml
-rw-r--r--+ 1 no one  _avipm   43008 Jan 15 05:28 mmc1.doc
-rw-r--r--+ 1 no one  _avipm  158431 Jan 15 05:28 mmc2.jpg
-rw-r--r--+ 1 no one  _avipm6826 Jan 15 05:28 mmc2.sml
-rw-r--r--+ 1 no one  _avipm  115921 Jan 15 05:28 mmc3.jpg
-rw-r--r--+ 1 no one  _avipm6381 Jan 15 05:28 mmc3.sml
-rw-r--r--+ 1 no one  _avipm  143626 Jan 15 05:28 mmc4.jpg
-rw-r--r--+ 1 no one  _avipm6690 Jan 15 05:28 mmc4.sml
-rw-r--r--+ 1 no one  _avipm   43136 Jan 15 05:28 mmc5.jpg
-rw-r--r--+ 1 no one  _avipm3829 Jan 15 05:28 mmc5.sml
-rw-r--r--+ 1 no one  _avipm   24595 Jan 15 05:28 mmc6.docx
-rw-r--r--+ 1 no one  _avipm   24714 Jan 15 05:28 mmc7.docx
-rw-r--r--+ 1 no one  _avipm   26137 Jan 15 05:28 mmc8.docx

01410229//v53i6-7/S0141022913001993/main.stripin:
total 32
drwxr-xr-x+ 2 no one  _avipm   204 Feb 18 15:48 .
drwxr-xr-x+ 4 no one  _avipm   238 Feb 18 15:48 ..
-rw-r--r--+ 1 no one  _avipm  1115 Jan 15 05:28 si1.gif
-rw-r--r--+ 1 no one  _avipm   497 Jan 15 05:28 si2.gif
-rw-r--r--+ 1 no one  _avipm   960 Jan 15 05:28 si3.gif
-rw-r--r--+ 1 no one  _avipm   505 Jan 15 05:28 si4.gif


signature.asc
Description: OpenPGP digital signature
--
Managing the Performance of Cloud-Based Applications
Take advantage of what the Cloud has to offer - Avoid Common Pitfalls.
Read the Whitepaper.
http://pubads.g.doubleclick.net/gampad/clk?id=121054471iu=/4140/ostg.clktrk___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

Re: [Dspace-tech] DSpace import from .tar archives

[helix84]

From the directory listing it looks like this format:

http://www.elsevier.com/__data/assets/pdf_file/0020/111971/ew-contrast-out.pdf

This is not ingestable by DSpace as is, but with some effort, you can
certainly transform them into some format that DSpace understands.
This will require some XSLT knowledge to transform your main.xml files
into dublin_core.xml files, plus creating the DSpace Simple Archive
Format structure. I'm assuming that you have at least several hundred
items here. If not, it might be easier to just do it manually.


Regards,
~~helix84

Compulsory reading: DSpace Mailing List Etiquette
https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

--
Managing the Performance of Cloud-Based Applications
Take advantage of what the Cloud has to offer - Avoid Common Pitfalls.
Read the Whitepaper.
http://pubads.g.doubleclick.net/gampad/clk?id=121054471iu=/4140/ostg.clktrk
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

Re: [Dspace-tech] DSpace import from .tar archives

[Manuel Subredu]

On 18/02/14 16:01, helix84 wrote:
 From the directory listing it looks like this format:
 
 http://www.elsevier.com/__data/assets/pdf_file/0020/111971/ew-contrast-out.pdf
 
 This is not ingestable by DSpace as is, but with some effort, you can
 certainly transform them into some format that DSpace understands.
 This will require some XSLT knowledge to transform your main.xml files
 into dublin_core.xml files, plus creating the DSpace Simple Archive
 Format structure. I'm assuming that you have at least several hundred
 items here. If not, it might be easier to just do it manually.

 I have lots of data (~ 1.3TB) :(

 Do you have some pointers about transforming that data ? Or should I
ask the vendor about it ?

 
 
 Regards,
 ~~helix84
 
 Compulsory reading: DSpace Mailing List Etiquette
 https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
 



signature.asc
Description: OpenPGP digital signature
--
Managing the Performance of Cloud-Based Applications
Take advantage of what the Cloud has to offer - Avoid Common Pitfalls.
Read the Whitepaper.
http://pubads.g.doubleclick.net/gampad/clk?id=121054471iu=/4140/ostg.clktrk___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

Re: [Dspace-tech] DSpace import from .tar archives

[helix84]

On Tue, Feb 18, 2014 at 3:04 PM, Manuel Subredu
manuel.subr...@roedu.net wrote:
  I have lots of data (~ 1.3TB) :(

It's the point of automation to help you with any amount of data ;)

  Do you have some pointers about transforming that data ? Or should I
 ask the vendor about it ?

Do you mean your data vendor or your software vendor? A data vendor
will not help you. A software vendor might, especially if they have
experience with DSpace.

If you can find someone with some XSLT experience, it's easy to do the
transformation. The target format (SAF) is described here [1].
Alternatively, you could transform also to the AIP format [2], but
that one is a bit more complex, so I recommend you to go with SAF.

[1] 
https://wiki.duraspace.org/display/DSDOC4x/Importing+and+Exporting+Items+via+Simple+Archive+Format
[2] https://wiki.duraspace.org/display/DSDOC4x/DSpace+AIP+Format


Regards,
~~helix84

Compulsory reading: DSpace Mailing List Etiquette
https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

--
Managing the Performance of Cloud-Based Applications
Take advantage of what the Cloud has to offer - Avoid Common Pitfalls.
Read the Whitepaper.
http://pubads.g.doubleclick.net/gampad/clk?id=121054471iu=/4140/ostg.clktrk
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

Re: [Dspace-tech] dspace import cmd not encoding utf-8 file names correctly

[helix84]

Hi Hayden,

issues tend to get forgotten when you just report them on the lists,
so I filed a Jira issue on your behalf:

https://jira.duraspace.org/browse/DS-1853


Regards,
~~helix84

Compulsory reading: DSpace Mailing List Etiquette
https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

--
Rapidly troubleshoot problems before they affect your business. Most IT 
organizations don't have a clear picture of how application performance 
affects their revenue. With AppDynamics, you get 100% visibility into your 
Java,.NET,  PHP application. Start your 15-day FREE TRIAL of AppDynamics Pro!
http://pubads.g.doubleclick.net/gampad/clk?id=84349831iu=/4140/ostg.clktrk
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

[Dspace-tech] dspace import cmd not encoding utf-8 file names correctly

[Hayden Young]

I am trying to export a record from one dspace instance to another.

Using the export cmd line tool, I have successfully exported a record 
but upon opening the resulting zip file I notice that the file name has 
invalid characters where some non-english characters have been used.

Example:

Using:

# ./dspace export -t ITEM -z 123456789_391.zip -d /tmp/ -i 123456789/391 
-n 1

I am able to export the record successfully, but the bitstream file 
called Masterthesis_Midtgård.pdf gets renamed to 
Masterthesis_Midtg├еrd.pdf (note the pipe/dash symbol).

My machine's locale settings are all UTF-8:

# echo $LANG
en_US.UTF-8

# cat /etc/default/locale
LANG=en_US.UTF-8

# locale -a
C
C.UTF-8
en_AG
en_AG.utf8
en_AU.utf8
en_BW.utf8
en_CA.utf8
en_DK.utf8
en_GB.utf8
en_HK.utf8
en_IE.utf8
en_IN
en_IN.utf8
en_NG
en_NG.utf8
en_NZ.utf8
en_PH.utf8
en_SG.utf8
en_US.utf8
en_ZA.utf8
en_ZM
en_ZM.utf8
en_ZW.utf8
POSIX

I've even tried overriding the JAVA_OPTS variable to no avail:

# export JAVA_OPTS=-Xmx512M -Xms64M -Dfile.encoding=UTF-8
# ./dspace export -t ITEM -z 123456789_391.zip -d /tmp/ -i 123456789/391 
-n 1

I can access the file Masterthesis_Midtgård.pdf within XMLUI and via the 
REST API so I don't think it is a Tomcat issue.

Any help much appreciated.

--
Rapidly troubleshoot problems before they affect your business. Most IT 
organizations don't have a clear picture of how application performance 
affects their revenue. With AppDynamics, you get 100% visibility into your 
Java,.NET,  PHP application. Start your 15-day FREE TRIAL of AppDynamics Pro!
http://pubads.g.doubleclick.net/gampad/clk?id=84349831iu=/4140/ostg.clktrk
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

Re: [Dspace-tech] Dspace import/Replace error

[Rahman, Sm F]

Tim, I redo from the scratch, install Ubuntu to Dspace and all that and now it 
is working fine. This is a nice helping tech group and appreciate everybody's 
help on resolving this issue, thanks again, 

Faizur Rahman, Ph.D.
UTD Library Systems
972-883-4100
sm.rah...@utdallas.edu

-Original Message-
From: Tim Donohue [mailto:tdono...@duraspace.org] 
Sent: Tuesday, September 07, 2010 11:12 AM
To: Rahman, Sm F
Cc: dspace-tech@lists.sourceforge.net
Subject: Re: [Dspace-tech] Dspace import/Replace error

Faizur,

There are several ways to backup Postgres -- so, you may want to ask the 
institution what sort of file they gave you.   There are even several 
outputs possible with 'pg_dump' (see the -F format option description).

http://www.postgresql.org/docs/8.2/interactive/app-pgdump.html

By default, pg_dump gives a textual format (i.e. you should be able to 
read it in a text editor).  But, it's also possible to select a custom 
format which can only be restored using the 'pg_restore' script.

Since you don't know how this backup was created, you're likely going to 
have to ask the person who created it.  It's also possible that they 
only backed up the data, and not the full table definitions themselves 
(by default everything is backed up, but again, it depends on what flags 
they passed to the 'pg_dump' script).

Generally speaking, you need to figure out which scenarios you have:

(1) Which file format do you have?
   (1a) If you have textual backup file, you want to restore it using 
'pgsql' command (like I sent you before)
   (1b) If you have an archive file (non-textual), that can only be 
restored using the 'pg_restore' command (with the proper flags):
http://www.postgresql.org/docs/8.2/interactive/app-pgrestore.html
(2) What info is in that file?
   (2a) If you only have data (no table definitions) -- you'll have to 
first create the tables before you can restore data. So, this would mean 
you'd *have* to first install DSpace from scratch (including running 
'ant fresh_install' to create all the tables)
   (2b) If you have table definitions + data (default for Postgres) then 
you do NOT want to run that 'ant fresh_install' command.

Essentially, your best choice now is to talk to the people who gave you 
the PostgreSQL backup file to find out how they created it.  If you 
cannot talk to them, then you'll probably need to do a 'trial and error' 
process of attempting different types of PostgreSQL restores until you 
can find the one that works properly.

Good luck,

- Tim


--
Start uncovering the many advantages of virtual appliances
and start using them to simplify application deployment and
accelerate your shift to cloud computing
http://p.sf.net/sfu/novell-sfdev2dev
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech

Re: [Dspace-tech] Dspace import/Replace error

[Mark H. Wood]

If you have it, the 'file -z' command may help you to figure out what
kind of backup you have.

-- 
Mark H. Wood, Lead System Programmer   mw...@iupui.edu
Balance your desire for bells and whistles with the reality that only a 
little more than 2 percent of world population has broadband.
-- Ledford and Tyler, _Google Analytics 2.0_


pgpUMKAxcgGt5.pgp
Description: PGP signature
--
This SF.net Dev2Dev email is sponsored by:

Show off your parallel programming skills.
Enter the Intel(R) Threading Challenge 2010.
http://p.sf.net/sfu/intel-thread-sfd___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech

Re: [Dspace-tech] Dspace import/Replace error

[Tim Donohue]

Faizur,

There are several ways to backup Postgres -- so, you may want to ask the 
institution what sort of file they gave you.   There are even several 
outputs possible with 'pg_dump' (see the -F format option description).

http://www.postgresql.org/docs/8.2/interactive/app-pgdump.html

By default, pg_dump gives a textual format (i.e. you should be able to 
read it in a text editor).  But, it's also possible to select a custom 
format which can only be restored using the 'pg_restore' script.

Since you don't know how this backup was created, you're likely going to 
have to ask the person who created it.  It's also possible that they 
only backed up the data, and not the full table definitions themselves 
(by default everything is backed up, but again, it depends on what flags 
they passed to the 'pg_dump' script).

Generally speaking, you need to figure out which scenarios you have:

(1) Which file format do you have?
   (1a) If you have textual backup file, you want to restore it using 
'pgsql' command (like I sent you before)
   (1b) If you have an archive file (non-textual), that can only be 
restored using the 'pg_restore' command (with the proper flags):
http://www.postgresql.org/docs/8.2/interactive/app-pgrestore.html
(2) What info is in that file?
   (2a) If you only have data (no table definitions) -- you'll have to 
first create the tables before you can restore data. So, this would mean 
you'd *have* to first install DSpace from scratch (including running 
'ant fresh_install' to create all the tables)
   (2b) If you have table definitions + data (default for Postgres) then 
you do NOT want to run that 'ant fresh_install' command.

Essentially, your best choice now is to talk to the people who gave you 
the PostgreSQL backup file to find out how they created it.  If you 
cannot talk to them, then you'll probably need to do a 'trial and error' 
process of attempting different types of PostgreSQL restores until you 
can find the one that works properly.

Good luck,

- Tim

On 9/3/2010 9:50 AM, Rahman, Sm F wrote:
 Tim,

 Here is the scenario that might reveal any clue what am I missing here:

 I am trying to restore the backup that I got from another institution. They 
 used to host our Dspace instance. I got 2 files, one is a Postgres backup and 
 another is Assetstore. Now, digging through all the docs, I found there are 3 
 ways of dumping the data and I am assuming they gave me 'pg_dump' output what 
 I am trying to restore with no luck yet. I followed the exact same steps that 
 you described below before sending any messages in this listserv (except 
 running the init-index script) but after running the script, nothing happened 
 yet. So, do you think, they might gave me a file system level backup or 
 another type instead of 'pg_dump', at least that's what I am thinking at this 
 point of time. What else should I done? Once again, I appreciate your help, 
 thanks,

 Faizur Rahman, Ph.D.
 UTD Library Systems
 972-883-4100
 sm.rah...@utdallas.edu


 -Original Message-
 From: Tim Donohue [mailto:tdono...@duraspace.org]
 Sent: Wednesday, September 01, 2010 4:34 PM
 To: Rahman, Sm F
 Cc: dspace-tech@lists.sourceforge.net
 Subject: Re: [Dspace-tech] Dspace import/Replace error

 Faizur,

 When you did your Postgres backup, you should have run 'pg_dump' to
 create a full backup of all your DSpace DB tables. So, it should have
 been a command similar to the following:

 pg_dump -E UNICODE dspace  my-dspace-backup.sql

 (where 'dspace' is the name of your DSpace Database, and
 'my-dspace-backup.sql' is the full location of your backup file)

 So, assuming you have a backup file created by pg_dump, you should be
 able to restore it by doing the following:

 (1) ReCreate an empty 'dspace' database owned by the 'dspace' user:

 createdb -U dspace -E UNICODE dspace

 (2) Restore all of its contents from your backup file:

 psql dspace  my-dspace-backup.sql

 More information on the various Postgres commands (e.g. 'pg_dump' and
 'psql'), along with all their options are available on the PostgreSQL
 website:

 pg_dump: http://www.postgresql.org/docs/8.2/interactive/app-pgdump.html
 psql: http://www.postgresql.org/docs/8.2/interactive/app-psql.html
 createdb: http://www.postgresql.org/docs/8.2/interactive/app-createdb.html

 After you have the database restored, it's recommended to run 'dspace
 index-init' to rebuild the DSpace Browse tables  also recreate the
 Search indexes.

 I hope that helps,

 - Tim

 On 9/1/2010 4:05 PM, Rahman, Sm F wrote:
 Tim, you are correct, I don't see any content, what steps exactly should I 
 take to restore the database from backup, I want to make sure I am taking 
 the right steps to make it work, thanks again, Faizur


 -Original Message-
 From: Tim Donohue [mailto:tdono...@duraspace.org]
 Sent: Wednesday, September 01, 2010 11:32 AM
 To: Rahman, Sm F
 Cc: dspace-tech@lists.sourceforge.net
 Subject: Re: [Dspace-tech] Dspace import/Replace error

 Faizur

Re: [Dspace-tech] Dspace import/Replace error

[Rahman, Sm F]

Tim,

Here is the scenario that might reveal any clue what am I missing here:

I am trying to restore the backup that I got from another institution. They 
used to host our Dspace instance. I got 2 files, one is a Postgres backup and 
another is Assetstore. Now, digging through all the docs, I found there are 3 
ways of dumping the data and I am assuming they gave me 'pg_dump' output what I 
am trying to restore with no luck yet. I followed the exact same steps that you 
described below before sending any messages in this listserv (except running 
the init-index script) but after running the script, nothing happened yet. So, 
do you think, they might gave me a file system level backup or another type 
instead of 'pg_dump', at least that's what I am thinking at this point of time. 
What else should I done? Once again, I appreciate your help, thanks,

Faizur Rahman, Ph.D.
UTD Library Systems
972-883-4100
sm.rah...@utdallas.edu


-Original Message-
From: Tim Donohue [mailto:tdono...@duraspace.org]
Sent: Wednesday, September 01, 2010 4:34 PM
To: Rahman, Sm F
Cc: dspace-tech@lists.sourceforge.net
Subject: Re: [Dspace-tech] Dspace import/Replace error

Faizur,

When you did your Postgres backup, you should have run 'pg_dump' to
create a full backup of all your DSpace DB tables. So, it should have
been a command similar to the following:

pg_dump -E UNICODE dspace  my-dspace-backup.sql

(where 'dspace' is the name of your DSpace Database, and
'my-dspace-backup.sql' is the full location of your backup file)

So, assuming you have a backup file created by pg_dump, you should be
able to restore it by doing the following:

(1) ReCreate an empty 'dspace' database owned by the 'dspace' user:

createdb -U dspace -E UNICODE dspace

(2) Restore all of its contents from your backup file:

psql dspace  my-dspace-backup.sql

More information on the various Postgres commands (e.g. 'pg_dump' and
'psql'), along with all their options are available on the PostgreSQL
website:

pg_dump: http://www.postgresql.org/docs/8.2/interactive/app-pgdump.html
psql: http://www.postgresql.org/docs/8.2/interactive/app-psql.html
createdb: http://www.postgresql.org/docs/8.2/interactive/app-createdb.html

After you have the database restored, it's recommended to run 'dspace
index-init' to rebuild the DSpace Browse tables  also recreate the
Search indexes.

I hope that helps,

- Tim

On 9/1/2010 4:05 PM, Rahman, Sm F wrote:
 Tim, you are correct, I don't see any content, what steps exactly should I 
 take to restore the database from backup, I want to make sure I am taking the 
 right steps to make it work, thanks again, Faizur


 -Original Message-
 From: Tim Donohue [mailto:tdono...@duraspace.org]
 Sent: Wednesday, September 01, 2010 11:32 AM
 To: Rahman, Sm F
 Cc: dspace-tech@lists.sourceforge.net
 Subject: Re: [Dspace-tech] Dspace import/Replace error

 Faizur,

 It looks like your Database did not restore properly.  It's saying you
 have no community table (which is one of the main tables in DSpace).
 Have you verified that your DSpace database actually has contents in it
 after your attempted restore?  If it has no contents, then obviously
 your database restore didn't work, and that's why DSpace is not
 functioning properly.

 - Tim

 On 9/1/2010 9:54 AM, Rahman, Sm F wrote:
 Tim/Claudia,

 Here is what I am getting after running the index-init script, any 
 suggestions? Thanks, Faizur

 dsp...@ubuntu:~/bin$ ./index-init
 Creating browse index
 Exception in thread main org.dspace.browse.BrowseException: 
 org.postgresql.util.PSQLException: ERROR: no schema has been selected to 
 create in
   at 
 org.dspace.browse.BrowseCreateDAOPostgres.createSequence(BrowseCreateDAOPostgres.java:394)
   at 
 org.dspace.browse.IndexBrowse.createItemTables(IndexBrowse.java:952)
   at 
 org.dspace.browse.IndexBrowse.createItemTables(IndexBrowse.java:921)
   at org.dspace.browse.IndexBrowse.prepTables(IndexBrowse.java:739)
   at org.dspace.browse.IndexBrowse.initBrowse(IndexBrowse.java:1045)
   at org.dspace.browse.IndexBrowse.main(IndexBrowse.java:707)
 Caused by: org.postgresql.util.PSQLException: ERROR: no schema has been 
 selected to create in
   at 
 org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:1531)
   at 
 org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1313)
   at 
 org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:188)
   at 
 org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:452)
   at 
 org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:354)
   at 
 org.postgresql.jdbc2.AbstractJdbc2Statement.executeUpdate(AbstractJdbc2Statement.java:308)
   at 
 org.apache.commons.dbcp.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:102

Re: [Dspace-tech] Dspace import/Replace error

[Claudia Jürgen]

Hello Faizur,

the error indicates that you forgot to run:
[dspace]/bin/dspace index-init

Hope that helps

Claudia Jürgen


Am 01.09.2010 00:39, schrieb Rahman, Sm F:
 Tim,

 I am sorry that I only hit reply instead of reply all which caused not to 
 send the email to Dspace-tech.

 Here is the Cocoon log with Errors:

 Caused by: org.postgresql.util.PSQLException: ERROR: current transaction is 
 aborted, commands ignored until end of transaction block
  at 
 org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:1531)

 Here is the Postgres log with Errors:

 2010-08-30 15:59:57 CDT ERROR:  relation bi_item does not exist
 2010-08-30 15:59:57 CDT STATEMENT:  SELECT  COUNT(*) AS num FROM bi_item
 2010-08-30 16:00:00 CDT ERROR:  relation bi_2_dis does not exist
 2010-08-30 16:00:00 CDT STATEMENT:  SELECT  COUNT(*) AS num FROM bi_2_dis
 2010-08-30 16:00:03 CDT ERROR:  relation bi_item does not exist
 2010-08-30 16:00:03 CDT STATEMENT:  SELECT  COUNT(*) AS num FROM bi_item
 2010-08-30 16:00:09 CDT ERROR:  relation community does not exist
 2010-08-30 16:00:09 CDT STATEMENT:  SELECT * FROM community WHERE NOT 
 community_id IN (SELECT child_comm_id FROM community2community) ORDER BY name
 2010-08-30 16:00:09 CDT ERROR:  current transaction is aborted, commands 
 ignored until end of transaction block
 2010-08-30 16:00:09 CDT STATEMENT:  SELECT * FROM community WHERE NOT 
 community_id IN (SELECT child_comm_id FROM community2community) ORDER BY name
 2010-08-30 16:00:11 CDT ERROR:  relation bi_item does not exist
 2010-08-30 16:00:11 CDT STATEMENT:  SELECT  COUNT(*) AS num FROM bi_item
 2010-08-30 16:00:28 CDT ERROR:  relation bi_4_dis does not exist
 2010-08-30 16:00:28 CDT STATEMENT:  SELECT  COUNT(*) AS num FROM bi_4_dis
 2010-08-30 20:02:01 CDT LOG:  incomplete startup packet
 2010-08-31 00:02:01 CDT LOG:  incomplete startup packet
 2010-08-31 05:02:01 CDT LOG:  incomplete startup packet
 2010-08-31 10:02:01 CDT LOG:  incomplete startup packet
 2010-08-31 13:53:53 CDT ERROR:  relation eperson does not exist
 2010-08-31 13:53:53 CDT STATEMENT:  select * from eperson where email = $1
 2010-08-31 13:53:56 CDT ERROR:  relation community does not exist

 Don't see any error in tomcat log

 I think the import didn't go through correctly, what do you think and how to 
 encouter this problem?

 Thanks,

 Faizur

 -Original Message-
 From: Tim Donohue [mailto:tdono...@duraspace.org]
 Sent: Tuesday, August 31, 2010 2:42 PM
 To: Rahman, Sm F
 Cc: dspace-tech
 Subject: Re: [Dspace-tech] Dspace import/Replace error

 Faizur,

 I'm copying in 'dspace-tech' again on my response.  We prefer to answer
 questions on the listserv itself, as it is then a resource for others
 who may end up experiencing the same issue.

 Your dspace.log file output looks normal.  Those lines of the log that
 you sent are just showing that you accessed the main homepage (or
 possibly the Community listing), which ran queries to determine which
 communities to display on that homepage.  There are no ERROR lines in
 that log (where it says DEBUG or INFO, you should see ERROR when a
 problem occurs).

 You may want to also check the Tomcat logs and PostgreSQL logs.
 Especially look to see what is logged when you see that An error has
 occurred message -- there should be a log file line somewhere with
 ERROR in it.  Again this webpage will detail the location of your
 logs: https://wiki.duraspace.org/display/DSPACE/Troubleshoot+an+error

 - Tim

 On 8/31/2010 2:23 PM, Rahman, Sm F wrote:
 Tim,

 Thanks again for offering the help, I restored the DB from backup and 
 replace the Assetstore but giving me the same error. I went through the 
 Troubleshoot instructions that you sent me, changed the config file and here 
 is what looks like in the Dspace log. Here is the instance at: 
 http://10.110.33.25:8180/xmlui/password-login

 Dspace log:

 2010-08-31 13:55:20,089 DEBUG org.dspace.storage.rdbms.DatabaseManager @ 
 Running query SELECT * FROM community WHERE NOT community_id IN (SELECT 
 child_comm_id FROM community2community) ORDER BY name  with parameters:
 2010-08-31 13:55:20,089 DEBUG org.dspace.storage.rdbms.DatabaseManager @ 
 Running query SELECT * FROM community WHERE NOT community_id IN (SELECT 
 child_comm_id FROM community2community) ORDER BY name  with parameters:
 2010-08-31 14:00:00,154 DEBUG org.dspace.storage.rdbms.DatabaseManager @ 
 Running query SELECT * FROM community WHERE NOT community_id IN (SELECT 
 child_comm_id FROM community2community) ORDER BY name  with parameters:
 2010-08-31 14:00:00,154 DEBUG org.dspace.storage.rdbms.DatabaseManager @ 
 Running query SELECT * FROM community WHERE NOT community_id IN (SELECT 
 child_comm_id FROM community2community) ORDER BY name  with parameters:
 2010-08-31 14:00:00,155 INFO  
 org.dspace.app.xmlui.aspect.artifactbrowser.CommunityBrowser @ 
 anonymous:session_id=E21866AE973E650DA0637719BE83BE00:ip_addr=10.110.33.126:view_community_list

Re: [Dspace-tech] Dspace import/Replace error

[Tim Donohue]

Faizur,

Claudia's correct -- running that 'dspace index-init' command is 
necessary.  Its purpose is to rebuild your Browse tables (which all 
begin bi_ -- based on your Postgres logs, those tables may be 
missing).  It's usually best practice to re-run that 'index-init' 
command after a restore (I overlooked that it wasn't in your restore steps).

If that still doesn't resolve things, you may want to take a closer look 
at your database tables to make sure the database is being restored 
properly.

- Tim

On 9/1/2010 1:46 AM, Claudia Jürgen wrote:
 Hello Faizur,

 the error indicates that you forgot to run:
 [dspace]/bin/dspace index-init

 Hope that helps

 Claudia Jürgen


 Am 01.09.2010 00:39, schrieb Rahman, Sm F:
 Tim,

 I am sorry that I only hit reply instead of reply all which caused not 
 to send the email to Dspace-tech.

 Here is the Cocoon log with Errors:

 Caused by: org.postgresql.util.PSQLException: ERROR: current transaction is 
 aborted, commands ignored until end of transaction block
   at 
 org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:1531)

 Here is the Postgres log with Errors:

 2010-08-30 15:59:57 CDT ERROR:  relation bi_item does not exist
 2010-08-30 15:59:57 CDT STATEMENT:  SELECT  COUNT(*) AS num FROM bi_item
 2010-08-30 16:00:00 CDT ERROR:  relation bi_2_dis does not exist
 2010-08-30 16:00:00 CDT STATEMENT:  SELECT  COUNT(*) AS num FROM bi_2_dis
 2010-08-30 16:00:03 CDT ERROR:  relation bi_item does not exist
 2010-08-30 16:00:03 CDT STATEMENT:  SELECT  COUNT(*) AS num FROM bi_item
 2010-08-30 16:00:09 CDT ERROR:  relation community does not exist
 2010-08-30 16:00:09 CDT STATEMENT:  SELECT * FROM community WHERE NOT 
 community_id IN (SELECT child_comm_id FROM community2community) ORDER BY name
 2010-08-30 16:00:09 CDT ERROR:  current transaction is aborted, commands 
 ignored until end of transaction block
 2010-08-30 16:00:09 CDT STATEMENT:  SELECT * FROM community WHERE NOT 
 community_id IN (SELECT child_comm_id FROM community2community) ORDER BY name
 2010-08-30 16:00:11 CDT ERROR:  relation bi_item does not exist
 2010-08-30 16:00:11 CDT STATEMENT:  SELECT  COUNT(*) AS num FROM bi_item
 2010-08-30 16:00:28 CDT ERROR:  relation bi_4_dis does not exist
 2010-08-30 16:00:28 CDT STATEMENT:  SELECT  COUNT(*) AS num FROM bi_4_dis
 2010-08-30 20:02:01 CDT LOG:  incomplete startup packet
 2010-08-31 00:02:01 CDT LOG:  incomplete startup packet
 2010-08-31 05:02:01 CDT LOG:  incomplete startup packet
 2010-08-31 10:02:01 CDT LOG:  incomplete startup packet
 2010-08-31 13:53:53 CDT ERROR:  relation eperson does not exist
 2010-08-31 13:53:53 CDT STATEMENT:  select * from eperson where email = $1
 2010-08-31 13:53:56 CDT ERROR:  relation community does not exist

 Don't see any error in tomcat log

 I think the import didn't go through correctly, what do you think and how to 
 encouter this problem?

 Thanks,

 Faizur

 -Original Message-
 From: Tim Donohue [mailto:tdono...@duraspace.org]
 Sent: Tuesday, August 31, 2010 2:42 PM
 To: Rahman, Sm F
 Cc: dspace-tech
 Subject: Re: [Dspace-tech] Dspace import/Replace error

 Faizur,

 I'm copying in 'dspace-tech' again on my response.  We prefer to answer
 questions on the listserv itself, as it is then a resource for others
 who may end up experiencing the same issue.

 Your dspace.log file output looks normal.  Those lines of the log that
 you sent are just showing that you accessed the main homepage (or
 possibly the Community listing), which ran queries to determine which
 communities to display on that homepage.  There are no ERROR lines in
 that log (where it says DEBUG or INFO, you should see ERROR when a
 problem occurs).

 You may want to also check the Tomcat logs and PostgreSQL logs.
 Especially look to see what is logged when you see that An error has
 occurred message -- there should be a log file line somewhere with
 ERROR in it.  Again this webpage will detail the location of your
 logs: https://wiki.duraspace.org/display/DSPACE/Troubleshoot+an+error

 - Tim

 On 8/31/2010 2:23 PM, Rahman, Sm F wrote:
 Tim,

 Thanks again for offering the help, I restored the DB from backup and 
 replace the Assetstore but giving me the same error. I went through the 
 Troubleshoot instructions that you sent me, changed the config file and 
 here is what looks like in the Dspace log. Here is the instance at: 
 http://10.110.33.25:8180/xmlui/password-login

 Dspace log:

 2010-08-31 13:55:20,089 DEBUG org.dspace.storage.rdbms.DatabaseManager @ 
 Running query SELECT * FROM community WHERE NOT community_id IN (SELECT 
 child_comm_id FROM community2community) ORDER BY name  with parameters:
 2010-08-31 13:55:20,089 DEBUG org.dspace.storage.rdbms.DatabaseManager @ 
 Running query SELECT * FROM community WHERE NOT community_id IN (SELECT 
 child_comm_id FROM community2community) ORDER BY name  with parameters:
 2010-08-31 14:00:00,154 DEBUG org.dspace.storage.rdbms.DatabaseManager

Re: [Dspace-tech] Dspace import/Replace error

[Rahman, Sm F]

Tim/Claudia,

Here is what I am getting after running the index-init script, any suggestions? 
Thanks, Faizur

dsp...@ubuntu:~/bin$ ./index-init
Creating browse index
Exception in thread main org.dspace.browse.BrowseException: 
org.postgresql.util.PSQLException: ERROR: no schema has been selected to create 
in
at 
org.dspace.browse.BrowseCreateDAOPostgres.createSequence(BrowseCreateDAOPostgres.java:394)
at org.dspace.browse.IndexBrowse.createItemTables(IndexBrowse.java:952)
at org.dspace.browse.IndexBrowse.createItemTables(IndexBrowse.java:921)
at org.dspace.browse.IndexBrowse.prepTables(IndexBrowse.java:739)
at org.dspace.browse.IndexBrowse.initBrowse(IndexBrowse.java:1045)
at org.dspace.browse.IndexBrowse.main(IndexBrowse.java:707)
Caused by: org.postgresql.util.PSQLException: ERROR: no schema has been 
selected to create in
at 
org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:1531)
at 
org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1313)
at 
org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:188)
at 
org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:452)
at 
org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:354)
at 
org.postgresql.jdbc2.AbstractJdbc2Statement.executeUpdate(AbstractJdbc2Statement.java:308)
at 
org.apache.commons.dbcp.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:102)
at 
org.apache.commons.dbcp.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:102)
at 
org.dspace.storage.rdbms.DatabaseManager.updateQuery(DatabaseManager.java:390)
at 
org.dspace.browse.BrowseCreateDAOPostgres.createSequence(BrowseCreateDAOPostgres.java:387)
... 5 more
Exception in thread main org.dspace.browse.ItemCountException: 
org.postgresql.util.PSQLException: ERROR: relation community does not exist
at org.dspace.browse.ItemCounter.buildItemCounts(ItemCounter.java:124)
at org.dspace.browse.ItemCounter.main(ItemCounter.java:85)
Caused by: org.postgresql.util.PSQLException: ERROR: relation community does 
not exist
at 
org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:1531)
at 
org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1313)
at 
org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:188)
at 
org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:452)
at 
org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:354)
at 
org.postgresql.jdbc2.AbstractJdbc2Statement.executeQuery(AbstractJdbc2Statement.java:258)
at 
org.apache.commons.dbcp.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:93)
at 
org.apache.commons.dbcp.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:93)
at 
org.dspace.storage.rdbms.DatabaseManager.queryTable(DatabaseManager.java:169)
at org.dspace.content.Community.findAllTop(Community.java:286)
at org.dspace.browse.ItemCounter.buildItemCounts(ItemCounter.java:115)
... 1 more
Creating search index

Faizur Rahman, Ph.D.
UTD Library Systems
972-883-4100
sm.rah...@utdallas.edu

-Original Message-
From: Tim Donohue [mailto:tdono...@duraspace.org] 
Sent: Wednesday, September 01, 2010 9:05 AM
To: claudia.juer...@ub.tu-dortmund.de
Cc: dspace-tech@lists.sourceforge.net
Subject: Re: [Dspace-tech] Dspace import/Replace error

Faizur,

Claudia's correct -- running that 'dspace index-init' command is 
necessary.  Its purpose is to rebuild your Browse tables (which all 
begin bi_ -- based on your Postgres logs, those tables may be 
missing).  It's usually best practice to re-run that 'index-init' 
command after a restore (I overlooked that it wasn't in your restore steps).

If that still doesn't resolve things, you may want to take a closer look 
at your database tables to make sure the database is being restored 
properly.

- Tim

On 9/1/2010 1:46 AM, Claudia Jürgen wrote:
 Hello Faizur,

 the error indicates that you forgot to run:
 [dspace]/bin/dspace index-init

 Hope that helps

 Claudia Jürgen


 Am 01.09.2010 00:39, schrieb Rahman, Sm F:
 Tim,

 I am sorry that I only hit reply instead of reply all which caused not 
 to send the email to Dspace-tech.

 Here is the Cocoon log with Errors:

 Caused by: org.postgresql.util.PSQLException: ERROR: current transaction is 
 aborted, commands ignored until end of transaction block
   at 
 org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:1531)

 Here is the Postgres log with Errors:

 2010-08-30 15:59:57 CDT ERROR:  relation bi_item does not exist
 2010-08-30 15:59:57 CDT

Re: [Dspace-tech] Dspace import/Replace error

[Tim Donohue]

Faizur,

It looks like your Database did not restore properly.  It's saying you 
have no community table (which is one of the main tables in DSpace). 
Have you verified that your DSpace database actually has contents in it 
after your attempted restore?  If it has no contents, then obviously 
your database restore didn't work, and that's why DSpace is not 
functioning properly.

- Tim

On 9/1/2010 9:54 AM, Rahman, Sm F wrote:
 Tim/Claudia,

 Here is what I am getting after running the index-init script, any 
 suggestions? Thanks, Faizur

 dsp...@ubuntu:~/bin$ ./index-init
 Creating browse index
 Exception in thread main org.dspace.browse.BrowseException: 
 org.postgresql.util.PSQLException: ERROR: no schema has been selected to 
 create in
  at 
 org.dspace.browse.BrowseCreateDAOPostgres.createSequence(BrowseCreateDAOPostgres.java:394)
  at 
 org.dspace.browse.IndexBrowse.createItemTables(IndexBrowse.java:952)
  at 
 org.dspace.browse.IndexBrowse.createItemTables(IndexBrowse.java:921)
  at org.dspace.browse.IndexBrowse.prepTables(IndexBrowse.java:739)
  at org.dspace.browse.IndexBrowse.initBrowse(IndexBrowse.java:1045)
  at org.dspace.browse.IndexBrowse.main(IndexBrowse.java:707)
 Caused by: org.postgresql.util.PSQLException: ERROR: no schema has been 
 selected to create in
  at 
 org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:1531)
  at 
 org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1313)
  at 
 org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:188)
  at 
 org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:452)
  at 
 org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:354)
  at 
 org.postgresql.jdbc2.AbstractJdbc2Statement.executeUpdate(AbstractJdbc2Statement.java:308)
  at 
 org.apache.commons.dbcp.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:102)
  at 
 org.apache.commons.dbcp.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:102)
  at 
 org.dspace.storage.rdbms.DatabaseManager.updateQuery(DatabaseManager.java:390)
  at 
 org.dspace.browse.BrowseCreateDAOPostgres.createSequence(BrowseCreateDAOPostgres.java:387)
  ... 5 more
 Exception in thread main org.dspace.browse.ItemCountException: 
 org.postgresql.util.PSQLException: ERROR: relation community does not exist
  at 
 org.dspace.browse.ItemCounter.buildItemCounts(ItemCounter.java:124)
  at org.dspace.browse.ItemCounter.main(ItemCounter.java:85)
 Caused by: org.postgresql.util.PSQLException: ERROR: relation community 
 does not exist
  at 
 org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:1531)
  at 
 org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1313)
  at 
 org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:188)
  at 
 org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:452)
  at 
 org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:354)
  at 
 org.postgresql.jdbc2.AbstractJdbc2Statement.executeQuery(AbstractJdbc2Statement.java:258)
  at 
 org.apache.commons.dbcp.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:93)
  at 
 org.apache.commons.dbcp.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:93)
  at 
 org.dspace.storage.rdbms.DatabaseManager.queryTable(DatabaseManager.java:169)
  at org.dspace.content.Community.findAllTop(Community.java:286)
  at 
 org.dspace.browse.ItemCounter.buildItemCounts(ItemCounter.java:115)
  ... 1 more
 Creating search index

 Faizur Rahman, Ph.D.
 UTD Library Systems
 972-883-4100
 sm.rah...@utdallas.edu

 -Original Message-
 From: Tim Donohue [mailto:tdono...@duraspace.org]
 Sent: Wednesday, September 01, 2010 9:05 AM
 To: claudia.juer...@ub.tu-dortmund.de
 Cc: dspace-tech@lists.sourceforge.net
 Subject: Re: [Dspace-tech] Dspace import/Replace error

 Faizur,

 Claudia's correct -- running that 'dspace index-init' command is
 necessary.  Its purpose is to rebuild your Browse tables (which all
 begin bi_ -- based on your Postgres logs, those tables may be
 missing).  It's usually best practice to re-run that 'index-init'
 command after a restore (I overlooked that it wasn't in your restore steps).

 If that still doesn't resolve things, you may want to take a closer look
 at your database tables to make sure the database is being restored
 properly.

 - Tim

 On 9/1/2010 1:46 AM, Claudia Jürgen wrote:
 Hello Faizur,

 the error indicates that you forgot to run:
 [dspace]/bin/dspace index-init

 Hope that helps

 Claudia Jürgen


 Am 01.09.2010 00:39

Re: [Dspace-tech] Dspace import/Replace error

[Rahman, Sm F]

Tim, you are correct, I don't see any content, what steps exactly should I take 
to restore the database from backup, I want to make sure I am taking the right 
steps to make it work, thanks again, Faizur


-Original Message-
From: Tim Donohue [mailto:tdono...@duraspace.org]
Sent: Wednesday, September 01, 2010 11:32 AM
To: Rahman, Sm F
Cc: dspace-tech@lists.sourceforge.net
Subject: Re: [Dspace-tech] Dspace import/Replace error

Faizur,

It looks like your Database did not restore properly.  It's saying you
have no community table (which is one of the main tables in DSpace).
Have you verified that your DSpace database actually has contents in it
after your attempted restore?  If it has no contents, then obviously
your database restore didn't work, and that's why DSpace is not
functioning properly.

- Tim

On 9/1/2010 9:54 AM, Rahman, Sm F wrote:
 Tim/Claudia,

 Here is what I am getting after running the index-init script, any 
 suggestions? Thanks, Faizur

 dsp...@ubuntu:~/bin$ ./index-init
 Creating browse index
 Exception in thread main org.dspace.browse.BrowseException: 
 org.postgresql.util.PSQLException: ERROR: no schema has been selected to 
 create in
  at 
 org.dspace.browse.BrowseCreateDAOPostgres.createSequence(BrowseCreateDAOPostgres.java:394)
  at 
 org.dspace.browse.IndexBrowse.createItemTables(IndexBrowse.java:952)
  at 
 org.dspace.browse.IndexBrowse.createItemTables(IndexBrowse.java:921)
  at org.dspace.browse.IndexBrowse.prepTables(IndexBrowse.java:739)
  at org.dspace.browse.IndexBrowse.initBrowse(IndexBrowse.java:1045)
  at org.dspace.browse.IndexBrowse.main(IndexBrowse.java:707)
 Caused by: org.postgresql.util.PSQLException: ERROR: no schema has been 
 selected to create in
  at 
 org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:1531)
  at 
 org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1313)
  at 
 org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:188)
  at 
 org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:452)
  at 
 org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:354)
  at 
 org.postgresql.jdbc2.AbstractJdbc2Statement.executeUpdate(AbstractJdbc2Statement.java:308)
  at 
 org.apache.commons.dbcp.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:102)
  at 
 org.apache.commons.dbcp.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:102)
  at 
 org.dspace.storage.rdbms.DatabaseManager.updateQuery(DatabaseManager.java:390)
  at 
 org.dspace.browse.BrowseCreateDAOPostgres.createSequence(BrowseCreateDAOPostgres.java:387)
  ... 5 more
 Exception in thread main org.dspace.browse.ItemCountException: 
 org.postgresql.util.PSQLException: ERROR: relation community does not exist
  at 
 org.dspace.browse.ItemCounter.buildItemCounts(ItemCounter.java:124)
  at org.dspace.browse.ItemCounter.main(ItemCounter.java:85)
 Caused by: org.postgresql.util.PSQLException: ERROR: relation community 
 does not exist
  at 
 org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:1531)
  at 
 org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1313)
  at 
 org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:188)
  at 
 org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:452)
  at 
 org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:354)
  at 
 org.postgresql.jdbc2.AbstractJdbc2Statement.executeQuery(AbstractJdbc2Statement.java:258)
  at 
 org.apache.commons.dbcp.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:93)
  at 
 org.apache.commons.dbcp.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:93)
  at 
 org.dspace.storage.rdbms.DatabaseManager.queryTable(DatabaseManager.java:169)
  at org.dspace.content.Community.findAllTop(Community.java:286)
  at 
 org.dspace.browse.ItemCounter.buildItemCounts(ItemCounter.java:115)
  ... 1 more
 Creating search index

 Faizur Rahman, Ph.D.
 UTD Library Systems
 972-883-4100
 sm.rah...@utdallas.edu

 -Original Message-
 From: Tim Donohue [mailto:tdono...@duraspace.org]
 Sent: Wednesday, September 01, 2010 9:05 AM
 To: claudia.juer...@ub.tu-dortmund.de
 Cc: dspace-tech@lists.sourceforge.net
 Subject: Re: [Dspace-tech] Dspace import/Replace error

 Faizur,

 Claudia's correct -- running that 'dspace index-init' command is
 necessary.  Its purpose is to rebuild your Browse tables (which all
 begin bi_ -- based on your Postgres logs, those tables may be
 missing).  It's usually best practice to re-run that 'index-init

Re: [Dspace-tech] Dspace import/Replace error

[Tim Donohue]

Faizur,

When you did your Postgres backup, you should have run 'pg_dump' to 
create a full backup of all your DSpace DB tables. So, it should have 
been a command similar to the following:

pg_dump -E UNICODE dspace  my-dspace-backup.sql

(where 'dspace' is the name of your DSpace Database, and 
'my-dspace-backup.sql' is the full location of your backup file)

So, assuming you have a backup file created by pg_dump, you should be 
able to restore it by doing the following:

(1) ReCreate an empty 'dspace' database owned by the 'dspace' user:

createdb -U dspace -E UNICODE dspace

(2) Restore all of its contents from your backup file:

psql dspace  my-dspace-backup.sql

More information on the various Postgres commands (e.g. 'pg_dump' and 
'psql'), along with all their options are available on the PostgreSQL 
website:

pg_dump: http://www.postgresql.org/docs/8.2/interactive/app-pgdump.html
psql: http://www.postgresql.org/docs/8.2/interactive/app-psql.html
createdb: http://www.postgresql.org/docs/8.2/interactive/app-createdb.html

After you have the database restored, it's recommended to run 'dspace 
index-init' to rebuild the DSpace Browse tables  also recreate the 
Search indexes.

I hope that helps,

- Tim

On 9/1/2010 4:05 PM, Rahman, Sm F wrote:
 Tim, you are correct, I don't see any content, what steps exactly should I 
 take to restore the database from backup, I want to make sure I am taking the 
 right steps to make it work, thanks again, Faizur


 -Original Message-
 From: Tim Donohue [mailto:tdono...@duraspace.org]
 Sent: Wednesday, September 01, 2010 11:32 AM
 To: Rahman, Sm F
 Cc: dspace-tech@lists.sourceforge.net
 Subject: Re: [Dspace-tech] Dspace import/Replace error

 Faizur,

 It looks like your Database did not restore properly.  It's saying you
 have no community table (which is one of the main tables in DSpace).
 Have you verified that your DSpace database actually has contents in it
 after your attempted restore?  If it has no contents, then obviously
 your database restore didn't work, and that's why DSpace is not
 functioning properly.

 - Tim

 On 9/1/2010 9:54 AM, Rahman, Sm F wrote:
 Tim/Claudia,

 Here is what I am getting after running the index-init script, any 
 suggestions? Thanks, Faizur

 dsp...@ubuntu:~/bin$ ./index-init
 Creating browse index
 Exception in thread main org.dspace.browse.BrowseException: 
 org.postgresql.util.PSQLException: ERROR: no schema has been selected to 
 create in
   at 
 org.dspace.browse.BrowseCreateDAOPostgres.createSequence(BrowseCreateDAOPostgres.java:394)
   at 
 org.dspace.browse.IndexBrowse.createItemTables(IndexBrowse.java:952)
   at 
 org.dspace.browse.IndexBrowse.createItemTables(IndexBrowse.java:921)
   at org.dspace.browse.IndexBrowse.prepTables(IndexBrowse.java:739)
   at org.dspace.browse.IndexBrowse.initBrowse(IndexBrowse.java:1045)
   at org.dspace.browse.IndexBrowse.main(IndexBrowse.java:707)
 Caused by: org.postgresql.util.PSQLException: ERROR: no schema has been 
 selected to create in
   at 
 org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:1531)
   at 
 org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1313)
   at 
 org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:188)
   at 
 org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:452)
   at 
 org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:354)
   at 
 org.postgresql.jdbc2.AbstractJdbc2Statement.executeUpdate(AbstractJdbc2Statement.java:308)
   at 
 org.apache.commons.dbcp.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:102)
   at 
 org.apache.commons.dbcp.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:102)
   at 
 org.dspace.storage.rdbms.DatabaseManager.updateQuery(DatabaseManager.java:390)
   at 
 org.dspace.browse.BrowseCreateDAOPostgres.createSequence(BrowseCreateDAOPostgres.java:387)
   ... 5 more
 Exception in thread main org.dspace.browse.ItemCountException: 
 org.postgresql.util.PSQLException: ERROR: relation community does not exist
   at 
 org.dspace.browse.ItemCounter.buildItemCounts(ItemCounter.java:124)
   at org.dspace.browse.ItemCounter.main(ItemCounter.java:85)
 Caused by: org.postgresql.util.PSQLException: ERROR: relation community 
 does not exist
   at 
 org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:1531)
   at 
 org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1313)
   at 
 org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:188)
   at 
 org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:452)
   at 
 org.postgresql.jdbc2

Re: [Dspace-tech] Dspace import/Replace error

[Tim Donohue]

Faizur,

Your steps sound correct.  All you need to do is restore your complete 
database from backup, and replace your Assetstore directory with the one 
from backup. Assuming your Database backup and Assetstore backup are 
from around the same time (doesn't need to be exact), everything should 
work fine.

Can you check your underlying log files to see if any other errors are 
reported there?  Please see the How to Troubleshoot an Error page for 
information about finding the error in the log files:
https://wiki.duraspace.org/display/DSPACE/Troubleshoot+an+error

- Tim

On 8/30/2010 3:52 PM, Rahman, Sm F wrote:
 Respected all,

 I am new in Dspace and Postgres and I am having trouble importing and
 replacing the existing dspace AssetStore and Postgress database using
 the backups. The steps I am following are:

 1) Stop tomcat

 2) Drop and recreate the dspace database

 3) Restore the data from the backup

 4) Update dspace sequences: [dspace-source]/dspace/etc/update-sequences.sql

 5) Delete existing AssetStore

 6) Restore the AssetStore from the backup

 7) Start tomcat.

 The error I am getting after clicking the communities are:

 *An error has occured*

 *org.postgresql.util.PSQLException: ERROR: current transaction is
 aborted, commands ignored until end of transaction block*

 * *

 *Cocoon stacktrace*

 *Java stacktrace *

 *Java full stacktrace*

 Thanks,

 Faizur Rahman, Ph.D.

 UTD Library Systems

 972-883-4100

 sm.rah...@utdallas.edu



 --
 This SF.net Dev2Dev email is sponsored by:

 Show off your parallel programming skills.
 Enter the Intel(R) Threading Challenge 2010.
 http://p.sf.net/sfu/intel-thread-sfd



 ___
 DSpace-tech mailing list
 DSpace-tech@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/dspace-tech

--
This SF.net Dev2Dev email is sponsored by:

Show off your parallel programming skills.
Enter the Intel(R) Threading Challenge 2010.
http://p.sf.net/sfu/intel-thread-sfd
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech

Re: [Dspace-tech] Dspace import/Replace error

[Tim Donohue]

Faizur,

I'm copying in 'dspace-tech' again on my response.  We prefer to answer 
questions on the listserv itself, as it is then a resource for others 
who may end up experiencing the same issue.

Your dspace.log file output looks normal.  Those lines of the log that 
you sent are just showing that you accessed the main homepage (or 
possibly the Community listing), which ran queries to determine which 
communities to display on that homepage.  There are no ERROR lines in 
that log (where it says DEBUG or INFO, you should see ERROR when a 
problem occurs).

You may want to also check the Tomcat logs and PostgreSQL logs. 
Especially look to see what is logged when you see that An error has 
occurred message -- there should be a log file line somewhere with 
ERROR in it.  Again this webpage will detail the location of your 
logs: https://wiki.duraspace.org/display/DSPACE/Troubleshoot+an+error

- Tim

On 8/31/2010 2:23 PM, Rahman, Sm F wrote:
 Tim,

 Thanks again for offering the help, I restored the DB from backup and replace 
 the Assetstore but giving me the same error. I went through the Troubleshoot 
 instructions that you sent me, changed the config file and here is what looks 
 like in the Dspace log. Here is the instance at: 
 http://10.110.33.25:8180/xmlui/password-login

 Dspace log:

 2010-08-31 13:55:20,089 DEBUG org.dspace.storage.rdbms.DatabaseManager @ 
 Running query SELECT * FROM community WHERE NOT community_id IN (SELECT 
 child_comm_id FROM community2community) ORDER BY name  with parameters:
 2010-08-31 13:55:20,089 DEBUG org.dspace.storage.rdbms.DatabaseManager @ 
 Running query SELECT * FROM community WHERE NOT community_id IN (SELECT 
 child_comm_id FROM community2community) ORDER BY name  with parameters:
 2010-08-31 14:00:00,154 DEBUG org.dspace.storage.rdbms.DatabaseManager @ 
 Running query SELECT * FROM community WHERE NOT community_id IN (SELECT 
 child_comm_id FROM community2community) ORDER BY name  with parameters:
 2010-08-31 14:00:00,154 DEBUG org.dspace.storage.rdbms.DatabaseManager @ 
 Running query SELECT * FROM community WHERE NOT community_id IN (SELECT 
 child_comm_id FROM community2community) ORDER BY name  with parameters:
 2010-08-31 14:00:00,155 INFO  
 org.dspace.app.xmlui.aspect.artifactbrowser.CommunityBrowser @ 
 anonymous:session_id=E21866AE973E650DA0637719BE83BE00:ip_addr=10.110.33.126:view_community_list:
 2010-08-31 14:00:00,157 DEBUG org.dspace.storage.rdbms.DatabaseManager @ 
 Running query SELECT * FROM community WHERE NOT community_id IN (SELECT 
 child_comm_id FROM community2community) ORDER BY name  with parameters:
 2010-08-31 14:00:00,157 DEBUG org.dspace.storage.rdbms.DatabaseManager @ 
 Running query SELECT * FROM community WHERE NOT community_id IN (SELECT 
 child_comm_id FROM community2community) ORDER BY name  with parameters:

 Thanks again, Faizur

 -Original Message-
 From: Tim Donohue [mailto:tdono...@duraspace.org]
 Sent: Tuesday, August 31, 2010 9:36 AM
 To: Rahman, Sm F
 Cc: dspace-tech@lists.sourceforge.net
 Subject: Re: [Dspace-tech] Dspace import/Replace error

 Faizur,

 Your steps sound correct.  All you need to do is restore your complete
 database from backup, and replace your Assetstore directory with the one
 from backup. Assuming your Database backup and Assetstore backup are
 from around the same time (doesn't need to be exact), everything should
 work fine.

 Can you check your underlying log files to see if any other errors are
 reported there?  Please see the How to Troubleshoot an Error page for
 information about finding the error in the log files:
 https://wiki.duraspace.org/display/DSPACE/Troubleshoot+an+error

 - Tim

 On 8/30/2010 3:52 PM, Rahman, Sm F wrote:
 Respected all,

 I am new in Dspace and Postgres and I am having trouble importing and
 replacing the existing dspace AssetStore and Postgress database using
 the backups. The steps I am following are:

 1) Stop tomcat

 2) Drop and recreate the dspace database

 3) Restore the data from the backup

 4) Update dspace sequences: [dspace-source]/dspace/etc/update-sequences.sql

 5) Delete existing AssetStore

 6) Restore the AssetStore from the backup

 7) Start tomcat.

 The error I am getting after clicking the communities are:

 *An error has occured*

 *org.postgresql.util.PSQLException: ERROR: current transaction is
 aborted, commands ignored until end of transaction block*

 * *

 *Cocoon stacktrace*

 *Java stacktrace *

 *Java full stacktrace*

 Thanks,

 Faizur Rahman, Ph.D.

 UTD Library Systems

 972-883-4100

 sm.rah...@utdallas.edu



 --
 This SF.net Dev2Dev email is sponsored by:

 Show off your parallel programming skills.
 Enter the Intel(R) Threading Challenge 2010.
 http://p.sf.net/sfu/intel-thread-sfd



 ___
 DSpace-tech mailing list
 DSpace-tech@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo

Re: [Dspace-tech] Dspace import/Replace error

[Rahman, Sm F]

Tim,

I am sorry that I only hit reply instead of reply all which caused not to 
send the email to Dspace-tech. 

 Here is the Cocoon log with Errors:

Caused by: org.postgresql.util.PSQLException: ERROR: current transaction is 
aborted, commands ignored until end of transaction block
at 
org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:1531)

 Here is the Postgres log with Errors:

2010-08-30 15:59:57 CDT ERROR:  relation bi_item does not exist
2010-08-30 15:59:57 CDT STATEMENT:  SELECT  COUNT(*) AS num FROM bi_item
2010-08-30 16:00:00 CDT ERROR:  relation bi_2_dis does not exist
2010-08-30 16:00:00 CDT STATEMENT:  SELECT  COUNT(*) AS num FROM bi_2_dis
2010-08-30 16:00:03 CDT ERROR:  relation bi_item does not exist
2010-08-30 16:00:03 CDT STATEMENT:  SELECT  COUNT(*) AS num FROM bi_item
2010-08-30 16:00:09 CDT ERROR:  relation community does not exist
2010-08-30 16:00:09 CDT STATEMENT:  SELECT * FROM community WHERE NOT 
community_id IN (SELECT child_comm_id FROM community2community) ORDER BY name
2010-08-30 16:00:09 CDT ERROR:  current transaction is aborted, commands 
ignored until end of transaction block
2010-08-30 16:00:09 CDT STATEMENT:  SELECT * FROM community WHERE NOT 
community_id IN (SELECT child_comm_id FROM community2community) ORDER BY name
2010-08-30 16:00:11 CDT ERROR:  relation bi_item does not exist
2010-08-30 16:00:11 CDT STATEMENT:  SELECT  COUNT(*) AS num FROM bi_item
2010-08-30 16:00:28 CDT ERROR:  relation bi_4_dis does not exist
2010-08-30 16:00:28 CDT STATEMENT:  SELECT  COUNT(*) AS num FROM bi_4_dis
2010-08-30 20:02:01 CDT LOG:  incomplete startup packet
2010-08-31 00:02:01 CDT LOG:  incomplete startup packet
2010-08-31 05:02:01 CDT LOG:  incomplete startup packet
2010-08-31 10:02:01 CDT LOG:  incomplete startup packet
2010-08-31 13:53:53 CDT ERROR:  relation eperson does not exist
2010-08-31 13:53:53 CDT STATEMENT:  select * from eperson where email = $1
2010-08-31 13:53:56 CDT ERROR:  relation community does not exist

 Don't see any error in tomcat log

I think the import didn't go through correctly, what do you think and how to 
encouter this problem?

Thanks,

Faizur

-Original Message-
From: Tim Donohue [mailto:tdono...@duraspace.org] 
Sent: Tuesday, August 31, 2010 2:42 PM
To: Rahman, Sm F
Cc: dspace-tech
Subject: Re: [Dspace-tech] Dspace import/Replace error

Faizur,

I'm copying in 'dspace-tech' again on my response.  We prefer to answer 
questions on the listserv itself, as it is then a resource for others 
who may end up experiencing the same issue.

Your dspace.log file output looks normal.  Those lines of the log that 
you sent are just showing that you accessed the main homepage (or 
possibly the Community listing), which ran queries to determine which 
communities to display on that homepage.  There are no ERROR lines in 
that log (where it says DEBUG or INFO, you should see ERROR when a 
problem occurs).

You may want to also check the Tomcat logs and PostgreSQL logs. 
Especially look to see what is logged when you see that An error has 
occurred message -- there should be a log file line somewhere with 
ERROR in it.  Again this webpage will detail the location of your 
logs: https://wiki.duraspace.org/display/DSPACE/Troubleshoot+an+error

- Tim

On 8/31/2010 2:23 PM, Rahman, Sm F wrote:
 Tim,

 Thanks again for offering the help, I restored the DB from backup and replace 
 the Assetstore but giving me the same error. I went through the Troubleshoot 
 instructions that you sent me, changed the config file and here is what looks 
 like in the Dspace log. Here is the instance at: 
 http://10.110.33.25:8180/xmlui/password-login

 Dspace log:

 2010-08-31 13:55:20,089 DEBUG org.dspace.storage.rdbms.DatabaseManager @ 
 Running query SELECT * FROM community WHERE NOT community_id IN (SELECT 
 child_comm_id FROM community2community) ORDER BY name  with parameters:
 2010-08-31 13:55:20,089 DEBUG org.dspace.storage.rdbms.DatabaseManager @ 
 Running query SELECT * FROM community WHERE NOT community_id IN (SELECT 
 child_comm_id FROM community2community) ORDER BY name  with parameters:
 2010-08-31 14:00:00,154 DEBUG org.dspace.storage.rdbms.DatabaseManager @ 
 Running query SELECT * FROM community WHERE NOT community_id IN (SELECT 
 child_comm_id FROM community2community) ORDER BY name  with parameters:
 2010-08-31 14:00:00,154 DEBUG org.dspace.storage.rdbms.DatabaseManager @ 
 Running query SELECT * FROM community WHERE NOT community_id IN (SELECT 
 child_comm_id FROM community2community) ORDER BY name  with parameters:
 2010-08-31 14:00:00,155 INFO  
 org.dspace.app.xmlui.aspect.artifactbrowser.CommunityBrowser @ 
 anonymous:session_id=E21866AE973E650DA0637719BE83BE00:ip_addr=10.110.33.126:view_community_list:
 2010-08-31 14:00:00,157 DEBUG org.dspace.storage.rdbms.DatabaseManager @ 
 Running query SELECT * FROM community WHERE NOT community_id IN (SELECT 
 child_comm_id FROM community2community) ORDER BY name

Re: [Dspace-tech] DSpace Import Issues

[Allen Lam]

Hi Caryn,

If you are going to use shell command ls for this purpose, I have a 
suggestion to reduce manual editing:

ls --ignore=contents --ignore=dublin_core.xml  contents

Not every version of linux supports this switch. If your linux does, it 
is possible to write a script to recursively run this command through 
all sub-dirs. Then all contents files creation can be finished in a second.

What editor you are using to edit the contents files? IMHO, file 
encoding is still the main suspect in the issue.

Best,
Allen Lam.
HKU Hub Administrator, http://hub.hku.hk


Caryn Neiswender wrote:
 Hi, Allen~

 Thanks for the tip!  I actually did notice this was an issue with some 
 of the contents files (I tried using a variety of methods to generate 
 the contents file). In the end, the most effective method was to do ls 
 contents, then remove the contents and dublin_core.xml line (very 
 time consuming for 1,027 items).  However, this actually didn't solve 
 the issue...  It seems like quite a strange (and lurking) issue!

 I was on a deadline, so I figured out a way to complete the load 
 without resolving the issue.  Once I have a moment or two, I'll go 
 back and see what I can do to actually fix the problem.

 Thanks again,
 Caryn



  Original Message 
 Subject: Re: [Dspace-tech] DSpace Import Issues
 From: Allen Lam allen.dsp...@gmail.com
 To: dspace-tech@lists.sourceforge.net
 Date: 2/18/2010 1:39 AM
 Hi Caryn,

 I am not sure if it is helpful. Just give a pointer to let you check 
 against.

  From your description, the error could be caused by incorrect 
 character encoding in your file that is named as contents.
 Make sure this contents file is **plain text**, with ANSI/ASCII 
 contents and NOT saved in unicode or UTF-8 encoding.

 UTF-8 encoded text files have 3 extra bytes at the head and this 
 could cause problem for the import program to process correctly.

 Best,
 Allen Lam.
 HKU Hub Administrator, http://hub.hku.hk


 Caryn Neiswender wrote:
  
 Hello, All~

 I'm encountering a strange import issue, that I'm hoping someone on 
 the list can help me track down.
 The command: /dspace/bin/import -a -e {email address} -c 10575/11 -s 
 /dspace/import -m /dspace/import/test
 DSpace Version: 1.5.2

 When I run a test run, everything looks perfectly fine, and multiple 
 items seem to be added. When I run it live, I keep getting file not 
 found.  While the error message is the same, the system sometimes 
 can't locate the contents file, sometimes the PDF, and sometimes the 
 license. I do a ls on the directory, and all files are there (and 
 non-blank).
 I have been able to load a few files, mostly through doing things 
 like renaming the file (and adjusting the contents file), 
 re-creating the contents file (either by hand, typing the file 
 names, or using ls  contents, then removing the contents and 
 dublin_core.xml lines).  The system reads the metadata just fine - 
 it just can't seem to find the files.  I also checked ownership on 
 the import directory - all directories and files are owned by dspace.

 Any help you can provide would be extremely appreciated!!!
 Thanks,
 Caryn

 ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~
 Caryn Neiswender
 Digital Projects Specialist
 UC Irvine Libraries
 (949) 824-9086

 Curiosity sends us out
 To a world both larger and smaller
 Than what we know and believe in
 With a passion for finding an answer
 Or at least understanding our questions.
 -Excerpt from Julia Alvarez's Why I Am in Love with Librarians.

 --
  

 SOLARIS 10 is the OS for Data Centers - provides features such as 
 DTrace,
 Predictive Self Healing and Award Winning ZFS. Get Solaris 10 NOW
 http://p.sf.net/sfu/solaris-dev2dev
 ___
 DSpace-tech mailing list
 DSpace-tech@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/dspace-tech
   



--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech

Re: [Dspace-tech] DSpace Import Issues

[Allen Lam]

Hi Caryn,

I am not sure if it is helpful. Just give a pointer to let you check 
against.

 From your description, the error could be caused by incorrect character 
encoding in your file that is named as contents.
Make sure this contents file is **plain text**, with ANSI/ASCII 
contents and NOT saved in unicode or UTF-8 encoding.

UTF-8 encoded text files have 3 extra bytes at the head and this could 
cause problem for the import program to process correctly.

Best,
Allen Lam.
HKU Hub Administrator, http://hub.hku.hk


Caryn Neiswender wrote:
 Hello, All~

 I'm encountering a strange import issue, that I'm hoping someone on the 
 list can help me track down. 

 The command: /dspace/bin/import -a -e {email address} -c 10575/11 -s 
 /dspace/import -m /dspace/import/test
 DSpace Version: 1.5.2

 When I run a test run, everything looks perfectly fine, and multiple 
 items seem to be added. 
 When I run it live, I keep getting file not found.  While the error 
 message is the same, the system sometimes can't locate the contents 
 file, sometimes the PDF, and sometimes the license. I do a ls on the 
 directory, and all files are there (and non-blank). 

 I have been able to load a few files, mostly through doing things like 
 renaming the file (and adjusting the contents file), re-creating the 
 contents file (either by hand, typing the file names, or using ls 
  contents, then removing the contents and dublin_core.xml lines).  The 
 system reads the metadata just fine - it just can't seem to find the 
 files.  I also checked ownership on the import directory - all 
 directories and files are owned by dspace.

 Any help you can provide would be extremely appreciated!!! 

 Thanks,
 Caryn

 ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~
 Caryn Neiswender
 Digital Projects Specialist
 UC Irvine Libraries
 (949) 824-9086

 Curiosity sends us out
 To a world both larger and smaller
 Than what we know and believe in
 With a passion for finding an answer
 Or at least understanding our questions.
 -Excerpt from Julia Alvarez's Why I Am in Love with Librarians. 


 --
 SOLARIS 10 is the OS for Data Centers - provides features such as DTrace,
 Predictive Self Healing and Award Winning ZFS. Get Solaris 10 NOW
 http://p.sf.net/sfu/solaris-dev2dev
 ___
 DSpace-tech mailing list
 DSpace-tech@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/dspace-tech
   


--
Download Intelreg; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs 
proactively, and fine-tune applications for parallel performance. 
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech

[Dspace-tech] DSpace Import Issues

[Caryn Neiswender]

Hello, All~

I'm encountering a strange import issue, that I'm hoping someone on the 
list can help me track down. 

The command: /dspace/bin/import -a -e {email address} -c 10575/11 -s 
/dspace/import -m /dspace/import/test
DSpace Version: 1.5.2

When I run a test run, everything looks perfectly fine, and multiple 
items seem to be added. 
When I run it live, I keep getting file not found.  While the error 
message is the same, the system sometimes can't locate the contents 
file, sometimes the PDF, and sometimes the license. I do a ls on the 
directory, and all files are there (and non-blank). 

I have been able to load a few files, mostly through doing things like 
renaming the file (and adjusting the contents file), re-creating the 
contents file (either by hand, typing the file names, or using ls 
 contents, then removing the contents and dublin_core.xml lines).  The 
system reads the metadata just fine - it just can't seem to find the 
files.  I also checked ownership on the import directory - all 
directories and files are owned by dspace.

Any help you can provide would be extremely appreciated!!! 

Thanks,
Caryn

~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~
Caryn Neiswender
Digital Projects Specialist
UC Irvine Libraries
(949) 824-9086

Curiosity sends us out
To a world both larger and smaller
Than what we know and believe in
With a passion for finding an answer
Or at least understanding our questions.
-Excerpt from Julia Alvarez's Why I Am in Love with Librarians. 


--
SOLARIS 10 is the OS for Data Centers - provides features such as DTrace,
Predictive Self Healing and Award Winning ZFS. Get Solaris 10 NOW
http://p.sf.net/sfu/solaris-dev2dev
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech

Re: [Dspace-tech] DSpace import throwing SQL connection error

[Mr Havercamp]

Thanks for the reply.

I tried your solution and something interesting has happened; the error 
has changed to;

Exception in thread main org.postgresql.util.PSQLException: FATAL: the 
database system is shutting down
at 
org.postgresql.core.v3.ConnectionFactoryImpl.doAuthentication(ConnectionFactoryImpl.java:275)
at 
org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:94)
at 
org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:65)
at 
org.postgresql.jdbc2.AbstractJdbc2Connection.init(AbstractJdbc2Connection.java:116)
at 
org.postgresql.jdbc3.AbstractJdbc3Connection.init(AbstractJdbc3Connection.java:30)
at org.postgresql.jdbc3.Jdbc3Connection.init(Jdbc3Connection.java:24)
at org.postgresql.Driver.makeConnection(Driver.java:369)
at org.postgresql.Driver.connect(Driver.java:245)
at java.sql.DriverManager.getConnection(DriverManager.java:582)
at java.sql.DriverManager.getConnection(DriverManager.java:185)
at 
org.apache.commons.dbcp.DriverManagerConnectionFactory.createConnection(DriverManagerConnectionFactory.java:48)
at 
org.apache.commons.dbcp.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:290)
at 
org.apache.commons.pool.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:840)
at org.apache.commons.dbcp.PoolingDriver.connect(PoolingDriver.java:175)
at java.sql.DriverManager.getConnection(DriverManager.java:582)
at java.sql.DriverManager.getConnection(DriverManager.java:207)
at 
org.dspace.storage.rdbms.DatabaseManager.getConnection(DatabaseManager.java:514)
at org.dspace.core.Context.init(Context.java:117)
at org.dspace.app.itemimport.ItemImport.main(ItemImport.java:336)

Does this mean my database is corrupted or am I able to recover from this?

mikan.d.dspace listmail wrote:
 Just a thought; try to run importer by changing to dspace/bin 
 directory first.

 -Mika


 2008/10/7 Mr Havercamp [EMAIL PROTECTED] 
 mailto:[EMAIL PROTECTED]

 I've recently been importing a few thousand records into dspace using
 the import tool that is supplied within the ./bin directory.

 Up until recently I have been importing collections without incident
 until last night when, during an import, I lost my remote
 connection to
 my DSpace server.

 When attempting to resume an import;

 # sudo /path/to/dspace/bin/import -c 123456789/8 -a -R -m
 /path/to/dspace/imports/photographs.log -e [EMAIL PROTECTED] -s
 /path/to/assets/photographs

 the following error is thrown;

 Exception in thread main java.sql.SQLException:
 java.lang.ClassNotFoundException:
at
 
 org.dspace.storage.rdbms.DatabaseManager.initialize(DatabaseManager.java:1555)
at
 
 org.dspace.storage.rdbms.DatabaseManager.getConnection(DatabaseManager.java:512)
at org.dspace.core.Context.init(Context.java:117)
at org.dspace.app.itemimport.ItemImport.main(ItemImport.java:336)

 I've checked the logs and have not been able to find any other
 information except for when I restart postgresql I see;

 2008-10-07 12:54:46 UTC LOG:  received smart shutdown request
 2008-10-07 12:54:46 UTC LOG:  autovacuum launcher shutting down
 2008-10-07 12:56:11 UTC LOG:  incomplete startup packet

 Restarting the Postgresql server a number of times fixed the
 problem but
 unfortunately, during the second update I lost the connection
 again and
 this time I get the same outcome above but I cannot seem to
 resolve it.
 I've checked my import log file for incomplete data but it looks fine
 and checking the last record in DSpace show that it was imported
 successfully.

 Any help would be much appreciated as I do not fancy setting up the
 entire dspace database again.

 -
 This SF.Net email is sponsored by the Moblin Your Move Developer's
 challenge
 Build the coolest Linux based applications with Moblin SDK  win
 great prizes
 Grand prize is a trip for two to an Open Source event anywhere in
 the world
 http://moblin-contest.org/redirect.php?banner_id=100url=/
 http://moblin-contest.org/redirect.php?banner_id=100url=/
 ___
 DSpace-tech mailing list
 DSpace-tech@lists.sourceforge.net
 mailto:DSpace-tech@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/dspace-tech




-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK  win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100url=/
___
DSpace-tech 

Re: [Dspace-tech] DSpace import throwing SQL connection error

[Mr Havercamp]

Yes, I've restarted the database a number of times but the problem still 
persists.

I've just restarted it again and tried a re-import and same problem.

During restart, the Postgresql logs report;

2008-10-08 08:22:21 UTC LOG:  incomplete startup packet

mikan.d.dspace listmail wrote:
 To me, it seems your postgres database is not running at all. Shutdown 
 and restart the database (etc/init.d/postqres restart, or similar), 
 then run importer.

 -Mika


 2008/10/8 Mr Havercamp [EMAIL PROTECTED] 
 mailto:[EMAIL PROTECTED]

 Thanks for the reply.

 I tried your solution and something interesting has happened; the
 error has changed to;

 Exception in thread main org.postgresql.util.PSQLException:
 FATAL: the database system is shutting down
   at
 
 org.postgresql.core.v3.ConnectionFactoryImpl.doAuthentication(ConnectionFactoryImpl.java:275)
   at
 
 org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:94)
   at
 
 org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:65)
   at
 
 org.postgresql.jdbc2.AbstractJdbc2Connection.init(AbstractJdbc2Connection.java:116)
   at
 
 org.postgresql.jdbc3.AbstractJdbc3Connection.init(AbstractJdbc3Connection.java:30)
   at
 org.postgresql.jdbc3.Jdbc3Connection.init(Jdbc3Connection.java:24)
   at org.postgresql.Driver.makeConnection(Driver.java:369)
   at org.postgresql.Driver.connect(Driver.java:245)
   at java.sql.DriverManager.getConnection(DriverManager.java:582)
   at java.sql.DriverManager.getConnection(DriverManager.java:185)
   at
 
 org.apache.commons.dbcp.DriverManagerConnectionFactory.createConnection(DriverManagerConnectionFactory.java:48)
   at
 
 org.apache.commons.dbcp.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:290)
   at
 
 org.apache.commons.pool.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:840)
   at
 org.apache.commons.dbcp.PoolingDriver.connect(PoolingDriver.java:175)
   at java.sql.DriverManager.getConnection(DriverManager.java:582)
   at java.sql.DriverManager.getConnection(DriverManager.java:207)
   at
 
 org.dspace.storage.rdbms.DatabaseManager.getConnection(DatabaseManager.java:514)


   at org.dspace.core.Context.init(Context.java:117)
   at org.dspace.app.itemimport.ItemImport.main(ItemImport.java:336)

 Does this mean my database is corrupted or am I able to recover
 from this?


 mikan.d.dspace listmail wrote:

 Just a thought; try to run importer by changing to dspace/bin
 directory first.

 -Mika


 2008/10/7 Mr Havercamp [EMAIL PROTECTED]
 mailto:[EMAIL PROTECTED] mailto:[EMAIL PROTECTED]
 mailto:[EMAIL PROTECTED]


I've recently been importing a few thousand records into
 dspace using
the import tool that is supplied within the ./bin directory.

Up until recently I have been importing collections without
 incident
until last night when, during an import, I lost my remote
connection to
my DSpace server.

When attempting to resume an import;

# sudo /path/to/dspace/bin/import -c 123456789/8 -a -R -m
/path/to/dspace/imports/photographs.log -e
 [EMAIL PROTECTED] -s
/path/to/assets/photographs

the following error is thrown;

Exception in thread main java.sql.SQLException:
java.lang.ClassNotFoundException:
   at
  
  
 org.dspace.storage.rdbms.DatabaseManager.initialize(DatabaseManager.java:1555)
   at
  
  
 org.dspace.storage.rdbms.DatabaseManager.getConnection(DatabaseManager.java:512)
   at org.dspace.core.Context.init(Context.java:117)
   at
 org.dspace.app.itemimport.ItemImport.main(ItemImport.java:336)

I've checked the logs and have not been able to find any other
information except for when I restart postgresql I see;

2008-10-07 12:54:46 UTC LOG:  received smart shutdown request
2008-10-07 12:54:46 UTC LOG:  autovacuum launcher shutting down
2008-10-07 12:56:11 UTC LOG:  incomplete startup packet

Restarting the Postgresql server a number of times fixed the
problem but
unfortunately, during the second update I lost the connection
again and
this time I get the same outcome above but I cannot seem to
resolve it.
I've checked my import log file for incomplete data but it
 looks fine
and checking the last record in DSpace show that it was
 imported
successfully.

Any help would be much appreciated as I do not fancy
 setting up the
entire dspace database again.

   

Re: [Dspace-tech] DSpace import throwing SQL connection error

[Mr Havercamp]

Well good news. I carried out an upgrade on our Ubuntu server and had to 
reboot it due to a kernel update. When it came back up, I started the 
import again and it's working.

Not sure what has happened here but I'm wondering if simply restarting 
the postgres daemon is not enough and whether I need to restart it using 
something more than;

sudo /etc/init.d/postgresql restart

Thanks again for the help.

mikan.d.dspace listmail wrote:
 To me, it seems your postgres database is not running at all. Shutdown 
 and restart the database (etc/init.d/postqres restart, or similar), 
 then run importer.

 -Mika


 2008/10/8 Mr Havercamp [EMAIL PROTECTED] 
 mailto:[EMAIL PROTECTED]

 Thanks for the reply.

 I tried your solution and something interesting has happened; the
 error has changed to;

 Exception in thread main org.postgresql.util.PSQLException:
 FATAL: the database system is shutting down
   at
 
 org.postgresql.core.v3.ConnectionFactoryImpl.doAuthentication(ConnectionFactoryImpl.java:275)
   at
 
 org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:94)
   at
 
 org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:65)
   at
 
 org.postgresql.jdbc2.AbstractJdbc2Connection.init(AbstractJdbc2Connection.java:116)
   at
 
 org.postgresql.jdbc3.AbstractJdbc3Connection.init(AbstractJdbc3Connection.java:30)
   at
 org.postgresql.jdbc3.Jdbc3Connection.init(Jdbc3Connection.java:24)
   at org.postgresql.Driver.makeConnection(Driver.java:369)
   at org.postgresql.Driver.connect(Driver.java:245)
   at java.sql.DriverManager.getConnection(DriverManager.java:582)
   at java.sql.DriverManager.getConnection(DriverManager.java:185)
   at
 
 org.apache.commons.dbcp.DriverManagerConnectionFactory.createConnection(DriverManagerConnectionFactory.java:48)
   at
 
 org.apache.commons.dbcp.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:290)
   at
 
 org.apache.commons.pool.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:840)
   at
 org.apache.commons.dbcp.PoolingDriver.connect(PoolingDriver.java:175)
   at java.sql.DriverManager.getConnection(DriverManager.java:582)
   at java.sql.DriverManager.getConnection(DriverManager.java:207)
   at
 
 org.dspace.storage.rdbms.DatabaseManager.getConnection(DatabaseManager.java:514)


   at org.dspace.core.Context.init(Context.java:117)
   at org.dspace.app.itemimport.ItemImport.main(ItemImport.java:336)

 Does this mean my database is corrupted or am I able to recover
 from this?


 mikan.d.dspace listmail wrote:

 Just a thought; try to run importer by changing to dspace/bin
 directory first.

 -Mika


 2008/10/7 Mr Havercamp [EMAIL PROTECTED]
 mailto:[EMAIL PROTECTED] mailto:[EMAIL PROTECTED]
 mailto:[EMAIL PROTECTED]


I've recently been importing a few thousand records into
 dspace using
the import tool that is supplied within the ./bin directory.

Up until recently I have been importing collections without
 incident
until last night when, during an import, I lost my remote
connection to
my DSpace server.

When attempting to resume an import;

# sudo /path/to/dspace/bin/import -c 123456789/8 -a -R -m
/path/to/dspace/imports/photographs.log -e
 [EMAIL PROTECTED] -s
/path/to/assets/photographs

the following error is thrown;

Exception in thread main java.sql.SQLException:
java.lang.ClassNotFoundException:
   at
  
  
 org.dspace.storage.rdbms.DatabaseManager.initialize(DatabaseManager.java:1555)
   at
  
  
 org.dspace.storage.rdbms.DatabaseManager.getConnection(DatabaseManager.java:512)
   at org.dspace.core.Context.init(Context.java:117)
   at
 org.dspace.app.itemimport.ItemImport.main(ItemImport.java:336)

I've checked the logs and have not been able to find any other
information except for when I restart postgresql I see;

2008-10-07 12:54:46 UTC LOG:  received smart shutdown request
2008-10-07 12:54:46 UTC LOG:  autovacuum launcher shutting down
2008-10-07 12:56:11 UTC LOG:  incomplete startup packet

Restarting the Postgresql server a number of times fixed the
problem but
unfortunately, during the second update I lost the connection
again and
this time I get the same outcome above but I cannot seem to
resolve it.
I've checked my import log file for incomplete data but it
 looks fine
and checking the last record in DSpace show that it was
 imported

[Dspace-tech] DSpace import throwing SQL connection error

[Mr Havercamp]

I've recently been importing a few thousand records into dspace using 
the import tool that is supplied within the ./bin directory.

Up until recently I have been importing collections without incident 
until last night when, during an import, I lost my remote connection to 
my DSpace server.

When attempting to resume an import;

# sudo /path/to/dspace/bin/import -c 123456789/8 -a -R -m 
/path/to/dspace/imports/photographs.log -e [EMAIL PROTECTED] -s 
/path/to/assets/photographs

the following error is thrown;

Exception in thread main java.sql.SQLException: 
java.lang.ClassNotFoundException:
at 
org.dspace.storage.rdbms.DatabaseManager.initialize(DatabaseManager.java:1555)
at 
org.dspace.storage.rdbms.DatabaseManager.getConnection(DatabaseManager.java:512)
at org.dspace.core.Context.init(Context.java:117)
at org.dspace.app.itemimport.ItemImport.main(ItemImport.java:336)

I've checked the logs and have not been able to find any other 
information except for when I restart postgresql I see;

2008-10-07 12:54:46 UTC LOG:  received smart shutdown request
2008-10-07 12:54:46 UTC LOG:  autovacuum launcher shutting down
2008-10-07 12:56:11 UTC LOG:  incomplete startup packet

Restarting the Postgresql server a number of times fixed the problem but 
unfortunately, during the second update I lost the connection again and 
this time I get the same outcome above but I cannot seem to resolve it. 
I've checked my import log file for incomplete data but it looks fine 
and checking the last record in DSpace show that it was imported 
successfully.

Any help would be much appreciated as I do not fancy setting up the 
entire dspace database again.

-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK  win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100url=/
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech