[Dspace-tech] OAI Import Error

2015-02-18 Thread Daan Lessing

Good morning, 


We are using DSpace 4.2 


When running the following command  dspace-run/bin/dspace oai import -c  to 
import SOLR Indexes it runs 100% until I get the following error; 


4800 items imported so far... 
4900 items imported so far... 
5000 items imported so far... 
5100 items imported so far... 
5200 items imported so far... 
5300 items imported so far... 
5400 items imported so far... 
5500 items imported so far... 
java.lang.NullPointerException 
at org.dspace.xoai.app.XOAI.index(XOAI.java:275) 
at org.dspace.xoai.app.XOAI.index(XOAI.java:229) 
at org.dspace.xoai.app.XOAI.indexAll(XOAI.java:210) 
at org.dspace.xoai.app.XOAI.index(XOAI.java:128) 
at org.dspace.xoai.app.XOAI.main(XOAI.java:439) 
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) 
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
 
at java.lang.reflect.Method.invoke(Method.java:606) 
at 
org.dspace.app.launcher.ScriptLauncher.runOneCommand(ScriptLauncher.java:225) 
at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:77) 


Please can someone help with a solution on this problem. 


Regards, 
Daan
--
Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server
from Actuate! Instantly Supercharge Your Business Reports and Dashboards
with Interactivity, Sharing, Native Excel Exports, App Integration  more
Get technology previously reserved for billion-dollar corporations, FREE
http://pubads.g.doubleclick.net/gampad/clk?id=190641631iu=/4140/ostg.clktrk___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

Re: [Dspace-tech] OAI Import Error

2015-02-18 Thread helix84
https://github.com/DSpace/DSpace/blob/dspace-4.2/dspace-oai/src/main/java/org/dspace/xoai/app/XOAI.java#L275

The problem is that the item you're indexing has a submitter with
empty email field. You need to find out which item it is and correct
the submitter's email.

Run the import again and in another terminal run:
tail -f /dspace/log/solr.log

You'll see lines like this one. The last one you'll see (e.g.
123456789/2611) will be the one with the problem:

org.apache.solr.update.processor.LogUpdateProcessor @ [oai]
webapp=/solr path=/update params={wt=javabinversion=2}
{add=[123456789/2611 (1493435116024758272)]} 0 2

If you have multiple submitters without an email, you'll need to
repeat the process.


Regards,
~~helix84

Compulsory reading: DSpace Mailing List Etiquette
https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

--
Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server
from Actuate! Instantly Supercharge Your Business Reports and Dashboards
with Interactivity, Sharing, Native Excel Exports, App Integration  more
Get technology previously reserved for billion-dollar corporations, FREE
http://pubads.g.doubleclick.net/gampad/clk?id=190641631iu=/4140/ostg.clktrk
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette


Re: [Dspace-tech] OAI Import Error

2015-02-18 Thread Hilton Gibson
Hi Daan

Looking into it, I see that a scheduled job is not in the recommended
crontab.
https://wiki.duraspace.org/display/DSDOC4x/OAI+2.0+Server#OAI2.0Server-UsingSolr
https://wiki.duraspace.org/display/DSDOC4x/Scheduled+Tasks+via+Cron
Maybe the DSpace docs need updating.
I am going to add the compile-items task to my docs:
http://wiki.lib.sun.ac.za/index.php/SUNScholar/Daily_Admin/4.X

A while back during a particular load shedding my OAI index became
corrupt.
So I rebuilt it with:
http://wiki.lib.sun.ac.za/index.php/SUNScholar/Harvesting/4.X#If_using_the_SOLR_DB_.28solr.29

Hope this helps.

Cheers

hg


*Hilton Gibson*
Ubuntu Linux Systems Administrator
JS Gericke Library
Room 1025C
Stellenbosch University
Private Bag X5036
Stellenbosch
7599
South Africa

Tel: +27 21 808 4100 | Cell: +27 84 646 4758

On 18 February 2015 at 10:23, Daan Lessing daan.less...@up.ac.za wrote:

  Good morning,


  We are using DSpace 4.2


  When running the following command  *dspace-run/bin/dspace oai import
 -c  *to import SOLR Indexes it runs 100% until I get the following error;


  4800 items imported so far...

 4900 items imported so far...

 5000 items imported so far...

 5100 items imported so far...

 5200 items imported so far...

 5300 items imported so far...

 5400 items imported so far...

 5500 items imported so far...

 java.lang.NullPointerException

 at org.dspace.xoai.app.XOAI.index(XOAI.java:275)

 at org.dspace.xoai.app.XOAI.index(XOAI.java:229)

 at org.dspace.xoai.app.XOAI.indexAll(XOAI.java:210)

 at org.dspace.xoai.app.XOAI.index(XOAI.java:128)

 at org.dspace.xoai.app.XOAI.main(XOAI.java:439)

 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

 at
 sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)

 at
 sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

 at java.lang.reflect.Method.invoke(Method.java:606)

 at
 org.dspace.app.launcher.ScriptLauncher.runOneCommand(ScriptLauncher.java:225)

 at
 org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:77)


  Please can someone help with a solution on this problem.


  Regards,

 Daan


 --
 Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server
 from Actuate! Instantly Supercharge Your Business Reports and Dashboards
 with Interactivity, Sharing, Native Excel Exports, App Integration  more
 Get technology previously reserved for billion-dollar corporations, FREE

 http://pubads.g.doubleclick.net/gampad/clk?id=190641631iu=/4140/ostg.clktrk
 ___
 DSpace-tech mailing list
 DSpace-tech@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/dspace-tech
 List Etiquette:
 https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

--
Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server
from Actuate! Instantly Supercharge Your Business Reports and Dashboards
with Interactivity, Sharing, Native Excel Exports, App Integration  more
Get technology previously reserved for billion-dollar corporations, FREE
http://pubads.g.doubleclick.net/gampad/clk?id=190641631iu=/4140/ostg.clktrk___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

Re: [Dspace-tech] OAI Import Error

2015-02-18 Thread Adan Roman

Good morning

It semms that you have an item without submitter (or with an incorrect
one).
Check your database, table item, searching for it.

select * from item where submitter_id not in (select eperson_id from
eperson) or submitter_id is null

good luck


Good morning,


We are using DSpace 4.2


When running the following command *dspace-run/bin/dspace oai import
-c *to import SOLR Indexes it runs 100% until I get the following error;


4800 items imported so far...

4900 items imported so far...

5000 items imported so far...

5100 items imported so far...

5200 items imported so far...

5300 items imported so far...

5400 items imported so far...

5500 items imported so far...

java.lang.NullPointerException

at org.dspace.xoai.app.XOAI.index(XOAI.java:275)

at org.dspace.xoai.app.XOAI.index(XOAI.java:229)

at org.dspace.xoai.app.XOAI.indexAll(XOAI.java:210)

at org.dspace.xoai.app.XOAI.index(XOAI.java:128)

at org.dspace.xoai.app.XOAI.main(XOAI.java:439)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)


at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)


at java.lang.reflect.Method.invoke(Method.java:606)

at
org.dspace.app.launcher.ScriptLauncher.runOneCommand(ScriptLauncher.java:225)


at
org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:77)


Please can someone help with a solution on this problem.


Regards,

Daan



--
Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server
from Actuate! Instantly Supercharge Your Business Reports and Dashboards
with Interactivity, Sharing, Native Excel Exports, App Integration  more
Get technology previously reserved for billion-dollar corporations, FREE
http://pubads.g.doubleclick.net/gampad/clk?id=190641631iu=/4140/ostg.clktrk


___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette



--



---
El software de antivirus Avast ha analizado este correo electrónico en busca de 
virus.
http://www.avast.com
--
Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server
from Actuate! Instantly Supercharge Your Business Reports and Dashboards
with Interactivity, Sharing, Native Excel Exports, App Integration  more
Get technology previously reserved for billion-dollar corporations, FREE
http://pubads.g.doubleclick.net/gampad/clk?id=190641631iu=/4140/ostg.clktrk___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette